高级检索+

基于ST-PRNet网络的小麦育种小区高精度分割方法

High-precision segmentation for wheat breeding plots using ST-PRNet network

  • 摘要: 针对大规模小麦育种小区试验田中,因小区密集排列、冠层纹理相似及冠层交错等,导致小区分割出现粘连与边界模糊等问题,该研究提出了一种高精度实例分割网络ST-PRNet。该网络以Mask R-CNN为基础,采用Swin Transformer作为骨干网络,提取具有长距离依赖关系的全局语义特征;搭建路径聚合特征金字塔网络(path aggregation feature pyramid network,PAFPN),增强底层几何特征向高层的传递效率;采用Soft-NMS策略,优化密集重叠区域的边界框筛选;引入PointRend模块,通过迭代点采样策略解决边缘锯齿。该研究在标注完善的数据集上对网络性能进行了评估,该数据集包含107个小麦品种、966个小区。结果表明,ST-PRNet在测试集上的平均精度(average precision,AP)达到92.8%,较Mask R-CNN提升8.6个百分点,整体性能优于Cascade Mask R-CNN、HTC以及OSNet。消融试验结果表明,PointRend模块对边缘分割效果的提升最为明显,加入该模块后,AP提升了6.8个百分点。ST-PRNet能够准确分割出研究区域内的所有小区,有效解决了分割粘连与边界模糊。此外,针对传统规则网格易将过道裸土误计入而导致表型评估失真的问题,以拔节期为例,利用 ST-PRNet 输出的高精度掩码作为纯净冠层空间基准,减少了非作物背景噪声。自动提取小区植被覆盖度(fractional vegetation cover,FVC)介于 41.6%~84.0% 之间,真实反映了群体长势异质性,验证了该模型在高通量表型精确解析中的实际应用价值。

     

    Abstract: High-precision segmentation of individual breeding plots is often required for high-throughput field phenotyping in precision agriculture. However, existing instance models are limited to boundary adhesion and blurred segmentation masks in large-scale fields using unmanned aerial vehicle (UAV) imagery. Particularly, wheat breeding trials can result in dense plot arrangements, similar canopy textures, and severe canopy interlacing during the mid-to-late growth stages. This study aims to propose a high-precision network for instance segmentation, named ST-PRNet. Mask R-CNN was utilized as the baseline architecture. Four technical improvements were integrated to enhance segmentation robustness under complex agricultural scenarios. 1) A Swin transformer backbone was employed to extract global semantic features using a shifted window-based multi-head self-attention (SW-MSA) mechanism. The complex global topological structure of breeding plots was more effectively captured than by conventional convolutional backbones. Semantic confusion was effectively suppressed from blurred canopy textures at various growth stages. 2) High-resolution geometric features were converted from low- to high-level semantic maps using a path aggregation feature pyramid network (PAFPN). Thereby, multi-scale feature representation was enhanced for the breeding plots at varying sizes. The loss of spatial information was reduced during downsampling. 3) A soft-nms (non-maximum suppression) post-processing was implemented to replace conventional hard-threshold nms. Gaussian decay function was also utilized to preserve overlapping with independent bounding boxes. The missed detections were effectively solved in dense, physically overlapped plot areas. 4) The PointRend module was integrated to replace the standard mask head. An iterative point-wise sampling and rendering strategy was employed on the boundary regions with high uncertainty. The jagged edge and over-smoothing were resolved in standard bilinear upsampling. Pixel-level boundary refinement was achieved to produce masks that closely match the non-regular contours of the wheat canopy, particularly with irregular plot boundaries. The framework was evaluated on the high-quality dataset with 966 plots from 107 wheat varieties. A total of 14028 images were partitioned into training, validation, and testing sets at a ratio of 8:1:1. Experimental results demonstrate that the ST-PRNet achieved an average precision (AP) of 92.8%, indicating an improvement of 8.6 percentage points over the Mask R-CNN baseline. Furthermore, ST-PRNet outperformed the state-of-the-art (SOTA) segmentation models, including Cascade Mask R-CNN, HTC, and the recently developed oriented instance segmentation network (OSNet). Ablation studies reveal that the PointRend module was introduced to provide the most significant performance gain. The AP improved by 6.8 percentage points than before. The complex serrated contours of wheat canopies were reconstructed after evaluation. Superior robustness of segmentation was achieved at different growth stages, particularly for severe boundary adhesion and segmentation overlap. ST-PRNet masks were also validated in crop phenotyping at the jointing stage. A case study was conducted to extract the fractional vegetation cover (FVC). High-fidelity masks were taken as the spatial references to isolate pure crop canopies. Non-crop background noise was eliminated, such as aisle pathways and soil. The extracted plot-level FVC values ranged from 41.6% to 84.0%, with a mean of 69.9%, objectively reflecting canopy growth heterogeneity across different varieties. Compared with conventional methods, the evaluation errors were significantly reduced under background contamination, indicating the visual representation of plot-level growth heterogeneity. ST-PRNet can also provide a robust and reliable algorithm for large-scale wheat phenotyping. More efficient data acquisition was facilitated for genetic trait evaluation and variety selection in intelligent breeding. ST-PRNet can effectively bridge the gap between raw UAV imagery and actionable phenotypic data. The findings can also offer high-precision end-to-end solutions to serve as a powerful tool for precision phenotyping in smart agriculture.

     

/

返回文章
返回