高级检索+

基于SAM几何先验驱动的大豆荚果原位分类计数

In-situ classification and counting of soybean pods driven by SAM geometric priors

  • 摘要: 大豆的荚数和粒数是衡量产量的核心性状,其在筛选优良品种、改良遗传性状及估测作物产量等方面发挥着重要作用。在田间原位环境中,复杂的背景干扰,严重的荚间遮挡以及不同粒数豆荚高度的形态相似性极大地限制了豆荚检测的精度。为此,该研究提出一种基于多阶段策略的田间单株大豆荚果分类检测与计数框架。首先,构建旋转目标检测模型TE-YOLO,实现对单株大豆的精准定向捕获,降低相邻植株干扰;随后,针对植株倾斜形态,创新性提出基于旋框几何先验的五点提示策略,将大模型注意力锚定于植株主轴,从而驱动SAM模型进行高质量实例分割,再结合增强型后处理算法有效地剔除了复杂背景噪声;最后,针对分割后的纯净图像构建SoyPod-FGC豆荚计数网络,通过强化特征提取与重建内容感知,增强模型对密集遮挡下豆荚边缘的感知能力,完成对不同粒数豆荚的分类识别。为验证模型的有效性,该研究在自构建数据集上进行了对比试验分析。试验结果表明,该多阶段策略能够有效应对复杂背景与荚果间遮挡带来的影响,SoyPod-FGC模型的平均精度达到74.4%,较基准模型YOLO11m提升1.5%;单株豆荚计数的平均绝对误差降到3.50个,种子计数的决定系数为0.816,相较其他检测模型提升明显。该模型提升了密集重叠目标下的计数准确度与抗干扰稳定性,可为大豆数字化育种提供高效的表型获取支撑。

     

    Abstract: Pod count and seed count per pod are two of the most important agronomic traits to accurately estimate soybean yield. These phenotypic parameters can also be used to screen superior and high-yielding varieties, such as genetic traits. However, in-situ measurement is limited by the complex background interference from soil and foliage, the severe inter-pod occlusions caused by dense planting, and the high morphological similarity among pods with varying numbers of seeds under the field environment. Particularly, conventional manual phenotyping cannot fully meet the needs of large-scale cultivation in recent years, due to high labor intensity, time-consuming nature, and subjective errors. Consequently, high accuracy, efficiency, and robustness are often required for pod detection. In this study, a fully robust and multi-stage framework was developed and then validated for the classification, detection, and precise counting of soybean pods at the individual plant level in a natural field. 1) An advanced model of object detection, named TE-YOLO, was constructed to achieve the precise directional capture of the individual soybean plants. This approach mitigated the severe visual interference and overlapping from the adjacent plants under dense planting environments. 2) A five-point prompting strategy was proposed for inclined morphology of plants using geometric priors of rotated bounding boxes. Attention was anchored into the main axis of the plant, thereby driving the segment anything model (SAM) to perform high-quality instance segmentation of targeted plants. 3) An enhanced post-processing algorithm was integrated into the overall pipeline. High-quality instance segmentation of individual soybean plants was achieved to remove the complex background noise and irrelevant clutter found in the field. 4) A soybean pod counting network, designated as SoyPod-FGC, was constructed specifically for the purified images after segmentation. Feature extraction was then strengthened to reconstruct content awareness. Consequently, the edges and boundaries of pods were enhanced under dense occlusion. This robust architecture enabled accurate classification and identification of pods with the number of seeds. A series of experiments were conducted on a custom-built field dataset to validate the framework. The experimental results demonstrated that the multi-stage strategy overcame the adverse impacts caused by the complex backgrounds and the severe inter-pod occlusions. Specifically, the mean average precision (mAP) of the SoyPod-FGC model reached an impressive 74.4%. The positive superior performance achieved a 1.5 percentage point improvement, compared with the baseline YOLO11m model. Furthermore, the mean absolute error (MAE) was reduced to 3.50 for the pod counting per individual plant. Concurrently, the coefficient of determination for the seed counting reached a reliable 0.816. In conclusion, the multi-stage model can elevate the counting accuracy and anti-interference stability, particularly when processing densely overlapping targets. The accurate, robust, and practical approach can be deployed for real-world agricultural monitoring. The efficient pipeline can provide solid phenotypic acquisition support for continuous, high-throughput digital breeding, precise yield estimation, and data-driven crop of soybeans in precision agriculture and crop cultivation.

     

/

返回文章
返回