高级检索+

葡萄成熟度与采摘点同步检测方法

A synchronous detection method for grape ripeness and picking point localizations

  • 摘要: 为实现成熟葡萄与采摘点的同步检测,保障果实品质并提升采收效率,该研究针对现有非同步分离检测方法中存在的流程复杂、模型冗余度高、效率低和计算资源消耗大等问题,提出一种葡萄成熟度和采摘点同步检测方法(a synchronous detection method for grape ripeness and picking point localizations, GrapickNet)。该方法由能同步检测葡萄成熟度与果梗关键点的改进模型(Grapick-YOLO12n)和基于多重约束规则的果串-采摘点匹配算法(a bunch-pick point matching algorithm based on multiple constraint rules, RBPM)组成。Grapick-YOLO12n以YOLO12n-pose为基准模型,设计了边缘信息传递模块(edge information transfer module, EIFT)模块和C3K2_RFAConv模块,增强了模型对密集遮挡的葡萄果串成熟度和细小果梗的多尺度特征提取能力。RBPM算法通过构建多重约束规则,实现了葡萄果串与采摘点的高精度空间关联。在涵盖多场景、多光照条件和多品种的自建温室葡萄RGB图像数据集(4 383张)的试验结果表明,GrapickNet在成熟度识别任务中的mAP@0.5达到88.9%,采摘点检测的精确率为82.7%。较基准模型(成熟度mAP@0.5 87.0%,采摘点精度77.8%)分别提升了1.9%和4.9%,且模型参数量仅为3.33 M。在定位精度方面,XY方向的平均误差分别为2.51像素和5.37像素,欧式距离平均误差为6.39像素。该研究为温室半结构化环境下葡萄自动化采收提供了一种高效、准确的技术解决方案。

     

    Abstract: The synchronous detection of ripe grapes and their picking point is crucial for ensuring fruit quality and improving harvesting efficiency. To overcome the limitations of conventional asynchronous detection methods in grape detection, such as complex processes, low efficiency, high model redundancy, and high computational cost, this study proposed GrapickNet, a novel synchronous detection method for grape ripeness and picking point localizations. This method employs an improved Grapick-YOLO12n model to simultaneously detect both grape ripeness and key stem points, and then utilizes a bunch-pick point matching algorithm based on multiple constraint rules (RBPM) to effectively match ripe bunches with their corresponding pick points. First, Grapick-YOLO12n used YOLO12n-pose as the baseline model, with the innovative integration of the Edge Information Transfer (EIFT) module and the C3K2_RFAConv module. The EIFT module enhances the model's perception of object boundaries and local elongated small targets through shallow multi-scale edge feature extraction and cross-channel fusion mechanisms. The C3K2_RFAConv module expands the receptive field and strengthens global context modeling to improve the model's feature discrimination capability in complex scenes with multi-target interweaving. Second, the RBPM algorithm constructed multiple constraints to improve the successful matching rate between ripe bunches and its picking point. A comprehensive dataset comprising 4 383 RGB images of greenhouse grapes, covering two distinct environments, four different lighting conditions, and five varieties, was established and used as model training data. Experimental results shown that GrapickNet achieves 88.9% mAP@0.5 for ripeness detection and 82.7% precision for picking point detection. Compared with the baseline model (87.0% mAP@0.5 for ripeness and 77.8% precision for picking points), the proposed method improves by 1.9% and 4.9%, respectively. Furthermore, the proposed model has a computational complexity of 8.4 GFLOPs and a parameter size of merely 3.33 M, while attaining an inference speed of 94.6 FPS. In terms of positioning accuracy, the average errors in the X and Y directions are 2.51 pixels and 5.37 pixels, respectively. The average error in Euclidean distance is 6.39 pixels. The performance of object detection is outperformed the existing models, including YOLOv5n-pose, YOLOv8n-pose, YOLOv10n-pose, YOLO11n-pose, YOLO12n-pose, Faster R-CNN, SSD, and RT-DETR. Compared with asynchronous separate detection tasks, GrapickNet, which possesses multi-task synchronous detection capability, achieves synchronous, accurate, and efficient detection of grape ripeness and picking points for different varieties in complex greenhouse scenarios. This method maintains good detection accuracy and short detection time while reducing parameter usage, offering greater advantages in computational efficiency and deployment on mobile devices. This study has good practical value, providing an efficient and accurate technical solution for the automated grape harvesting in semi-structured greenhouses and promoting the intelligent development of grape harvesting robots.

     

/

返回文章
返回