高级检索+

基于深度学习和几何约束的苹果花蕾期花蕾生长位置估计

Estimation of apple flower bud growth position during bud stage based on deep learning and geometric constraints

  • 摘要: 针对苹果花蕾期自动化疏花对花蕾生长位置精准估计的需求,解决复杂冠层环境下花蕾检测困难、枝条拓扑重建模糊及花蕾-枝条归属判定不准的问题。提出一种融合深度学习和几何约束的疏花期花蕾生长位置估计方法。改进YOLOv8模型(YOLO-Bud),引入可变形卷积(DCNv4)增强形态适应性,设计轻量级下采样模块(DSampleLite)平衡效率与特征表达,采用Shape-IoU损失优化边界回归,实现花蕾、枝条、叶片及花枝的实例分割;基于主成分分析(PCA)提取枝条片段主方向,结合生长方向一致性(第一主成分(PCA1)夹角≤20°)和空间分布相关性(质心连线与PCA1夹角≤15°)双重约束判定枝条片段隶属关系,并利用基样条曲线(B-样条曲线)拟合重建断裂枝条轮廓;依据花蕾/花枝质心至枝条多边形的最近距离判定隶属关系,结合花蕾生长方向与枝条方向锐角约束,以花枝-枝条轮廓交线中点定位花蕾生长位置。YOLO-Bud模型在复杂果园图像分割中平均精度(mAP)达81.70%,交并比(IoU)为67.70%;双重约束下枝条片段分类准确率达96.10%,重建枝条边缘与真实标注的IoU为0.82;花蕾、花枝隶属判定准确率分别为90.81%和95.58%,花蕾生长位置估计的均方根误差(RMSE)为3.37像素。该研究方法在复杂果园环境下具备良好的分割精度与几何重建能力,可为苹果疏花机器人提供可靠的空间决策依据。

     

    Abstract: To address the critical demand for precise estimation of flower bud growth positions in automated apple thinning operations during the bud stage, this study aimed to solve persistent challenges in complex orchard canopy environments including flower bud detection difficulties, ambiguous branch topology reconstruction, and inaccurate flower bud-branch affiliation determination. A novel flower bud growth position estimation method integrating deep learning and geometric constraints was proposed. An improved YOLOv8 model (YOLO-Bud) was developed with Deformable Convolution version 4 (DCNv4) to enhance morphological adaptability for irregular agricultural targets. A lightweight downsampling module (DSampleLite) was designed to balance computational efficiency and feature expression capability. Shape-Intersection over Union (Shape-IoU) loss function was adopted to optimize boundary regression accuracy for precise instance segmentation of flower buds, branches, leaves, and flower stems. Principal component analysis (PCA) was employed to extract the main growth direction of individual branch segments. Dual geometric constraints combining growth direction consistency (first principal component PCA1 angle ≤20°) and spatial distribution correlation (centroid connection line with PCA1 angle ≤15°) were applied to determine branch segment affiliation relationships. B-spline curves were utilized to fit and reconstruct fractured branch contours caused by severe occlusion. Flower bud growth positions were located based on the midpoint of the intersection line between flower stem and branch contours. Affiliation was determined by minimum Euclidean distance from flower bud or flower stem centroids to branch polygon boundaries. The YOLO-Bud model achieved a mean average precision (mAP50) of 81.70% in complex orchard image segmentation tasks. The intersection over union (IoU) reached 67.70%. The precision and recall were 85.60% and 76.40% respectively. The Dice coefficient reached 80.74%. Under dual geometric constraints, the branch segment classification accuracy reached 96.10%. The IoU between reconstructed branch edges and ground truth annotations was 0.82. The Dice coefficient for branch reconstruction was 0.90. The root mean square error (RMSE) of branch reconstruction was 2.62 pixels. The mean absolute error (MAE) was 1.79 pixels. The affiliation determination accuracies for flower buds and flower stems were 90.81% and 95.58% respectively. The RMSE of flower bud growth position estimation was 3.37 pixels in Euclidean distance measurement. The MAE was 2.72 pixels. The x-axis and y-axis RMSE were 3.21 pixels and 2.93 pixels respectively. 90% of all experimental samples had estimation errors within 4.2 pixels. 95% of samples had estimation errors within 5.1 pixels. The model maintained real-time inference speed of 38.20 frames per second. The parameter count was 20.34 million. The floating point operations (FLOPs) were 105.40 G. The proposed method demonstrated superior performance compared to Mask R-CNN, MaskLab, YOLACT, FastInst, YOLOv9c, and YOLOv11m models. The proposed hybrid technical framework combining deep learning and geometric constraints effectively resolved multi-object segmentation, fractured branch reconstruction, and flower bud positioning challenges in complex orchard environments. The method achieved the research objectives of accurate flower bud growth position estimation with pixel-level precision suitable for robotic thinning applications. This work provided reliable spatial decision support for apple thinning robots and enriched research methodologies for precision visual perception in agricultural orchards.

     

/

返回文章
返回