高级检索+

基于三维点云的雪茄植株表型参数高效精准提取方法

Efficientand precise method for phenotypic parameter extraction of cigar plants based on 3D point clouds

  • 摘要: 精准提取雪茄植株表型参数对于科学评估植株生长状态、指导精准育种和优化栽培管理具有重要意义。针对雪茄植株具有层间遮蔽严重、接触紧密等特点所造成的点云叶片粘连和实例边界模糊问题,该研究提出了一种基于三维点云的雪茄植株实例分割与表型参数提取方法。首先,提出一种融合几何结构与全局上下文语义的三维点云实例分割模型PnP-3D-PSegNet,通过在PSegNet编码器中引入PnP-3D模块,增强对复杂点云中细粒度结构的识别能力。其次,针对实例边界模糊和叶片粘连问题,改进Mean Shift聚类算法,构建一种融合边缘滤波与密度–距离加权的实例优化策略。通过引入基于邻域曲率与法向量变化的边缘感知机制,计算边界区域点的边缘置信度,并与实例特征进行融合,有效抑制边界区域不可靠点对聚类过程的干扰,从而缓解实例分割中的边界模糊问题。同时,针对叶片粘连条件下部分点易被误分配至相邻实例的问题,引入局部密度与簇中心距离的加权判据,进一步缓解叶片粘连条件下的实例混淆问题。结果表明,PnP-3D-PsegNet模型在平均覆盖率、平均加权覆盖率、平均精度和平均召回率上分别达到93.59 %、95.77 %、97.21 %和98.55 %,较基线模型PSegNet分别提升3.39、3.56、3.65和2.78个百分点。基于实例分割结果,进一步提取株高、叶片数量、叶长、叶宽、叶面积及冠宽6种表型参数。与人工测量对比,株高、叶长、叶宽、冠宽、叶面积和叶片数的决定系数分别为0.96、0.97、0.92、0.95、0.98和0.97,均方根误差分别为1.2、0.82、1.13、1.26 cm、11.83 cm2和0.32 片,验证了本方法的高精度与可靠性。进一步在番茄点云数据集上的试验结果表明,PnP-3D-PSegNet具有良好的跨作物泛化能力。综上,本研究实现了从点云分割到表型参数提取的完整流程,所提出的特征融合与边界优化策略不仅有效解决了雪茄叶片粘连难题,也为其他复杂作物三维表型分析提供了一定的技术参考。

     

    Abstract: Accurate extraction of phenotypic parameters from cigar tobacco plants is essential for scientifically assessing plant growth status, guiding precision breeding, and optimizing cultivation management. However, cigar plants exhibit complex structural characteristics, such as severe inter-layer occlusion and tightly overlapping leaves, which often lead to point cloud adhesion and blurred instance boundaries. To address these challenges, this study proposes a novel method for instance segmentation and phenotypic parameter extraction based on 3D point clouds. First, we develop an enhanced 3D point cloud instance segmentation model, termed PnP-3D-PSegNet, which integrates geometric structure with global contextual semantics. Specifically, a PnP-3D module is embedded into the encoder of the baseline PSegNet architecture to improve the model’s ability to capture fine-grained structural features in complex plant point clouds. This design enables more precise discrimination of individual plant organs under challenging conditions. Second, to tackle the issues of blurred instance boundaries and leaf adhesion, an improved Mean Shift clustering algorithm is introduced. We design an instance-aware clustering strategy that combines edge-aware feature integration with density–distance weighted constraints. By incorporating an edge perception mechanism based on local curvature and variations in surface normals, edge confidence is estimated and integrated with instance features, thereby guiding the clustering process in an enhanced feature space and effectively reducing the influence of unreliable boundary points. This significantly alleviates the boundary ambiguity problem in instance segmentation. Furthermore, to mitigate the incorrect assignment of points between adjacent leaves under adhesion conditions, a weighted criterion based on local point density and the distance to cluster centers is employed, further improving segmentation accuracy in densely overlapping regions. Experimental results demonstrate that the proposed PnP-3D-PSegNet model achieves notable improvements over the baseline PSegNet. Specifically, the model reaches 93.59% in mean coverage, 95.77% in mean weighted coverage, 97.21% in mean precision, and 98.55% in mean recall, representing increases of 3.39, 3.56, 3.65, and 2.78 percentage points, respectively. These results highlight the effectiveness of the proposed feature fusion and optimization strategies. Based on the segmentation outputs, six key phenotypic parameters are further extracted, including plant height, leaf number, leaf length, leaf width, leaf area, and canopy width. Comparisons with manual measurements show strong agreement, with coefficients of determination (R2) of 0.96, 0.97, 0.92, 0.95, 0.98, and 0.97, respectively. The corresponding root mean square errors (RMSE) are 1.2 cm for plant height, 0.82 cm for leaf length, 1.13 cm for leaf width, 1.26 cm for canopy width, 11.83 cm2 for leaf area, and 0.32 leaves for leaf count. These results confirm the high accuracy and reliability of the proposed method. Additionally, experiments conducted on a tomato point cloud dataset further demonstrate the strong cross-crop generalization capability of PnP-3D-PSegNet. Overall, this study establishes a complete pipeline from point cloud segmentation to phenotypic parameter extraction. The proposed feature fusion and boundary optimization strategies not only effectively address the problem of leaf adhesion in cigar tobacco plants but also provide valuable technical insights for 3D phenotypic analysis of other complex crops.

     

/

返回文章
返回