高级检索+

基于LG-YOLOv8n-seg全生长期哈密瓜田视觉导航路径提取方法

Visual navigation path extraction method for hami melon fields at all growth stages using LG-YOLOv8n-seg

  • 摘要: 针对哈密瓜全生长期复杂生长环境所引发的机器人导航路径提取难度大、实时性差与连续作业换行不准确等难题,该研究提出一种针对哈密瓜全生长期生长状态的农业机器人视觉导航路径提取方法。首先采用改进的LG-YOLOv8n-seg模型分割哈密瓜行间区域,设计了主干模块MB_VanillaBlock(multi-branch VanillaBlock)与轻量化共享检测头SharedLite_Segment(shared lightweight segmentation head)以提升推理速度,并加入BGE_Module(boundary geometry enhancement module)模块增强边界分割精度。试验结果表明,LG-YOLOv8n-seg模型的参数量、计算量、mAP50F1分数分别为1.437 M、7.5 G、96.10%和61.17%,相较于基准模型YOLOv8n-seg的3.258 M、12 G、97.65%和57.68%,参数量降低了55.89%,计算量降低了37.5%,F1分数提高了3.49个百分点,而mAP50仅降低1.55个百分点。然后,基于分割结果提取特征点、去除噪声点,采用最小二乘法拟合作物中心行路径,引入Dubins曲线实现换行路径的提取,最终实现对不同生长期哈密瓜行的连续路径提取。将所提出的LG-YOLOv8n-seg模型部署至NVIDIA Jetson Orin NX开发板中,其推理速度达到了42.55帧/s,相比YOLOv8n-seg模型提高了17.41%,全生长期哈密瓜行间路径的平均偏转角仅为0.82°,各生长时期的导航偏差与同期行间区域宽度占比均在合理范围,满足哈密瓜田的视觉导航需求。

     

    Abstract: Honey melon cultivation has posed severe challenges to autonomous agricultural robots, due to the variable environment of plant growth over the entire growth cycle. Plant leaves continuously cover the inter-row soil areas, as the vines grow and spread progressively in different periods, thus blurring the dividing lines between crop rows. Dynamic canopy closure can also aggravate three engineering troubles: difficult extraction of navigation path, unsatisfactory real-time response, and erroneous line switching during operation in the field. In this study, the visual navigation path extraction was proposed for the full-cycle growth of honey melon in agricultural robots. An improved lightweight instance segmentation model, termed Lightweight Geometry-enhanced YOLOv8n-seg (LG-YOLOv8n-seg), was also employed for the accurate pixel-level segmentation of inter-row regions in honey melon farmland. A multi-branch VanillaBlock, named MB_VanillaBlock, was constructed as the backbone structure to extract multi-scale spatial features of crop and soil areas. Meanwhile, a shared lightweight segmentation head with SharedLite_Segment was specially designed to avoid repeated feature calculation. Both optimal modules were adopted to effectively elevate the overall inference efficiency of the segmentation network and baseline accuracy. Furthermore, a boundary geometry enhancement module, abbreviated as BGE_Module, was integrated into the network framework. Geometric constraints were imposed on ambiguous boundary predictions. This module remarkably strengthened the segmentation precision of fuzzy and irregular boundary areas blocked by dense melon leaves. A series of valid experimental data was acquired to systematically verify the performance of the improved model against the original YOLOv8n-seg benchmark. The parameter scale, computational load, mean average precision under 0.5 intersection over union threshold (mAP50), and boundary fitting score (BF_Score) of LG-YOLOv8n-seg were measured as 1.437 M, 7.5 G, 96.10%, and 61.17%, respectively. In YOLOv8n-seg, those were the 3.258 M parameters, 12 G computational load, 97.65% mAP50, and 57.68% F1 Score, while the total parameters decreased by 55.89% and the computational consumption was lowered by 37.5%, compared with the original YOLOv8n-seg model. The BF_Score indicator was raised by 3.49 percentage points, whereas a slight decline of 1.55 percentage points was generated in the mAP50 index. The trade-off demonstrated the effective balance between lightweight and segmentation boundary accuracy. Valid feature points were then optimized from the foreground–background separation using the segmentation images. Redundant noise points were removed against weeds and uneven ground. The least squares algorithm was applied to fit smooth central navigation paths of crop rows using the points retained from the effective boundary feature. Furthermore, Dubins' curve theory was introduced to generate smooth and stable line-switching trajectories without sharp steering angles. Dubins curve respected the minimum turning radius of the agricultural vehicle to produce kinematically executable paths, thereby directly overcoming the erroneous line switching. Steady and continuous path extraction tasks were consequently completed for honey melon rows at different growth phases, from the seedling to the fruit ripening stage. The LG-YOLOv8n-seg model was established and then deployed onto an NVIDIA Jetson Orin NX embedded board in field real-time tests. The actual running inference speed was evaluated up to 42.55 frames per second, achieving a 17.41% performance, compared with the original YOLOv8n-seg model under the same embedded hardware environment. The average deflection angle of inter-row navigation paths was controlled at only 0.82° in the whole growth period. Permissible ranges of agricultural vehicles were obtained for the navigation deviations and their proportional values relative to the actual inter-row width at each growth stage. The findings can fully meet the practical demands of a visual navigation system under complex honey melon field scenarios with a dynamically growing plant canopy.

     

/

返回文章
返回