高级检索+

多场景果园视觉导航路径识别与导航线提取方法

Recognizing visual navigation path to extract navigation lines for multi-scenario orchards

  • 摘要: 针对复杂果园场景普遍存在地表纹理复杂、路径边界模糊等因素导致自主导航系统识别精度差、实时性与适应能力不足的问题,该研究提出一种路径识别模型MEG-UNet和具有通行决策机制的导航线生成算法。在路径识别模型MEG-UNet中,采用融合HWD(haar wavelet downsampling)下采样的MobileNetV4作为编码器的主干特征提取网络,以满足特征提取需求的同时控制模型复杂度,在解码器中引入Ghost卷积降低计算开销,将SCC-ELA(spatial-channel cooperative efficient local attention)注意力机制嵌入跳跃连接中抑制背景干扰,提升路径分割精度;在路径识别的基础上,提出一种融合通行决策、边缘检测、中点序列生成与曲线拟合的导航线提取方法;通过基于双缓冲机制的流水线并行处理架构实现算法间的协同处理。试验结果表明,相较基线模型ResNet50-UNet,所提出模型在苹果园、葡萄园和草莓园多个场景中,平均交并比和平均像素准确率分别提升5.27和2.96个百分点,模型参数量为8.32M。导航线生成算法的平均角度误差为0.37°~2.45°,最大角度误差为3.26°。整体算法在视频流处理试验和田间测试中均能够流畅进行,帧频保持在25帧/s以上,验证了所提方法在多场景果园视觉导航中的可行性。

     

    Abstract: Autonomous navigation is required for high recognition accuracy, real-time performance, and environmental adaptability under complex ground textures and ambiguous path boundaries in orchards. In this study, a lightweight improved U-Net path recognition model, named MEG-UNet, was proposed to extract navigation lines for multi-scenario orchards. A navigation line generation algorithm was developed to incorporate with a traversability determination mechanism. In the MEG-UNet model, MobileNetV4 was first adopted as the encoder backbone to reduce computational complexity for feature extraction. Haar wavelet downsampling was introduced into the deep feature extraction to enhance the perception of global path structures and continuity. Subsequently, Ghost Convolution was employed in the decoder to further reduce the computational cost for effective feature reconstruction. Moreover, a Spatial-Channel Collaborative Efficient Local Attention (SCC-ELA) mechanism was embedded into the skip connection module. Spatial and channel attention features were integrated to improve the path segmentation accuracy in a multi-scenario orchard. The mechanism also guided the network to focus on critical path regions. A navigation line generation algorithm was designed with a traversability decision. A binary path image was obtained to extract the traversable region at the bottom of the image. The path width was estimated after extraction. The path traversability was determined by comparing the path width with the dimensions of agricultural machinery. Once the path was determined to be traversable, edge detection was performed to generate a midpoint sequence. Subsequently, B-spline curve fitting was applied to generate the final navigation line. Furthermore, a pipeline parallel processing architecture was introduced using a dual-buffer mechanism in collaborative processing between path recognition and navigation line generation. Experiments were conducted in multiple orchards, including plain apple orchards, hilly apple orchards, vineyards, and greenhouse strawberry orchards. The path recognition model achieved higher segmentation accuracy than classical semantic segmentation and YOLO-series models. Compared with the baseline ResNet50-UNet model, the mean Intersection over Union (mIoU) and mean Pixel Accuracy (mPA) improved by 5.27 percentage points and 2.96 percentage points, respectively, among different orchard scenarios. In the two-apple orchards, the mIoU values reached 93.06% and 92.37%, and the mPA values reached 96.85% and 95.97%, respectively. In vineyard and strawberry orchards, the mIoU values were 92.03% and 91.80%, while the mPA values were 96.32% and 96.05%, respectively. Only 8.32 million parameters were able to fully meet the requirements of the lightweight deployment. In addition, the navigation line generation algorithm achieved the maximum traversability determination accuracy of 98%, and the navigation line extraction completeness exceeded 90%. The average angular error of the B-spline-fitted navigation lines ranged from 0.37°to 2.45°, the maximum angular error was 3.26°, and the maximum distance error was within 7.52cm. The overall algorithm operated stably in both video-stream processing experiments and field tests, with the processing frame rate above 25 frames per second. The MEG-UNet improved path segmentation accuracy in complex orchards, indicating its low computational cost. Combined with the traversability determination mechanism and B-spline-based navigation line generation, reliable path recognition and navigation guidance can be expected for autonomous agricultural equipment. The real-time performance and environmental adaptability can also provide effective technical support for visual navigation in multi-scenario orchard environments.

     

/

返回文章
返回