高级检索+

基于VINS-MONO和改进YOLO v4-Tiny的果园自主寻筐方法

Autonomous Basket Searching Method for Orchards Transporter Based on VINS-MONO and Improved YOLO v4-Tiny

  • 摘要: 面向果园运输车果品采收自主运输作业场景,提出了一种基于VINS-MONO和改进YOLO v4-Tiny的果园自主寻筐方法。首先基于VINS-MONO视觉惯性里程计算法,进行果园运输车位置姿态的实时估计。然后基于改进YOLO v4-Tiny目标检测算法,根据图像数据进行果筐实时目标检测并获取对应深度信息。其次根据运输车当前位置姿态、果筐深度信息以及深度相机内参,进行被识别果筐位置更新。最后基于三次B样条曲线拟合原理,以被识别果筐位置为控制点,进行寻筐路径实时拟合,为果园运输车抵近果筐提供路线引导。试验结果表明:改进YOLO v4-Tiny果筐识别模型的平均识别精度为93.96%,平均推理时间为14.7 ms, 4 m内的果筐距离定位误差小于4.02%,果筐角度定位误差小于3°,果园运输车实测平均行驶速度为3.3 km/h,果筐搜寻路线平均更新时间为0.092 s,能够在果树行间和果园道路两种作业环境下稳定实现自主寻筐。该方法能够为果园运输车提供自主寻筐路径引导,为其视觉导航提供研究参考。

     

    Abstract: A method for orchard autonomous basket searching based on VINS-MONO and improved YOLO v4-Tiny was proposed for the scenario of orchard transporter fruit harvesting and autonomous transportation operations. Firstly, the position of the orchard transporter was estimated in real time based on the VINS-MONO visual inertial odometry calculation method. Then based on the improved YOLO v4-Tiny target detection algorithm, real-time target detection of the fruit basket was performed on the image data, and its depth information was obtained. Nextly, the position of the identified fruit basket was estimated based on the current position pose of the transporter, the depth information of the fruit basket and the parameters of the depth camera. Finally, based on the principle of cubic B spline curve fitting, the path of the identified fruit basket was fitted in real time, using the position of the identified fruit basket as the control point, to provide route guidance for the autonomous fruit basket search of the orchard transporter. The test results showed that the average recognition accuracy of the improved YOLO v4-Tiny fruit basket recognition model was 93.96%, the average inference time was 14.7 ms, the measurement error of the fruit basket distance within 4 m was less than 4.02%, the measurement error of the fruit basket angle was less than 3°, the measured driving speed of the orchard transporter was 3.3 km/h, the average update time of the fruit basket search route was 0.092 s, and the transporter could stably achieve autonomous basket searching in two operating environments: fruit tree rows and orchard roads. This method could provide autonomous basket finding path guidance for orchard transporter and provide research reference for visual navigation of orchard transporter.

     

/

返回文章
返回