高级检索+

基于多传感融合的农田障碍物检测优化研究

Research on Optimization of Field Obstacle Detection Based on Multi-sensor Fusion

  • 摘要: 为满足农机自主作业过程中障碍物检测的需求,解决视觉检测容易受作业环境条件影响的问题,提出了融合毫米波雷达和相机信息的农田障碍物检测的优化方案。首先,根据雷达散射截面值以及转换矩阵完成雷达点向图像像素坐标系中的映射;然后,利用提出的改进暗通道先验去雾算法及基于显著性的增强算法对映射区域进行处理,以完成局部图像的增强;最后,通过yolov4-tiny网络进行检测,并利用决策级融合策略,完成毫米波雷达同相机检测结果的数据关联,综合输出农田障碍物信息。测试结果表明:相较于仅视觉的检测结果,融入毫米波雷达信息后,在不同的数据集上检测性能均有所提升。在恶劣环境数据集上尤为突出,在晴天有烟尘数据集上,召回率R上升了16.4%,平均精度均值mAP上升了7.95%;在雾天无烟尘数据集上,召回率R上升了17.7%,平均精度均值mAP上升了6.63%。同时,算法对单帧图像的处理时间约148ms,可以满足农机自主作业过程中实时性检测的要求。

     

    Abstract: In order to meet the requirements of obstacle detection in the process of autonomous operation of agricultural machinery and solve the problem that visual detection is easily affected by operating environment, this paper proposes a field obstacle detection scheme that integrates millimeter-wave radar and camera information. Firstly, according to the radar cross section(RCS) value of the radar and the transformation matrix, the mapping of the radar point to the image pixel coordinate system is completed. Afterwards, the improved dark channel prior dehazing algorithm and the saliency-based enhancement algorithm proposed in this paper are used to complete the local image enhancement. Finally, the yolov4-tiny network is used for detection, and the decision-level fusion strategy is used to complete the data association between the millimeter-wave radar and the camera detection results, and comprehensively output information of the obstacles. The test results show that compared with the detection results of the visual detection, after incorporating the millimeter-wave radar information, on different datasets, the detection performance has been improved. Specifically, on the sunny day with dust dataset, R rises 16.4%, mAP rises 7.95%. On the foggy data set, R rises 17.7%, and mAP rises 6.63%. At the same time, the processing time for a single image of the algorithm after incorporating millimeter-wave radar information is about 148ms, which can meet the real-time requirements of agricultural machinery in the process of autonomous operation.

     

/

返回文章
返回