高级检索+

拖拉机平视显示研究与分析——基于DeeplabV3+和眼动追踪技术

Research and Analysis of Tractor Head-up Display——Based on DeepLabV3+ and Eye Tracking

  • 摘要: 为了提高拖拉机驾驶人员的驾驶安全系数,解决拖拉机驾驶人员经常扭头观看后方农机机具作业情况的问题,对拖拉机驾驶室使用平视显示(HUD)进行研究分析。首先,利用Deeplabv3+图像语义分割法与眼动追踪技术结合的方式,对拖拉机驾驶人员观察后方农机机具的画面进行采集并对重要信息进行标注;然后,使用Pytorch深度学习框架来搭建所需的模型网络结构和完成相应的代码开发,最终得到较为清晰的分割图像;最后,对原始图像及分割后图像进行眼动追踪实验验证,提取被试者的眼动轨迹,发现分割后图像能更好地被观看者识别。研究结果表明:利用DeeplabV3+对图像进行分割增强,应用到平视显示技术中,可以有效提高拖拉机驾驶人员的驾驶安全性和工作效率。

     

    Abstract: In order to improve the driving safety factor of tractor drivers and improve the problem that tractor drivers often turn their heads to watch the operation of rear farm machinery and tools, the use of HUD in tractor cab was studied and analyzed. Firstly, the images of tractor drivers observing the rear agricultural machinery and tools were collected and the important information was marked by the combination of DeepLabv3+ image semantic segmentation method and eye movement tracking technology. In the experimental part, Pytorch deep learning framework is used to build the required model network structure and complete the corresponding code development, and finally get a relatively clear segmentation image. Then the original image and the segmented image are verified by eye movement tracking experiment, and the eye movement track of the subject is extracted. After watching, it is found that the segmented image can be better recognized by the viewer. The results show that using DeepLabV3+ image segmentation enhancement, applied to the head-up display technology can effectively improve the safety and efficiency of tractor drivers.

     

/

返回文章
返回