高级检索+

基于跟踪生长ROI的茶垄道路导航线提取

Extracting navigation line for tea ridge roads using tracking growing ROI

  • 摘要: 针对现有跨垄式采茶机导航中心线提取效率低的问题,该研究提出一种基于机器视觉跟踪生长ROI茶垄间导航线提取算法。首先采用固定ROI(region of interest)方法,选取图像左下方区域为第一块ROI,在ROI内进行超绿指数灰度化,最大类方差法分割茶垄道路与背景,通过形态学操作对图像进行增强与降噪,使用最大连通域检测操作提取ROI内的坐标信息与特征点,根据ROI提取的坐标信息动态生成ROI,直到整个图像中所有茶垄道路信息提取完成,最后采用最小二乘法获取跨垄式采茶机底盘在垄间行驶的导航线。该方法经过连续帧测试,处理一帧1920×1080 px图像的平均时间为18 ms,该研究算法与人工提取导航线的航向角平均误差为0.405°,标准差为0.463°,可在一定杂草、落叶干扰的情况下完成导航角提取。

     

    Abstract: Real-time and accurately acquisition the navigation centerline is often required for the interrow tea harvesting machine. In this study, an interrow navigation line algorithm was proposed to extract the tea ridge roads using tracking growth ROI and machine vision. Firstly, the fixed ROI (region of interest) was used, where the lower left region of the image was selected as the first ROI. The grayscaling was carried out in the ROI. The same ROI was grayscaled using a variety of RGB component combinations. A comparison was performed on the super green index grayscaling, as the best grayscaling. Secondly, the maximum class variance was used to segment the tea ridge road and background. The morphological operations were then carried out to reduce the noise. The coordinate information and feature points were extracted from the ROI, according to the maximum connectivity domain. The ROI was dynamically generated to extract all the information of the tea ridge road in the whole image. Finally, the least square method was used to obtain the trans-radial tea plucking machine chassis travelling between the ridge navigation line. A comparison was made on the accuracy and time consumption of the navigation line extraction, including the diffuse filling, dynamic ROI and the tracking growth ROI algorithm. The results show that the deviation of the heading angle after extraction was all in the range of -4°~4°. The absolute value of the deviation was greater than 4° in the heading angle of only two frames extracted by the dynamic ROI algorithm. The reason was that the larger convolution kernel of the image preprocessing was resulted in the loss of image information from some of the tea ridge roads. The ROIs were accounted for 34.47% of the total pixels of the image. The amount of the pixel computation was reduced by 11.82% on average, compared with the dynamic ROI. The average computation time of the single-frame images was 41.6 and 156.3ms lower than that of the dynamic ROI and diffuse filling algorithm, respectively. The errors in the variance of the navigation were 0.039° and 0.012° lower than those of the diffuse filling and the automatic ROI algorithm, respectively. The continuous frame and field tests were performed to verify the extraction. The navigation centerline of 1782 consecutive image frames in the video stream was extracted in the continuous frame test. The maximum magnitude of the extracted heading angle deviation was 2.41°, with an average absolute heading and standard deviation of 0.405° and 0.463°, respectively. The processing time of each frame was 44~14 ms, with an average processing time of 18 ms; The field test was conducted to collect the images of the tea rows and then extract the navigation line. The industrial camera (RER-USB4kCAM01H) was placed at the position of 0.2 m directly above the center of the front bracket of the cross-row tea harvester, with a tilt angle of -12°. The navigation angle was obtained -3.11° and the navigation error was 0.5°. The interrow navigation line extraction of the tracking growth ROI tea ridge was realized using navigation angle extraction under weed and leaf fall interference, fully meeting the requirements of the navigation center line extraction accuracy for the interrow interrow tea harvesting machine. The finding can provide a research basis to further study the unmanned system of tea harvester.

     

/

返回文章
返回