高级检索+

基于改进ORB-SLAM2算法的苗期玉米植株重建方法

Reconstructing maize plants at the seedling stage using the improved ORB-SLAM2 algorithm

  • 摘要: 针对现有作物三维重建方法存在重建时间长、重建效果差的问题,构建了一种基于改进定向快速旋转描述-即时定位与地图构建二代系统(oriented FAST and rotated BRIEF-SLAM2, ORB-SLAM2)算法的苗期玉米植株重建方法。利用快速最近邻搜索库(fast library for approximate nearest neighbors, FLANN)算法结合随机抽样一致性算法(random sample consensus, RANSAC)对苗期玉米植株图像进行特征匹配,并结合多视角立体算法(multiple view -tereo, MVS)实现对苗期玉米植株的稠密重建。在此基础上,利用重建模型对两个玉米品种植株的主要构型参数进行获取,并与实测值进行对比,以验证构型获取方法的准确性和有效性。试验结果表明:FLANN+RANSAC算法进行特征匹配的正确率是89.00%,点云平均稠密重建点数为7.13×105个,平均重建时间仅为15.32 min,利用三维重建模型进行苗期玉米植株构型参数提取的误差均能控制在10%以内,且与人工实测值具有较好的相关性。该算法重建时间短,且重建精度较高,能够为苗期玉米植株的构型获取提供理论依据和技术支撑。

     

    Abstract: Three-dimensional (3D) reconstruction for crops is often limited to a prolonged duration and suboptimal quality. In this study, an improved framework was proposed as the Oriented FAST and Rotated BRIEF-SLAM2 (ORB-SLAM2) system, in order to specifically reconstruct the seedling-stage maize plants. Several advanced computer vision techniques were integrated to achieve a robust and efficient reconstruction. Initially, the Fast Library for Approximate Nearest Neighbors (FLANN) algorithm was employed to combine with the Random Sample Consensus (RANSAC) algorithm, in order to perform high-accuracy feature matching on the multi-view images of the maize seedlings. This hybrid matching strategy was effectively identified to align the keypoints over the different images. While the outliers and incorrect matches were filtered out for the subsequent 3D processing. Feature matching and sparse point cloud generation were then realized using the modified ORB-SLAM2 front-end. A Multi-View Stereo (MVS) algorithm was seamlessly integrated into the pipeline. This MVS module was utilized for the pose estimations using a precise camera. The feature was performed on dense matching and depth estimation. Ultimately, a dense and accurate 3D point cloud model was generated to represent the morphology and spatial structure of the target maize plants. After that, the key architectural parameters were extracted from two maize cultivars, such as the plant height, leaf length, and stem diameter. A comparison was then made between the conventional and manual measurements in order to evaluate the practical utility and accuracy of the reconstructed models. Experimental results demonstrate that the superior performance of the integrated approach was achieved in the accuracy, reliability, and overall effectiveness of the non-contact phenotype using imaging. Specifically, the FLANN+RANSAC combination achieved a high correctness rate of 89.00% in the feature matching. The dense reconstruction produced the point clouds with an average density of 7.13×105 points per model. Remarkably, the entire reconstruction, from the image input to dense point cloud output, was required for an average time of only 15.32 min, indicating its significant efficiency. All architectural parameters were extracted from the 3D models for the seedling maize plants. The errors were consistently maintained within a 10% threshold. There was a significant correlation between the extraction and the manual measurements, indicating the strong robustness. In conclusion, the high speed and precision were realized in plant phenotyping. The computational time was substantially reduced without compromising the reconstruction quality, thus offering a rapid, accurate, and non-destructive solution. Therefore, this work can provide a solid theoretical foundation and a practical, high-performance technical framework for the automatic acquisition of the 3D architectural traits in the maize plants during the critical seedling stage. The considerable potential was provided to advance the high-throughput plant phenotyping. The efficient morphological analysis can also accelerate crop genetics and breeding in precision agriculture.

     

/

返回文章
返回