高级检索+

基于机器视觉的农用无人机精准降落系统研制

Design and implementation of precision landing system for agricultural UAVs based on machine vision

  • 摘要: 针对无人机在农田复杂环境中难以实现精准降落的问题,该研究以实现无人机在无人机机场上的精准降落为目标,设计了一种基于机器视觉的无人机精准降落系统。首先对降落标志进行改进,采用红色圆形搭配双层嵌套ArUco码(augmented reality University of Cordoba)以提升识别鲁棒性;并采用改进的YOLOv9s(you only look once)模型进行训练;然后借助张正友相机标定法构建坐标系,结合透视n点法(perspective-n-point, PnP)计算无人机位置。最后搭建仿真环境与无人机进行试验。试验结果表明:改进后的模型参数量相比YOLOv9s下降49%,交并比阈值为0.50时的平均精度均值(mean average precision, mAP50)达到91.96%;改进后的降落标志使横、纵轴降落误差从110.6 mm和99.8 mm降至64 mm和62.4 mm;仿真试验表明,在500 mm×500 mm平台上,无人机降落时横轴误差为93 mm、纵轴误差为86 mm,分别占对应边长的18.6%和17.2%,均小于20%。本研究实现了无人机在机场上的精准降落,可为实现农用无人机精准降落提供参考,助力其在农业作业中的应用。

     

    Abstract: To address the difficulty of achieving precise landing of unmanned aerial vehicles (UAVs) in complex farmland environments, this study designed a machine vision-based precision landing system for agricultural UAVs, with the objective of realizing accurate landing on a UAV airport platform. In this study, the landing marker was first improved to enhance recognition robustness under farmland conditions. A red circular pattern was combined with a double-layer nested ArUco (augmented reality University of Cordoba) marker to form the landing marker. The red circular feature improved the visual distinctiveness of the landing marker in field environments, while the nested ArUco structure enhanced the continuity and stability of marker recognition during landing. The complete marker measured 580 mm × 580 mm, with a first-level ArUco code of 310 mm × 310 mm for long-range recognition and a nested second-level code of 50 mm for precise close-range positioning. To further improve target detection performance, an improved YOLOv9s (you only look once, version 9, small) model was adopted for training and recognition of the landing marker. A total of 126 UAV remote-sensing images were collected over a corn field and divided into training and validation sets at a ratio of 8:2 before brightness augmentation expanded the dataset to 630 images. The use of the improved model helped balance detection accuracy and computational complexity, thereby providing technical support for practical deployment on UAV platforms. A star operation, which mapped low-dimensional features into a high-dimensional space through element-wise multiplication, was embedded in the backbone to strengthen feature representation. The resulting lightweight model comprised 7.28 million parameters and required 29.1 G floating-point operations. After target detection, Zhang’s camera calibration method was employed to establish the coordinate system and obtain the camera parameters. On this basis, the UAV position was calculated by combining the perspective-n-point (PnP) algorithm. By integrating marker detection, camera calibration, and pose estimation, a complete machine vision-based precision landing system was established. To achieve stable flight control during descent, a cascade control strategy combining model predictive control (MPC) and proportional-integral-derivative (PID) was adopted, where MPC generated optimal trajectory references and PID regulated attitude and position for precise trajectory tracking. To evaluate the effectiveness of the proposed system, simulation tests and UAV experiments were carried out. The experimental results showed that the improved YOLOv9s model effectively reduced model complexity while maintaining favorable detection performance. Compared with the original YOLOv9s model, the number of parameters of the improved model was reduced by 49%, and the mean average precision at an intersection-over-union threshold of 0.50 (mAP50) reached 91.96%. In the model evaluation, the improved model attained a precision of 98.6%, a recall of 78.0%, and an F1-score of 82%. These results indicated that the proposed model had good potential for real-time application on platforms with limited onboard computing resources. In addition, the improved landing marker significantly enhanced landing accuracy. The landing errors along the horizontal and vertical axes were reduced from 110.6 mm and 99.8 mm to 64.0 mm and 62.4 mm, respectively, showing that the redesigned landing marker could effectively improve the positional alignment accuracy of the UAV during landing. At heights of 5 to 20 m, its mean detection confidence ranged from 89.5% to 97.3%, whereas that of the conventional single marker ranged from 57.9% to 83.6%. The simulation results further verified the feasibility of the proposed system. When the UAV landed on the platform, the landing errors along the horizontal and vertical axes were 93 mm and 86 mm, respectively, corresponding to 18.6% and 17.2% of the respective side lengths of the 500 mm × 500 mm platform; both individual-axis errors were below 20%. In field experiments, six landing trials were conducted with the original marker, including one failed landing; only the five successful landings were included in the landing-error statistics. The UAV with the improved marker completed five precise landings, and descending from 20 m took about 75 s. This demonstrated that the developed system could meet the basic requirements of precision landing on a UAV airport platform. In summary, this study realized precise landing of UAVs on a UAV airport by developing a machine vision-based precision landing system. The proposed system integrated an improved landing marker, a lightweight target detection model, camera calibration, and visual position estimation, and provided a feasible technical solution for autonomous landing of agricultural UAVs in farmland environments. The findings of this study could provide a reference for the realization of precision landing of agricultural UAVs and support their further application in agricultural operations.

     

/

返回文章
返回