高级检索+

基于改进UNet的小麦叶片黄化分割与程度分级方法

Improved UNet-based segmentation and severity grading for wheat leaf yellowing

  • 摘要: 高效分割小麦叶片黄化区域并精准分级黄化程度,对小麦长势监测、营养胁迫诊断以及生长状态定量评估等具有重要意义。针对小麦叶片黄化区域分割中存在的边缘模糊、颜色误判和实时分割部署困难等问题,该研究基于UNet提出了一种轻量化小麦叶片黄化分割模型CTGE-MobileUNet(color-texture guided edge-refined MobileNetV3-UNet)。首先,以轻量化MobileNetV3-large作为编码主干,在降低参数量和计算复杂度的同时,保持有效特征提取能力;然后,在编码器的浅层、中层、深层及瓶颈层分别引入纹理(texture)、色调-饱和度-亮度(hue-saturation-value,HSV)、明度-红绿对立-黄蓝对立(LAB)以及红-绿-蓝(red-green-blue,RGB)等多通道信息,构建颜色-纹理引导注意力模块(color-texture guided attention,CTGA),增强模型对渐变黄化区域的感知能力;之后,在解码器中引入边界细化模块(edge refinement module,ERM),改善叶脉与黄化交界处的结构表达,减少模糊与边缘断裂现象;最后,解码阶段采用亚像素卷积,提升空间细节恢复质量。结果表明,CTGE-MobileUNet的平均交并比、平均像素精度、宏平均F1分数分别为80.96%、88.53%和88.62%,相比于原始UNet分别提升7.11、6.89和5.67个百分点;与主流图像分割模型PSPNet、DeepLabV3+相比,平均交并比、平均像素精度、宏平均F1分数分别提升2.53~3.43、2.98~4.15和1.90~2.67个百分点。同时,参数量仅为11.19 M,明显低于对比模型,有效实现了分割精度与模型效率的平衡。基于模型CTGE-MobileUNet分割结果计算黄化区域占比,对黄化程度进行分级,平均分级准确率为93.08%。将模型部署于边缘设备Nvidia Jetson Orin Nano Super,平均预测时间为0.17 s、浮点运算量为14.96 G,经TensorRT加速后平均预测时间缩短35.29%。模型CTGE-MobileUNet能够为小麦叶片黄化精准分割与分级提供高效的技术支持。

     

    Abstract: Wheat leaf yellowing is one of the most serious phenotypic traits to directly reflect the nutritional status, physiological stress response, and growth vitality of the plant. Abnormal yellowing can lead to a sharp decline in chlorophyll content and photosynthetic efficiency, where dry matter accumulation can significantly reduce grain yield and quality. It is often required for accurate and real-time segmentation of wheat leaf yellowing areas. Severity grading can also combine with intelligent growth monitoring, precise nutritional stress diagnosis, and targeted field practices. Existing research on wheat leaf phenotypic analysis has focused on disease type identification and leaf area measurement. However, it is still lacking in the fine-grained segmentation of gradual yellowing regions and the severity grading. Moreover, most current segmentation models suffer from large parameter counts, high computational complexity, and low real-time performance, thus hindering their deployment on resource-constrained edge devices and on-site detection of wheat leaf yellowing. In this study, a lightweight model was proposed for wheat leaf yellowing segmentation and grading, termed CTGE-MobileUNet (color-texture guided edge-refined MobileNetV3-UNet). The lightweight MobileNetV3-large was taken as the encoding backbone. Depthwise separable convolutions were adopted to invert residual structures for fewer parameters and computational complexity, while preserving effective multi-scale feature extraction of wheat leaves. A color-texture guided attention (CTGA) module was constructed and then embedded into the shallow, middle, deep, and bottleneck layers of the encoder. Multi-channel information was integrated, including texture features, HSV, LAB, and RGB. The CTGA module was used to perceive features of gradual yellowing regions with low contrast and blurred boundaries. In the decoding stage, an edge refinement module (ERM) was incorporated to strengthen the structural representation at the junctions between wheat leaf veins and yellowing regions. Edge blurring and discontinuity were effectively mitigated after segmentation. Additionally, sub-pixel convolution was used to replace conventional interpolation and deconvolution. The spatial resolution recovery was improved for fewer segmentation artifacts via channel rearrangement. Comparative experiments were conducted to evaluate the performance of the improved model. Three original models were selected, such as UNet, PSPNet, and DeepLabV3+. Experimental results show that the CTGE-MobileUNet model achieved fine segmentation of wheat leaf yellowing areas after multi-module collaboration. Compared with UNet, PSPNet, and DeepLabV3+, the mean intersection over union (mIoU), mean pixel accuracy (mPA), and F1-Macro were improved by 2.53~7.11, 2.98~6.89, and 1.90~5.67 percentage points, respectively, indicating excellent performance of fine segmentation for the wheat leaf yellowing areas. Furthermore, the CTGE-MobileUNet model converged steadily under the staged freeze-thaw training, as shown by the loss function and mIoU curves. The loss function decreased from an initial value of 0.95 to 0.65. The validation mIoU eventually stabilized at 80%. Better generalization and segmentation accuracy were obtained for the effective and precise segmentation of wheat leaf yellowing areas. In terms of lightweight performance, the parameter number of CTGE-MobileUNet was only 11.19 M, with a prediction time of 9.04 ms. Compared with UNet, PSPNet, and DeepLabV3+, the parameter count was reduced by 13.70, 35.52, and 43.52 M, respectively, indicating a favorable balance between segmentation accuracy and model efficiency. A series of experiments was conducted on the severity grading of wheat leaf yellowing, according to the lesion area ratio specified in the national standard GB/T15790-2017. The average grading accuracy of the CTGE-MobileUNet model reached 93.08%, which was 3.74, 10.24, and 2.21 percentage points higher than that of UNet, PSPNet, and DeepLabV3+, respectively, indicating the robust stability and discriminative ability in the task of severity grading. In practical edge deployment, the CTGE-MobileUNet model was deployed on the NVIDIA Jetson Orin Nano edge computing device and then optimized with TensorRT acceleration. Deployment results show that the average prediction time on the edge device was 0.17 s with 14.96 G floating-point operations (FLOPs) without acceleration. The FLOPs of the model remained stable after TensorRT acceleration. While the average prediction time was reduced to 0.11 s, with a decrease of 35.29%, compared with that before acceleration. which significantly improved the real-time inference performance of the model on edge devices. In conclusion, the edge device deployment and TensorRT acceleration validated the practical applicability of the CTGE-MobileUNet model. Meanwhile, there was an excellent balance between segmentation accuracy and inference efficiency during yellowing region segmentation, boundary structure restoration, and severity grading. The feasibility and effectiveness of the improved lightweight model were also verified under controlled laboratory. The finding can provide a solid technical foundation for large-scale field identification and intelligent evaluation of wheat leaf yellowing severity.

     

/

返回文章
返回