高级检索+

双模型框架下的小麦条锈病显微高光谱图像分割方法

Microscopic hyperspectral image segmentation of wheat stripe rust based on a dual-model semi-supervised framework

  • 摘要: 显微高光谱成像技术可同步获取组织空间结构与连续光谱信息,从细胞层面揭示病变特征,为小麦条锈病害识别提供了新手段。针对该类图像数据维度高、冗余性强,且像素级标注成本高昂问题,该研究提出一种双模型动态高置信伪标签半监督学习框架,该框架以卷积神经网络(CNN)与Vision Transformer为基础,通过交叉伪标签双向监督机制融合局部纹理与全局语义信息;引入基于验证集性能的动态阈值更新策略,使伪标签筛选阈值随模型能力自适应调整;同时采用高置信度筛选机制,仅保留教师模型预测置信度高的像素参与学生模型更新,有效抑制噪声干扰。试验结果表明,该方法可显著改善分割精度,U-Net模型的平均Dice系数(mDice)与平均交并比(mIoU)分别提升至0.8290和0.7079,ViT模型分别提升至0.8209和0.6962。该研究在减少人工标注依赖的同时,通过融合模型互补优势与动态伪标签优化策略,有效抑制伪标签噪声并提升显微高光谱图像分割精度与稳定性,可为小麦组织结构分析及寄主–病原互作表型研究提供技术支撑。

     

    Abstract:
    Microscopic hyperspectral imaging can simultaneously capture spatial structural information and continuous spectral signatures of biological tissues, thereby providing a novel means for disease detection and analysis at the cellular level. By integrating microscopic morphology with spectral reflectance characteristics, this technique makes it possible to identify subtle pathological changes that are difficult to observe using conventional imaging methods. However, hyperspectral images are typically characterized by extremely high dimensionality, strong inter-band redundancy, and substantial data complexity. In addition, pixel-level annotation of microscopic hyperspectral images is highly labor-intensive and time-consuming, which greatly restricts the direct application of fully supervised segmentation methods, especially in plant disease studies where expert labeling is costly and limited.
    To address these challenges, this study proposes a dual-model semi-supervised segmentation framework with dynamic high-confidence pseudo-labeling for microscopic hyperspectral images of wheat leaves infected by stripe rust. The proposed framework is designed to reduce the dependence on large-scale manually annotated datasets while improving segmentation accuracy and robustness. Specifically, the method employs a convolutional neural network (CNN) and a Vision Transformer (ViT) as two complementary teacher-student branches. The CNN branch is effective in capturing local texture details and fine-grained spatial patterns, whereas the ViT branch is more capable of modeling global contextual dependencies and long-range semantic relationships. Through a bidirectional cross pseudo-label supervision strategy, the two models iteratively exchange reliable predictions and jointly exploit their complementary advantages, enabling the framework to learn more discriminative representations from limited labeled samples and abundant unlabeled data.
    Furthermore, a dynamic threshold update mechanism based on validation-set performance is introduced to adaptively adjust the pseudo-label selection threshold according to the evolving capability of the models during training. Unlike fixed-threshold strategies, the proposed mechanism allows the pseudo-label filtering criterion to change with model performance, which helps maintain a balance between pseudo-label quantity and quality throughout the learning process. At the same time, a high-confidence filtering strategy is incorporated to retain only those pixels with sufficiently reliable teacher predictions for student model optimization. This design effectively suppresses the accumulation of noisy pseudo-labels and reduces error propagation during iterative training, thereby enhancing both segmentation stability and generalization ability.
    Experimental results demonstrate that the proposed method can significantly improve the segmentation performance of microscopic hyperspectral images of wheat stripe rust. After semi-supervised optimization, the U-Net model achieved an mDice of 0.8290 and an mIoU of 0.7079, while the ViT-based model achieved an mDice of 0.8209 and an mIoU of 0.6962. These results indicate that the proposed framework effectively enhances segmentation precision under limited annotation conditions. Overall, this study provides a feasible and effective solution for reducing manual labeling dependence in microscopic hyperspectral image segmentation. By integrating complementary model architectures with dynamic pseudo-label optimization, the proposed framework effectively alleviates pseudo-label noise and improves segmentation accuracy and stability. The method can provide technical support for wheat tissue structure analysis and host-pathogen interaction phenotyping research, and it also offers a useful reference for semi-supervised segmentation of other microscopic hyperspectral imaging tasks in agricultural and biological applications.

     

/

返回文章
返回