高级检索+

结构光反射成像结合SPT和机器学习的黄桃隐性损伤检测

Detection of implicit bruises in yellow peaches using structured illumination reflectance imaging combined with SPT and machine learning

  • 摘要: 针对黄桃早期隐性损伤特征不明显,常规光学成像技术检测难的问题,该研究采用结构光反射成像(structured-illumination reflectance imaging, SIRI)技术结合螺旋相位变换(spiral phase transform,SPT)解调和机器学习算法,以实现黄桃隐性损伤快速检测。首先利用搭建的SIRI系统采集6个空间频率(0.05、0.10、0.15、0.20 、0.25、0.30 mm−1)的条纹结构光反射图像,采用三相位解调(three-phase demodulation,TPD)得到交流分量(amplitude component,AC)图像和直流分量(direct component,DC)图像,计算AC图像对比度指数用于选择适用于黄桃隐性损伤检测的最优空间频率,并采集所有样品的三相位条纹图像。利用SPT解调方法得到AC和DC图像,计算AC/DC获得比值图像(ratio image,RT)。基于DC、AC、RT 3种图像的灰度共生矩阵(gray level co-occurrence matrix,GLCM)、局部二值模式(local binary pattern,LBP)图像纹理特征和基于ResNet-50提取的深度特征,使用5种图像(DC、AC、RT、DC-AC、DC-AC-RT)的GLCM-LBP特征、深度特征和混合特征作为输入,分别建立支持向量机(support vector machine,SVM)、K近邻(K-NearestNeighbor,KNN)、极端梯度提升(XGBoost)、随机森林(random forest,RF)等机器学习模型对健康和损伤黄桃进行分类检测。结果表明,基于GLCM-LBP特征、深度特征和混合特征建立的模型最高平均准确率分别为92.6%、95.0%和95.7%,混合特征模型的平均准确率最高。在混合特征分类模型中,基于DC-AC-RT组合图像的XGBoost模型准确率最高为97.6%。对比相同条件下的TPD解调图像分类结果,SPT解调图像的总体分类准确率与TPD解调图像相当,准确率最高均为97.6%,且只需任意两幅相位图像,与TPD相比图像采集时间可节约1/3。研究表明,SIRI结合SPT和机器学习算法可实现黄桃隐性损伤检测,保持较高准确率的同时还减少了检测时间,有效提高了SIRI技术的检测效率,研究结果可为果蔬表面隐性损伤实时检测提供参考。

     

    Abstract: Mechanical bruising has been one of the main influencing factors of yellow peaches on consumer satisfaction and shelf life. The implicit bruises can often be suffered during picking, grading, and transportation. Early slight bruising can accelerate the spoilage and decay under the action of biological enzymes, due to the fungal infection. Therefore, it is crucial to timely and efficiently detect the implicit bruises in yellow peaches. However, the manual identification of surface bruises on fruits and vegetables cannot fully meet the large-scale production at present, due to the inefficiency, cost, and easy influence by subjective human factors. Common non-destructive testing techniques also share some limitations in detecting fruit and vegetable bruises, such as machine vision, multispectral/hyperspectral, X-ray/CT, thermal and fluorescence imaging. Structured illumination reflectance imaging (SIRI) is characterized by a non-contact, wide field of view and depth discrimination. The spatial frequency of structured light and the penetration depth of light in biological tissues can be regulated to overcome the limitation of conventional uniform illumination imaging that cannot obtain depth information. The SIRI can be combined the image processing and classification, in order to effectively detect the implicit defects of the fruits and vegetables. However, it is usually required to obtain three-phase shifted structured illumination images, which is limited to the imaging and detection speed. In this study, the SIRI technology was combined with the SPT fast demodulation and machine learning, and then rapidly detected the early implicit bruises in yellow peaches. The feasibility of hidden damage detection was verified using SIRI technology and two SPT demodulations. The detection efficiency of SIRI technology was improved for the online detection of implicit bruises in yellow peaches. Firstly, the SIRI system was used to collect the stripe-structured light reflection images at the spatial frequencies of 0.05, 0.10, 0.15, 0.20, 0.25, and 0.30 mm−1. Three-phase demodulation (TPD) was used to obtain the amplitude component (AC) and direct component (DC) images. The contrast index (CI) of the AC image was calculated to select the optimal spatial frequency. Three-phase stripe images were collected on all samples. The AC and DC images were obtained after capture. The ratio image (RT) of AC/DC was calculated to improve the uneven surface brightness of yellow peaches after SPT demodulation. According to the gray level co-occurrence matrix (GLCM) of DC, AC, and RT images, the local binary pattern (LBP) image texture features, and depth features extracted by ResNet-50, the inputs were taken as the GLCM-LBP, depth and mixed features of five images (DC, AC, RT, DC-AC, and DC-AC-RT). The healthy and bruised yellow peaches were classified using machine learning models, such as the support vector machine (SVM), K-Nearest Neighbor (KNN), XGBoost, and random forest (RF). The results showed that the highest average accuracies of the improved model were 92.6%, 95.0%, and 95.7%, respectively, for the detection of bruised peaches using GLCM-LBP, depth, and mixed features. The mixed feature model achieved the highest average accuracy. Therefore, the GMLC-LBP and depth features were combined to effectively improve the classification accuracy of the model. The XGBoost model with the DC-AC-RT image features also shared the highest accuracy of 97.6%. Furthermore, the overall classification accuracy of the SPT demodulated images was comparable to that of TPD ones, with the highest accuracy of 97.6%. The image acquisition time was also saved by one-third, with only any two-phase shifted images. In summary, the SIRI with the SPT and machine learning was achieved to detect the implicit bruises in peaches, with high accuracy and less detection time, thus improving the detection efficiency of SIRI technology. This finding can also provide a strong reference for the real-time detection of implicit bruises on fruits and vegetables.

     

/

返回文章
返回