高级检索+

基于LLM数据标注与MB-BSG模型的小麦病虫害命名实体识别

Recognizing named entities of wheat pests and diseases using LLM data annotation and MB-BSG model

  • 摘要: 小麦病虫害命名实体识别是农业信息挖掘、构建农业知识图谱的关键步骤。针对小麦病虫害领域缺乏公开高质量标注语料库,非结构化文本中普遍存在的实体嵌套、边界模糊导致传统方法识别精度受限等问题,该研究构建了基于大语言模型(large language model, LLM)协同标注的小麦病虫害语料库,提出了一种基于MB-BSG(MacBERT-BiGRU- multi-head self-attention-global pointer)的命名实体识别方法。方法首先利用MacBERT(masked language model as correction bert)预训练模型获取上下文相关的深层语义表征,提升对农业专业术语的理解能力;其次,通过双向门控循环单元(bidirectional gated recurrent unit, BiGRU)提取文本的局部序列特征;然后,引入多头自注意力机制(multi-head self-attention, MHA)捕获文本的全局依赖关系与长距离特征,实现局部与全局语义信息的深度融合;最后,采用全局指针网络(global pointer, GP)对标签序列进行解码,有效解决嵌套实体的边界识别难题。试验结果表明,基于LLM协同数据标注构建的语料库训练的MacBERT模型精确率、召回率和F1值分别达到88.14%、91.19%和89.52%,有效提高标注质量并为模型训练提供可靠的数据支撑;MB-BSG模型在该数据集上的精确率、召回率和F1值分别达到91.57%、90.08%和90.82%,表现出较好的综合实体识别性能;模型单句推理耗时仅69.01ms,具有较低的显存占用和较高的推理效率。该研究所提方法为农业领域低资源场景下的知识抽取提供了技术范式,有助于提升小麦病虫害知识图谱构建效率。

     

    Abstract: Named entity recognition (NER) of wheat pests and diseases is essential for extracting structured information from agricultural texts and constructing knowledge graphs, thereby supporting intelligent pest management and reducing economic losses in wheat production. With the rapid accumulation of unstructured agricultural texts, field investigation reports, and pest management guidelines, accurate and efficient NER has become increasingly important. However, two major challenges remain. First, publicly available, high-quality annotated corpora for wheat pests and diseases are scarce, while manual annotation requires substantial domain expertise and labor, limiting the availability of training data. Second, conventional NER methods often struggle to identify nested entities and determine entity boundaries in complex agricultural texts, which can compromise recognition accuracy and generalization. To address these challenges, this study constructed a high-quality annotated corpus of wheat pests and diseases and developed a collaborative annotation framework integrating large language models (LLMs) with manual calibration. By combining the semantic understanding capabilities of LLMs with human verification, the framework aims to improve annotation quality and alleviate data scarcity in low-resource agricultural settings. Furthermore, an NER model, termed MB-BSG (MacBERT-BiGRU-multi-head self-attention-global pointer), was developed. Specifically, MacBERT was used as the pre-trained language model to obtain contextualized semantic representations of Chinese agricultural texts. A bidirectional gated recurrent unit (BiGRU) was integrated with a multi-head self-attention mechanism to capture sequential dependencies and local contextual features while modeling long-range semantic interactions. A Global Pointer network was then employed to identify entity spans, enabling the recognition of nested entities and more precise entity boundary localization. Experimental results showed that the LLM-assisted collaborative annotation framework achieved an average F1 score of 89.52%, exceeding manual annotation and weak supervision by 1.20 and 1.77 percentage points, respectively, while effectively reducing annotation noise. On the constructed corpus, MB-BSG achieved precision, recall, and F1 scores of 91.57%, 90.08%, and 90.82%, respectively, outperforming the conventional and baseline models evaluated in this study. Efficiency analysis further showed that MB-BSG contained 108.17 million parameters and required 22.80 GFLOPs, with a single-sentence inference time of 69.01 ms and peak memory consumption of 451.83 MB. These results indicate that the model achieves a favorable balance between recognition performance and computational cost, suggesting its potential for deployment in resource-constrained environments. Overall, this study provides a high-quality annotated corpus and an efficient NER approach for wheat pest and disease knowledge extraction, offering methodological support for knowledge graph construction and precision pest management in intelligent agriculture.

     

/

返回文章
返回