高级检索+

协同知识路由与智能体反思机制的猪病智能问答方法

Swine disease intelligent question answering method integrating knowledge routing and agent reflection mechanism

  • 摘要: 通用大语言模型应用于猪病问答任务时普遍存在领域知识储备不足、专业推理能力薄弱等问题,同时现有方案缺少答案优化机制,引发事实偏差与知识幻觉,限制问答准确性。针对上述问题,该研究提出一种协同知识路由与智能体反思机制的猪病智能问答方法。首先,构建包含了163类的猪病、文本总量近1000万字的领域语料库,并依据致病机理划分为5个子语料库,实现领域知识结构化组织;其次,提出基于大模型加权投票的协同知识路由策略,实现子语料库精准调度,有效压缩知识检索空间;最后,构建“初步回答者-兽医-猪病专家”多角色协同智能体体系生成候选应答文本,并进一步引入分层反思机制,从知识覆盖性、用户意图匹配度与多智能体协作效率3方面开展答案质量诊断及优化。试验结果表明,在自建猪病问答评测数据集上,该方法的双语评估替补指标、面向摘要评估的召回型替补指标及基于BERT的语义匹配评分召回率相较于基线模型均有提升,分别为51.93%、30.50%、0.7409。此外,在选择题回答任务中的结果显示,该方法在简单题、中等难度题、高等难度题上的回答准确率分别达到90%、80%、70%。消融试验结果显示,知识路由策略、多智能体协同策略、智能体反思机制均能够提升问答准确率。该方法能够有效抑制事实幻觉,增强答案专业性与完备性,为农业垂直领域专业问答系统搭建提供技术参考。

     

    Abstract: General large language models (LLMs) have suffered from insufficient domain knowledge and professional expertise in specialized swine disease question answering (QA) tasks. It is lacking on the effective answer evaluation and optimization to reduce factual hallucinations, severely undermining the logical consistency and diagnostic accuracy of LLMs in smart agriculture. In this study, an intelligent QA framework for swine disease was proposed to integrate with knowledge routing and agent reflection mechanisms, termed Reflective-QA. The dataset was constructed for swine disease question answering. (1) A high-quality corpus of swine disease was constructed with 10 million characters covering 163 swine diseases, according to professional veterinary books, authoritative monographs, and clinical case records. Five sub-corpora were divided into infectious, parasitic, toxic, nutritional-metabolic, and common diseases, according to pathogenic characteristics. Background knowledge of the QA model was also strengthened to enhance the professionalism of answers. (2) Knowledge routing with multi-agent voting was designed to map user queries to targeted disease sub-corpora. Noise interference and retrieval explosion were effectively reduced in the process of QA. The retrieval space was realized for the purity of vectorized retrieval information. (3) A multi-agent QA mechanism was designed to collaborate with different interaction partners, including a preliminary diagnostician, veterinary expert, and swine specialist. Structured and professionally candidate answers were generated after collaboration. Furthermore, an agent reflection mechanism was established to achieve closed-loop self-correction of answer quality. Specifically, three evaluation indicators were adopted to assess answer quality, including knowledge coverage, intent understanding deviation, and role collaboration efficiency. Two optimization strategies, namely semantic rewriting and task decomposition, were deployed to refine the generated answers. Experimental results demonstrated that the framework outperformed baseline models in terms of bilingual evaluation understudy (4-gram) (BLEU-4), recall-oriented understudy for evaluation-longest common subsequence (ROUGE-L), and BERT-based score recall (R), with the scores of 51.93%, 30.50%, and 0.7409, respectively. BLEU-4, ROUGE-L, and R scores increased significantly by 8.43 percentage points, 1.19 percentage points, and 0.0359, respectively, compared with the baseline model, i.e., DeepSeek-R1. The improved model outperformed the currently popular general LLMs in terms of question answering performance in the field of swine diseases. In addition, the multiple-choice QA task revealed that substantial accuracy was improved for easy, medium, and hard questions, with the accuracy values of 90%, 80%, and 70%, respectively. An ablation experiment verified that the knowledge routing, multi-agent collaborative strategy, and agent reflection mechanism contributed to higher question answering accuracy. Specifically, the average accuracy decreased from 80% to 67% in multiple-choice question answering after the knowledge routing module was removed. In summary, the ambiguity and hallucination were resolved in knowledge retrieval of swine disease. This finding can provide a modular and reliable technical scheme for agricultural QA and professional LLM agent deployment. The promising generalization potential can be expected for crop protection and aquaculture in modern agriculture.

     

/

返回文章
返回