高级检索+

融合动态提示与三维信息的葡萄电商评论细粒度情感分析

Aspect-based sentiment analysis of grape e-commerce reviews with dynamic prompting and tri-dimensional information fusion

  • 摘要: 细粒度情感分析的任务是从评论句子中提取方面词、观点词以及方面词的情感极性。现有的模型仅限于识别句子中明确提到的方面词的情感极性。然而,当方面词未明确提及但相关观点词存在时,现有模型无法识别方面词的情感极性;同时,观点词会蕴含方面词的特征信息,且葡萄电商评论中也存在着领域专有的特征,这些特征并未被现有模型充分利用。为了克服上述限制,该研究提出了一个包含了预训练语言模型BERT(bidirectional encoder representations from transformers)、双层编码层(dual-encoding-layer)、双通道注意力机制(dual-channel-attention)、动态提示层以及CRF(conditional random field)层的细粒度情感分析模型。预训练语言模型BERT作为向量编码嵌入层,而双层编码层由一维卷积层和循环卷积神经网络(recurrent convolutional neural network,RCNN)层组成,负责序列编码。双通道注意力机制结合了标准注意力和线性注意力,用于融合上下文特征向量并进行情感三维信息的递进式传递,从而关联方面词、观点词及其情感极性之间的关系。动态提示层则通过为不同的评论语句构建不同的动态提示模板从而辅助模型理解领域专有的特征。通过在包含18984条葡萄电商评论数据集上进行试验验证,该研究提出的DMP-BTL-DA(dynamic prompt-based BERT+LSTM-dualchannel attention)模型在中文葡萄电商评论的细粒度情感分析任务中取得了较优的结果,其在方面词提取、观点词提取和情感极性分类上的精确率分别为86.3%、86.4%和83.4%,召回率分别为92.5%、90.1%和89.4%,F1值分别为89.3%、87.3%以及86.3%。此外,研究发现当评论中提及口感、价格、性价比、运输和包装等属性时,这些方面更倾向于与正面情感词共现;而当讨论品质或重量问题时,则更多与负面情感词相关联。综上所述,该研究构建的葡萄电商评论情感分析模型,通过挖掘消费者对各属性的情感倾向,可为农产品电商领域的理论研究和实践优化提供数据支撑。

     

    Abstract: aspect-based sentiment analysis (ABSA) is one of the most critical tasks in natural language processing (NLP). The sentiment information can be extracted from the text in order to identify the aspect terms, opinion terms, and their sentiment polarities. Conventional ABSA models can focus mainly on the scenarios where the aspect terms are explicitly mentioned in review sentences. However, the significant limitations are confined to the implicit aspect terms, even though the relevant opinion terms can convey the sentiment toward unstated aspects. Furthermore, the opinion terms can often contain implicit feature information about the aspects. There are also domain-specific linguistic patterns in the specialized contexts, such as the grape e-commerce reviews. Some additional challenges have posed on the model's comprehension of the sentences. In this study, an advanced ABSA model, termed DMP-BTL-DA, was proposed to integrate a pre-trained language model (BERT) with a Dual-Encoding Layer, a Dual-Channel Attention mechanism, a Dynamic Prompt Layer, and a Conditional Random Field (CRF) layer. The architecture was specifically designed to capture the implicit aspect-opinion relationships and domain-specific sentiment expressions in the grape e-commerce reviews. The BERT was selected as the embedding layer to generate the contextualized word representations, particularly for robust semantic encoding. The Dual-Encoding Layer, composed of a 1D convolutional neural network (CNN) and a Recurrent Convolutional Neural Network (RCNN), was used to extract both local and global sequential features. The Dual-Channel Attention mechanism was combined with the standard attention and linear attention in order to fuse the contextual features, thus facilitating the progressive transmission of the three-dimensional sentiment information (aspect, opinion, and polarity). The mechanism was explicitly simulated to show the relationships among implicit aspect terms, opinion terms, and their sentiment polarities. To further enhance the domain adaptability, the Dynamic Prompt Layer was constructed into the customized prompt templates for the different review sentences, thereby incorporating the domain-specific knowledge (e.g., grape-related attributes like taste, quality, price, and packaging). The implicit aspects and their sentiments were recognized to improve the performance in the e-commerce grape review domain. Finally, the CRF layer was used to optimize the sequence labeling for the aspect and opinion term extraction, in order to realize the coherent and contextually appropriate predictions. A dataset of 18 984 Chinese grape e-commerce reviews was annotated with the aspect terms, opinion terms, and sentiment polarities. Experimental results demonstrate that the DMP-BTL-DA model achieved optimal performance, particularly in the ABSA task of Chinese grape e-commerce reviews. Precision values of 86.3%, 86.4%, and 83.4% were found for the aspect term extraction, opinion term extraction, and sentiment polarity classification, respectively; Recall values of 92.5%, 90.1%, and 89.4%; and F1 scores of 89.3%, 87.3%, and 86.3%. Additionally, several key insights into consumer sentiment trends were observed in the grape e-commerce. Taste and quality were the most frequently mentioned aspects, thereby reflecting the consumer priorities. Positive sentiments were strongly associated with the mentions of the taste, price, cost-performance, transportation, and packaging, thus fully meeting these attributes. Negative sentiments predominantly arose about quality or weight issues, indicating enhanced customer satisfaction. Some insights were gained for the e-commerce platforms and grape sellers, in order to optimize the product descriptions, logistics, and quality control. Moreover, the implicit aspects and domain-specific expressions greatly contributed to the broader field of agricultural product e-commerce, particularly to the data-driven decision-making on the market strategy refinement. In summary, the ABSA was realized on the implicit aspect recognition and domain adaptation in the e-commerce reviews. The DMP-BTL-DA model improved the sentiment accuracy for the consumer sentiment patterns. The finding can offer valuable data support for the theoretical research and practical applications in agricultural e-commerce.

     

/

返回文章
返回