1673-159X

CN 51-1686/N

方面级情感分析的知识增强提示模板构建

Construction of Knowledge-Enhancing Prompt Templates for Aspect-Level Sentiment Analysis

  • 摘要: 当前,基于神经网络的方面级情感分析模型主要是将方面术语提取和方面极性分类2个子任务进行离散训练,或对预训练的语言模型进行微调,忽略了2个子任务之间的联系,很难充分利用预训练过程中学到的语言模型知识。为此,文章构建外部知识增强提示模板(KPT),将预训练语言模型的词汇表构建为一棵K维树,使用K近邻搜索算法在K维树上搜索最优提示词,进而构建最佳提示模板。在此过程中:将外部知识融入词汇以丰富其语义信息;使用方面术语提取任务的特征,进一步提高方面极性分类任务的性能;使用多头注意力机制实现两任务交互,并将它们进行整合,以提高外部知识增强提示模板判断情感极性的准确性。在Lap14、Rest14和Twitter 3个公开数据集上的实验结果表明,该方法与现有的ASGCN、BiGCN、CDT等模型相比,具有更好性能。

     

    Abstract: Currently, aspect-level sentiment analysis models based on neural networks primarily involve discrete training of two subtasks: aspect term extraction and aspect polarity classification, or fine-tuning of pre-trained language models. These approaches neglect the interplay between the two subtasks, making it challenging to fully leverage the language model knowledge acquired during pre-training. This paper proposes an external knowledge-enhanced prompt template approach(KPT), which constructs the vocabulary of the pre-trained language model into a K-dimensional tree. The K-nearest neighbor search algorithm is employed to search for optimal prompt words on this K-dimensional tree, thereby constructing an optimal prompt template. In this process, external knowledge is integrated into the vocabulary to enrich its semantic information. Features from the aspect term extraction task are utilized to further enhance the performance of the aspect polarity classification task. A multi-head attention mechanism is employed to enable interaction between the two tasks and integrate them, thereby improving the accuracy of sentiment polarity judgment by the external knowledge-enhanced prompt template. Experimental results on three public datasets, namely Lap14, Rest14, and Twitter, demonstrate that the proposed method outperforms existing models such as ASGCN, BiGCN, CDT, and others.

     

/

返回文章
返回