SAKP: A Korean Sentiment Analysis Model via Knowledge Base and Prompt Tuning

Haiqiang Wen,Zhenguo Zhang

2023 IEEE 3rd International Conference on Computer Communication and Artificial Intelligence (CCAI)(2023)

引用 0|浏览0
暂无评分
摘要
With the help of pre-trained language models, tasks such as sentiment analysis and text classification have achieved good results. With the advent of prompt tuning, especially previous studies have shown that in the case of few data, the prompt tuning method has significant advantages over the general tuning method of additional classifiers. At present, there are relatively few studies on sentiment analysis of Korean Chinese texts.This paper proposes a low resource sentiment classification method based on pre-trained language models (PLMs) combined with prompt tuning. In this work, we chose to use the pre-trained language model KLUE and elaborated a Korean prompt template with an expanded knowledge base and filtering in the verbalizer section. We focus on collecting external knowledge and integrating it into the utterance to form a prompt tuning of knowledge to improve and stabilize the prompt tuning. Specifically, we use the K-means clustering algorithm to construct the label wordspace of the external knowledge base (kb) extended language, and use PLM itself to refine the extended labeled wordspace before using the extended labeled wordspace for prediction. A large number of experiments on the few-shot emotion classification task prove the effectiveness of knowledge prompt tuning.
更多
查看译文
关键词
Korean sentiment classification,knowledge base,pre-trained language model,prompt,Korean natural language processing
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要