Unsupervised Style Control for Image Captioning.

International Conference of Pioneering Computer Scientists, Engineers and Educators (ICPCSEE)(2022)

引用 0|浏览2
暂无评分
摘要
We propose a novel unsupervised image captioning method. Image captioning involves two fields of deep learning, natural language processing and computer vision. The excessive pursuit of model evaluation results makes the caption style generated by the model too monotonous, which is difficult to meet people's demands for vivid and stylized image captions. Therefore, we propose an image captioning model that combines text style transfer and image emotion recognition methods, with which the model can better understand images and generate controllable stylized captions. The proposed method can automatically judge the emotion contained in the image through the image emotion recognition module, better understand the image content, and control the description through the text style transfer method, thereby generating captions that meet people's expectations. To our knowledge, this is the first work to use both image emotion recognition and text style control.
更多
查看译文
关键词
Image caption,Image sentiment recognization,Text style transfer
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要