LFSimCC: Spatial fusion lightweight network for human pose estimation

Qian Zheng,Hualing Guo, Yunhua Yin,Bin Zheng, Hongxu Jiang

JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION(2024)

引用 0|浏览0
暂无评分
摘要
To address the limitations of existing 2D human pose estimation methods in terms of speed and lightweight, we propose a method called Lightweight Fusion SimCC (LFSimCC). LFSimCC incorporates two modules: LiteFNet, which enhances multi-scale spatial information fusion, and LKC-GAU, which improves the modeling capability of spatial information. Specifically, LiteFNet utilizes a combination of self -attention mechanism and novel spatial convolution to enable feature maps to capture richer multi-level global feature representations within the network. On the other hand, LKC-GAU enhances SimCC's ability to capture spatial relationships between joints by incorporating a large kernel of convolution and a self -attention mechanism. Furthermore, we design a keypoint information fusion loss (IFL) that enhances the model's sensitivity to information between keypoints in the human body. Experimental results demonstrate that our method is capable of extracting more decisive information and suppressing redundant feature representations, leading to high recognition accuracy and low inference latency.
更多
查看译文
关键词
Lightweight model SimCC Self attention mechanism Spatial information fusion
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要