Unsupervised scene detection and commentator building using multi-modal chains
Multimedia Tools and Applications(2012)
摘要
This paper presents a novel unsupervised method for identifying the semantic structure in long semi-structured video streams. We identify chains , i.e., local clusters of repeated features from both the video stream and audio transcripts. Each chain serves as an indicator that the temporal interval it demarcates is part of the same semantic event. By layering all the chains over each other, dense regions emerge from the overlapping chains, from which we can identify the semantic structure of the video. We present two clustering strategies that accomplish this task, and compare them against a baseline Scene Transition Graph approach. We then develop a commentator that provides a semantic labeling of the resultant video segmentation.
更多查看译文
关键词
Semantic event detection,Feature extraction,Multi-modal scene segmentation,Video summarization
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要