Function-Based Classification from 3D Data and Audio
IROS(2006)
摘要
We propose a novel scheme for fusion between two types of modalities to support function-based classification. While the first modality targets functional classification from sounds registered at impact, the second one aims classification of objects in 3D images. Using audio one can answer functional questions such as what is the material the analyzed objects are built of, if the objects are full or hollow, if they are heavy, and if they are rigidly linked to their supports. Audio based signatures are used to label parts of the object under analysis. Different parts of any object can be partitioned in generic multi-level hierarchical descriptions of functional components. Functionality, in the visual modality reasoning scheme, is derived from a large set of geometric attributes and relationships between object parts. These geometric properties represent labeling signatures to the primitive and functional parts of the analyzed classes. The fusion between both of the modalities relies on a shared cooperation among audio and visual signatures of the functional and primitive parts. The scheme does not require a-priori knowledge about any class. We tested the proposed scheme on a database of about one thousand different 3D objects. The results show high accuracy in classification
更多查看译文
关键词
generic multi-level hierarchical descriptions,support function-based classification,3d images,shared cooperation,visual modality reasoning scheme,image classification,computer vision,audio based signatures,audio signal processing,sensor fusion,support function,3d imaging,a priori knowledge
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络