A Novel Multispectral Fusion Defect Detection Framework With Coarse-to-Fine Multispectral Registration

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT(2024)

引用 0|浏览4
暂无评分
摘要
This article introduces a new imaging approach to nondestructive defect detection by combining visual testing (VT) and infrared thermal testing (IRT) in a multispectral vision sensing fusion system. The goal is to overcome the hampering challenges faced by traditional imaging methods, including complex environments, irregular samples, various defect types, and the need for efficient detection. The proposed system simultaneously detects and classifies surface and subsurface defects, addressing issues, such as false detection due to changes in surface emissivity in IRT and the inability to detect subsurface defects in VT. A novel multispectral fusion defect detection framework is proposed, employing coarse-to-fine multispectral registration for accurate alignment of infrared and visible images with different resolutions and fields of view. Domain adaptation unifies the feature domains of infrared and visible images by replacing the phase components in the frequency domain. The framework utilizes the complementary information from infrared and visible modalities to enhance detection accuracy and robustness. Experimental validation is conducted on different specimens, confirming the effectiveness of the proposed framework in detecting and generalizing to various shapes and materials. Overall, this article presents a novel imaging system that combines VT and IRT, offering improved detection capabilities in complex environments and diverse defect scenarios. The demo code is available at: https://github.com/ljcuestc/YoloMultispectralFusion-Coarse-to-fine-Registration.gi.
更多
查看译文
关键词
Cameras,Feature extraction,Visualization,Multimodal sensors,Fourier transforms,Detectors,YOLO,Coarse-to-fine image registration,defect detection,late fusion,multimodal,multispectral fusion
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要