X-maps: Direct Depth Lookup for Event-based Structured Light Systems
CVPR Workshops(2024)
摘要
We present a new approach to direct depth estimation for Spatial Augmented
Reality (SAR) applications using event cameras. These dynamic vision sensors
are a great fit to be paired with laser projectors for depth estimation in a
structured light approach. Our key contributions involve a conversion of the
projector time map into a rectified X-map, capturing x-axis correspondences for
incoming events and enabling direct disparity lookup without any additional
search. Compared to previous implementations, this significantly simplifies
depth estimation, making it more efficient, while the accuracy is similar to
the time map-based process. Moreover, we compensate non-linear temporal
behavior of cheap laser projectors by a simple time map calibration, resulting
in improved performance and increased depth estimation accuracy. Since depth
estimation is executed by two lookups only, it can be executed almost instantly
(less than 3 ms per frame with a Python implementation) for incoming events.
This allows for real-time interactivity and responsiveness, which makes our
approach especially suitable for SAR experiences where low latency, high frame
rates and direct feedback are crucial. We present valuable insights gained into
data transformed into X-maps and evaluate our depth from disparity estimation
against the state of the art time map-based results. Additional results and
code are available on our project page: https://fraunhoferhhi.github.io/X-maps/
更多查看译文
关键词
art time map-based results,cheap laser projectors,direct depth estimation,direct depth lookup,direct feedback,disparity estimation,dynamic vision sensors,enabling direct disparity lookup,event cameras,event-based structured light systems,incoming events,increased depth estimation accuracy,projector time map,real-time interactivity,rectified X-map,simple time map calibration,Spatial Augmented Reality applications,structured light approach,time 3.0 ms,time map-based process,X-maps project page
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要