A Time-Memory-based CMOS Vision Sensor with In-Pixel Temporal Derivative Computing for Multi-Mode Image Processing

This paper presents in-pixel and near-pixel processing circuit techniques for multi-mode processing CMOS vision sensor. The new design includes a checkerboard patch-based pixel circuit and column-shared frame difference processing circuits that detect a patch-level temporal change and generate 1b event signal. In-pixel time memory circuit is proposed to process a temporal derivative of the event in both area and power efficient way. The 324x252 vision sensor is implemented in 0.18 mu m CMOS process and consumes 4.79 mu W @12.5fps showing FoM of 42.2pJ/pix center dot frame in the patch mode operation for frame difference-based motion detection and temporal derivative generation.