Retina : Low-Power Eye Tracking with Event Camera and Spiking Hardware

arXiv:2312.00425v2 Announce Type: replace
Abstract: This paper introduces a neuromorphic methodology for eye tracking, harnessing pure event data captured by a Dynamic Vision Sensor (DVS) camera. The framework integrates a directly trained Spiking Neuron Network (SNN) regression model and leverages a state-of-the-art low power edge neuromorphic processor - Speck, collectively aiming to advance the precision and efficiency of eye-tracking systems. First, we introduce a representative event-based eye-tracking dataset, "Ini-30", which was collected with two glass-mounted DVS cameras from thirty volunteers. …

abstract art arxiv cs.cv cs.ne data dynamic edge event framework hardware low low power methodology network neuromorphic neuron paper power processor regression sensor snn state tracking type vision