Co-designing a Sub-millisecond Latency Event-based Eye Tracking System with Submanifold Sparse CNN

arXiv:2404.14279v1 Announce Type: new
Abstract: Eye-tracking technology is integral to numerous consumer electronics applications, particularly in the realm of virtual and augmented reality (VR/AR). These applications demand solutions that excel in three crucial aspects: low-latency, low-power consumption, and precision. Yet, achieving optimal performance across all these fronts presents a formidable challenge, necessitating a balance between sophisticated algorithms and efficient backend hardware implementations. In this study, we tackle this challenge through a synergistic software/hardware co-design of the system with an event …

arxiv cnn cs.ar cs.cv designing event latency tracking type