Best of Both Worlds: Hybrid SNN-ANN Architecture for Event-based Optical Flow Estimation

arXiv:2306.02960v2 Announce Type: replace-cross
Abstract: In the field of robotics, event-based cameras are emerging as a promising low-power alternative to traditional frame-based cameras for capturing high-speed motion and high dynamic range scenes. This is due to their sparse and asynchronous event outputs. Spiking Neural Networks (SNNs) with their asynchronous event-driven compute, show great potential for extracting the spatio-temporal features from these event streams. In contrast, the standard Analog Neural Networks (ANNs) fail to process event data effectively. However, training SNNs …

abstract ann architecture arxiv asynchronous best of cameras cs.cv cs.lg dynamic event flow hybrid low networks neural networks optical optical flow power robotics snn speed spiking neural networks type