EgoGen: An Egocentric Synthetic Data Generator

arXiv:2401.08739v2 Announce Type: replace
Abstract: Understanding the world in first-person view is fundamental in Augmented Reality (AR). This immersive perspective brings dramatic visual changes and unique challenges compared to third-person views. Synthetic data has empowered third-person-view vision models, but its application to embodied egocentric perception tasks remains largely unexplored. A critical challenge lies in simulating natural human movements and behaviors that effectively steer the embodied cameras to capture a faithful egocentric representation of the 3D world. To address this challenge, …

arxiv cs.ai cs.cv data generator synthetic synthetic data type