Seeing the World through Your Eyes

arXiv:2306.09348v2 Announce Type: replace
Abstract: The reflective nature of the human eye is an underappreciated source of information about what the world around us looks like. By imaging the eyes of a moving person, we can collect multiple views of a scene outside the camera's direct line of sight through the reflections in the eyes. In this paper, we reconstruct a 3D scene beyond the camera's line of sight using portrait images containing eye reflections. This task is challenging due …

abstract arxiv cs.cv human human eye imaging information line moving multiple nature person reflections through type world