AdaGlimpse: Active Visual Exploration with Arbitrary Glimpse Position and Scale

arXiv:2404.03482v1 Announce Type: new
Abstract: Active Visual Exploration (AVE) is a task that involves dynamically selecting observations (glimpses), which is critical to facilitate comprehension and navigation within an environment. While modern AVE methods have demonstrated impressive performance, they are constrained to fixed-scale glimpses from rigid grids. In contrast, existing mobile platforms equipped with optical zoom capabilities can capture glimpses of arbitrary positions and scales. To address this gap between software and hardware capabilities, we introduce AdaGlimpse. It uses Soft Actor-Critic, …

abstract arxiv contrast cs.cv environment exploration mobile modern navigation performance scale type visual