Benchmarking Mobile Device Control Agents across Diverse Configurations

arXiv:2404.16660v1 Announce Type: cross
Abstract: Developing autonomous agents for mobile devices can significantly enhance user interactions by offering increased efficiency and accessibility. However, despite the growing interest in mobile device control agents, the absence of a commonly adopted benchmark makes it challenging to quantify scientific progress in this area. In this work, we introduce B-MoCA: a novel benchmark designed specifically for evaluating mobile device control agents. To create a realistic benchmark, we develop B-MoCA based on the Android operating system …

agents arxiv benchmarking control cs.ai cs.hc cs.lg diverse mobile mobile device type