Automatic Macro Mining from Interaction Traces at Scale

arXiv:2310.07023v2 Announce Type: replace-cross
Abstract: Macros are building block tasks of our everyday smartphone activity (e.g., "login", or "booking a flight"). Effectively extracting macros is important for understanding mobile interaction and enabling task automation. These macros are however difficult to extract at scale as they can be comprised of multiple steps yet hidden within programmatic components of mobile apps. In this paper, we introduce a novel approach based on Large Language Models (LLMs) to automatically extract semantically meaningful macros from …

abstract arxiv automation block building cs.cl cs.hc cs.lg enabling extract however login macro macros mining mobile multiple scale smartphone task automation tasks traces type understanding