VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robots

arXiv:2404.04066v1 Announce Type: cross
Abstract: Physically assistive robots present an opportunity to significantly increase the well-being and independence of individuals with motor impairments or other forms of disability who are unable to complete activities of daily living. Speech interfaces, especially ones that utilize Large Language Models (LLMs), can enable individuals to effectively and naturally communicate high-level commands and nuanced preferences to robots. Frameworks for integrating LLMs as interfaces to robots for high level task planning and code generation have been …

arxiv cs.cl cs.hc cs.ro interfaces llms robots speech type