Small Character Models Match Large Word Models for Autocomplete Under Memory Constraints. (arXiv:2210.03251v1 [cs.CL])

Autocomplete is a task where the user inputs a piece of text, termed prompt,
which is conditioned by the model to generate semantically coherent
continuation. Existing works for this task have primarily focused on datasets
(e.g., email, chat) with high frequency user prompt patterns (or focused
prompts) where word-based language models have been quite effective. In this
work, we study the more challenging setting consisting of low frequency user
prompt patterns (or broad prompts, e.g., prompt about 93rd academy awards) …

arxiv autocomplete constraints memory small