Integrating large language models and active inference to understand eye movements in reading and dyslexia

arXiv:2308.04941v2 Announce Type: replace-cross
Abstract: We present a novel computational model employing hierarchical active inference to simulate reading and eye movements. The model characterizes linguistic processing as inference over a hierarchical generative model, facilitating predictions and inferences at various levels of granularity, from syllables to sentences.
Our approach combines the strengths of large language models for realistic textual predictions and active inference for guiding eye movements to informative textual information, enabling the testing of predictions. The model exhibits proficiency in …

abstract arxiv computational cs.cl generative hierarchical inference inferences language language models large language large language models movements novel predictions processing q-bio.nc reading type