Harmonizing Program Induction with Rate-Distortion Theory

arXiv:2405.05294v1 Announce Type: cross
Abstract: Many aspects of human learning have been proposed as a process of constructing mental programs: from acquiring symbolic number representations to intuitive theories about the world. In parallel, there is a long-tradition of using information processing to model human cognition through Rate Distortion Theory (RDT). Yet, it is still poorly understood how to apply RDT when mental representations take the form of programs. In this work, we adapt RDT by proposing a three way trade-off …

abstract arxiv cognition cs.cl cs.hc cs.lg cs.sc human information process processing rate stat.ml theory through tradition type world