Opening the black box of language acquisition

arXiv:2402.11681v1 Announce Type: new
Abstract: Recent advances in large language models using deep learning techniques have renewed interest on how languages can be learned from data. However, it is unclear whether or how these models represent grammatical information from the learned languages. In addition, the models must be pre-trained on large corpora before they can be used. In this work, we propose an alternative, more transparent and cognitively plausible architecture for learning language. Instead of using deep learning, our approach …

abstract acquisition advances arxiv black box box cs.cl cs.na data deep learning deep learning techniques information language language acquisition language models languages large language large language models math.na type