What Makes a Language Easy to Deep-Learn?

arXiv:2302.12239v3 Announce Type: replace
Abstract: Deep neural networks drive the success of natural language processing. A fundamental property of language is its compositional structure, allowing humans to systematically produce forms for new meanings. For humans, languages with more compositional and transparent structures are typically easier to learn than those with opaque and irregular structures. However, this learnability advantage has not yet been shown for deep neural networks, limiting their use as models for human language learning. Here, we directly test …

abstract arxiv cs.cl drive easy forms humans language language processing languages learn natural natural language natural language processing networks neural networks processing property success transparent type