On the Shape of Brainscores for Large Language Models (LLMs)

arXiv:2405.06725v1 Announce Type: cross
Abstract: With the rise of Large Language Models (LLMs), the novel metric "Brainscore" emerged as a means to evaluate the functional similarity between LLMs and human brain/neural systems. Our efforts were dedicated to mining the meaning of the novel score by constructing topological features derived from both human fMRI data involving 190 subjects, and 39 LLMs plus their untrained counterparts. Subsequently, we trained 36 Linear Regression Models and conducted thorough statistical analyses to discern reliable and …

abstract arxiv brain cs.ai cs.cl cs.lg features functional human language language models large language large language models llms meaning mining novel q-bio.nc systems type