Items or Relations -- what do Artificial Neural Networks learn?

arXiv:2404.12401v1 Announce Type: new
Abstract: What has an Artificial Neural Network (ANN) learned after being successfully trained to solve a task - the set of training items or the relations between them? This question is difficult to answer for modern applied ANNs because of their enormous size and complexity. Therefore, here we consider a low-dimensional network and a simple task, i.e., the network has to reproduce a set of training items identically. We construct the family of solutions analytically and …

abstract ann anns artificial artificial neural networks arxiv complexity cs.ai cs.dm cs.lg cs.ne learn modern network networks neural network neural networks question relations set solve them training type