Systematic construction of continuous-time neural networks for linear dynamical systems

arXiv:2403.16215v1 Announce Type: new
Abstract: Discovering a suitable neural network architecture for modeling complex dynamical systems poses a formidable challenge, often involving extensive trial and error and navigation through a high-dimensional hyper-parameter space. In this paper, we discuss a systematic approach to constructing neural architectures for modeling a subclass of dynamical systems, namely, Linear Time-Invariant (LTI) systems. We use a variant of continuous-time neural networks in which the output of each neuron evolves continuously as a solution of a first-order …

abstract architecture architectures arxiv challenge construction continuous cs.lg cs.na discuss error linear math.ds math.na modeling navigation network network architecture networks neural architectures neural network neural networks paper space systems through type