Learning Object Permanence from Videos via Latent Imaginations

arXiv:2310.10372v2 Announce Type: replace
Abstract: While human infants exhibit knowledge about object permanence from two months of age onwards, deep-learning approaches still largely fail to recognize objects' continued existence. We introduce a slot-based autoregressive deep learning system, the looped location and identity tracking model Loci-Looped, which learns to adaptively fuse latent imaginations with pixel-space observations into consistent latent object-specific what and where encodings over time. The novel loop empowers Loci-Looped to learn the physical concepts of object permanence, directional inertia, …

abstract age arxiv autoregressive cs.cv deep learning human identity knowledge location object objects tracking type via videos