all AI news
Attention-based Neural Cellular Automata. (arXiv:2211.01233v1 [cs.CV])
Nov. 3, 2022, 1:15 a.m. | Mattie Tesfaldet, Derek Nowrouzezahrai, Christopher Pal
cs.CV updates on arXiv.org arxiv.org
Recent extensions of Cellular Automata (CA) have incorporated key ideas from
modern deep learning, dramatically extending their capabilities and catalyzing
a new family of Neural Cellular Automata (NCA) techniques. Inspired by
Transformer-based architectures, our work presents a new class of
$\textit{attention-based}$ NCAs formed using a spatially
localized$\unicode{x2014}$yet globally organized$\unicode{x2014}$self-attention
scheme. We introduce an instance of this class named $\textit{Vision
Transformer Cellular Automata}$ (ViTCA). We present quantitative and
qualitative results on denoising autoencoding across six benchmark datasets,
comparing ViTCA to a …
More from arxiv.org / cs.CV updates on arXiv.org
Jobs in AI, ML, Big Data
Senior Data Engineer
@ Publicis Groupe | New York City, United States
Associate Principal Robotics Engineer - Research.
@ Dyson | United Kingdom - Hullavington Office
Duales Studium mit vertiefter Praxis: Bachelor of Science Künstliche Intelligenz und Data Science (m/w/d)
@ Gerresheimer | Wackersdorf, Germany
AI/ML Engineer (TS/SCI) {S}
@ ARKA Group, LP | Aurora, Colorado, United States
Data Integration Engineer
@ Find.co | Sliema
Data Engineer
@ Q2 | Bengaluru, India