all AI news
The I/O Complexity of Attention, or How Optimal is Flash Attention?
Feb. 13, 2024, 5:42 a.m. | Barna Saha Christopher Ye
cs.LG updates on arXiv.org arxiv.org
algorithm architecture attention cache chip complexity cs.cc cs.ds cs.it cs.lg flash gpu math.it memory popular scaling self-attention transformer transformer architecture transformers true
More from arxiv.org / cs.LG updates on arXiv.org
Jobs in AI, ML, Big Data
Artificial Intelligence – Bioinformatic Expert
@ University of Texas Medical Branch | Galveston, TX
Lead Developer (AI)
@ Cere Network | San Francisco, US
Research Engineer
@ Allora Labs | Remote
Ecosystem Manager
@ Allora Labs | Remote
Founding AI Engineer, Agents
@ Occam AI | New York
AI Engineer Intern, Agents
@ Occam AI | US