Web: https://syncedreview.com/2022/09/23/transformers-on-edge-devices-monash-us-energy-saving-attention-with-linear-complexity-reduces-compute-cost-by-73/

Sept. 23, 2022, 12:02 p.m. | Synced

Synced syncedreview.com

In the new paper EcoFormer: Energy-Saving Attention with Linear Complexity, a Monash University research team presents EcoFormer, an attention mechanism with linear complexity that replaces expensive multiply-accumulate operations with simple accumulations and achieves a 73 percent energy footprint reduction on ImageNet.


The post Transformers on Edge Devices? Monash U’s Energy-Saving Attention With Linear Complexity Reduces Compute Cost by 73% first appeared on Synced.

ai artificial intelligence attention complexity compute cost deep-neural-networks devices edge edge devices energy linear machine learning machine learning & data science ml research saving technology transformers

More from syncedreview.com / Synced

Research Scientists

@ ODU Research Foundation | Norfolk, Virginia

Embedded Systems Engineer (Robotics)

@ Neo Cybernetica | Bedford, New Hampshire

2023 Luis J. Alvarez and Admiral Grace M. Hopper Postdoc Fellowship in Computing Sciences

@ Lawrence Berkeley National Lab | San Francisco, CA

Senior Manager Data Scientist

@ NAV | Remote, US

Senior AI Research Scientist

@ Earth Species Project | Remote anywhere

Research Fellow- Center for Security and Emerging Technology (Multiple Opportunities)

@ University of California Davis | Washington, DC

Staff Fellow - Data Scientist

@ U.S. FDA/Center for Devices and Radiological Health | Silver Spring, Maryland

Staff Fellow - Senior Data Engineer

@ U.S. FDA/Center for Devices and Radiological Health | Silver Spring, Maryland

BI Data Analyst

@ EquipmentShare | Remote: Kansas City; Denver; Columbia MO

2023 Data Science Intern

@ Dialexa | Dallas, Texas, United States

Senior Data Engineer - Gdańsk (Remote)

@ Craft | Gdańsk, Pomeranian Voivodeship, Poland

Scientist / Sr. Scientist, Machine Learning & Computational Biology (Genomics)

@ 23andMe | Chicago, Illinois