Web: https://www.reddit.com/r/MachineLearning/comments/xjculh/d_what_other_nonmainstream_memory_architectures/

Sept. 20, 2022, 4:07 p.m. | /u/jshkk

Machine Learning reddit.com

From my hobbyist perspective, it seems that, other than simple memory gates, LSTMs and Transformers have a sort of market dominance on conceptualizing "memory" into neural network architecture, and this leads me to wonder what other methods we might be sleeping on?

I'm particularly interested in this from the concept of RL agents where one *might* intuitively desire memory conceptualizations that approach patterns seen in humans. For instance, given that desire, LSTMs might seem "strange" in that their is no …

agents architectures machinelearning memory other

Research Scientists

@ ODU Research Foundation | Norfolk, Virginia

Embedded Systems Engineer (Robotics)

@ Neo Cybernetica | Bedford, New Hampshire

2023 Luis J. Alvarez and Admiral Grace M. Hopper Postdoc Fellowship in Computing Sciences

@ Lawrence Berkeley National Lab | San Francisco, CA

Senior Manager Data Scientist

@ NAV | Remote, US

Senior AI Research Scientist

@ Earth Species Project | Remote anywhere

Research Fellow- Center for Security and Emerging Technology (Multiple Opportunities)

@ University of California Davis | Washington, DC

Staff Fellow - Data Scientist

@ U.S. FDA/Center for Devices and Radiological Health | Silver Spring, Maryland

Staff Fellow - Senior Data Engineer

@ U.S. FDA/Center for Devices and Radiological Health | Silver Spring, Maryland

Machine Learning Engineers, Confluence Cloud

@ Atlassian | Mountain View, United States

Staff Data Engineer

@ Clio | Remote-US

Data Scientist (Analytics) - Singapore

@ Momos | Singapore, Central, Singapore

Machine Learning Scientist, Drug Discovery

@ Flagship Pioneering, Inc. | Cambridge, MA