March 13, 2024, 3:59 p.m. | /u/Singularian2501

Machine Learning www.reddit.com

Blog: [https://deepmind.google/discover/blog/sima-generalist-ai-agent-for-3d-virtual-environments/](https://deepmind.google/discover/blog/sima-generalist-ai-agent-for-3d-virtual-environments/)

Paper: [https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/sima-generalist-ai-agent-for-3d-virtual-environments/Scaling%20Instructable%20Agents%20Across%20Many%20Simulated%20Worlds.pdf](https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/sima-generalist-ai-agent-for-3d-virtual-environments/Scaling%20Instructable%20Agents%20Across%20Many%20Simulated%20Worlds.pdf)

Abstract:

>Building **embodied AI systems that can follow arbitrary language instructions in any 3D environment is a key challenge for creating general AI.** Accomplishing this goal requires learning to ground language in perception and embodied actions, in order to accomplish complex tasks. The **Scalable, Instructable, Multiworld Agent (SIMA) project** tackles this by training agents to follow free-form instructions across a diverse range of virtual 3D environments, including curated research environments as well as **open-ended, commercial video …

abstract agent agents ai systems building challenge embodied embodied ai environment form free general general ai key language machinelearning perception project scalable sima systems tasks training

Senior Data Engineer

@ Displate | Warsaw

Solution Architect

@ Philips | Bothell - B2 - Bothell 22050

Senior Product Development Engineer - Datacenter Products

@ NVIDIA | US, CA, Santa Clara

Systems Engineer - 2nd Shift (Onsite)

@ RTX | PW715: Asheville Site W Asheville Greenfield Site TBD , Asheville, NC, 28803 USA

System Test Engineers (HW & SW)

@ Novanta | Barcelona, Spain

Senior Solutions Architect, Energy

@ NVIDIA | US, TX, Remote