Google API brings LLMs to Android and iOS devices

Google has released an experimental API that allows large language models to run fully on-device across Android, iOS, and web platforms.

Introduced March 7, the MediaPipe LLM Inference API was designed to streamline on-device LLM integration for web developers, and supports web, Android, and iOS platforms. The API provides initial support for four LLMs: Gemma, Phi 2, Falcon, and Stable LM.

To read this article in full, please click here

android api artificial intelligence developers devices experimental generative-ai google inference integration ios language language models large language large language models llm llms mediapipe mobile development platforms software development support web web development