Google Text Embedding Model Gecko Distills Large Language Models for Improved Performance

Gecko is a text embedding model that Google created by distilling knowledge from large language models into a general-purpose model. Gecko is trained using a novel approach on a variety of tasks including document retrieval, semantic similarity, and classification, and aims to be as general-purpose as it goes as well as highly performant.

ai classification document embedding gecko general google knowledge language language models large language large language models ml & data engineering natural language processing novel performance retrieval semantic tasks text text embedding