Open source embedding models are winning

gte-base is faster, cheaper, and more accurate than open ai ada. Ran some experiments on wikipedia articles to evaluate factual consistency --

🔍 gte-base is better at recognizing the subject and retrieving finer details📷 Hallucinating search terms yields better performance

We just embedded all public corporate docs (sec filings, press releases, etc) using gte-base and the performance is insane (check these [examples](https://twitter.com/vishalrohra_/status/1697318320767381588))


Will be open sourcing a bunch of these experiments soon on our [github](https://github.com/kaydotai/kay)

ada articles embedding embedding models faster machinelearningnews open ai open source performance search terms wikipedia