[P] bert.cpp, sentence embeddings in C++ with ggml

Project page: https://github.com/skeskinen/bert.cpp

Sentence embeddings in C++ with very light dependencies. Should run on embedded devices, etc.

Validated against sbert.net with benchmark results in the readme and benchmarking code (uses MTEB) in the repo.

Context:

A while back I tried to make llama.cpp produce cheap sentence embeddings in https://github.com/skeskinen/llama-lite project

But ultimately I decided that this is a dead end approach and implemented BERT in ggml instead.

BERT is nice because there are very small models that produce quality embeddings …

benchmark benchmarking bert code compute context cpp dependencies devices embedded embedded devices embeddings etc good light machinelearning .net nice performance quality quantization readme small