hobby attempt at creating a local desktop semantic search

Did anyone tried running the latest nlp models on desktop with non gpu hardware? any learning experiences?

I tried creating one last week with rust+faiss+bert. Seems to be running fine on my 4 year old macbook. It finds it difficult to parse large text files though eating up cache and swapping disk in and out hot, excluded those large files for now.

[https://github.com/tsureshkumar/semdesk](https://github.com/tsureshkumar/semdesk)

bert gpu hardware hobby languagetechnology macbook nlp nlp models running rust search semantic text