Nov. 24, 2023, 6:11 p.m. | /u/Ok-Equipment9840

Machine Learning www.reddit.com

Have you ever wanted to perform inference with a Vision Transformer (ViT) in pure C++? No ? Well, now you can.

Using ggml, I've implemented an inference engine for the ViT family of models, which allows for inference at the edge.
No need for Torch or even ONNX, just pure C/C++.

You can access it here: [https://github.com/staghado/vit.cpp](https://github.com/staghado/vit.cpp)
It has been added to the ggml library on GitHub: [https://github.com/ggerganov/ggml](https://github.com/ggerganov/ggml)

edge family inference machinelearning onnx the edge torch transformer vision vit

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Business Data Scientist, gTech Ads

@ Google | Mexico City, CDMX, Mexico

Lead, Data Analytics Operations

@ Zocdoc | Pune, Maharashtra, India