Nov. 24, 2023, 5:44 p.m. | /u/Ok-Equipment9840

Computer Vision www.reddit.com

Have you ever wanted to perform inference with a Vision Transformer (ViT) in pure C++? No ? Well, now you can.

Using ggml, I've implemented an inference engine for the ViT family of models, which allows for inference at the edge.

No need for Torch, OpenCV or even ONNX, just pure C/C++.

Find it here : [https://github.com/staghado/vit.cpp](https://github.com/staghado/vit.cpp)

It is also part of the examples in the ggml library : [https://github.com/ggerganov/ggml/tree/master](https://github.com/ggerganov/ggml/tree/master)

computervision edge family inference onnx opencv the edge torch transformer vision vit

Senior Machine Learning Engineer

@ GPTZero | Toronto, Canada

Customer Data Analyst with Spanish

@ Michelin | Voluntari

HC Data Analyst - Senior

@ Leidos | 1662 Intelligence Community Campus - Bethesda MD

Healthcare Research & Data Analyst- Infectious, Niche, Rare Disease

@ Clarivate | Remote (121- Massachusetts)

Data Analyst (maternity leave cover)

@ Clarivate | R155-Belgrade

Sales Enablement Data Analyst (Remote)

@ CrowdStrike | USA TX Remote