Nov. 24, 2023, 5:44 p.m. | /u/Ok-Equipment9840

Computer Vision www.reddit.com

Have you ever wanted to perform inference with a Vision Transformer (ViT) in pure C++? No ? Well, now you can.

Using ggml, I've implemented an inference engine for the ViT family of models, which allows for inference at the edge.

No need for Torch, OpenCV or even ONNX, just pure C/C++.

Find it here : [https://github.com/staghado/vit.cpp](https://github.com/staghado/vit.cpp)

It is also part of the examples in the ggml library : [https://github.com/ggerganov/ggml/tree/master](https://github.com/ggerganov/ggml/tree/master)

computervision edge family inference onnx opencv the edge torch transformer vision vit

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Sr. VBI Developer II

@ Atos | Texas, US, 75093

Wealth Management - Data Analytics Intern/Co-op Fall 2024

@ Scotiabank | Toronto, ON, CA