all AI news
[P] Inference Vision Transformer (ViT) in plain C/C++ with ggml
Nov. 24, 2023, 6:11 p.m. | /u/Ok-Equipment9840
Machine Learning www.reddit.com
Using ggml, I've implemented an inference engine for the ViT family of models, which allows for inference at the edge.
No need for Torch or even ONNX, just pure C/C++.
You can access it here: [https://github.com/staghado/vit.cpp](https://github.com/staghado/vit.cpp)
It has been added to the ggml library on GitHub: [https://github.com/ggerganov/ggml](https://github.com/ggerganov/ggml)
edge family inference machinelearning onnx the edge torch transformer vision vit
More from www.reddit.com / Machine Learning
[R] KAN: Kolmogorov-Arnold Networks
19 hours ago |
www.reddit.com
[D] TensorDock — GPU Cloud Marketplace, H100s from $2.49/hr
1 day, 1 hour ago |
www.reddit.com
Jobs in AI, ML, Big Data
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Senior Machine Learning Engineer (MLOps)
@ Promaton | Remote, Europe
Business Data Scientist, gTech Ads
@ Google | Mexico City, CDMX, Mexico
Lead, Data Analytics Operations
@ Zocdoc | Pune, Maharashtra, India