all AI news
[R] Nvidia RTX 4090 ML benchmarks. Under QEMU/KVM. Image + Transformers. FP16/FP32.
July 13, 2023, 8:54 p.m. | /u/nenkoru
Machine Learning www.reddit.com
I am running a proxmox instance for tinkering with devops stuff, k8s, ci and so on. And wanted to also have the ability to run ML workloads specifically any kind of ClosedAI open-sourced alternatives. Like Guanaco, WizardLM, Starcoder, Codegen. As well as having some kind of pre-prod environment for ML deployments.
**Environment**:
All the tests were run within a virtual machine(qemu) which is run using proxmox 7.4-3.
```
CPU: Intel Xeon 2696v4 2.2Ghz
Storage: Samsung SSD 870 EVO
OS:Linux …
benchmarks devops fp16 image instance k8s kind kvm machinelearning motivation nvidia nvidia rtx prod qemu rtx running starcoder transformers workloads
More from www.reddit.com / Machine Learning
Jobs in AI, ML, Big Data
Founding AI Engineer, Agents
@ Occam AI | New York
AI Engineer Intern, Agents
@ Occam AI | US
AI Research Scientist
@ Vara | Berlin, Germany and Remote
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Consultant Senior Power BI & Azure - CDI - H/F
@ Talan | Lyon, France