July 13, 2023, 8:54 p.m. | /u/nenkoru

Machine Learning www.reddit.com

**Motivation**:

I am running a proxmox instance for tinkering with devops stuff, k8s, ci and so on. And wanted to also have the ability to run ML workloads specifically any kind of ClosedAI open-sourced alternatives. Like Guanaco, WizardLM, Starcoder, Codegen. As well as having some kind of pre-prod environment for ML deployments.

**Environment**:

All the tests were run within a virtual machine(qemu) which is run using proxmox 7.4-3.

```
CPU: Intel Xeon 2696v4 2.2Ghz
Storage: Samsung SSD 870 EVO
OS:Linux …

benchmarks devops fp16 image instance k8s kind kvm machinelearning motivation nvidia nvidia rtx prod qemu rtx running starcoder transformers workloads

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Consultant Senior Power BI & Azure - CDI - H/F

@ Talan | Lyon, France