May 6, 2023, 11:14 a.m. | /u/davew111

Deep Learning www.reddit.com

I'm currently running LLM models on a desktop PC with a 3090. It's quite power hungry. I am thinking about building a new rig that is energy efficient and can be left on all the time. Nvidia A2s can be found quite cheap on eBay. If I had two that would give me 32GB of vram, and each card pulls only 60w.

My question is what kind of performance can I expect, how would two A2s performance compared to a …

building deeplearning ebay energy energy efficient llm nvidia power running thinking

Data Engineer

@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX

Lead Developer (AI)

@ Cere Network | San Francisco, US

Research Engineer

@ Allora Labs | Remote

Ecosystem Manager

@ Allora Labs | Remote

Founding AI Engineer, Agents

@ Occam AI | New York