May 7, 2024, 5:07 p.m. | /u/PlagueCookie

Data Science www.reddit.com

Right now I'm choosing between RTX 4060 Ti 16GB and RTX 4070 Ghost 12GB (cost is exactly the same). What's better for machine learning and LLMs (and possibly physics simulations)? More VRAM sounds better as I would be able to host 7B LLM models without quantization, but with RTX 4070 I will have better performance (but on quantized models).

My additional reason for buying GPU is gaming, and that's where RTX 4070 shines.

I am also open to other options …

cost datascience ghost gpu llm llm models llms machine machine learning performance physics quantization rtx rtx 4060 rtx 4060 ti rtx 4070 simulations will

Software Engineer for AI Training Data (School Specific)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Python)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Tier 2)

@ G2i Inc | Remote

Data Engineer

@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX

Lead Developer (AI)

@ Cere Network | San Francisco, US