Dec. 6, 2023, 4:13 p.m. | /u/thefreemanever

Deep Learning www.reddit.com

Considering we have an LLM model sized 48GB, can we use 2x 24GB or 3x16GB GPUs (With no NVLink) to run the model? (I mean model inference by run.)

deeplearning gpus inference llm mean multiple nvlink small

Software Engineer for AI Training Data (School Specific)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Python)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Tier 2)

@ G2i Inc | Remote

Data Engineer

@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX

Lead Developer (AI)

@ Cere Network | San Francisco, US