all AI news logo
all AI news - Your AI news aggregator
Log in Sign up
all AI news

[D] can I fintune Mistral 7B model on 8 * A100 40GB ?

Add to bookmarks
Dec. 25, 2023, 10:42 a.m. | /u/MustafaAlahmid

Machine Learning www.reddit.com

I want to finetune Mistral 7B and I have access to 8 A100 40GB and I'm doing a full finetune not Lora
Is this possible? Or I need A100 80GB at least?

How to calculate minimum requirements?

a100 least lora machinelearning mistral mistral 7b requirements

Visit resource

More from www.reddit.com / Machine Learning

[R] What is the state-of-art of model parallelism ? 7 hours ago | www.reddit.com
architecture art easy frameworks +4
[P] Simplified PyTorch Implementation of AlphaFold 3 9 hours ago | www.reddit.com
alphafold alphafold 3 implementation machinelearning +2
[D] What role do you think machine learning will play in fields like computational biology … 12 hours ago | www.reddit.com
bioinformatics biology computation computational +10
[D] Are LLM observability tools really used in startups and companies? 12 hours ago | www.reddit.com
adversarial adversarial attacks attacks combination +12
[D] Does DSPy actually change the LM weights? 15 hours ago | www.reddit.com
change dspy engineering machinelearning +2
[D] How did OpenAI go from doing exciting research to a big-tech-like company? 16 hours ago | www.reddit.com
capabilities engineering fast forward gpt4 +6
Multimodal AI from First Principles - Most fundamental approaches [D] 16 hours ago | www.reddit.com
building fundamental machinelearning multimodal +4
[D] Culture of Recycling Old Conference Submissions in ML 18 hours ago | www.reddit.com
conference conferences culture iclr +10
[D] How Do You Efficiently Conduct Ablation Studies in Machine Learning? 18 hours ago | www.reddit.com
fine-tuning grid insights machine +7

Jobs in AI, ML, Big Data

Post a Job Search Talent

Software Engineer for AI Training Data (School Specific)

@ G2i Inc | Remote
View on ai-jobs.net

Software Engineer for AI Training Data (Python)

@ G2i Inc | Remote
View on ai-jobs.net

Software Engineer for AI Training Data (Tier 2)

@ G2i Inc | Remote
View on ai-jobs.net

Data Engineer

@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania
View on ai-jobs.net

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX
View on ai-jobs.net

Lead Developer (AI)

@ Cere Network | San Francisco, US
View on ai-jobs.net