all AI news logo
all AI news - Your AI news aggregator
Log in Sign up
all AI news

[D] can I fintune Mistral 7B model on 8 * A100 40GB ?

Add to bookmarks
Dec. 25, 2023, 10:42 a.m. | /u/MustafaAlahmid

Machine Learning www.reddit.com

I want to finetune Mistral 7B and I have access to 8 A100 40GB and I'm doing a full finetune not Lora
Is this possible? Or I need A100 80GB at least?

How to calculate minimum requirements?

a100 least lora machinelearning mistral mistral 7b requirements

Visit resource

More from www.reddit.com / Machine Learning

[D] Intra-Document prefix (cumulative) sum when using sequence packing in PyTorch 7 hours ago | www.reddit.com
computational context context window documents +7
[Research] xLSTM: Extended Long Short-Term Memory 13 hours ago | www.reddit.com
abstract contributed deep learning error +16
Non Technical ML Podcasts? [D] 20 hours ago | www.reddit.com
challenge context current data +16
[D] PEFT techniques actually used in the industry 1 day ago | www.reddit.com
industry machinelearning normally peft +2
[D] Can anyone with the expertise speak to the overlap, or not, between Nvidia's hardware … 1 day, 1 hour ago | www.reddit.com
apple chips expertise hardware +4
[P] Skyrim - Open-source model zoo for Large Weather Models 1 day, 2 hours ago | www.reddit.com
ai models building capabilities fine-tuning +7
[P] Identify toxic underwater air bubbles lurking in the substrate with aquatic ultrasonic scans via … 1 day, 4 hours ago | www.reddit.com
arduino classification color identify +11
[P] YARI - Yet Another RAG Implementation. Hybrid context retrieval 1 day, 6 hours ago | www.reddit.com
api context cosine embedding +14
[D] limiting LLM output to certain words 1 day, 7 hours ago | www.reddit.com
apple class classification engineer +10

Jobs in AI, ML, Big Data

Post a job on ai-jobs.net Find talent on ai-jobs.net

Lead Developer (AI)

@ Cere Network | San Francisco, US
View on ai-jobs.net

Research Engineer

@ Allora Labs | Remote
View on ai-jobs.net

Ecosystem Manager

@ Allora Labs | Remote
View on ai-jobs.net

Founding AI Engineer, Agents

@ Occam AI | New York
View on ai-jobs.net

AI Engineer Intern, Agents

@ Occam AI | US
View on ai-jobs.net

AI Research Scientist

@ Vara | Berlin, Germany and Remote
View on ai-jobs.net
View more jobs