all AI news
[D] How long should it take to train a diffusion model on CIFAR-10?
Nov. 15, 2022, 4:32 a.m. | /u/ButterscotchLost421
Machine Learning www.reddit.com
I am currently training a diffusion model on CIFAR.
The network is very similar to the code in the annotated diffusion model blog post ([https://huggingface.co/blog/annotated-diffusion](https://huggingface.co/blog/annotated-diffusion)).
Checking Yang Songs code for CIFAR 10 ( [https://github.com/yang-song/score\_sde](https://github.com/yang-song/score_sde) ), I see that the DM is trained for a staggering amount of 1 300 000 epochs.
One epoch takes 7 seconds on the machine (NVIDIA A100-SXM4-40GB).
Therefore overall training would take 2500 hours, i.e. a hundred days?
What am I doing wrong? Was the …
More from www.reddit.com / Machine Learning
Jobs in AI, ML, Big Data
Software Engineer for AI Training Data (School Specific)
@ G2i Inc | Remote
Software Engineer for AI Training Data (Python)
@ G2i Inc | Remote
Software Engineer for AI Training Data (Tier 2)
@ G2i Inc | Remote
Data Engineer
@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania
Artificial Intelligence – Bioinformatic Expert
@ University of Texas Medical Branch | Galveston, TX
Lead Developer (AI)
@ Cere Network | San Francisco, US