all AI news
slow training
Jan. 21, 2022, 5:43 p.m. | /u/zelenadinja
Deep Learning www.reddit.com
I dont get it.I can fit up to 256 images on single batch size of 3x448x448, im using amp, gradient clipping,gradient accumulation,not a single .item(), .cpu(), moving with .to(device), torch.backends.cudnn.deterministic = False, torch.backends.cudnn.benchmark = True, using pillow simd for reading images.There 250 batches, and still one epoch take 2h30minutes.It takes 30 seconds pre batch.It should be about 5 or less.
HOW?
submitted by /u/zelenadinja[link] [comments]
More from www.reddit.com / Deep Learning
Final Year Project Ideas
3 days, 16 hours ago |
www.reddit.com
Conditioning mechanism in DiT
4 days, 6 hours ago |
www.reddit.com
Learning deep learning from scratch
4 days, 19 hours ago |
www.reddit.com
Deep Learning Theory and Interpretability books and resources
5 days, 15 hours ago |
www.reddit.com
Jobs in AI, ML, Big Data
Data Scientist (m/f/x/d)
@ Symanto Research GmbH & Co. KG | Spain, Germany
Data Scientist 3
@ Wyetech | Annapolis Junction, Maryland
Technical Program Manager, Robotics
@ DeepMind | Mountain View, California, US
Machine Learning Engineer
@ Issuu | Braga
Business Intelligence Manager
@ Intuitive | Bengaluru, India
Expert Data Engineer (m/w/d)
@ REWE International Dienstleistungsgesellschaft m.b.H | Wien, Austria