Web: https://www.reddit.com/r/deeplearning/comments/s9gcgd/slow_training/

Jan. 21, 2022, 5:43 p.m. | /u/zelenadinja

Deep Learning reddit.com

I dont get it.I can fit up to 256 images on single batch size of 3x448x448, im using amp, gradient clipping,gradient accumulation,not a single .item(), .cpu(), moving with .to(device), torch.backends.cudnn.deterministic = False, torch.backends.cudnn.benchmark = True, using pillow simd for reading images.There 250 batches, and still one epoch take 2h30minutes.It takes 30 seconds pre batch.It should be about 5 or less.


submitted by /u/zelenadinja
[link] [comments]

deeplearning training

Clinical Assistant or Associate Professor of Management Science and Systems

@ University at Buffalo | Buffalo, NY

Data Analyst

@ Colorado Springs Police Department | Colorado Springs, CO

Predictive Ecology Postdoctoral Fellow

@ Lawrence Berkeley National Lab | Berkeley, CA

Data Analyst, Patagonia Action Works

@ Patagonia | Remote

Data & Insights Strategy & Innovation General Manager

@ Chevron Services Company, a division of Chevron U.S.A Inc. | Houston, TX

Faculty members in Research areas such as Bayesian and Spatial Statistics; Data Privacy and Security; AI/ML; NLP; Image and Video Data Analysis

@ Ahmedabad University | Ahmedabad, India