Web: https://www.reddit.com/r/deeplearning/comments/s9xw1r/schduler_with_warmup/

Jan. 22, 2022, 8:25 a.m. | /u/zelenadinja

Deep Learning reddit.com

Hi, im using scheduler with warmup, also im using gradient acummuluation.For number of training steps do i have to divide len(trainloder) with gradient acummulation step.

submitted by /u/zelenadinja
[link] [comments]


Data Analytics and Technical support Lead

@ Coupa Software, Inc. | Bogota, Colombia

Data Science Manager

@ Vectra | San Jose, CA

Data Analyst Sr

@ Capco | Brazil - Sao Paulo

Data Scientist (NLP)

@ Builder.ai | London, England, United Kingdom - Remote

Senior Data Analyst

@ BuildZoom | Scottsdale, AZ/ San Francisco, CA/ Remote

Senior Research Scientist, Speech Recognition

@ SoundHound Inc. | Toronto, Canada