Dec. 11, 2023, 11:06 a.m. | /u/Melodic_Stomach_2704

Machine Learning

I've been experimenting with batch size and what I found is using a larger batch size on the training set is giving lower loss compared to the smaller ones. I'm aware of the fact that with smaller batch sizes, there are more weight updates however I cannot comprehend how the losses are different given the same no. of epochs for training.

found giving loss machinelearning set training training loss updates

Data Scientist (m/f/x/d)

@ Symanto Research GmbH & Co. KG | Spain, Germany

Robotics Technician - Weekend Day Shift

@ GXO Logistics | Hillsboro, OR, US, 97124

Gen AI Developer

@ NTT DATA | Irving, TX, US

Applied AI/ML - Vice President

@ JPMorgan Chase & Co. | LONDON, United Kingdom

Research Fellow (Computer Science/Engineering/AI)

@ Nanyang Technological University | NTU Main Campus, Singapore

Senior Machine Learning Engineer

@ Rasa | Remote - Germany