Oct. 9, 2023, 4:20 p.m. | /u/Appropriate_Ant_4629

Machine Learning www.reddit.com

Seems the way people train language models today feels like sending a preschooler to a college library and telling him to start browsing books.

Anyone know of papers describing language models being trained more like a child?

Perhaps starting with preschool books with a tiny vocabulary and short sentence fragments like "goodnight moon...", moving up to "the lorax".... and then fine-tuning on elementary school books ... then jr high level reading ... then high school .... etc.

I'm guessing this …

advanced books child college elementary fine-tuning language language models library machinelearning people preschool school simple text training

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Research Scientist (Computer Science)

@ Nanyang Technological University | NTU Main Campus, Singapore

Intern - Sales Data Management

@ Deliveroo | Dubai, UAE (Main Office)