all AI news
[D] Anyone tried training language models on simple (elementary school) text first and fine-tuning on progressively more advanced text?
Oct. 9, 2023, 4:20 p.m. | /u/Appropriate_Ant_4629
Machine Learning www.reddit.com
Anyone know of papers describing language models being trained more like a child?
Perhaps starting with preschool books with a tiny vocabulary and short sentence fragments like "goodnight moon...", moving up to "the lorax".... and then fine-tuning on elementary school books ... then jr high level reading ... then high school .... etc.
I'm guessing this …
advanced books child college elementary fine-tuning language language models library machinelearning people preschool school simple text training
More from www.reddit.com / Machine Learning
Jobs in AI, ML, Big Data
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Senior Machine Learning Engineer (MLOps)
@ Promaton | Remote, Europe
Research Scientist (Computer Science)
@ Nanyang Technological University | NTU Main Campus, Singapore
Intern - Sales Data Management
@ Deliveroo | Dubai, UAE (Main Office)