all AI news logo
all AI news - Your AI news aggregator
Log in Sign up
all AI news

[P] NanoPhi, Implementing some of the success of Phi-1.5, with GPT-2(124m)

Add to bookmarks
Oct. 2, 2023, 3:35 a.m. | /u/vatsadev

Machine Learning www.reddit.com

Hi, i'm trying to replicate at least some of the success of Phi 1.5 on a model 10x smaller, gpt-2 124m.

I have started with model finetuning, and have a simple github with roadmap, https://github.com/VatsaDev/NanoPhi, check it out there!

gpt gpt-2 least machinelearning replicate success

Visit resource

More from www.reddit.com / Machine Learning

[N] AI is promoted from back-office duties to investment decisions 7 hours ago | www.reddit.com
decisions investment machinelearning office +1
[P] Baysian bandits item pricing in a Moonlighter shop simulation 8 hours ago | www.reddit.com
agent bayesian customer game +8
[D] The Dilemma of Taking Notes on Every ML Resource or Accepting Knowledge Loss Over … 9 hours ago | www.reddit.com
every knowledge loss machine +7
[R] MetaEarth - A Generative Foundation Model for Global-Scale Remote Sensing Image Generation 10 hours ago | www.reddit.com
foundation foundation model generative global +5
If LLMs are token-based autoregressive models, how do they generate images? (Transformers + VQVAE) [D] 11 hours ago | www.reddit.com
autoregressive autoregressive models gemini generate +10
[Discussion] Are people interested in creating a mid-tier GPU rig using two RTX A6000's joined … 13 hours ago | www.reddit.com
costs grant grant program machinelearning +3
[Research] Tangles: a new mathematical ML tool in book announced by Diestel 13 hours ago | www.reddit.com
artificial artificial intelligence book cambridge +11
[R] Tech report on FineWeb: decanting the web for the finest text data at scale 17 hours ago | www.reddit.com
arc benchmarks crawl datasets +10
[D] Teacher student training strategy 20 hours ago | www.reddit.com
accuracy data extract llama3 +12

Jobs in AI, ML, Big Data

Post a Job Search Talent

Senior Machine Learning Engineer

@ GPTZero | Toronto, Canada
View on ai-jobs.net

ML/AI Engineer / NLP Expert - Custom LLM Development (x/f/m)

@ HelloBetter | Remote
View on ai-jobs.net

Doctoral Researcher (m/f/div) in Automated Processing of Bioimages

@ Leibniz Institute for Natural Product Research and Infection Biology (Leibniz-HKI) | Jena
View on ai-jobs.net

Seeking Developers and Engineers for AI T-Shirt Generator Project

@ Chevon Hicks | Remote
View on ai-jobs.net

Principal Data Architect - Azure & Big Data

@ MGM Resorts International | Home Office - US, NV
View on ai-jobs.net

GN SONG MT Market Research Data Analyst 11

@ Accenture | Bengaluru, BDC7A
View on ai-jobs.net