all AI news logo
all AI news - Your AI news aggregator
Log in Sign up
all AI news

[P] NanoPhi, Implementing some of the success of Phi-1.5, with GPT-2(124m)

Add to bookmarks
Oct. 2, 2023, 3:35 a.m. | /u/vatsadev

Machine Learning www.reddit.com

Hi, i'm trying to replicate at least some of the success of Phi 1.5 on a model 10x smaller, gpt-2 124m.

I have started with model finetuning, and have a simple github with roadmap, https://github.com/VatsaDev/NanoPhi, check it out there!

gpt gpt-2 least machinelearning replicate success

Visit resource

More from www.reddit.com / Machine Learning

[Research] Understanding The Attention Mechanism In Transformers: A 5-minute visual guide. 🧠 6 hours ago | www.reddit.com
architectures attention dictionary guide +12
[D] Is there a more systematic way of choosing the layers or how deep the … 11 hours ago | www.reddit.com
architecture deep learning least machinelearning +6
[D] Where does the real value of a data scientist come from? 15 hours ago | www.reddit.com
code companies data data scientist +11
[D] NVIDIA GPU Benchmarks & Comparison 17 hours ago | www.reddit.com
a100 ada cards cloud +15
[N] 1st Workshop on In-Context Learning at ICML 2024 18 hours ago | www.reddit.com
context context learning icml in-context learning +2
[R] A Careful Examination of Large Language Model Performance on Grade School Arithmetic 19 hours ago | www.reddit.com
abstract benchmark benchmarks claim +21
[D] [R] Are there any methods/works that enable extracting high-quality dense feature map from CLIP/OpenCLIP … 21 hours ago | www.reddit.com
clip compute feature finetuning +8
[P] [D] Is inference time the important performance metric for ML Models on edge/mobile? 1 day, 2 hours ago | www.reddit.com
apps devices edge embed +15
[D] UI-based Agents - the next big thing? 1 day, 3 hours ago | www.reddit.com
agents ai agents become big +10

Jobs in AI, ML, Big Data

Post a job on ai-jobs.net Find talent on ai-jobs.net

Founding AI Engineer, Agents

@ Occam AI | New York
View on ai-jobs.net

AI Engineer Intern, Agents

@ Occam AI | US
View on ai-jobs.net

AI Research Scientist

@ Vara | Berlin, Germany and Remote
View on ai-jobs.net

Data Architect

@ University of Texas at Austin | Austin, TX
View on ai-jobs.net

Data ETL Engineer

@ University of Texas at Austin | Austin, TX
View on ai-jobs.net

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne
View on ai-jobs.net
View more jobs