[D] System Requirement to host a finetuned GPT Neo X 20B model

Web: https://www.reddit.com/r/MachineLearning/comments/uop2mc/d_system_requirement_to_host_a_finetuned_gpt_neo/

GPT 3 Davinci with 175B parameters costs $0.0600 / 1K tokens

Their cheaper model Curie with 13B parameters costs $0.0060 / 1K tokens

​

GPT Neo X has 20B parameters...

​

But on so many sites, GPT Neo X with 20B parameters cost more than GPT 3 Davinci with 175B parameters...

​

For example on NLPCloud,

GPT Neo X costs $0.095/1K tokens.

​

and on Goose AI,

it costs 0.063 / 1K tokens

​

Quality difference between Davinci and Neo …

gpt machinelearning model