Big Tech's LLM evals are just marketing | allainews.com

Dec. 13, 2023, 6:02 p.m. | Nathan Lambert

Interconnects www.interconnects.ai

A PSA everyone needs. The importance of a wait and see attitude when it comes to new models, big and small, open and closed.

attitude big evals importance llm marketing psa small tech

More from www.interconnects.ai / Interconnects

How RLHF works, part 2: A thin line between useful and lobotomized 4 days, 5 hours ago | www.interconnects.ai

beyond chat evaluation fine-tuning +5

Phi 3 and Arctic: Outlier LMs are hints 5 days, 20 hours ago | www.interconnects.ai

arctic industry llms lms +3

AGI is what you want it to be 1 week, 4 days ago | www.interconnects.ai

agi definitions people

WIP Llama 3: Scaling open LLMs 2 weeks, 3 days ago | www.interconnects.ai

article llama llama 3 llms +3

Stop "reinventing" everything to solve alignment 2 weeks, 4 days ago | www.interconnects.ai

alignment computing everything feedback +7

The end of the “best open LLM” 2 weeks, 6 days ago | www.interconnects.ai

compute llm llms modeling +2

We disagree on what open-source AI should mean 1 month ago | www.interconnects.ai

mean multiple open-source ai people +3

DBRX: The new best open model and Databricks’ ML strategy 1 month, 1 week ago | www.interconnects.ai

70b databricks llama llama 2 +4

Evaluations: Trust, performance, and price (bonus, announcing RewardBench) 1 month, 2 weeks ago | www.interconnects.ai

bonus evaluation llms modern +4

Founding AI Engineer, Agents

@ Occam AI | New York

View on ai-jobs.net

AI Engineer Intern, Agents

@ Occam AI | US

View on ai-jobs.net

AI Research Scientist

@ Vara | Berlin, Germany and Remote

View on ai-jobs.net

Data Architect

@ University of Texas at Austin | Austin, TX

View on ai-jobs.net

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

View on ai-jobs.net

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

View on ai-jobs.net