all AI news logo
all AI news - Your AI news aggregator
Log in Sign up
all AI news

[R] Skeptical about LLM benchmarks telling the whole story? This paper shows how tiny tweaks to tests like MMLU can shuffle model rankings like a deck of cards. 🃏

Add to bookmarks
Feb. 10, 2024, 9:33 p.m. | /u/PoisonousHashbrown

Machine Learning www.reddit.com

benchmarks cards llm llm benchmarks machinelearning mmlu paper rankings shows story tests

Visit resource

More from www.reddit.com / Machine Learning

[D] How did OpenAI go from doing exciting research to a big-tech-like company? 2 hours ago | www.reddit.com
capabilities engineering fast forward gpt4 +6
[D] Culture of Recycling Old Conference Submissions in ML 5 hours ago | www.reddit.com
conference conferences culture iclr +10
[D] How Do You Efficiently Conduct Ablation Studies in Machine Learning? 5 hours ago | www.reddit.com
fine-tuning grid insights machine +7
[P] N-way-attention 9 hours ago | www.reddit.com
algorithm attention concept every +12
[D] Is it possible to train ViTMAE with Hyperspectral Satellite Images? 19 hours ago | www.reddit.com
encoder format images learn +4
[D] Mamba Convergence speed 22 hours ago | www.reddit.com
class convergence dataset example +10
[P] Local RAG with RETSim, Ollama and Gemma 1 day, 1 hour ago | www.reddit.com
gemma machinelearning notebooks ollama +3
[Project] Tabletop HandyBot: low-cost robotic arm assistant for tabletop tasks 1 day, 3 hours ago | www.reddit.com
arm assistant cost functional +9
[R] Grounding DINO 1.5 Release: the most capable open-set detection model 1 day, 3 hours ago | www.reddit.com
building dataset detection foundation +12

Jobs in AI, ML, Big Data

Post a Job Search Talent

Software Engineer for AI Training Data (School Specific)

@ G2i Inc | Remote
View on ai-jobs.net

Software Engineer for AI Training Data (Python)

@ G2i Inc | Remote
View on ai-jobs.net

Software Engineer for AI Training Data (Tier 2)

@ G2i Inc | Remote
View on ai-jobs.net

Data Engineer

@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania
View on ai-jobs.net

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX
View on ai-jobs.net

Lead Developer (AI)

@ Cere Network | San Francisco, US
View on ai-jobs.net