Possible OpenAI's Q* breakthrough and DeepMind's AlphaGo-type systems plus LLMs

tl;dr: OpenAI leaked AI breakthrough called Q\*, acing grade-school math. It is hypothesized combination of Q-learning and A*. It was then refuted. DeepMind is working on something similar with Gemini, AlphaGo-style Monte Carlo Tree Search. Scaling these might be crux of planning for increasingly abstract goals and agentic behavior. Academic community has been circling around these ideas for a while.

https://www.reuters.com/technology/sam-altmans-ouster-openai-was-precipitated-by-letter-board-about-ai-breakthrough-2023-11-22/

https://twitter.com/MichaelTrazzi/status/1727473723597353386

"Ahead of OpenAI CEO Sam Altman’s four days in exile, several staff researchers sent the board of directors …

abstract academic alphago artificial behavior combination deepmind gemini leaked llms math openai planning q-learning scaling school search something systems tree type type systems