[R] Towards Autonomous Hypothesis Verification via Language Models with Minimal Guidance

Researchers decided to see if today's huge language models like GPT-4 could generate and test hypotheses without much human guidance - basically "do science" autonomously.

They gave GPT-4 a simple "toy" research problem about how it tends to output verbose text unrelated to the question prompt. For "What is 1+1" it says "The answer is 2" rather than just "2".

GPT-4 successfully generated reasonable hypotheses like modifying the prompt to request one-word answers. And it could create decent plans to …

autonomous generate gpt gpt-4 guidance human hypothesis language language models machinelearning prompt research researchers science simple test text verification