[R] LLMs surpass human experts in predicting neuroscience experiment outcomes (81% vs 63%)

A new study shows that LLMs can predict which neuroscience experiments are likely to yield positive findings more accurately than human experts. The researchers used a GPT-3.5 class model with only 7 billion parameters and found that fine-tuning it on neuroscience literature boosted performance even further.

I thought the experiment design was interesting. The LLMs were presented with two versions of an abstract with significantly different results, and we were asked to predict which was more likely to be the …

billion class experiment experts fine-tuning found gpt gpt-3 gpt-3.5 human literature llms machinelearning neuroscience parameters performance positive researchers shows study