all AI news
Does ChatGPT have a liberal bias?
Simon Willison's Weblog simonwillison.net
Does ChatGPT have a liberal bias?
An excellent debunking by Arvind Narayanan and Sayash Kapoor of the "Measuring ChatGPT political bias" paper that's been doing the rounds recently.
It turns out that paper didn't even test ChatGPT/gpt-3.5-turbo - they ran their test against the older Da Vinci GPT3.
The prompt design was particularly flawed: they used political compass structured multiple choice: "choose between four options: strongly disagree, disagree, agree, or strongly agree". Arvind and Sayash found that asking an open …
ai bias chatgpt design ethics generativeai gpt gpt-3 gpt3 gpt-3.5 gpt-3.5-turbo llms paper political prompt test turbo