OpenAI’s Web Crawler and FTC Missteps

OpenAI launches a default opt-in crawler to scrape the Internet, while FTC pursues an obscure consumer deception investigation

With AI adoption steeply rising, it’s becoming more and more important for data professionals to think about data sourcing. While the initial wave of high performant LLMs were trained using a common yet controversial tactic of data scraping, this questionable practice has been in the spotlight lately, opening up lawsuits and questions of data ownership. …

adoption ai adoption artificial intelligence business chatgpt consumer copyright crawler data data sourcing deception deep-dives ftc internet llms openai professionals think web web crawler