NYT, CNN, and some other news outlets block OpenAI's GPTBot web crawler from accessing their content; some have also blocked Common Crawl Foundation's CCBot (Ariel Bogle/The Guardian)

Ariel Bogle / The Guardian:

NYT, CNN, and some other news outlets block OpenAI's GPTBot web crawler from accessing their content; some have also blocked Common Crawl Foundation's CCBot  —  Chicago Tribune and Australian newspapers the Canberra Times and Newcastle Herald also appear to have disallowed web crawler from maker of Chat GPT

cnn crawler foundation gptbot openai the guardian web web crawler