Feb. 15, 2024, 9:25 a.m. |

Techmeme www.techmeme.com


David Pierce / The Verge:

A look at robots.txt, a good will-based social contract governing the behavior of web crawlers, as experts call for more rigid tools for managing AI crawlers  —  For decades, robots.txt governed the behavior of web crawlers.  But as unscrupulous AI companies seek out more and more data …

behavior call david experts good look robots social tools web will

More from www.techmeme.com / Techmeme

Software Engineer for AI Training Data (School Specific)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Python)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Tier 2)

@ G2i Inc | Remote

Data Engineer

@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX

Lead Developer (AI)

@ Cere Network | San Francisco, US