I built a tool that auto-generates scrapers for any website with GPT

I got frustrated with the time and effort required to code and maintain custom web scrapers, so me and my friends built a generic LLM-based solution for data extraction from websites. AI should automate tedious and un-creative work, and web scraping definitely fits this description.

We're leveraging LLMs to semantically understand websites and generate the DOM selectors for it. Using GPT for every data extraction, as most comparable tools do, would be way too expensive and very slow, but using …

automate code creative data data extraction datascience dom extraction gpt llm llms scraping solution tool tools web web scraping website websites work