all AI news
How to Scrape a URL for your Custom GPTs
Feb. 11, 2024, 10:02 a.m. | Thomas Hansen
DEV Community dev.to
Our website scraper have always been the envy of the industry, and it's also the corner stone of our AI Chatbot.
When we released AI Workflows, we decided to make the scraper publicly available for everyone to use, allowing you to create an API endpoint that accepts a URL - For then to scrape the specified URL, and return the content as high quality Markdown.
By transforming the original URL's content into Markdown, we get to preserve …
ai ai chatbot ai workflows api chatbot chatgpt gpts industry lowcode productivity scraper stone url website workflows
More from dev.to / DEV Community
Jobs in AI, ML, Big Data
Artificial Intelligence – Bioinformatic Expert
@ University of Texas Medical Branch | Galveston, TX
Lead Developer (AI)
@ Cere Network | San Francisco, US
Research Engineer
@ Allora Labs | Remote
Ecosystem Manager
@ Allora Labs | Remote
Founding AI Engineer, Agents
@ Occam AI | New York
AI Engineer Intern, Agents
@ Occam AI | US