Dec. 15, 2023, 6:25 a.m. | /u/Tamalelulu

Data Science www.reddit.com

I've been doing some scraping and the website in question seems, let's say less than happy with it. I'm in the process of transitioning to a different data source but for the time being I kinda need the data for a tool I built and am using. Does anyone have any tricks for making the process look less programmatic on their side? I'm going very slowly, have random sleeps built in, recently started visiting other random websites at specified intervals …

data datascience look process programmatic scraping tool tricks website

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne