Sept. 24, 2023, 2:45 a.m. | /u/elhamoly98

Data Science www.reddit.com

I am currently embarking on my first web scraping project as part of my internship, and I've encountered a challenge that has left me uncertain about its feasibility. My task involves signing in to Glassdoor, conducting searches within the 'companies' section for specific countries, and then extracting salary data for all job positions within those companies in the respective countries. However, I've encountered a few complexities.

Firstly, I'm faced with a scenario where I have 200 pages to navigate, each …

challenge companies country data datascience internship part project salaries salary salary data scraper scraping uncertain web web scraping

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Data Science Analyst

@ Mayo Clinic | AZ, United States

Sr. Data Scientist (Network Engineering)

@ SpaceX | Redmond, WA