all AI news
Tutorial: Web Scraping LinkedIn Jobs with Playwright.
July 30, 2023, 3:48 p.m. | Vic
DEV Community dev.to
Tutorial: Web Scraping LinkedIn Jobs with Playwright.
In this tutorial, we will explore a Python script that uses Playwright and Scrapy to scrape job listings from LinkedIn. The script will log in to LinkedIn, apply various search parameters, and scrape job details. We'll then save the scraped data to a CSV file.
Overview
The Python script is designed to perform the following tasks:
- Log in to LinkedIn using provided credentials.
- Load search parameters from a YAML configuration file.
- Scrape job …
apply csv data explore job job listings jobs linkedin overview playwright python python script save scraping scrapy search tutorial web web scraping
More from dev.to / DEV Community
Jobs in AI, ML, Big Data
Founding AI Engineer, Agents
@ Occam AI | New York
AI Engineer Intern, Agents
@ Occam AI | US
AI Research Scientist
@ Vara | Berlin, Germany and Remote
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Codec Avatars Research Engineer
@ Meta | Pittsburgh, PA