July 30, 2023, 3:48 p.m. | Vic

DEV Community dev.to




Tutorial: Web Scraping LinkedIn Jobs with Playwright.


In this tutorial, we will explore a Python script that uses Playwright and Scrapy to scrape job listings from LinkedIn. The script will log in to LinkedIn, apply various search parameters, and scrape job details. We'll then save the scraped data to a CSV file.



Overview


The Python script is designed to perform the following tasks:



  1. Log in to LinkedIn using provided credentials.

  2. Load search parameters from a YAML configuration file.

  3. Scrape job …

apply csv data explore job job listings jobs linkedin overview playwright python python script save scraping scrapy search tutorial web web scraping

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Codec Avatars Research Engineer

@ Meta | Pittsburgh, PA