Oct. 5, 2023, 6:49 p.m. | Vincent A. Cicirello

DEV Community dev.to




TL;DR


I just released generate-sitemap 1.9.2, a GitHub Action for generating XML sitemaps for static websites. The generate-sitemap GitHub Action is implemented in Python, and generates an XML sitemap by crawling the GitHub repository containing the html of the site, using commit dates to generate <lastmod> tags in the sitemap.


This release, generate-sitemap 1.9.2, is primarily a fix for a minor bug in the regular expression used to detect whether a page has a meta robots noindex directive in …

crawling generate github html python release showdev webdev websites xml

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Director, Clinical Data Science

@ Aura | Remote USA

Research Scientist, AI (PhD)

@ Meta | Menlo Park, CA | New York City