all AI news logo
all AI news - Your AI news aggregator
Log in Sign up
all AI news

Fundus: A Simple-to-Use News Scraper Optimized for High Quality Extractions

Add to bookmarks
March 25, 2024, 4:47 a.m. | Max Dallabetta, Conrad Dobberstein, Adrian Breiding, Alan Akbik

cs.CL updates on arXiv.org arxiv.org

arXiv:2403.15279v1 Announce Type: new
Abstract: This paper introduces Fundus, a user-friendly news scraper that enables users to obtain millions of high-quality news articles with just a few lines of code. Unlike existing news scrapers, we use manually crafted, bespoke content extractors that are specifically tailored to the formatting guidelines of each supported online newspaper. This allows us to optimize our scraping for quality such that retrieved news articles are textually complete and without HTML artifacts. Further, our framework combines both …

arxiv cs.cl cs.ir quality scraper simple type

Visit resource

More from arxiv.org / cs.CL updates on arXiv.org

BEIR-PL: Zero Shot Information Retrieval Benchmark for the Polish Language 1 day, 19 hours ago | arxiv.org
arxiv benchmark cs.ai cs.cl +6
Should agentic conversational AI change how we think about ethics? Characterising an interactional ethics centred … 1 day, 19 hours ago | arxiv.org
abstract agents arxiv change +18
Capturing Perspectives of Crowdsourced Annotators in Subjective Learning Tasks 1 day, 19 hours ago | arxiv.org
abstract agreement annotations arxiv +13
ALBA: Adaptive Language-based Assessments for Mental Health 1 day, 19 hours ago | arxiv.org
abstract accuracy arxiv assessment +13
PACE: Improving Prompt with Actor-Critic Editing for Large Language Model 1 day, 19 hours ago | arxiv.org
abstract actor actor-critic arxiv +23
Enhancing Small Medical Learners with Privacy-preserving Contextual Prompting 1 day, 19 hours ago | arxiv.org
arxiv cs.ai cs.cl medical +5
Escaping the sentence-level paradigm in machine translation 1 day, 19 hours ago | arxiv.org
abstract arxiv context cs.cl +11
Building Knowledge-Grounded Dialogue Systems with Graph-Based Semantic Modeling 1 day, 19 hours ago | arxiv.org
abstract arxiv building challenge +17
Words as Trigger Points in Social Media Discussions 1 day, 19 hours ago | arxiv.org
abstract arxiv concept cs.cl +19

Jobs in AI, ML, Big Data

Post a Job Search Talent

Software Engineer for AI Training Data (School Specific)

@ G2i Inc | Remote
View on ai-jobs.net

Software Engineer for AI Training Data (Python)

@ G2i Inc | Remote
View on ai-jobs.net

Software Engineer for AI Training Data (Tier 2)

@ G2i Inc | Remote
View on ai-jobs.net

Data Engineer

@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania
View on ai-jobs.net

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX
View on ai-jobs.net

Lead Developer (AI)

@ Cere Network | San Francisco, US
View on ai-jobs.net