Web: https://www.reddit.com/r/LanguageTechnology/comments/uny0bt/measuring_sentiment_accurately_from_arbitrary/

May 12, 2022, 10:30 a.m. | /u/Settleforthep0p

Natural Language Processing reddit.com

Hello, I was wondering how you would go about getting a fairly accurate sentiment analysis from an arbitrary webpages body of content?

I’m interested in scraping websites from google search results for different query terms and measuring the mean and standard deviation of sentiment polarity given different search terms and search history.

The problem I ran into is diverse website formatting, including links and banner content text when scraping. These additional paragraphs likely affect the sentiment score when measuring.

How …

languagetechnology website

Data Analyst, Patagonia Action Works

@ Patagonia | Remote

Data & Insights Strategy & Innovation General Manager

@ Chevron Services Company, a division of Chevron U.S.A Inc. | Houston, TX

Faculty members in Research areas such as Bayesian and Spatial Statistics; Data Privacy and Security; AI/ML; NLP; Image and Video Data Analysis

@ Ahmedabad University | Ahmedabad, India

Director, Applied Mathematics & Computational Research Division

@ Lawrence Berkeley National Lab | Berkeley, Ca

Business Data Analyst

@ MainStreet Family Care | Birmingham, AL

Assistant/Associate Professor of the Practice in Business Analytics

@ Georgetown University McDonough School of Business | Washington DC