all AI news
Metric for text summarization
Jan. 16, 2022, 12:13 p.m. | /u/Tarang_Soni
Natural Language Processing www.reddit.com
Recently, I was reading some literature about text summarization and came across its evaluation metric, the "ROUGE" score. From what I understood from preliminary reading, the ROUGE score only measures n-gram overlap between candidate summary and reference summary which wrongly penalizes abstractive summaries containing different n-grams but conveying the same meaning. There's also a BERTScore metric (arXiv'19, ICLR'20) that does not suffer from these issues of ROUGE and computes contextual similarity rather than just n-gram overlap. How can I assess …
!-->More from www.reddit.com / Natural Language Processing
The Languages AI Is Leaving Behind
3 days, 9 hours ago |
www.reddit.com
Feeling so inferior in the NLP job market.
4 days, 6 hours ago |
www.reddit.com
NLP: building a sentiment model
4 days, 7 hours ago |
www.reddit.com
ReFT: Representation Finetuning for Language Models
1 week, 5 days ago |
www.reddit.com
Jobs in AI, ML, Big Data
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Senior Machine Learning Engineer (MLOps)
@ Promaton | Remote, Europe
Lead Data Engineer
@ JPMorgan Chase & Co. | Jersey City, NJ, United States
Senior Machine Learning Engineer
@ TELUS | Vancouver, BC, CA
CT Technologist - Ambulatory Imaging - PRN
@ Duke University | Morriville, NC, US, 27560
BH Data Analyst
@ City of Philadelphia | Philadelphia, PA, United States