all AI news
Stanford AI Researchers Propose ‘LinkBERT’: A New Pretraining Method That Improves Language Model Training with Document Links
June 8, 2022, 9:52 p.m. | /u/No_Coffee_4638
Artificial Intelligence www.reddit.com
(1) obtaining links between documents to build a document graph from the text corpus,
(2) creating link-aware training instances from the graph by placing linked documents together, and finally
(3) pretraining the LM with link-aware self-supervised tasks: masked language modeling (MLM) and document relation prediction (DRP).
👉 LinkBERT is especially effective for multi-hop reasoning and few-shot QA (+5% absolute improvement on HotpotQA and TriviaQA)
[*Continue reading*](https://www.marktechpost.com/2022/06/08/stanford-ai-researchers-propose-linkbert-a-new-pretraining-method-that-improves-language-model-training-with-document-links/) *| Check out the*[ ](https://www.prnewswire.com/news-releases/introducing-the-digital-upcycling-project-by-tilda-the-first-ai-artist-by-lg-ai-research-301561017.html)[*paper*](https://arxiv.org/pdf/2203.15827.pdf)*,* [*github*](https://github.com/michiyasunaga/LinkBERT) *and* [*blog …
ai artificial language language model researchers stanford training
More from www.reddit.com / Artificial Intelligence
Jobs in AI, ML, Big Data
Senior ML Researcher - 3D Geometry Processing | 3D Shape Generation | 3D Mesh Data
@ Promaton | Europe
Research Assistant/Associate, Health Data Science [LKCMedicine]
@ Nanyang Technological University | NTU Novena Campus, Singapore
Senior Machine Learning Engineer, Portfolio ML
@ Affirm | Remote Canada
[Sessional Lecturer] Foundations of Data Analytics and Machine Learning - APS1070
@ University of Toronto | Toronto, ON, CA
Senior Data Scientist
@ Prosper | United States
Data Analyst
@ ZF Friedrichshafen AG | Coimbatore, TN, IN, 641659