Web: https://www.reddit.com/r/LanguageTechnology/comments/scyef9/question_regarding_the_denominators_in_kneserney/

Jan. 26, 2022, 5:30 a.m. | /u/gravenberchre-vision

Natural Language Processing reddit.com

Hi everyone!

I am currently studying smoothing techniques, specifically Kneser-Ney smoothing. I understand that it helps to handle the case where the next word hasn't appeared in the given context previously. For eg, the corpus could have non zero trigram counts of 'This is a', but no occurrence of the 4-gram 'This is a car'.

The count C(This is a) is captured in the denominator of the lambda term as well, and this lambda term is multiplied with the recursion …

languagetechnology

Engineering Manager, Machine Learning (Credit Engineering)

@ Affirm | Remote Poland

Sr Data Engineer

@ Rappi | [CO] Bogotá

Senior Analytics Engineer

@ GetGround | Porto

Senior Staff Software Engineer, Data Engineering

@ Galileo, Inc. | New York City or Remote

Data Engineer

@ Atlassian | Bengaluru, India

Data Engineer | Hybrid (Pune)

@ Velotio | Pune, Maharashtra, India