[SRILM User List] Probability of Unknown Words - Kneser Ney?

Burkay Gur burkay at mit.edu
Sun May 20 20:28:49 PDT 2012


Hi!

I was wondering how we calculate the probability of unk words while 
using unmodified Kneser Ney. I know that Kneser Ney never assigns zero 
probs. How is that possible with words that are never seen? Or words 
that are in the dictionary but not in the training corpus?

Best,
Burkay


More information about the SRILM-User mailing list