Search SRILM-USER Archives

Match: Format: Sort by:
Search:

Re: Error in discount estimator

From: Andreas Stolcke <stolcke at ADDRESS HIDDEN>
Date: Thu, 15 Mar 2007 11:26:10 -0700

Antoine Ghaoui wrote:
> Hello,
>
> When using fngram-count to generate a Language Model, i'm getting the
> following error:
>
> warning: one of required modified KneserNey count-of-count is zero
> error in discount estimator
>
>
> Can someone help?
>
> knowing that the factor file is

This is a problem with the frequency distribution of factors in your data.
You probably have no singleton ngrams for some factor-ngram.  Try using
a discounting method like wbdiscount
instead of kndiscount.

Andreas

>
>
> ## root trigram
> 1
> R : 2 R(-1) R(-2) ntextfile_99.flm.cnt ntextfile_99.flm.lm 3
> R1R2    R2      kndiscount gtmin 1 interpolate
> R1      R1      kndiscount gtmin 1 interpolate
> 0       0       kndiscount gtmin 1
>
> Thanks
>
> Antoine
>

Click here to go to the SRILM home page.