<html><body bgcolor="#FFFFFF"><div>Is your Dutch model arranged so that there is one sentence on each line? Also which command are you using? I recommend using -gt1max 1 -gt2max 1 -gt3max 1 and -ukndiscount for kneser ney smoothing. These will give you more accurate perplexities.</div><div><br></div><div>-Burkay<br><br>Sent from my iPad</div><div><br>On Dec 27, 2011, at 6:26 AM, Saman Noorzadeh <<a href="mailto:saman_2004@yahoo.com">saman_2004@yahoo.com</a>> wrote:<br><br></div><div></div><blockquote type="cite"><div><div style="color:#000; background-color:#fff; font-family:times new roman, new york, times, serif;font-size:12pt"><div><br></div><div><span>I made 2 models of 2 languages, Dutch and English, to make a language recognition.</span></div><div><span>I got the following perplexities:</span></div><div><span><br></span></div><div><span>Model: Dutch</span><span class="tab"> Test: English</span><span class="tab"> ppl:55</span><span class="tab"> ppl2: 2* 10^18</span></div><div><span>Model: Dutch</span><span class="tab"> Test: Dutch</span><span class="tab"> ppl:303</span><span class="tab"> ppl2: 400</span></div><div><span>Model: English</span><span class="tab"> Test: Dutch</span><span class="tab"> ppl: 600</span><span class="tab"> ppl2: 3122ses n<br></span></div><div><span>Model: English</span><span class="tab">
Test: English</span><span class="tab"> ppl: 227</span><span class="tab"> ppl2: 1897</span></div><div><br></div><div>I think it is reasonable if I have a large perplexity when my model and test are different but why ppl=55 <span class="tab">when having a Duch model and an English test?</span></div><div><span class="tab">and<br></span></div><div><span class="tab">Why is there a BIG difference in their ppl and ppl1 ?</span></div><div><br><span class="tab"></span></div><div><span class="tab">Thanks in advance<br></span></div><div><span class="tab"><br></span></div><div><span class="tab"><br></span></div>
</div></div></blockquote><blockquote type="cite"><div><span>_______________________________________________</span><br><span>SRILM-User site list</span><br><span><a href="mailto:SRILM-User@speech.sri.com">SRILM-User@speech.sri.com</a></span><br><span><a href="http://www.speech.sri.com/mailman/listinfo/srilm-user">http://www.speech.sri.com/mailman/listinfo/srilm-user</a></span></div></blockquote></body></html>