<html>
<head>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 10pt;
font-family:Tahoma
}
--></style>
</head>
<body class='hmmessage'>
<font class="Apple-style-span" face="Tahoma" size="2">Hello,</font><div style="font-family: Tahoma; font-size: 10pt; "><br></div><div style="font-family: Tahoma; font-size: 10pt; ">I used the "-debug 2" during the perplexity computation of a word language model and a class language model, and don't understand the output.</div><div style="font-family: Tahoma; font-size: 10pt; "><br></div><div style="font-family: Tahoma; font-size: 10pt; ">I start with:</div><div><font class="Apple-style-span" face="Tahoma" size="2">ngram -lm lm.3g -order 3 -mix-lm lm300 -lambda 0.518735 -bayes 0 -classes classes300 -ppl dev.text -debug 2</font></div><div style="font-family: Tahoma; font-size: 10pt; ">lm.3g: word lm</div><div style="font-family: Tahoma; font-size: 10pt; ">lm300: class lm</div><div style="font-family: Tahoma; font-size: 10pt; "><br></div><div style="font-family: Tahoma; font-size: 10pt; ">and get:</div><div><div><font class="Apple-style-span" face="Tahoma" size="2">她 还在 读 她的 ...</font></div><div><font class="Apple-style-span" face="Tahoma" size="2"> p( 她 | <s> ) = [OOV][2gram][2gram][OOV] 0.00193608 [ -2.71308 ]</font></div><div><font class="Apple-style-span" face="Tahoma" size="2"> p( 还在 | 她 ...) = [OOV][1gram][OOV][2gram][1gram][OOV][1gram][OOV] 7.96669e-05 [ -4.09872 ]</font></div><div><font class="Apple-style-span" face="Tahoma" size="2"> p( 读 | 还在 ...) = [OOV][1gram][OOV][2gram][1gram][OOV][1gram][OOV] 0.00486257 [ -2.31313 ]</font></div><div><font class="Apple-style-span" face="Tahoma" size="2"> p( 她的 | 读 ...) = [OOV][1gram][OOV][2gram][1gram][OOV][1gram][OOV] 0.000237892 [ -3.62362 ]</font></div><div><font class="Apple-style-span" face="Tahoma" size="2"> p( 对 | 她的 ...) = [OOV][1gram][OOV][2gram][2gram][OOV][1gram][OOV] 0.00242938 [ -2.6145 ]</font></div></div><d
iv><font class="Apple-style-span" face="Tahoma" size="2">...</font></div><div style="font-family: Tahoma; font-size: 10pt; ">are the words covered by 1-grams/2-grams or OOV?</div><div style="font-family: Tahoma; font-size: 10pt; "><br></div><div style="font-family: Tahoma; font-size: 10pt; ">Thank you!!!</div><div style="font-family: Tahoma; font-size: 10pt; "><br></div><div style="font-family: Tahoma; font-size: 10pt; ">-Fabian</div> </body>
</html>