<html><body><div style="color:#000; background-color:#fff; font-family:times new roman, new york, times, serif;font-size:12pt"><div><span>Hi ,</span></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><br><span></span></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><span>Thanks.</span></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><br><span></span></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><span>I used NIST sclite command:</span></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new
roman,new york,times,serif; background-color: transparent; font-style: normal;"><span>./sclite -r refs -i wsj -h hyps -o dtl</span></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><span>but I got the same scoring result for the baseline 1-best hypothesis and updated 1-best hypothesis obtained by updated LM using rescore-decipher and rescore-reweight.</span></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><br><span></span></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><span>I tried with compute-sclite of SRILM with command: compute-sclite -r refs -h hyps -i wsj -o dtl</span></div><div style="color: rgb(0, 0, 0); font-size:
16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><span>but it shows line 247: sclite: command not found.</span></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><br><span></span></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><span>Can anyone tell me where is the problem?</span></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><br><span></span></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><span>Thanks</span></div><div style="color: rgb(0, 0, 0); font-size:
16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><span>Best Regards <br></span></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><span>Akmal<br></span></div><div><span></span></div><div><br></div> <div style="font-family: times new roman, new york, times, serif; font-size: 12pt;"> <div style="font-family: times new roman, new york, times, serif; font-size: 12pt;"> <div dir="ltr"> <font face="Arial" size="2"> <hr size="1"> <b><span style="font-weight:bold;">From:</span></b> Andreas Stolcke <stolcke@icsi.berkeley.edu><br> <b><span style="font-weight: bold;">To:</span></b> Md. Akmal Haidar <akmalcuet00@yahoo.com> <br><b><span style="font-weight: bold;">Cc:</span></b> Anand Venkataraman <venkataraman.anand@gmail.com>; "srilm-user@speech.sri.com"
<srilm-user@speech.sri.com> <br> <b><span style="font-weight: bold;">Sent:</span></b> Sunday, November 4, 2012 7:02:38 PM<br> <b><span style="font-weight: bold;">Subject:</span></b> Re: [SRILM User List] Fw: nbest-error option<br> </font> </div> <br><div id="yiv1706404242">
<div>
<div class="yiv1706404242moz-cite-prefix">On 11/4/2012 12:52 PM, Md. Akmal Haidar
wrote:<br>
</div>
<blockquote type="cite">
<div style="color:#000;background-color:#fff;font-family:times new roman, new york, times, serif;font-size:12pt;">
<div><span>Thanks Anand,</span></div>
<div style="color:rgb(0, 0, 0);font-size:16px;
font-family:times new roman, new york, times, serif;
background-color:transparent;font-style:normal;">It works now.<br>
<span></span></div>
<div style="color:rgb(0, 0, 0);font-size:16px;
font-family:times new roman, new york, times, serif;
background-color:transparent;font-style:normal;"><span>But I found the same
WER for the original n-best list and the rescored nbest
list.</span></div>
<div style="color:rgb(0, 0, 0);font-size:16px;
font-family:times new roman, new york, times, serif;
background-color:transparent;font-style:normal;"><span><br>
</span></div>
<div style="color:rgb(0, 0, 0);font-size:16px;
font-family:times new roman, new york, times, serif;
background-color:transparent;font-style:normal;"><span>For rescoring, I use
the following command:</span></div>
<div style="color:rgb(0, 0, 0);font-size:16px;
font-family:times new roman, new york, times, serif;
background-color:transparent;font-style:normal;"><span>rescore-decipher
nbestfilelist new_rescored_nbestlist_dir -lm updated_lm</span></div>
</div>
</blockquote>
<br>
nbest-error computes the "N-best error rate", meaning the best
possible error rate that can be achieved by picking a hypothesis
from anywhere among the N best. This is sometimes called the
"oracle" error. It doesn't changed as a result of rescoring.<br>
<br>
What you probably want is the error rate of the highest-scoring
hypothesis. For this, you first extract the highest-scoring hyps
using the "rescore-reweight" command (see nbest-scripts(1) man
page), then you using your favorite WER scoring program. If you
have NIST sclite installed, you could use the compute-sclite
wrapper, which takes care of format differences.<br>
<br>
Andreas<br>
<br>
</div>
</div><br><br> </div> </div> </div></body></html>