<div dir="ltr">Dear all, <br>I'm using srilm on some data crawled from the Web. The lm contains some strange symbols as these:<br>\1-grams:<br>-6.774207 ^A 0<br>-6.774207 ^C<br>-6.774207 ^D<br>-6.774207 ^E 0<br>
-6.774207 ^F 0<br>-6.774207 ^G 0<br>-6.774207 ^H 0<br>-6.774207 ^K 0<br>-6.774207 ^N 0<br>-6.774207 ^O<br>-6.774207 ^P<br>-6.774207 ^T 0<br>-6.774207 ^X<br>
-6.774207 ^Y 0<br>-6.774207 ^\<br>-6.774207 ^]<br>-6.774207 ^^ 0<br>-6.774207 ^_<br><br>these symbols are not the simple combination of ^ and a letter but it seems to be something different as a character that has been truncated or something similar.<br>
Do u have an idea what they are and how to remove them?<br><br>thanks a lot<br>Marco<br></div>