Hey IRST, why are you generating positive log probabilities? I'll have to fix the error message to print the number 4 instead of ASCII value 4.
On 01/06/11 04:13, [email protected] wrote: > I've been using IRSTLM's build-lm.sh to build an LM. Then converted from > iARPA to ARPA with compile-lm --text yes. On a recent data set, I > encountered the following exception with KenLM's build_binary on the > resulting ARPA file: > > > > Reading cased.irstlm.arpa > ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 > ***********************terminate called after throwing an instance of > 'lm::FormatLoadException' > what(): Positive probability 4.00956e-08 in the -gram at byte > 46366584 in file cased.irstlm.arpa > Aborted > > > > build_binary is successful with almost exactly the same data set in > lower case. > > Any ideas? > > Tom > > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
