Hi, I have a tiny LM that is giving me some problems. The LM wasn't trained with any of the usual toolkits, so it may violate some assumptions that the KenLM code in Moses makes.
I'm able to successfully query the LM using bin/query, but when I use the LM within Moses I get the following error: Reading dd_lm0.arpa > > ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 > > **************************************************************************************************** > mosesserver: lm/model.cc:250: lm::FullScoreReturn > lm::ngram::detail::GenericModel<Search, > VocabularyT>::ScoreExceptBackoff(const WordIndex*, const WordIndex*, > lm::WordIndex, lm::ngram::State&) const [with Search = > lm::ngram::detail::HashedSearch<lm::ngram::BackoffValue>; VocabularyT = > lm::ngram::ProbingVocabulary; lm::WordIndex = unsigned int]: Assertion > `new_word < vocab_.Bound()' failed. And here's the LM: \data\ > ngram 1=22 > ngram 2=21 > \1-grams: > 0 . -99 > 0 : -99 > 0 </s> -99 > -99 <s> -99 > -99 <unk> > -4.30102999566 a -99 > -5.00005 affect > 0 certain -99 > -4.30102999566 have -99 > -4.30102999566 impact -99 > 0 is -99 > -4.30102999566 negative -99 > -5.00005 negatively > 0 new -99 > -4.30102999566 on -99 > 0 one -99 > 0 provisions -99 > 0 the -99 > 0 these -99 > 0 thing -99 > 0 turnout -99 > 0 will -99 > \2-grams: > 0 . </s> > 0 : these > 0 <s> one > -4.30102999566 a negative > -5.00005 affect negatively > 0 certain : > -4.30102999566 have a > -4.30102999566 impact on > 0 is certain > -4.30102999566 negative impact > -5.00005 negatively the > 0 new provisions > -4.30102999566 on the > 0 one thing > 0 provisions will > 0 the turnout > 0 these new > 0 thing is > 0 turnout . > -5.00005 will affect > -4.30102999566 will have > \end\
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
