Dear All, I am having some troubles with the the binarisation of a POS language model
It was successfully compiled into an arpa file. As a run the command : /home/Moses/mosesdecoder/bin/build_binary -i lm.pos.arpa lm.pos.blm I'm getting the following message : lm/search_hashed.cc:276 in void lm::ngram::detail::HashedSearch<Value>::ApplyBuild(util::FilePiece&, const std::vector<long unsigned int, std::allocator<long unsigned int> >&, const lm::ngram::Config&, const lm::ngram::ProbingVocabulary&, lm::PositiveProbWarn&, const Build&) [with Build = lm::ngram::NoRestBuild, Value = lm::ngram::BackoffValue] threw util::ProbingSizeException'. Avoid pruning n-grams like "bar baz quux" when "foo bar baz quux" is still in the model. KenLM will work when this pruning happens, but the probing model assumes these events are rare enough that using blank space in the probing hash table will cover all of them. Increase probing_multiplier (-p to build_binary) to add more blank spaces. Byte: 16380 File: lm.pos.arpa ERROR Any help will be appreciated Thank you Kind Regards Jean E.
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
