I'm encountering a bus error while building a trie KenLM: $ build_binary -m 4096 trie lm-pruned.arpa lm-pruned.mmap Reading lm-pruned.arpa ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 **************************************************************************************************** Counting n-grams that should not have been pruned ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 **************************************************************************************************** Building trie ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 *******************************************************************Bus error
The ARPA LM file is 13G in size with the following n-gram counts: ngram 1= 281277 ngram 2= 24981586 ngram 3= 116033104 ngram 4= 146285904 ngram 5= 94016017 I'm using Moses revision 3873. The ARPA LM was estimated and pruned with IRSTLM 5.50.02. Similarly built LMs with similar size (15G) were converted to KenLM without problems. Regards, Karlis _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
