What architecture are you on? 64-bit x86? I'm assuming you compiled 64-bit.
Could you send me either the ARPA or a tarball of the temporary building directory snapshotted by hitting ctrl+c in while the second progress bar is running? I've sent you off-list instructions on how transfer a file to me. On 02/09/11 04:14, Kārlis Goba wrote: > I'm encountering a bus error while building a trie KenLM: > > $ build_binary -m 4096 trie lm-pruned.arpa lm-pruned.mmap > Reading lm-pruned.arpa > ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 > **************************************************************************************************** > Counting n-grams that should not have been pruned > ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 > **************************************************************************************************** > Building trie > ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 > *******************************************************************Bus error > > The ARPA LM file is 13G in size with the following n-gram counts: > > ngram 1= 281277 > ngram 2= 24981586 > ngram 3= 116033104 > ngram 4= 146285904 > ngram 5= 94016017 > > I'm using Moses revision 3873. The ARPA LM was estimated and pruned with > IRSTLM 5.50.02. Similarly built LMs with similar size (15G) were converted to > KenLM without problems. > > Regards, > Karlis > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
