Ken, I finally tested various combinations, and no solution to the segfault with rev 4036. My scripts now do not add the -i switch with build_binary when binarizing srilm models. Here are the results:
1) irstlm (build-lm.sh), binarized with compile-lm and decoded with irstlm - runs fine 2) irstlm (build-lm.sh), converted to arpa with compile-lm, binarized with build_binary -i, and decoded with KenLM (8 & 9) - runs fine 3) srilm (ngram-count), decoded with srilm - runs fine 4) srilm (ngram-count), binarized with build_binary (w/o -i) and decoded with KenLM (8 & 9) - fails with segfault. I'm ready to update my SVN revision when there's a good candidate for a solution. Regards, Tom On Fri, 29 Jul 2011 22:52:13 +0200, Alex Fraser <[email protected]> wrote: > Hi Kenneth -- > > Latest revision, 4096. Single threaded also crashes. > > Cheers, Alex > > > On Fri, Jul 29, 2011 at 6:00 PM, Kenneth Heafield > <[email protected]> wrote: >> Hi, >> >> There was a problem with this; thought it was fixed but maybe >> it came >> back. Which revision are you running? Does it still happen if you >> run >> single-threaded? >> >> Kenneth >> >> On 07/29/11 09:39, Alex Fraser wrote: >>> Hi Folks, >>> >>> Tom Hoar previously mentioned that he had a problem with KenLMs >>> built >>> from SRILM crashing Moses. >>> >>> Fabienne Cap and I also have had a problem with this. It seems to >>> be >>> restricted to using the trie option with build-binary. >>> >>> Ken, if you have any problems reproducing this, please let me know. >>> I >>> can send you a very small SRILM trained language model that crashes >>> moses when converted to binary with the trie option, but works fine >>> as >>> a probing binary and using the original ARPA. (BTW, this is running >>> the decoder multi-threaded and the crash comes at some point during >>> decoding the first sentence, not during loading files) >>> >>> Cheers, Alex >>> _______________________________________________ >>> Moses-support mailing list >>> [email protected] >>> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
