Thanks Hieu for your reply. Is it possible to do a verbose output of what’s happening, so that I can identify when it’s going out of memory? I’m only running it for 1928 sentences. I have almost 170gb of free memory and additional 400gb memory in buffer.
Thanks, Jasneet > On Feb 12, 2016, at 2:36 PM, Hieu Hoang <[email protected]> wrote: > > looks like it's run out of memory. > > On 11/02/16 23:23, Jasneet Sabharwal wrote: >> Hi, >> >> I was adding a new feature function in Moses ( >> <https://github.com/KonceptGeek/mosesdecoder/blob/master/moses/FF/CoarseBiLM.cpp>https://github.com/KonceptGeek/mosesdecoder/blob/master/moses/FF/CoarseBiLM.cpp >> >> <https://github.com/KonceptGeek/mosesdecoder/blob/master/moses/FF/CoarseBiLM.cpp>). >> It works fine when I test it for 1-2 sentences, but when I’m trying to tune >> my parameters, I’m getting segmentation faults or sometimes it is bad_alloc. >> Following was one of the commands that was executed during the tuning >> process which caused the Segmentation Fault or bad_alloc: >> >> moses -threads 40 -v 0 -config filtered/moses.ini -weight-overwrite >> 'CoarseLM100= 0.075758 LM0= 0.075758 CoarseBiLMNotClustered= 0.075758 >> WordPenalty0= -0.151515 PhrasePenalty0= 0.030303 CoarseBiLMClustered= >> 0.075758 TranslationModel0= 0.030303 0.030303 0.030303 0.030303 Distortion0= >> 0.045455 CoarseLM1600= 0.075758 LexicalReordering0= 0.045455 0.045455 >> 0.045455 0.045455 0.045455 0.045455' -n-best-list run1.best100.out 100 >> distinct -input-file tune.word.lc.cn <http://tune.word.lc.cn/> >> >> The log is enclosed in this email. >> >> Any pointers would be very useful. >> >> Thanks, >> Jasneet >> >> >> >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] <mailto:[email protected]> >> http://mailman.mit.edu/mailman/listinfo/moses-support >> <http://mailman.mit.edu/mailman/listinfo/moses-support> > > -- > Hieu Hoang > http://www.hoang.co.uk/hieu <http://www.hoang.co.uk/hieu>
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
