Hello John and Phillip, thank you very much for your responses. Indeed it was snt2cooc that was causing the trouble. I tried with --parts 3 and setting -max-phrase-length to 4 and it seems to have worked fine. I would try with the same value for --parts and using the default value for max-phrase-length.
It is amazing to see how beautifully it works. Thanks for bringing moses to the community!! Regards, Niraj Thank you very much Philipp Koehn wrote: > Hi, > > if snt2cooc is causing trouble, I suggest to run the training > script with the additional option "--parts 4", which splits up > the data for snt2cooc. > > -phi > > On Mon, Mar 29, 2010 at 2:43 PM, John Burger <[email protected]> wrote: > >>> C:\cygwin\home\moses\tools\bin\snt2cooc.out: *** fatal error - cmalloc >>> would have returned NULL >>> ========= >>> >>> Am I running short of RAM? >>> >> Yes - malloc is failing to get more memory. FWIW, I run phrase >> extraction on a machine with 66G, but that's probably more than is >> necessary. You could try extracting shorter phrases - I think the >> default is 7, so you could try this: >> >> train-factored-phrase-model.perl ... --max-phrase-length 4 >> >> - John D. Burger >> MITRE >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
