this means you have run out of memory. you can either:
--get more memory --use less data --use a lower-order LM --use RandLM, which can easily handle this amount of data (i am currently building LMs using more than 30 billion words with it for example) Miles On 21 April 2010 09:57, Zahurul Islam <[email protected]> wrote: > Hi, > I am trying to build a language model large amount text (13GB). In the step > of converting iARPA format to ARPA format i met following error: > > /tools/irstlm-5.22.01/bin/compile-lm wiki.it.truecase.ilm.gz --text yes > wiki.it.lm > inpfile: wiki.it.truecase.ilm.gz > dub: 10000000 > Reading wiki.it.truecase.ilm.gz... > iARPA > loadtxt() > terminate called after throwing an instance of 'std::bad_alloc' > what(): std::bad_alloc > /tools/irstlm-5.22.01/bin/compile-lm: line 9: 20328 Aborted > $dir/$name "$@" > Any help to identify|solve this problem will be appreciated. Thank you very > much. > Regards, > Zahurul > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
