Hello Zahurul, Have you tried the latest release of IRSTLM? It is currently at 5.40.01 which is available from here:
http://hlt.fbk.eu/en/irstlm Updates since 5.22 are: B.10 Version 5.30 *Support for a safe management of LMs with a total amount of n-grams larger than 250 million* Use of a new parameter to specify a directory for temporary computation because the default (”/tmp”) could be too small Improved a safer method of concatenation of gzipped sub lms Improved management of log files B.11 Version 5.40 Merging of internal-only tlm code into the public version Updated documentation into the public version Included documentation into the public version Kind regards, Lee Ball Infrastructure Manager lee.b...@appliedlanguage.com Applied Language Solutions High quality language solutions delivered on time ...with a smile! www.appliedlanguage.com Tel (UK): +44 (0)845 367 7000 Tel (US): +1 (800) 579-5010 Riverside Court, Huddersfield Road, Delph, Oldham, OL3 5FZ. UK Registered in the UK 5122429 Pride in everything we do | Respect everyone like a friend Think of the environment; please don't print this e-mail unless you really need to. On 21 April 2010 09:57, Zahurul Islam <zai...@gmail.com> wrote: > Hi, > I am trying to build a language model large amount text (13GB). In the step > of converting iARPA format to ARPA format i met following error: > > /tools/irstlm-5.22.01/bin/compile-lm wiki.it.truecase.ilm.gz --text yes > wiki.it.lm > inpfile: wiki.it.truecase.ilm.gz > dub: 10000000 > Reading wiki.it.truecase.ilm.gz... > iARPA > loadtxt() > terminate called after throwing an instance of 'std::bad_alloc' > what(): std::bad_alloc > /tools/irstlm-5.22.01/bin/compile-lm: line 9: 20328 Aborted > $dir/$name "$@" > > Any help to identify|solve this problem will be appreciated. Thank you very > much. > > Regards, > Zahurul > > _______________________________________________ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support > >
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
