How big is "huge?" You can use build-lm.sh with the -k option to split the training job into smaller parts and conserve memory.
Moses with irstlm supports memory mapped irstlm files that reduces memory use during decoding. If these two techniques stretch your resources, you might consider using RandLM. Tom On Fri, 12 Nov 2010 09:27:26 +0400, Abbasov Samir <[email protected]> wrote: > Hi everyone, who can build huge LM with IRSTLM? > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
