Hi, I have a large language model from the common crawl data set and it takes forever to load when running moses. My model is a trigram kenlm binarized with quantization, trie structures and pointer compression (-a 22 -q 8 -b 8). The model is about 140GB and it takes hours to load (I’m still waiting). I run on a machine with 256GB RAM ...
I also tried lazy loading without success. Is this normal or do I do something wrong? Thanks for your help! Jörg
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
