Hi Koormoosh, lmplz is looking for training data from stdin instead of a normal file. Make sure the command-line argument structure is correct. lmplz prints out the arpa file to stdout, so redirect it as: bin/lmplz -o 2 training.data > training.arpa
or alternatively: bin/lmplz -o 2 < training.data > training.arpa Best, -Jon On Mon, Feb 23, 2015 at 1:34 PM, koormoosh <[email protected]> wrote: > I am doing some experiment with KenLM over a few GBs of text: > > bin/lmplz -o 2 training.data training.arpa > > It somehow gives the following message and gets stuck > > === 1/5 Counting and sorting n-grams === > File /dev/pts/1 isn't normal. Using slower read() instead of mmap(). No > progress bar. > > What does it mean by /dev/pts/1 not being normal and why is it actually > looking at that directory? > > Thanks, > Koorm > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > On Mon, Feb 23, 2015 at 1:34 PM, koormoosh <[email protected]> wrote: > I am doing some experiment with KenLM over a few GBs of text: > > bin/lmplz -o 2 training.data training.arpa > > It somehow gives the following message and gets stuck > > === 1/5 Counting and sorting n-grams === > File /dev/pts/1 isn't normal. Using slower read() instead of mmap(). No > progress bar. > > What does it mean by /dev/pts/1 not being normal and why is it actually > looking at that directory? > > Thanks, > Koorm > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
