My understanding is that part of the point is examining the full n-gram. There is no analogue to state minimization, but some recombination may be licensed by the small vocabulary of the model. In terms of efficiency, you might just want to carry the vocab ids instead of a hash.
I've made a treadsafe fork of their code at https://github.com/kpu/nplm . The idea is that you make a copy of neuralLM for each thread. Ashish Vaswani and David Chiang said they have their own threadsafe version; waiting for them to release it. Kenneth On 10/30/13 10:02, Hieu Hoang wrote: > an assumption made in the moses integration is that there is no backoff > state. Therefore, the state info is just a hash to the full ngram. Do > you think there is a better state info? > > > On 29 October 2013 15:48, Kenneth Heafield <[email protected] > <mailto:[email protected]>> wrote: > > Hi, > > I also feel obliged to point out that nplm aka NeuralLM is > currently > not threadsafe, but I have an open thread with Ashish on this point. > > Kenneth > > On 10/29/13 04:36, Hieu Hoang wrote: > > I just integrated Ashish Vaswani's Neural LM into the decoder, > based on > > code by Lane Schwartz. > > > > To compile Moses with the new LM, do > > ./bjam .... --with-nplm=[path/to/nplm] > > > > I don't know if it works yet, or know how to use it. You should read > > Ashish's paper and download his code > > http://nlg.isi.edu/software/nplm/ > > > > If you find out how to use it, please let us know! > > > > > > > > On 29 October 2013 02:28, Li Xiang <[email protected] > <mailto:[email protected]> > > <mailto:[email protected] <mailto:[email protected]>>> wrote: > > > > Hi, > > > > I just find the NeuralLM is added into the Moses. Could you > give me > > an example about the usage? Thanks. > > > > -- > > Xiang Li > > > > _______________________________________________ > > Moses-support mailing list > > [email protected] <mailto:[email protected]> > <mailto:[email protected] <mailto:[email protected]>> > > http://mailman.mit.edu/mailman/listinfo/moses-support > > > > > > > > > > -- > > Hieu Hoang > > Research Associate > > University of Edinburgh > > http://www.hoang.co.uk/hieu > > > > > > > > _______________________________________________ > > Moses-support mailing list > > [email protected] <mailto:[email protected]> > > http://mailman.mit.edu/mailman/listinfo/moses-support > > > _______________________________________________ > Moses-support mailing list > [email protected] <mailto:[email protected]> > http://mailman.mit.edu/mailman/listinfo/moses-support > > > > > -- > Hieu Hoang > Research Associate > University of Edinburgh > http://www.hoang.co.uk/hieu > _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
