I'm the one who wrote that code. I don't remember off hand exactly what was necessary, but I believe that I left notes in the git commit log. Somewhere in my archives I think I have the actual scripts that I used, but I don't have those easily accessible right now. I'll try to find them.
In the meantime, the best way to figure it out is to run git log within the moses repo, and search for all mentioned of the word "backward". That will show you my commits. I did create unit tests for the backward LM, so I would advise looking at the unit tests. I have checked in a trained backward LM. I believe it's a backward trigram model trained on the text of the GNU GPL license file. That file is in the moses repo at moses/LM/backward.arpa. There is a corresponding unit test at moses/LM/BackwardTest.cpp that tests the correctness of the code when querying moses/LM/backward.arpa for certain specific n-grams. I suspect that looking at those two files should be sufficient to answer your questions. If it's not, let me know and I can spend some time digging through my old archived files. On Thu, Mar 10, 2016 at 3:33 PM, Michael Denkowski < [email protected]> wrote: > Hi Moses LM enthusiasts, > > This may be a silly question. If I want to use the BackwardLanguageModel > feature, what (if anything) should I do to let KenLM know that it's a > backward model? > > If I just reverse the words in each sentence and run lmplz/build_binary, > will Moses do the right thing with the model? Do I need to do anything > special with <s> and </s>? > > Best, > Michael > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > -- When a place gets crowded enough to require ID's, social collapse is not far away. It is time to go elsewhere. The best thing about space travel is that it made it possible to go elsewhere. -- R.A. Heinlein, "Time Enough For Love"
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
