I've forgotten that I've tested Moses2 with tuning multiple times during the testing for the previous release http://www.statmt.org/moses/RELEASE-4.0/Moses-v4.0-release-notes.pdf So you can use Moses2 in tuning without worry
Hieu Hoang http://moses-smt.org/ On 21 December 2017 at 11:48, Hieu Hoang <[email protected]> wrote: > The Moses2 page contains details on what you need to change for > lexicalised reordering > > http://www.statmt.org/moses/?n=Site.Moses2 > > Here are some tips in getting training & tuning to run faster > > http://www.statmt.org/moses/?n=Moses.Optimize > > Moses2 can output n-best list so can be used for tuning. However I've > never tried it so there might be problems. If you don't want to those > problems you're better off stick to Moses(1) > > On 21/12/17 09:31, Yasmin Moslem wrote: > > Many thanks, Hieu! > > So that worked perfectly. > > In moses.ini, I changed PhraseDictionaryMemory to ProbingPT and changed > its path to that of the output folder "integrated_phrase-reordering". > When I run moses2 (~/mosesdecoder/bin/moses2 -f moses.ini), it works > perfectly. > > > >>> You may also need to change line 'LexicalReordering' > > Do you mean the path or something else? I kept the same " > reordering-table.wbe-msd-bidirectional-fe.gz". I tried also to use " > reordering-table.minlexr" (/home/ubuntu/working/binarise > d-model/reordering-table) and it worked also. Which one should I use? > > > > Another question, please, is moses2 for translation only? Can it be used > for the Tuning phase to make it faster? Also, is there a way to make other > steps faster? Currently, they take a few days to finish. > > > Many thanks, > Yasmin > > > > > > > On 20 December 2017 at 14:33, Hieu Hoang <[email protected]> wrote: > >> In the moses.ini file, change the line >> [feature] >> PhraseDictionaryMemory..... >> to >> [feature] >> ProbingPT.... >> You may also need to change line 'LexicalReordering' >> >> For example, attached is my moses.ini file for moses2 >> >> Hieu Hoang >> http://moses-smt.org/ >> >> >> On 19 December 2017 at 11:38, Yasmin Moslem <[email protected]> >> wrote: >> >>> Hello! >>> >>> I tried to binarize the phrase table for Moses2 as follows: >>> >>> MOSES_DIR=~/mosesdecoder >>> >>> >>> $MOSES_DIR/scripts/generic/binarize4moses2.perl >>> --phrase-table=/home/ubuntu/working/train/model/phrase-table >>> .gz >>> --lex-ro=/home/ubuntu/working/train/model/reordering-table.wbe-msd-bidirectional-fe.gz >>> --output-dir=/home/ubuntu/working/integrated_phrase-reordering/ >>> --num-lex-scores=6 >>> >>> >>> >>> However, I got the following error: >>> >>> >> ERROR: compile contrib/sigtest-filter >>> >>> >>> >>> So I followed these steps to compile it with SALM: >>> >>> git clone https://github.com/moses-smt/salm >>> >>> >>> export CPLUS_INCLUDE_PATH=/home/ubuntu/mosesdecoder/opt/include >>> >>> export LIBRARY_PATH=/home/ubuntu/mosesdecoder/opt/lib >>> >>> >>> cd ~/salm/Distribution/Linux >>> >>> make >>> >>> >>> cd ~/mosesdecoder/contrib/sigtest-filter >>> >>> make SALMDIR=/home/ubuntu/salm >>> >>> >>> >>> Then, I ran the binarizing command above again. It worked fine and the >>> folder "integrated_phrase-reordering" was created. (By the way, I had to >>> restart the machine after compiling or I would get errors.) >>> >>> >>> >>> My question is: Now, what is the next step? Apparently, the change is >>> not reflected in moses.ini >>> >>> >>> >>> Many thanks, >>> >>> Yasmin >>> >>> >>> >>> >>> _______________________________________________ >>> Moses-support mailing list >>> [email protected] >>> http://mailman.mit.edu/mailman/listinfo/moses-support >>> >>> >> > > > _______________________________________________ > Moses-support mailing > [email protected]http://mailman.mit.edu/mailman/listinfo/moses-support > > > -- > Hieu Hoanghttp://moses-smt.org/ > >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
