Hi Hieu! Great! I am going to try this. Also, will try to binarize before tuning.
Many thanks! Kind regards, Yasmin On 23 December 2017 at 14:28, Hieu Hoang <[email protected]> wrote: > I've forgotten that I've tested Moses2 with tuning multiple times during > the testing for the previous release > http://www.statmt.org/moses/RELEASE-4.0/Moses-v4.0-release-notes.pdf > So you can use Moses2 in tuning without worry > > Hieu Hoang > http://moses-smt.org/ > > > On 21 December 2017 at 11:48, Hieu Hoang <[email protected]> wrote: > >> The Moses2 page contains details on what you need to change for >> lexicalised reordering >> >> http://www.statmt.org/moses/?n=Site.Moses2 >> >> Here are some tips in getting training & tuning to run faster >> >> http://www.statmt.org/moses/?n=Moses.Optimize >> >> Moses2 can output n-best list so can be used for tuning. However I've >> never tried it so there might be problems. If you don't want to those >> problems you're better off stick to Moses(1) >> >> On 21/12/17 09:31, Yasmin Moslem wrote: >> >> Many thanks, Hieu! >> >> So that worked perfectly. >> >> In moses.ini, I changed PhraseDictionaryMemory to ProbingPT and changed >> its path to that of the output folder "integrated_phrase-reordering". >> When I run moses2 (~/mosesdecoder/bin/moses2 -f moses.ini), it works >> perfectly. >> >> >> >>> You may also need to change line 'LexicalReordering' >> >> Do you mean the path or something else? I kept the same " >> reordering-table.wbe-msd-bidirectional-fe.gz". I tried also to use " >> reordering-table.minlexr" (/home/ubuntu/working/binarise >> d-model/reordering-table) and it worked also. Which one should I use? >> >> >> >> Another question, please, is moses2 for translation only? Can it be used >> for the Tuning phase to make it faster? Also, is there a way to make other >> steps faster? Currently, they take a few days to finish. >> >> >> Many thanks, >> Yasmin >> >> >> >> >> >> >> On 20 December 2017 at 14:33, Hieu Hoang <[email protected]> wrote: >> >>> In the moses.ini file, change the line >>> [feature] >>> PhraseDictionaryMemory..... >>> to >>> [feature] >>> ProbingPT.... >>> You may also need to change line 'LexicalReordering' >>> >>> For example, attached is my moses.ini file for moses2 >>> >>> Hieu Hoang >>> http://moses-smt.org/ >>> >>> >>> On 19 December 2017 at 11:38, Yasmin Moslem <[email protected]> >>> wrote: >>> >>>> Hello! >>>> >>>> I tried to binarize the phrase table for Moses2 as follows: >>>> >>>> MOSES_DIR=~/mosesdecoder >>>> >>>> >>>> $MOSES_DIR/scripts/generic/binarize4moses2.perl >>>> --phrase-table=/home/ubuntu/working/train/model/phrase-table >>>> .gz >>>> --lex-ro=/home/ubuntu/working/train/model/reordering-table.wbe-msd-bidirectional-fe.gz >>>> --output-dir=/home/ubuntu/working/integrated_phrase-reordering/ >>>> --num-lex-scores=6 >>>> >>>> >>>> >>>> However, I got the following error: >>>> >>>> >> ERROR: compile contrib/sigtest-filter >>>> >>>> >>>> >>>> So I followed these steps to compile it with SALM: >>>> >>>> git clone https://github.com/moses-smt/salm >>>> >>>> >>>> export CPLUS_INCLUDE_PATH=/home/ubuntu/mosesdecoder/opt/include >>>> >>>> export LIBRARY_PATH=/home/ubuntu/mosesdecoder/opt/lib >>>> >>>> >>>> cd ~/salm/Distribution/Linux >>>> >>>> make >>>> >>>> >>>> cd ~/mosesdecoder/contrib/sigtest-filter >>>> >>>> make SALMDIR=/home/ubuntu/salm >>>> >>>> >>>> >>>> Then, I ran the binarizing command above again. It worked fine and the >>>> folder "integrated_phrase-reordering" was created. (By the way, I had to >>>> restart the machine after compiling or I would get errors.) >>>> >>>> >>>> >>>> My question is: Now, what is the next step? Apparently, the change is >>>> not reflected in moses.ini >>>> >>>> >>>> >>>> Many thanks, >>>> >>>> Yasmin >>>> >>>> >>>> >>>> >>>> _______________________________________________ >>>> Moses-support mailing list >>>> [email protected] >>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>> >>>> >>> >> >> >> _______________________________________________ >> Moses-support mailing >> [email protected]http://mailman.mit.edu/mailman/listinfo/moses-support >> >> >> -- >> Hieu Hoanghttp://moses-smt.org/ >> >> >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
