The Moses2 page contains details on what you need to change for
lexicalised reordering
http://www.statmt.org/moses/?n=Site.Moses2
Here are some tips in getting training & tuning to run faster
http://www.statmt.org/moses/?n=Moses.Optimize
Moses2 can output n-best list so can be used for tuning. However I've
never tried it so there might be problems. If you don't want to those
problems you're better off stick to Moses(1)
On 21/12/17 09:31, Yasmin Moslem wrote:
Many thanks, Hieu!
So that worked perfectly.
In moses.ini, I changed PhraseDictionaryMemory to ProbingPT and
changed its path to that of the output folder
"integrated_phrase-reordering". When I run moses2
(~/mosesdecoder/bin/moses2 -f moses.ini), it works perfectly.
>>> You may also need to change line 'LexicalReordering'
Do you mean the path or something else? I kept the same
"reordering-table.wbe-msd-bidirectional-fe.gz". I tried also to use
"reordering-table.minlexr"
(/home/ubuntu/working/binarised-model/reordering-table) and it worked
also. Which one should I use?
Another question, please, is moses2 for translation only? Can it be
used for the Tuning phase to make it faster? Also, is there a way to
make other steps faster? Currently, they take a few days to finish.
Many thanks,
Yasmin
On 20 December 2017 at 14:33, Hieu Hoang <[email protected]
<mailto:[email protected]>> wrote:
In the moses.ini file, change the line
[feature]
PhraseDictionaryMemory.....
to
[feature]
ProbingPT....
You may also need to change line 'LexicalReordering'
For example, attached is my moses.ini file for moses2
Hieu Hoang
http://moses-smt.org/
On 19 December 2017 at 11:38, Yasmin Moslem
<[email protected] <mailto:[email protected]>> wrote:
Hello!
I tried to binarize the phrase table for Moses2 as follows:
MOSES_DIR=~/mosesdecoder
$MOSES_DIR/scripts/generic/binarize4moses2.perl
--phrase-table=/home/ubuntu/working/train/model/phrase-table.gz
--lex-ro=/home/ubuntu/working/train/model/reordering-table.wbe-msd-bidirectional-fe.gz
--output-dir=/home/ubuntu/working/integrated_phrase-reordering/
--num-lex-scores=6
However, I got the following error:
>> ERROR: compile contrib/sigtest-filter
So I followed these steps to compile it with SALM:
git clone https://github.com/moses-smt/salm
<https://github.com/moses-smt/salm>
export CPLUS_INCLUDE_PATH=/home/ubuntu/mosesdecoder/opt/include
export LIBRARY_PATH=/home/ubuntu/mosesdecoder/opt/lib
cd ~/salm/Distribution/Linux
make
cd ~/mosesdecoder/contrib/sigtest-filter
make SALMDIR=/home/ubuntu/salm
Then, I ran the binarizing command above again. It worked fine
and the folder "integrated_phrase-reordering" was created. (By
the way, I had to restart the machine after compiling or I
would get errors.)
My question is: Now, what is the next step? Apparently, the
change is not reflected in moses.ini
Many thanks,
Yasmin
_______________________________________________
Moses-support mailing list
[email protected] <mailto:[email protected]>
http://mailman.mit.edu/mailman/listinfo/moses-support
<http://mailman.mit.edu/mailman/listinfo/moses-support>
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
--
Hieu Hoang
http://moses-smt.org/
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
