looks fine to me. This is what I get when I used it to run
# $MOSES_DIR/bin/moses -f moses.ini -show-weights
....
LexicalReordering0= 0.300000 0.300000 0.300000 0.300000 0.300000 0.300000
Distortion0= 0.300000
UnknownWordPenalty0 UNTUNEABLE
WordPenalty0= -1.000000
PhrasePenalty0= 0.200000
TranslationModel0= 0.200000 0.200000 0.200000 0.200000
Double check that the moses.ini file you sent me is truly what you're using.
To be sure, you MUST use absolute paths for all file names, ie. not
binarised/moses-tm.ini
but
/media/bigdata/whatever/binarised/moses-tm.ini
On 13/01/16 14:16, Read, James C wrote:
#########################
### MOSES CONFIG FILE ###
#########################
# input factors
[input-factors]
0
# mapping steps
[mapping]
0 T 0
[distortion-limit]
6
# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4
path=/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/phrase-table
input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data/binarised/reordering-table
Distortion
# dense weights for feature functions
[weight]
# The default weights are NOT optimized for translation quality. You
MUST tune the weights.
# Documentation for tuning is here:
http://www.statmt.org/moses/?n=FactoredTraining.Tuning
UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3
/media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/mert-moses.pl
-no-filter-phrase-table ../tuning_data/true.bg ../tuning_data/true.en
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/moses
binarised/moses-tm.ini --mertdir
/media/bigdata/jcread/3rd_party_software/mosesdecoder/bin/
------------------------------------------------------------------------
*From:* Hieu Hoang <[email protected]>
*Sent:* Wednesday, January 13, 2016 2:05 PM
*To:* Read, James C
*Cc:* Moses Support
*Subject:* Re: [Moses-support] Tuning with no language model
please show me the EXACT moses.ini and command that you use.
Hieu Hoang
http://www.hoang.co.uk/hieu
On 13 January 2016 at 14:04, Read, James C <[email protected]
<mailto:[email protected]>> wrote:
So now I get the following error:
Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Loading Distortion0
Loading TranslationModel0
LM0
The following weights have no feature function. Maybe incorrectly
spelt weights: LM0,Exit code: 1
I didn't get this error without deleting LM0 line.
------------------------------------------------------------------------
*From:* Hieu Hoang <[email protected] <mailto:[email protected]>>
*Sent:* Wednesday, January 13, 2016 1:58 PM
*To:* Read, James C; Moses Support
*Subject:* Re: [Moses-support] Tuning with no language model
there lies your problem. There's a weight for a non-existant
feature function
On 13/01/16 13:57, Read, James C wrote:
no
------------------------------------------------------------------------
*From:* Hieu Hoang <[email protected]> <mailto:[email protected]>
*Sent:* Wednesday, January 13, 2016 1:56 PM
*To:* Read, James C; Moses Support
*Subject:* Re: [Moses-support] Tuning with no language model
did you delete the line
LM0= 0.5
too?
On 13/01/16 13:53, Read, James C wrote:
The following command works fine for when a language model is
specified. Deleting the line KENLM lazyken=0 name=LM0 factor=0
path=$PWD/blm.en order=3
causes the script to fail with error:
ERROR: Failed to run '/pathtomoses/mosesdecoder/bin/moses
-config /pathtodata/binarised/moses.ini -show-weights'. at
/pathtomoses/mosesdecoder/scripts/training/mert-moses.pl
<http://mert-moses.pl> line 1744.
#########################
### MOSES CONFIG FILE ###
#########################
# input factors
[input-factors]
0
# mapping steps
[mapping]
0 T 0
[distortion-limit]
6
# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4
path=/pathtodata/binarised/phrase-table input-factor=0
output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0
output-factor=0 path=/pathtodata/binarised/reordering-table
Distortion
KENLM lazyken=0 name=LM0 factor=0 path=/pathtodata/blm.en order=3
# dense weights for feature functions
[weight]
# The default weights are NOT optimized for translation quality.
You MUST tune the weights.
# Documentation for tuning is here:
<http://www.statmt.org/moses/?n=FactoredTraining.Tuning>http://www.statmt.org/moses/?n=FactoredTraining.Tuning
<http://www.statmt.org/moses/?n=FactoredTraining.Tuning>
Moses - FactoredTraining/Tuning
<http://www.statmt.org/moses/?n=FactoredTraining.Tuning>
www.statmt.org <http://www.statmt.org>
Tuning. Overview. During decoding, Moses scores translation
hypotheses using a linear model. In the traditional approach,
the features of the model are the ...
UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3
LM0= 0.5
/pathtomoses/mosesdecoder/scripts/training/mert-moses.pl
<http://mert-moses.pl> -no-filter-phrase-table true.fr
<http://true.fr> true.en /pathtomoses/mosesdecoder/bin/moses
binarised/moses.ini --mertdir /pathtomoses/mosesdecoder/bin/
--
Hieu Hoang
http://www.hoang.co.uk/hieu
--
Hieu Hoang
http://www.hoang.co.uk/hieu
--
Hieu Hoang
http://www.hoang.co.uk/hieu
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
