Re: [Moses-support] after tuning UnknownWordPenalty parameter is missing

2016-09-22 Thread Hieu Hoang 
the unknown word penalty is not tuned so the mert script ignores it. It 
has a default weight (1 i think).

you can make it tuneable like this

   [feature]

   UnknownWordPenalty tuneable=true


___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] after tuning UnknownWordPenalty parameter is missing

2016-09-20 Thread Dimitar Shterionov 
Hello,

I am trying to tune an engine using mert. I run the mert-moses.pl script
without filtering (i.e., --no-filter-phrase-table). At the end I use
substitute-weights.perl to have a new ini file.

I noticed that in the new ini file I don't have the UnknownWordPenalty
paramter. The original file looks like this (some lines omitted):

...
# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
...

# dense weights for feature functions
[weight]
UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3
LM0= 0.5



And the new ini file looks like this:
...
# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
...

...
[weight]
LexicalReordering0= 0.0762169 0.00608827 0.0268392 0.123948 0.0511544
0.127807
Distortion0= 0.0304069
LM0= 0.0635183
WordPenalty0= -0.268702
PhrasePenalty0= 0.0536959
TranslationModel0= 0.0525019 0.0459397 0.000797115 0.0723839


Does anyone have any idea why is the UnknownWordPenalty missing?

Thank you for your support.

Kind regards,
Dimitar.
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support