On 11/12/14 08:52, Ben Ao wrote:
Dear all,
I was trained the tree-to-tree rule-table from Chinese to English.
The command I used to train the model is:
~/mosesdecoder/scripts/training/train-model.perl \
-external-bin-dir /share/apps/moses/gcc/giza-bin-dir \
-root-dir zct2t_en \
-corpus test.10.moses -f cn -e en \
-alignment grow-diag-final-and -source-syntax -target-syntax
-glue-grammar \
-lm 0:3:/home/ben/data/zc.blm.en:1
However, I find out the rule-table is very strange. Such as:
Brunel 可 能[VP][VP] ，[IP] ||| now brunel may have [VP][VP] , [TOP]
||| 0.499999 7.48437e-05 0.499999 0.0159349 2.718 ||| 0-0 0-1 1-2 1-3
2-4 3-5 ||| 0.166667 0.166667 0.0833333
CA： 我[VP][VBD] 。[IP] ||| ca : i [VP][VBD] . [TOP] ||| 0.5 0.15398
0.5 0.0413438 2.718 ||| 0-0 0-1 1-2 2-3 3-4 ||| 0.222222 0.222222 0.111111
Question 1: There contain 5 probabilities in the middle:
0.499999 7.48437e-05 0.499999 0.0159349 2.718
0.5 0.15398 0.5 0.0413438 2.718
The last part “2.718” is same in all rules of the rule-table, but what
it means?
all probabilities are transformed by the log() function before being
used by the decoder. log(2.718)=1.
It's really just a phrase-penalty, not a probability.
You are using a slightly old version of moses. In the current version,
the phrase-table does not have this number, it has been moved to its own
feature function
Question 2: What is meaning for the last part in the rule?
0.166667 0.166667 0.0833333
0.222222 0.222222 0.111111
It look like some probabilities, but what it means?
they are count, for debugging information. They don't affect decoding
I worked on this problem for a few weeks, and no idea of the
definition for the rule-table generated by tree-to-tree training.
Many and many thanks for solving those problem!!
Regards,
Ben
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
