Hi list,

I swapped the score and alignment column of the phrase table halves in
commit 01bc3c1. The format of the final phrase table is not affected. If you
know of any side effects (such as downstream software that relies on the
column order in the phrase table halves), please complain here. 

We recently found a bug with hierarchical/syntactic models that had multiple
rules with the same source and target phrase, but different non-terminal
alignments. The current implementation does not guarantee that the order of
such rules is the same in both phrase table halves, and may cause the scores
of two rules to be swapped.

To ensure that the rules are sorted in the same order in both halves (and
can be consolidated), the scorer now writes the alignment info to both
phrase table halves (for hierarchical models), and puts the alignment before
the scores.

While the change is only important for hierarchical/syntactic models, I
applied it to all models for consistency.

-
Rico

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to