Dear Phi, Thanks for the note on the weights and the prob vs log prob!
Regards, Nat On Thu, Oct 13, 2016 at 5:17 AM, Philipp Koehn <p...@jhu.edu> wrote: > Hi, > > the numbers in the (text) phrase table are raw probability, but Moses > internally uses log-probabilites, so the weights are used as: > > weight * log(phrase-table-prob) > > which is equivalent to > > log( phrase-table-prob ^ weight) > > -phi > > > On Wed, Oct 12, 2016 at 5:59 AM, Nat Gillin <nat.gil...@gmail.com> wrote: > >> Dear Moses community, >> >> One more question on the numbers in the phrase-table and moses.ini. >> >> Assuming that the numbers in the phrase-table are probabilities (not yet >> log) If i were to multiply the weights from moses.ini to the phrase-table, >> would it be: >> >> log(weight * phrase-tabe-prob) >> >> >> or >> >> weight * log(phrase-table-prob) >> >> >> >> Considering that the decoder later do an argmax, i guess the value >> doesn't really matter. But it'll be good to know if its log after >> multiplying the weights or weights multiplied by the log. >> >> Regards, >> Nat >> >> On Wed, Oct 12, 2016 at 4:48 PM, Nat Gillin <nat.gil...@gmail.com> wrote: >> >>> Dear Moses community, >>> >>> After training the model with train-model.pl, I have got several files >>> from the model. >>> >>> Are the numbers in the phrase-table.gz probabilities or log prob? They >>> look like probabiltiites (ranging from 0-1), but I would like to confirm >>> it. Is that also the same for the >>> reordering-table.wbe-msd-bidirectional-fe.gz >>> ? >>> >>> And as for the weights in moses.ini after MERT, are they also raw >>> probabilities or log probabilities? >>> >>> Thanks in advance for the information! >>> >>> Regards, >>> Nat >>> >> >> >> _______________________________________________ >> Moses-support mailing list >> Moses-support@mit.edu >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> >
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
