Hi all, Small correction: --dropout isn't on Github (yet). I never got gains from it, and thus didn't commit. I'll have to double-check my implementation.
--input_dropout also didn't give me any gains, but could make training more stable (helping against nan), and is helpful if you want to get probabilities with incomplete context (say, if you have a 5-gram nplm and want to score a bigram. This is common in hiero decoding). Best wishes, Rico Sent from my Hitchhiker's guide -------- Original Message -------- From:Barry Haddow <[email protected]> Sent:Mon, 21 Sep 2015 08:58:16 +0100 To:Nikolay Bogoychev <[email protected]>,jian zhang <[email protected]> Cc:[email protected] Subject:Re: [Moses-support] Blingual neural lm, log-likelihood: -nan >The University of Edinburgh is a charitable body, registered in >Scotland, with registration number SC005336. > >_______________________________________________ >Moses-support mailing list >[email protected] >http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
