Hi all, Small correction: --dropout isn't on Github (yet). I never got gains from it, and thus didn't commit. I'll have to double-check my implementation.
--input_dropout also didn't give me any gains, but could make training more stable (helping against nan), and is helpful if you want to get probabilities with incomplete context (say, if you have a 5-gram nplm and want to score a bigram. This is common in hiero decoding). Best wishes, Rico Sent from my Hitchhiker's guide -------- Original Message -------- From:Barry Haddow <bhad...@staffmail.ed.ac.uk> Sent:Mon, 21 Sep 2015 08:58:16 +0100 To:Nikolay Bogoychev <nhe...@gmail.com>,jian zhang <zha...@computing.dcu.ie> Cc:moses-support@mit.edu Subject:Re: [Moses-support] Blingual neural lm, log-likelihood: -nan >The University of Edinburgh is a charitable body, registered in >Scotland, with registration number SC005336. > >_______________________________________________ >Moses-support mailing list >Moses-support@mit.edu >http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
