[Moses-support] Blingual neural lm, log-likelihood: -nan

Hi all, I got Epoch Current learning rate: 1 Training minibatches: Validation log-likelihood: -nan perplexity: nan during bilingual neural lm training. I use command: /home/user/tools/nplm-master-rsennrich/src/trainNeuralNetwork --train_file work_dir/blm/train.numberized --n

Re: [Moses-support] (no subject)

Hi Sanjanasri, we have seen improvements in BLEU from having both KENLM and NPLM in our system. Things can go wrong during training though (e.g. a bad choice of hyperparameters (vocabulary size, number of training epochs)). I recommend using a development set during NPLM training, and comparin

Re: [Moses-support] Confidence weights for parallel corpus

Hi Anoop, I am not aware of how to incorporate quality score of parallel sentence during SMT training. But, you may think to create 2 parallel corpus (PC): PC1: Select all source sentence with their best translated sentence (let's say in-domain) PC2: Rest of the translation with their source sente

[Moses-support] Compact Phrase Table

Dear all, I also tried to binarize the phrase table following this http://www.statmt.org/moses/?n=Advanced.RuleTables#ntoc3, and compilation with moses is done succesfully. But. when i run processPhraseTableMin -threads 3 -in train/model/phrase-table.gz -nscores 4 -out binarised-model/phrase-tabl

[Moses-support] OD: Compact Phrase Table

Hi, are you sure that your output path exists?--Sent from my phone Wiadomość oryginalna Temat: [Moses-support] Compact Phrase TableOd: Sanjanashree Palanivel Do: moses-support@mit.eduDW: Dear all,I also tried to binarize the phrase table following this http://www.statmt.org/moses/?n

[Moses-support] Kendall's tau metric

Hi everyone I'm testing a reordering model for hierarchical moses. I want to interpolate bleu with kendall's tau permutation distance and use it as my tuning metric. can anyone help me how to do this? Regards -- *Email Disclaimer"This e-mail and any files transmitted with it are confidentia