Hi all,
I got
Epoch xxxx
Current learning rate: 1
Training minibatches: Validation log-likelihood: -nan
perplexity: nan
during bilingual neural lm training.
I use command:
/home/user/tools/nplm-master-rsennrich/src/trainNeuralNetwork --train_file
work_dir/blm/train.numberized --num_epochs 30 --model_prefix
work_dir/blm/train.10k.model.nplm --learning_rate 1 --minibatch_size 1000
--num_noise_samples 100 --num_hidden 2 --input_embedding_dimension 512
--output_embedding_dimension 192 --num_threads 6 --loss_function log
--activation_function tanh --validation_file work_dir/blm/valid.numberized
--validation_minibatch_size 10
where train.numberized and valid.numberized files are splitted from the
file generated by
script ${moses}/scripts/training/bilingual-lm/extract_training.py.
Training/Validation numbers are:
Number of training instances: 4128195
Number of validation instances: 217274
Thanks,
Jian
Jian Zhang
Centre for Next Generation Localisation (CNGL)
<http://www.cngl.ie/index.html>
Dublin City University <http://www.dcu.ie/>
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
