Hi Mauro
You can set the language model type by adding a line of the form "type =
1" to the LM stanza
cheers - Barry
On 26/07/12 16:18, Mauro Zanotti wrote:
Dear all,
I did some experiments and I get always the following error
ERROR:Language model type unknown. Probably not compiled into library
ERROR:no LM created. We probably don't have it compiled
this happens in TUNING-tune and in EVALUATION-decode phases, because
in the used ini files (e.g. tuning/moses.filtered.ini.6 and
evaluation/testset.filtered.ini.7) the file type of the language model
is set to 0 instead 1 (I use IrstLM).
The created moses.ini file contains the following rows
# language models: type(srilm/irstlm), factors, order, file
[lmodel-file]
0 0 5 /opt/tools/moses/scripts/ems/example/ex9wabis/lm/lm-en.lm.1
If I manually correct the type and I run again the experiment all
works fine.
Below you can find the LM section of the experiment config file.
How can I fix the problem?
Thank you in advance
Mauro
#################################################################
# LANGUAGE MODEL TRAINING
[LM]
### tool to be used for language model training
# srilm
#lm-training = $srilm-dir/ngram-count
#settings = "-interpolate -kndiscount -unk"
# irstlm
lm-training = "$moses-script-dir/generic/trainlm-irst.perl -cores
$cores -irst-dir $irstlm-dir -temp-dir $working-dir/lm"
settings = ""
# order of the language model
order = 5
### tool to be used for training randomized language model from scratch
# (more commonly, a SRILM is trained)
#
#rlm-training = "$moses-src-dir/randlm/bin/buildlm -falsepos 8 -values 8"
### script to use for binary table format for irstlm or kenlm
# (default: no binarization)
# irstlm
# lm-binarizer = $irstlm-dir/compile-lm
# kenlm, also set type to 8
#lm-binarizer = $moses-bin-dir/build_binary
#type = 8
### script to create quantized language model format (irstlm)
# (default: no quantization)
#
# lm-quantizer = $irstlm-dir/quantize-lm
### script to use for converting into randomized table format
# (default: no randomization)
#
#lm-randomizer = "$randlm-dir/buildlm -falsepos 8 -values 8"
### each language model to be used has its own section here
[LM:lm-en]
raw-corpus =
/opt/tools/moses/scripts/ems/example/data/lm/lm-en.$output-extension
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
