You can edit the moses.ini file and replace IRSTLM with KENLM which is built into Moses.
Next time when you train a moses system, do this: .../train-model.perl -lm 0:5:lm-path:*8* rather than .../train-model.perl -lm 0:5:lm-path:*1* Hieu Hoang http://moses-smt.org/ On 10 December 2017 at 08:26, Shikhar Jaiswal <[email protected]> wrote: > Here is the output I get: > > shikhar@shikhar-XPS-15-9560:~/set_eng_to_hindi/mert-work$ > ~/mosesdecoder/bin/moses -config filtered/moses.ini -show-weights > Defined parameters (per moses.ini or switch): > config: filtered/moses.ini > distortion-limit: 6 > feature: UnknownWordPenalty WordPenalty PhrasePenalty > PhraseDictionaryMemory name=TranslationModel0 num-features=4 > path=/home/shikhar/set_eng_to_hindi/mert-work/filtered/phrase-table.0-0.1.1.gz > input-factor=0 output-factor=0 LexicalReordering name=LexicalReordering0 > num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 > output-factor=0 path=/home/shikhar/set_eng_to_hindi/mert-work/filtered/ > reordering-table.wbe-msd-bidirectional-fe.0-0.1 Distortion IRSTLM > name=LM0 factor=0 > path=/home/shikhar/set_eng_to_hindi/lm/corpora_train.lm.arpa.binary > order=3 > input-factors: 0 > mapping: 0 T 0 > show-weights: > weight: UnknownWordPenalty0= 1 WordPenalty0= -1 PhrasePenalty0= 0.2 > TranslationModel0= 0.2 0.2 0.2 0.2 LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 > 0.3 Distortion0= 0.3 LM0= 0.5 > line=UnknownWordPenalty > FeatureFunction: UnknownWordPenalty0 start: 0 end: 0 > line=WordPenalty > FeatureFunction: WordPenalty0 start: 1 end: 1 > line=PhrasePenalty > FeatureFunction: PhrasePenalty0 start: 2 end: 2 > line=PhraseDictionaryMemory name=TranslationModel0 num-features=4 > path=/home/shikhar/set_eng_to_hindi/mert-work/filtered/phrase-table.0-0.1.1.gz > input-factor=0 output-factor=0 > FeatureFunction: TranslationModel0 start: 3 end: 6 > line=LexicalReordering name=LexicalReordering0 num-features=6 > type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 > path=/home/shikhar/set_eng_to_hindi/mert-work/filtered/ > reordering-table.wbe-msd-bidirectional-fe.0-0.1 > Initializing Lexical Reordering Feature.. > FeatureFunction: LexicalReordering0 start: 7 end: 12 > line=Distortion > FeatureFunction: Distortion0 start: 13 end: 13 > line=IRSTLM name=LM0 factor=0 path=/home/shikhar/set_eng_to_ > hindi/lm/corpora_train.lm.arpa.binary order=3 > Exception: moses/FF/Factory.cpp:390 in void > Moses::FeatureRegistry::Construct(const > string&, const string&) threw UnknownFeatureException because `i == > registry_.end()'. > Feature name IRSTLM is not registered. > > I am also attaching the script I'm using to run this. I'm using factory > KenLM but still the .ini file is registering IRSTLM? > > On Sun, Dec 10, 2017 at 2:26 AM, Hieu Hoang <[email protected]> wrote: > >> also, can you please attach the file >> >> filtered/moses.ini >> so i can see whats happening >> >> >> On 09/12/17 20:55, Hieu Hoang wrote: >> >>> what is the error when you run >>> >>> /home/shikhar/mosesdecoder/bin/moses -config filtered/moses.ini >>> -show-weights >>> >>> ? >>> >>> >> -- >> Hieu Hoang >> http://moses-smt.org/ >> >> >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
