This succeeds: [weight] UnknownWordPenalty0= 1
Whereas these fail, and with different errors (other related examples attached:
[weight] UnknownWordPenalty0=1 (run0.moses.3.ini.log) [weight] UnknownWordPenalty0 = 1 (run0.moses.3a.ini.log)
Defined parameters (per moses.ini or switch): config: run0.moses.3.ini distortion-limit: 6 feature: UnknownWordPenalty WordPenalty PhrasePenalty PhraseDictionaryMemory name=TranslationModel0 num-features=4 path=/opt/domt/TRAININGS/smt/tm-en_gb-nl_nl-micro_tm/domt-s=nl_nl-t=en_gb-p=micro_tm-a=giza_grow-diag-final-and-g=3/phrase-table.gz input-factor=0 output-factor=0 LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/opt/domt/TRAININGS/smt/tm-en_gb-nl_nl-micro_tm/domt-s=nl_nl-t=en_gb-p=micro_tm-a=giza_grow-diag-final-and-g=3/reordering-table.wbe-msd-bidirectional-fe.gz Distortion KENLM lazyken=1 name=LM0 factor=0 order=0 path=/home/tahoar/Desktop/domt/LM0/kenlm.en_gb.bin input-factors: 0 mapping: 0 T 0 weight: UnknownWordPenalty0=1 WordPenalty0=-1 PhrasePenalty0=0.2 TranslationModel0=0.2 0.2 0.2 0.2 LexicalReordering0=0.3 0.3 0.3 0.3 0.3 0.3 Distortion0=0.3 LM0=0.5 Exception: moses/Parameter.cpp:949 in void Moses::Parameter::CreateWeightsMap(const PARAM_VEC&) threw util::Exception because `toks.size() < 2'. Error in format of weights: UnknownWordPenalty0=1
run0.moses.3.ini
Description: application/wine-extension-ini
Defined parameters (per moses.ini or switch): config: run0.moses.3.ini distortion-limit: 6 feature: UnknownWordPenalty WordPenalty PhrasePenalty PhraseDictionaryMemory name=TranslationModel0 num-features=4 path=/opt/domt/TRAININGS/smt/tm-en_gb-nl_nl-micro_tm/domt-s=nl_nl-t=en_gb-p=micro_tm-a=giza_grow-diag-final-and-g=3/phrase-table.gz input-factor=0 output-factor=0 LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/opt/domt/TRAININGS/smt/tm-en_gb-nl_nl-micro_tm/domt-s=nl_nl-t=en_gb-p=micro_tm-a=giza_grow-diag-final-and-g=3/reordering-table.wbe-msd-bidirectional-fe.gz Distortion KENLM lazyken=1 name=LM0 factor=0 order=0 path=/home/tahoar/Desktop/domt/LM0/kenlm.en_gb.bin input-factors: 0 mapping: 0 T 0 weight: UnknownWordPenalty0 = 1 WordPenalty0= -1 PhrasePenalty0= 0.2 TranslationModel0= 0.2 0.2 0.2 0.2 LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3 Distortion0= 0.3 LM0= 0.5 line=UnknownWordPenalty FeatureFunction: UnknownWordPenalty0 start: 0 end: 0 line=WordPenalty FeatureFunction: WordPenalty0 start: 1 end: 1 line=PhrasePenalty FeatureFunction: PhrasePenalty0 start: 2 end: 2 line=PhraseDictionaryMemory name=TranslationModel0 num-features=4 path=/opt/domt/TRAININGS/smt/tm-en_gb-nl_nl-micro_tm/domt-s=nl_nl-t=en_gb-p=micro_tm-a=giza_grow-diag-final-and-g=3/phrase-table.gz input-factor=0 output-factor=0 FeatureFunction: TranslationModel0 start: 3 end: 6 line=LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/opt/domt/TRAININGS/smt/tm-en_gb-nl_nl-micro_tm/domt-s=nl_nl-t=en_gb-p=micro_tm-a=giza_grow-diag-final-and-g=3/reordering-table.wbe-msd-bidirectional-fe.gz FeatureFunction: LexicalReordering0 start: 7 end: 12 Initializing LexicalReordering.. line=Distortion FeatureFunction: Distortion0 start: 13 end: 13 line=KENLM lazyken=1 name=LM0 factor=0 order=0 path=/home/tahoar/Desktop/domt/LM0/kenlm.en_gb.bin FeatureFunction: LM0 start: 14 end: 14 Loading UnknownWordPenalty0 Loading WordPenalty0 Loading PhrasePenalty0 Loading LexicalReordering0 Loading table into memory...done. Loading Distortion0 Loading LM0 Loading TranslationModel0 Start loading text phrase table. Moses format : [1.780] seconds Reading /opt/domt/TRAININGS/smt/tm-en_gb-nl_nl-micro_tm/domt-s=nl_nl-t=en_gb-p=micro_tm-a=giza_grow-diag-final-and-g=3/phrase-table.gz ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 **************************************************************************************************** UnknownWordPenalty The following weights have no feature function. Maybe incorrectly spelt weights: UnknownWordPenalty,
Defined parameters (per moses.ini or switch): config: run0.moses.3.ini distortion-limit: 6 feature: UnknownWordPenalty WordPenalty PhrasePenalty PhraseDictionaryMemory name=TranslationModel0 num-features=4 path=/opt/domt/TRAININGS/smt/tm-en_gb-nl_nl-micro_tm/domt-s=nl_nl-t=en_gb-p=micro_tm-a=giza_grow-diag-final-and-g=3/phrase-table.gz input-factor=0 output-factor=0 LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/opt/domt/TRAININGS/smt/tm-en_gb-nl_nl-micro_tm/domt-s=nl_nl-t=en_gb-p=micro_tm-a=giza_grow-diag-final-and-g=3/reordering-table.wbe-msd-bidirectional-fe.gz Distortion KENLM lazyken=1 name=LM0 factor=0 order=0 path=/home/tahoar/Desktop/domt/LM0/kenlm.en_gb.bin input-factors: 0 mapping: 0 T 0 weight: UnknownWordPenalty0= 1 WordPenalty0=-1 PhrasePenalty0= 0.2 TranslationModel0= 0.2 0.2 0.2 0.2 LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3 Distortion0= 0.3 LM0= 0.5 Exception: moses/Parameter.cpp:949 in void Moses::Parameter::CreateWeightsMap(const PARAM_VEC&) threw util::Exception because `toks.size() < 2'. Error in format of weights: WordPenalty0=-1
Defined parameters (per moses.ini or switch): config: run0.moses.3.ini distortion-limit: 6 feature: UnknownWordPenalty WordPenalty PhrasePenalty PhraseDictionaryMemory name=TranslationModel0 num-features=4 path=/opt/domt/TRAININGS/smt/tm-en_gb-nl_nl-micro_tm/domt-s=nl_nl-t=en_gb-p=micro_tm-a=giza_grow-diag-final-and-g=3/phrase-table.gz input-factor=0 output-factor=0 LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/opt/domt/TRAININGS/smt/tm-en_gb-nl_nl-micro_tm/domt-s=nl_nl-t=en_gb-p=micro_tm-a=giza_grow-diag-final-and-g=3/reordering-table.wbe-msd-bidirectional-fe.gz Distortion KENLM lazyken=1 name=LM0 factor=0 order=0 path=/home/tahoar/Desktop/domt/LM0/kenlm.en_gb.bin input-factors: 0 mapping: 0 T 0 weight: UnknownWordPenalty0= 1 WordPenalty0 = -1 PhrasePenalty0= 0.2 TranslationModel0= 0.2 0.2 0.2 0.2 LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3 Distortion0= 0.3 LM0= 0.5 line=UnknownWordPenalty FeatureFunction: UnknownWordPenalty0 start: 0 end: 0 line=WordPenalty FeatureFunction: WordPenalty0 start: 1 end: 1 Exception: moses/ScoreComponentCollection.cpp:250 in void Moses::ScoreComponentCollection::Assign(const Moses::FeatureFunction*, const std::vector<float>&) threw util::Exception'. Feature function WordPenalty0 specified 1 dense scores or weights. Actually has 0
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
