Did you try to escape special chars in your data? See scripts/tokenizer/escape-special-chars.perl.
Best, Benjamin Von: moses-support-boun...@mit.edu [mailto:moses-support-boun...@mit.edu] Im Auftrag von charmaine ponay Gesendet: Dienstag, 3. Juni 2014 07:30 An: moses-support@mit.edu Betreff: [Moses-support] what is wrong with my data hi, what is wrong with my data if i get errors like these after training? $ ../mosesdecoder-master/bin/moses -f Charmaine/training/model/moses.ini < Charmaine/testing.fl > Charmaine/Testing/CharmaineOut Defined parameters (per moses.ini or switch): config: Charmaine/training/model/moses.ini distortion-limit: 6 feature: UnknownWordPenalty WordPenalty PhrasePenalty PhraseDictionaryMemory name=TranslationModel0 table-limit=20 num-features=4 path=/Masters/Charmaine/training/model/phrase-table.gz input-factor=0 output-factor=0 Distortion SRILM name=LM0 factor=0 path=/Masters/Charmaine/ order=3 input-factors: 0 mapping: 0 T 0 weight: UnknownWordPenalty0= 1 WordPenalty0= -1 PhrasePenalty0= 0.2 TranslationModel0= 0.2 0.2 0.2 0.2 Distortion0= 0.3 LM0= 0.5 ../mosesdecoder-master/bin line=UnknownWordPenalty FeatureFunction: UnknownWordPenalty0 start: 0 end: 0 line=WordPenalty FeatureFunction: WordPenalty0 start: 1 end: 1 line=PhrasePenalty FeatureFunction: PhrasePenalty0 start: 2 end: 2 line=PhraseDictionaryMemory name=TranslationModel0 table-limit=20 num-features=4 path=/Masters/Charmaine/training/model/phrase-table.gz input-factor=0 output-factor=0 FeatureFunction: TranslationModel0 start: 3 end: 6 line=Distortion FeatureFunction: Distortion0 start: 7 end: 7 line=SRILM name=LM0 factor=0 path=/Masters/Charmaine/ order=3 FeatureFunction: LM0 start: 8 end: 8 /Masters/Charmaine/: line 0: reached EOF before \end\ Start loading text SCFG phrase table. Moses format : [0.000] seconds Reading /Masters/Charmaine/training/model/phrase-table.gz ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 Check nextPos != string::npos failed in moses\Phrase.cpp:214 Aborted (core dumped) Regards, Charmaine Salvador - Ponay Instructor Information and Computer Studies Dept. University of Santo Tomas
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
