Please see my reply to another thread below. I believe you need your source part of the tuning set factored as well.
On 30/06/2016 21:44, Sašo Kuntaric wrote: Hi all, I would like to ask one more question. When you say that my reference only has the surface form, are you talking about the "tuning corpus", which in the case of my command ~/mosesdecoder/scripts/training/mert-moses.pl ~/working/IT_corpus/TMX/txt/ factored_corpus/singles/tuning_corpus.tagged.clean.en ~/working/IT_corpus/TMX/txt/factored_corpus/singles/tuning _corpus.tagged.clean.sl ~/mosesdecoder/bin/moses ~/working/IT_corpus/TMX/txt/factored_corpus/singles/test/model/moses.ini --mertdir ~/mosesdecoder/bin/ --decoder-flags="-threads all" are tuning_corpus.tagged.clean.en and tuning_corpus.tagged.clean.sl? Can tuning be done with files that only contains surface forms? it's usual that the reference tuning data does not have factors, even if there are factors in the phrase table. After all, you don't care if the output surface form is correct but the other factors are wrong. Will the results be compatible with tuning done with a factored tuning corpus? yes Best regards, Sašo 2016-12-06 10:18 GMT+01:00 Hasan Sait ARSLAN <[email protected]>: > Hi, > > I have a factored dataset. It involves 4 factors, > factor1|factor2|factor3|factor4. > I have trained my model with such a dataset. > > Now when I want to tune my model, I encounter with the following error: > > > > > *Exception: moses/Word.cpp:159 in void > Moses::Word::CreateFromString(Moses::FactorDirection, const > std::vector<long unsigned int>&, const StringPiece&, bool, bool) threw > util::Exception because `!isNonTerminal && i < factorOrder.size()'.Too few > factors in string '-|-|Punc|Punc* > The details of the error is in mert.txt file, which is attached to this > e-mail. > > Thanks, > > Kind Regards, > Hasan Sait Arslan > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > -- lp, Sašo
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
