When i applied moses tokeniser to the text file, all the '|' pipe as factor separator convert to "|" .... so can't produce the moses.ini as error :: ERROR: Couldn't find factor 1 in token "artificial" in c:/mosesdecoder-master/try/ai/sep/fsmt/data/UNpos.tok.en LINE 1
Any advice please ?? Marwa N. Refaie > Date: Tue, 7 Oct 2014 21:13:36 -0400 > From: [email protected] > To: [email protected] > Subject: Re: [Moses-support] Factored Model / <s> Error ??? > > Well, does your data contain <s> in a position other than the first > word? If so you should be escaping it e.g. with the Moses tokenizer. > > On 10/07/14 20:32, Marwa Refaie wrote: > > > > > > Thank's for help ,, I fix all what mentioned now I'm stuck in this error :: > > > > Start loading text SCFG phrase table. Moses format : [1.000] seconds > > Reading > > /cygdrive/c/mosesdecoder-master/try/ai/sep/fsmt/work/model/phrase-table. > > > > 0,1-0,1.gz > > ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80 > > > > ---85---90---95--100 > > Either your data contains <s> in a position other than the first word or > > your la > > nguage model is missing <s>. Did you > > build your ARPA using IRSTLM and forget to > > run > > add-start-end.sh? > > [1]+ Done > > c:/mosesdecoder-master/scripts/training/train-mode > > > > l.perl -external-bin-dir c:/mosesdecoder-master/tools/bin -root-dir > > work -corpus > > > > c:/mosesdecoder-master/try/ai/sep/fsmt/data/UNpos.lo -f en -e ar > > -Translation-f > > actors 0,1-0,1 -lm > > 0:5:/cygdrive/c:/mosesdecoder-master/try/ai/sep/fsmt/model/su > > > > rface.lm -lm > > 1:5:/cygdrive/c:/mosesdecoder-master/try/ai/sep/fsmt/model/pos.lm & > > > > >training.out > > Aborted (core dumped) > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > As mentioned I build non factored model , it worked well, but when I > > start use the pos & surface language model for my training data I got > > these errors ?? > > I used the SRILM. > > > > > > > > > > > > /*Marwa N. Refaie*/ > > > > > > > > _______________________________________________ > > Moses-support mailing list > > [email protected] > > http://mailman.mit.edu/mailman/listinfo/moses-support > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
