Hi, you should first run tokenization, then add your factors, to avoid this problem.
-phi On Wed, Oct 8, 2014 at 12:17 PM, Marwa Refaie <[email protected]> wrote: > When i applied moses tokeniser to the text file, all the '|' pipe as factor > separator convert to "|" .... so can't produce the moses.ini as error :: > > > ERROR: Couldn't find factor 1 in token "artificial" in > c:/mosesdecoder-master/try/ai/sep/fsmt/data/UNpos.tok.en LINE 1 > > Any advice please ?? > > > > > > Marwa N. Refaie > > > >> Date: Tue, 7 Oct 2014 21:13:36 -0400 >> From: [email protected] >> To: [email protected] >> Subject: Re: [Moses-support] Factored Model / <s> Error ??? >> >> Well, does your data contain <s> in a position other than the first >> word? If so you should be escaping it e.g. with the Moses tokenizer. >> >> On 10/07/14 20:32, Marwa Refaie wrote: >> > >> > >> > Thank's for help ,, I fix all what mentioned now I'm stuck in this error >> > :: >> > >> > Start loading text SCFG phrase table. Moses format : [1.000] seconds >> > Reading >> > /cygdrive/c/mosesdecoder-master/try/ai/sep/fsmt/work/model/phrase-table. >> > >> > 0,1-0,1.gz >> > >> > ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80 >> > >> > ---85---90---95--100 >> > Either your data contains <s> in a position other than the first word or >> > your la >> > nguage model is missing <s>. Did you >> > build your ARPA using IRSTLM and forget to >> > run >> > add-start-end.sh? >> > [1]+ Done >> > c:/mosesdecoder-master/scripts/training/train-mode >> > >> > l.perl -external-bin-dir c:/mosesdecoder-master/tools/bin -root-dir >> > work -corpus >> > >> > c:/mosesdecoder-master/try/ai/sep/fsmt/data/UNpos.lo -f en -e ar >> > -Translation-f >> > actors 0,1-0,1 -lm >> > 0:5:/cygdrive/c:/mosesdecoder-master/try/ai/sep/fsmt/model/su >> > >> > rface.lm -lm >> > 1:5:/cygdrive/c:/mosesdecoder-master/try/ai/sep/fsmt/model/pos.lm & >> > >> > >training.out >> > Aborted (core dumped) >> > >> > >> >> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >> > As mentioned I build non factored model , it worked well, but when I >> > start use the pos & surface language model for my training data I got >> > these errors ?? >> > I used the SRILM. >> > >> > >> > >> > >> > >> > /*Marwa N. Refaie*/ >> > >> > >> > >> > _______________________________________________ >> > Moses-support mailing list >> > [email protected] >> > http://mailman.mit.edu/mailman/listinfo/moses-support >> > >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
