In my short experience: I've used 1/20 parts of the europarl file and have reached a well done work, but when I used the entire file I have some problems Step 8 "no generation model requested, skipping step"
this ran on cygwin. I'll try to run on linux machine later. Masami R. 2008/10/22 <[EMAIL PROTECTED]> > Send Moses-support mailing list submissions to > [email protected] > > To subscribe or unsubscribe via the World Wide Web, visit > http://mailman.mit.edu/mailman/listinfo/moses-support > or, via email, send a message with subject or body 'help' to > [EMAIL PROTECTED] > > You can reach the person managing the list at > [EMAIL PROTECTED] > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Moses-support digest..." > > > Today's Topics: > > 1. Re: train-factored-phrase-model.perl error (Radek Barto?) > (Masami R.) > 2. Re: train-factored-phrase-model.perl error (Radek Barto? ) > (Radek Barto?) > 3. Re: train-factored-phrase-model.perl error (Radek Barto? ) > (Radek Barto?) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Tue, 21 Oct 2008 17:33:53 -0300 > From: "Masami R." <[EMAIL PROTECTED]> > Subject: Re: [Moses-support] train-factored-phrase-model.perl error > (Radek Barto?) > To: [email protected] > Message-ID: > <[EMAIL PROTECTED]> > Content-Type: text/plain; charset="iso-8859-1" > > Hi!. > If possible that error is because size of corpus what you use. I have the > same problem, now. > What system do you use?(linux, cygwin..?). > > Masami R. > > > 2008/10/21 <[EMAIL PROTECTED]> > > > Send Moses-support mailing list submissions to > > [email protected] > > > > To subscribe or unsubscribe via the World Wide Web, visit > > http://mailman.mit.edu/mailman/listinfo/moses-support > > or, via email, send a message with subject or body 'help' to > > [EMAIL PROTECTED] > > > > You can reach the person managing the list at > > [EMAIL PROTECTED] > > > > When replying, please edit your Subject line so it is more specific > > than "Re: Contents of Moses-support digest..." > > > > > > Today's Topics: > > > > 1. train-factored-phrase-model.perl error (Radek Barto?) > > > > > > ---------------------------------------------------------------------- > > > > Message: 1 > > Date: Tue, 21 Oct 2008 11:25:19 +0200 > > From: Radek Barto? <[EMAIL PROTECTED]> > > Subject: [Moses-support] train-factored-phrase-model.perl error > > To: [email protected] > > Message-ID: <[EMAIL PROTECTED]> > > Content-Type: text/plain; charset="utf-8" > > > > Hello. > > > > I checkouted today's svn trunk and compiled with SRILM support. Then I > > trained > > corpus using procedure described here > > http://www.statmt.org/wmt08/baseline.html but it fails with following > > message: > > > > Executing: /mnt/data/Projekty/NLP/tools2/moses/scripts/training/phrase- > > extract/score ./model/extract.inv.sorted ./model/lex.e2f ./model/phrase- > > table.half.e2f inverse > > PhraseScore v1.4 written by Philipp Koehn > > phrase scoring methods for extracted phrases > > using inverse mode > > Loading lexical translation table from ./model/lex.e2f > > Executing: rm -f ./model/extract.inv.sorted > > (6.5) sorting inverse e2f table@ Tue Oct 21 09:32:42 CEST 2008 > > Executing: LC_ALL=C sort -T ./model ./model/phrase-table.half.e2f > > > ./model/phrase-table.half.e2f.sorted > > Executing: rm -f ./model/phrase-table.half.e2f > > (6.6) consolidating the two halves @ Tue Oct 21 09:32:42 CEST 2008 > > Executing: rm -f ./model/phrase-table.half.* > > (7) learn reordering model @ Tue Oct 21 09:32:43 CEST 2008 > > Executing: gunzip < ./model/extract.o.gz | LC_ALL=C sort -T ./model > > > ./model/extract.o.sorted > > (7.2) building tables @ Tue Oct 21 09:32:43 CEST 2008 > > Executing: rm ./model/extract.o.sorted > > (8) learn generation model @ Tue Oct 21 09:32:43 CEST 2008 > > no generation model requested, skipping step > > (9) create moses.ini @ Tue Oct 21 09:32:43 CEST 2008 > > After default: -l mem_free=0.5G -hard > > Using SCRIPTS_ROOTDIR: /mnt/data/Projekty/NLP/tools2/moses/scripts > > checking weight-count for ttable-file > > checking weight-count for lmodel-file > > checking weight-count for distortion-file > > moses.ini:31:File does not exist or empty: > > /mnt/data/Projekty/NLP/corpora/test/model/msd-table.0-0.bi.fe.0.5.gz > > > > There is no such file in that directory, there is only > > /mnt/data/Projekty/NLP/corpora/test/reordering-table.msd-bidirectional- > > fe.0.5.gz file that should not be there. I think that there is some > > regression > > bug in train-factored-phrase-model.perl script. > > > > Could you confirm and fix it, please? > > > > -- > > Ing. Radek Barto? > > > > Faculty of Information Technology > > Department of Computer Graphics and Multimedia > > Brno University of Technology > > > > E-mail: [EMAIL PROTECTED] > > Web: http://blackhex.no-ip.org > > Jabber: [EMAIL PROTECTED] > > > > -------------- next part -------------- > > An HTML attachment was scrubbed... > > URL: > > > http://mailman.mit.edu/pipermail/moses-support/attachments/20081021/3277e183/attachment-0001.htm > > > > ------------------------------ > > > > _______________________________________________ > > Moses-support mailing list > > [email protected] > > http://mailman.mit.edu/mailman/listinfo/moses-support > > > > > > End of Moses-support Digest, Vol 24, Issue 14 > > ********************************************* > > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/pipermail/moses-support/attachments/20081021/6a64308e/attachment-0001.htm > > ------------------------------ > > Message: 2 > Date: Tue, 21 Oct 2008 23:18:51 +0200 > From: Radek Barto? <[EMAIL PROTECTED]> > Subject: Re: [Moses-support] train-factored-phrase-model.perl error > (Radek Barto? ) > To: [email protected] > Message-ID: <[EMAIL PROTECTED]> > Content-Type: text/plain; charset="utf-8" > > On Tuesday 21 October 2008 22:33:53 Masami R. wrote: > > Hi!. > > If possible that error is because size of corpus what you use. I have the > > same problem, now. > > What system do you use?(linux, cygwin..?). > > > > Masami R. > > > > Do you mean too big corpus? If so, I don't think so. I tried it on very > small > testing corpus (999 sentence pairs). If you mean too big corpus, I'll > update > as soon as training, which I started now, finishes. My system is amd64 > Linux. > > Thank you for response anyway. > > -- > Ing. Radek Barto? > > Faculty of Information Technology > Department of Computer Graphics and Multimedia > Brno University of Technology > > E-mail: [EMAIL PROTECTED] > Web: http://blackhex.no-ip.org > Jabber: [EMAIL PROTECTED] > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/pipermail/moses-support/attachments/20081021/f516f2ff/attachment-0001.htm > > ------------------------------ > > Message: 3 > Date: Tue, 21 Oct 2008 23:34:26 +0200 > From: Radek Barto? <[EMAIL PROTECTED]> > Subject: Re: [Moses-support] train-factored-phrase-model.perl error > (Radek Barto? ) > To: [email protected] > Message-ID: <[EMAIL PROTECTED]> > Content-Type: text/plain; charset="utf-8" > > On Tuesday 21 October 2008 23:18:51 Radek Barto? wrote: > > > If you mean too big corpus, I'll update as soon as training, which I > started > now, finishes. > > Sorry, it should be "too small corpus". Nevertheless, training on 46k > sentence > pairs failed with same error. > > -- > Ing. Radek Barto? > > Faculty of Information Technology > Department of Computer Graphics and Multimedia > Brno University of Technology > > E-mail: [EMAIL PROTECTED] > Web: http://blackhex.no-ip.org > Jabber: [EMAIL PROTECTED] > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/pipermail/moses-support/attachments/20081021/12503bec/attachment-0001.htm > > ------------------------------ > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > > End of Moses-support Digest, Vol 24, Issue 15 > ********************************************* >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
