Hi, either the GIZA++ runs or the merging of their output with with the word alignment program "symal" failed.
Check the output of the GIZA++ runs, it should look something like this: -rw-r--r-- 1 pkoehn people 1694973594 Nov 23 07:26 eng-chi.A3.final.gz -rw-r--r-- 1 pkoehn people 2117713098 Nov 13 16:33 eng-chi.cooc -rw-r--r-- 1 pkoehn people 2161 Nov 13 16:34 eng-chi.gizacfg If that is OK, check, if you can run the symal command by hand. (check for "Executing: /.../scripts-20070109-1725/training/symal/giza2bal.pl") in the STDERR of the training script. -phi On Nov 28, 2007 11:38 AM, Nguyen Tien Huy <[EMAIL PROTECTED]> wrote: > > Dear all, > > Below is contents of model directory: > > ------------------------------------------------------------------------- > [EMAIL PROTECTED]:~/Project/testdata/model$ ls -l > total 2632 > -rw-r--r-- 1 nguyen root 815863 2007-11-27 02:47 aligned.0.en > -rw-r--r-- 1 nguyen root 924249 2007-11-27 02:47 aligned.0.fr > -rw-r--r-- 1 nguyen root 0 2007-11-27 02:47 aligned.grow-diag-final-and > -rw-r--r-- 1 nguyen root 0 2007-11-27 02:48 extract.0-0.o > -rw-r--r-- 1 nguyen root 463493 2007-11-27 02:48 lex.0-0.f2n > -rw-r--r-- 1 nguyen root 463493 2007-11-27 02:48 lex.0-0.n2f > ---------------------------------------------------------------------------- > Size of files are small because I only used 10000 sentences from original > files. > > Thanks > > ________________________________ > > Date: Tue, 27 Nov 2007 12:56:12 +0000 > > From: [EMAIL PROTECTED] ed.ac.uk > > To: [EMAIL PROTECTED] > > > Subject: Re: [Moses-support] Error in training phrase > > CC: [email protected]; [EMAIL PROTECTED]; [EMAIL PROTECTED] > > > > > Hi, > > > > can you do a "ls -l model" and email the contents of that directory? > > > > -phi > > > > On Nov 27, 2007 2:14 AM, Nguyen Tien Huy <[EMAIL PROTECTED]> wrote: > > > > > > Dear all, > > > > > > Thanks for your response. > > > > > > I've passed this error by change param "-CoocurrenceFile" to > > > "-coocurrencefile", but no luck on step 5 (extract phrases) > > > > > > > > > > ------------------------------------------------------------------------------------------------------------------------------------------------- > > > [EMAIL PROTECTED]:~$ perl > > > $SCRIPTS_ROOTDIR/training/train-factored-phrase-model.perl > -scripts-root-dir > > > $SCRIPTS_ROOTDI! R -root-dir /home/nguyen/Project/testdata -corpus > > > /home/n guyen/Project/testdata/corpus/prototype.lowercased -f fr -e en > > > > -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm > > > 0:5:/home/nguyen/Project/testdata/lm/prototype.en.lm:0 > > > ......... > > > Saved: /home/nguyen/Project/testdata/model/lex.0-0.f2n and > > > /home/nguyen/Project/testdata/model/lex.0-0.n2f > > > (5) extract phrases @ Tue Nov 27 02:48:36 ICT 2007 > > > (1.0.5) reducing factors to produce /home/nguyen/Project/te! > > > stdata/model/aligned.0.fr @ Tue Nov 27 02:48:36 ICT 2007 > > > /home/nguyen/Project/testdata/model/aligned.0.fr in place, reusing > > > (1.0.5) reducing factors to produce > > > /home/nguyen/Project/testdata/model/aligned.0.en @ Tue Nov 27 02:48:36 > ICT > > > 2007 > > > /home/nguyen/Project/testdata/model/aligned.0.en in place, reusing > > > (5) [0-0] extract phrases @ Tue Nov 27 02:48:36 ICT 2007 > > > /home/ngu! > yen/Project/bin/moses-scripts/scripts-20071126-0027/training/phrase-extract/extract > > > > /home/nguyen/Project/testdata/model/aligned.0.en > > > /home/nguyen/Project/testdata/model/aligned.0.fr > > > /home/nguyen/Project/testdata/model/aligned.grow-diag-final-and > > > /home/nguyen/Project/testdata/model/extract.0-0 7 orientation > > > Executing: > > > > /home/nguyen/Project/bin/moses-scripts/scripts-20071126-0027/training/phrase-extract/extract > > > /home/nguyen/Project/testdata/model/aligned.0.en > > > /home/nguyen/Project/testdata/model/aligned.0.fr > > > /home/nguyen/Project/testdata/model/aligned.grow-diag-final-a! nd > > > /home/nguyen/Project/testdata/model/extract.0-0 7 orientation > > > Ph raseExtract v1.3.0, written by Philipp Koehn > > > phrase extraction from an aligned parallel corpus > > > (also extracting orientation) > > > Executing: cat /home/nguyen/Project/test! data/model/extract.0-0.o.part* > > > > > > > /home/nguyen/Project/ testdata/model/extract.0-0.o > > > cat: /home/nguyen/Project/testdata/model/extract.0-0.o.part*: No such > file > > > or directory > > > Exit code: 1 > > > Died at > > > > /home/nguyen/Project/bin/moses-scripts/scripts-20071126-0027/training/train-factored-phrase-model.perl > > > line 879. > > > > ------------------------------------------------------------------------------------------------------------------------------------------------- > > > Could you please point me to a solution? > > > Thank in advance, > > > Huy. > > > > > > ________________________________ > > > > Date: Mon, 26 Nov 2007 17:25:22 +0100 > > > > From: [EMAIL PROTECTED] > > > > > > > To: [email protected] > > > > Subject: Re: [Moses-support] Error in training phrase > > > > > > > > > > > Hi, > > > > > > > > Philipp Koehn a écrit :! > > > >! > > > > > you need to compile GIZA++ with the option > -DBINARY_SEARCH_FOR_TTABLE > > > > > > > > Possible but not necessaray. I found that compiling with > > > > -DBINARY_SEARCH_FOR_TTABLE leads to a slower training. I would use > > > > -DBINARY_SEARCH_FOR_TTABLE only when the training data is so large > that > > > > GIZA++ runs out of memory. > > > > > > > > > On Nov 22, 2007 4:10 PM, Nguyen Tien Huy <[EMAIL PROTECTED]> > wrote: > > > > > > > > > > > > ERROR: parameter 'coocurrencefile' does not exist. > > > > > > WARNING: ignoring unrecognized option: -CoocurrenceFile > > > > > > ERROR: parameter 'prototypegizavienviencooc' does not exist. > > > > > > WARNING: ignoring unrecognized option: > > > > > > prototype/giza.vi-en/vi-en.cooc ..... > > > > > > ERR! OR: parameter 'coocurrencefile' does not exist. > > > > > > > WARNING: ignoring unrecognized option: -CoocurrenceFile > > > > > > ERROR: parameter 'protot! ypegizaenvienvicooc' does not exist. > > > > > > WARNING: ignori ng unrecognized option: > > > > > > > > > prototype/giza.en-vi/en-vi.cooc ..... > > > > > > > > Those should be warnings, not errors, and are harmless. > > > > > > > > > > ..Executing: cat prototype/model/extract.0-0.o.part* > > > > > > > prototype/model/extract.0-0.o > > > > > > cat: prototype/model/extract.0-0.o.part*: No such file or > directory > > > > > > > > This, is the problem. Any previous error messages? (For instance, disk > > > > full?) > > > > > > > > -- Daniel > > > > _______________________________________________ > > > > Moses-support mailing list > > > > [email protected] > > &g! t; > http://mailman.mit.edu/mailman/listinfo/moses-support > > > > > > > ________________________________ > > > Get news, entertainment and everything you care about at Live.com. Check > it > > > out! > > ________________________________ > Connect to the next generation of MSN Messenger Get it now! _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
