Hi Sanne, In case that you do not do hmm training, GIZA++ will assume that you trained Model 2, and need to "transfer" the model to model 3 and prepare future training. It does not care about whether you will train model 3/4, just transfer it.
My suggestion is to set mh equals 1. In that case, it will perform one round of HMM training, but because it is the first iteration, it will still use the model of previous step, namely the fifth iteration of model one, to perform alignment. One thing to keep in mind is that the alignment outputted by iteration K is produced by using the model of K-1, and the first iteration of IBM model one actually using "Uniform" model and first iteration of HMM using Model 1, first iteration of Model 3 using HMM and so on. Best, Qin On Tue, May 27, 2008 at 12:36 PM, Sanne Korzec <[EMAIL PROTECTED]> wrote: > Hi Mailing, > > I am trying to train IBM model I only with GIZA++ > I am using the following command: > > GIZA++ -S source_vcb -T target_vcb -C source_snt -CoocurrenceFile > giza.cooc > -m1 5 -m2 0 -mh 0 -m3 0 -m4 0 -m5 0 -m6 0 -model1dumpfrequency 5 > > The program generates the appropriate output files: > > - s-t-A1.5 (alignment file if I'm correct) > - s-t-t1.5 (translation table probability file if I'm correct) > > The program still seems to train additional stuff, here is a snippet of > output: > > ''' > Transfer started at: Tue May 27 18:32:57 2008 > > Transfering Model2 --> Model3 (i.e. estimating initial parameters of Model3 > from > Model2 tables) > Reading more sentence pairs into memory ... > Reading more sentence pairs into memory ... > Reading more sentence pairs into memory ... > Normalizing t, a, d, n count tables now ... A/D table contains 646 > parameters. > A/D table contains 549 parameters. > NTable contains 331000 parameter. > > Transfer: TRAIN CROSS-ENTROPY 25.0174 PERPLEXITY 3.39619e+07 > Transfer took: 23 seconds > Transfer Finished at: Tue May 27 18:33:20 2008 > ''' > > Does anybody know why GIZA outputs these higher models? What is going on > here? > > Regards, > Sanne > > > > -----Original Message----- > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] > On Behalf Of [EMAIL PROTECTED] > Sent: dinsdag 20 mei 2008 18:12 > To: [email protected] > Subject: Moses-support Digest, Vol 19, Issue 19 > > Send Moses-support mailing list submissions to > [email protected] > > To subscribe or unsubscribe via the World Wide Web, visit > http://mailman.mit.edu/mailman/listinfo/moses-support > or, via email, send a message with subject or body 'help' to > [EMAIL PROTECTED] > > You can reach the person managing the list at > [EMAIL PROTECTED] > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Moses-support digest..." > > > Today's Topics: > > 1. moses compiling help (Khan Md. Anwarus Salam) > 2. Fwd: moses compiling help (Khan Md. Anwarus Salam) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Tue, 20 May 2008 13:08:52 +0600 > From: "Khan Md. Anwarus Salam" <[EMAIL PROTECTED]> > Subject: [Moses-support] moses compiling help > To: [email protected] > Message-ID: > <[EMAIL PROTECTED]> > Content-Type: text/plain; charset="utf-8" > > Hi, > I am trying to compile moses. > It's doing this succesfully: ./regenerate-makefiles.sh > But when I give thi: > ./configure --with-irstlm=~/irstlm/bin/i386-redhat-linux-gnu/ > it says configure: error: Cannot find IRST-LM! > > Waiting for some kind help for this. I installed IRSTLM in root folder. > -- > Thanks, > Khan Md. Anwarus Salam > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > > http://mailman.mit.edu/pipermail/moses-support/attachments/20080520/0f626bbd > /attachment-0001.htm<http://mailman.mit.edu/pipermail/moses-support/attachments/20080520/0f626bbd/attachment-0001.htm> > > ------------------------------ > > Message: 2 > Date: Tue, 20 May 2008 20:22:18 +0600 > From: "Khan Md. Anwarus Salam" <[EMAIL PROTECTED]> > Subject: [Moses-support] Fwd: moses compiling help > To: [email protected], [EMAIL PROTECTED] > Message-ID: > <[EMAIL PROTECTED]> > Content-Type: text/plain; charset="utf-8" > > Hi, > Thanks a lot. It's compiling successfully now. But I am facing problem to > run this now. > I downloaded *sample-models.tgz* > > But when giving this command it's giving error as there is nothing named > moses in src folder: > ~/mosesdecoder/trunk/moses-cmd/src/moses -f moses.ini < in > out > > Waiting for some kind help for this. > > -- > Thanks, > Khan Md. Anwarus Salam > > > > > On 20/05/2008, Nicola Bertoldi <[EMAIL PROTECTED]> wrote: > > > > dear Khan > > do not specify the full path, > > but only the parent directory "~/irstlm" > > and expand the tilde "~" symbol > > > > hope this is fine! > > > > best, > > Nicola > > > > ________________________________________ > > From: [EMAIL PROTECTED] [EMAIL PROTECTED] On > > Behalf Of Khan Md. Anwarus Salam [EMAIL PROTECTED] > > Sent: Tuesday, May 20, 2008 9:08 AM > > To: [email protected] > > Subject: [Moses-support] moses compiling help > > > > Hi, > > I am trying to compile moses. > > It's doing this succesfully: ./regenerate-makefiles.sh > > But when I give thi: > > ./configure --with-irstlm=~/irstlm/bin/i386-redhat-linux-gnu/ > > it says configure: error: Cannot find IRST-LM! > > > > Waiting for some kind help for this. I installed IRSTLM in root folder. > > -- > > Thanks, > > Khan Md. Anwarus Salam > > > > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > > http://mailman.mit.edu/pipermail/moses-support/attachments/20080520/bd1bb0c6 > /attachment-0001.htm<http://mailman.mit.edu/pipermail/moses-support/attachments/20080520/bd1bb0c6/attachment-0001.htm> > > ------------------------------ > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > > End of Moses-support Digest, Vol 19, Issue 19 > ********************************************* > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
