Hi all, i changed the file_spec.h contents and in that time_spec array's size was changed from 17 to 37. After rebuilding giza. problem got solved. :)
On Fri, Jan 28, 2011 at 1:31 PM, <[email protected]> wrote: > Send Moses-support mailing list submissions to > [email protected] > > To subscribe or unsubscribe via the World Wide Web, visit > http://mailman.mit.edu/mailman/listinfo/moses-support > or, via email, send a message with subject or body 'help' to > [email protected] > > You can reach the person managing the list at > [email protected] > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Moses-support digest..." > > > Today's Topics: > > 1. Re: questions (Roberto Rios) > 2. error training giza++ (nakul sharma) > 3. running moses on a cluster with sge (Noubours, Sandra) > 4. Re: running moses on a cluster with sge (Tom Hoar) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Thu, 27 Jan 2011 12:54:01 -0500 > From: Roberto Rios <[email protected]> > Subject: Re: [Moses-support] questions > To: [email protected] > Message-ID: > > <[email protected]<qf3dgyacvfoa%[email protected]> > > > Content-Type: text/plain; charset="iso-8859-1" > > hi...in plain giza the training runs good....u right this is a small corpus > so it does no make much of a difference...but evetually i am going to use > big corpuses so i have to learn those little tweaks for mgiza :-) for now I > am about to start the tunning following > http://www.statmt.org/wmt07/baseline.html tutorial > > 1. I do not understand why are we using different corpuses for tuning ( > dev2006.fr dev2006.en) than from the original corpuses (europarl). For > what > i understand the input corpus (dev2006.fr) is what i am going to be using > to > be translated when i run the system on Development test set > > 1.1 why do i need it in tuning (dev2006.fr --> in theory is a .doc i > do > not know yet, it will be the doc to be translated) > > 1.2 the same for dev2006.en...why do i need it in tuning...i already > have the training results > > 1.3 is the purpose of this corpuses to improve the training results..if > its so why not runing them on training? > > 2. is tuning memory-bound or cpu-bound.....increasing my memory will > decrease tuning time? I read i can tweak tuning (phrase table model, lm, > dist model, word penalty) for a faster results but the quality of the > translation will not be as good as default settings...did i understand that > correctly? > > 3. where is dev2006. fr en.es > > > thanks a lot > Roberto > > > > > > On Thu, Jan 27, 2011 at 11:38 AM, Hieu Hoang <[email protected]> wrote: > > > just a personally preference - you should try using plain giza before > using > > mgiza. MGiza may have perculiarities that people may not be aware of. You > > don't need it anyway if you have a small corpus > > > > On 27 January 2011 23:22, Roberto Rios <[email protected]> wrote: > > > >> thank you for your previous answer..it was a lot of help....I am new at > >> this and trying to leartn how to use this tool.....I am able to run > mgiza..I > >> am using a small corpus now for testing (news-commentary en es). I get > this > >> error after model4 iteration6: > >> > >> ERROR: Giza did not produce the output file > >> /home/roberto/demo/tools/working-dir/giza.es-en/es-en.A3.final. Is your > >> corpus clean (reasonably-sized sentences)? at ./train-model.perl line > 1013. > >> > >> 1. corpuses were tokenized.cleaned and lowercased...what could it be > >> wrong? > >> > >> 2. why do i have to run so many iterations per model (m1=5 hmm=5, > >> H333444: Viterbi Training) and what is the difference between the > models? > >> where can i find good information about it? > >> > >> thanks > >> Roberto > >> > >> _______________________________________________ > >> Moses-support mailing list > >> [email protected] > >> http://mailman.mit.edu/mailman/listinfo/moses-support > >> > >> > > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20110127/71619e48/attachment-0001.htm > > ------------------------------ > > Message: 2 > Date: Fri, 28 Jan 2011 11:35:06 +0530 > From: nakul sharma <[email protected]> > Subject: [Moses-support] error training giza++ > To: [email protected] > Message-ID: > > <[email protected]<aanlktikj1umeu3d0qs4aib1yxjx8vkiycumum%[email protected]> > > > Content-Type: text/plain; charset="iso-8859-1" > > Hi, > i execute giza on g++ version 4.4.3. ubuntu os version 10.04. I got > following error while training GIZA++:- > > *** buffer overflow detected ***: ./GIZA++ terminated > ======= Backtrace: ========= > [0x81749bc] > [0x817497d] > [0x8174798] > [0x815ce8e] > [0x8181725] > [0x8174834] > [0x817478d] > [0x806cd2d] > [0x806d7a3] > [0x80739c0] > [0x8147c5f] > [0x8048191] > ======= Memory map: ======== > 004e5000-004e6000 r-xp 00000000 00:00 0 [vdso] > 08048000-081f3000 r-xp 00000000 08:0b 178177 > /home/nakul/Desktop/smt_sw/giza-pp/GIZA++-v2/GIZA++ > 081f3000-081f5000 rw-p 001ab000 08:0b 178177 > /home/nakul/Desktop/smt_sw/giza-pp/GIZA++-v2/GIZA++ > 081f5000-081fd000 rw-p 00000000 00:00 0 > 09399000-0940d000 rw-p 00000000 00:00 0 [heap] > bfdd7000-bfdec000 rw-p 00000000 00:00 0 [stack] > Aborted > > Please tell what should be done to overcome this problem. the problem seems > to be in memory allocations done by giza. > > > -- > Thanks & Regards, > nakul > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20110128/32589fa7/attachment-0001.htm > > ------------------------------ > > Message: 3 > Date: Fri, 28 Jan 2011 08:40:22 +0100 > From: "Noubours, Sandra" <[email protected]> > Subject: [Moses-support] running moses on a cluster with sge > To: <[email protected]> > Message-ID: > < > 1ff0cfc89178b64dbd5cf6696750ac43519...@mailserv1.lorien.fkie.fgan.de> > Content-Type: text/plain; charset="us-ascii" > > Hello, > > > > I would like to run Moses on a cluster. I am yet inexperienced in using > Sun Grid as well as clusters in common. Could you give me any > instructions or tips for implementing a Linux-Cluster with Sun Grid > Engine for running Moses? > > a) What kind of cluster would you recommend, i.e. how many > machines, how many cpus, what memory, etc.? > > b) When tuning is performed with the multicore option it does not > use more than one cpu. Does the tuning step use more than one cpu when > run on a cluster? > > c) Can Sun Grid implement a cluster virtually on one computer, so > that jobs are spread locally to different cpus of one computer? > > > > Thank you and best regards! > > > > Sandra > > > > > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20110128/27392e24/attachment-0001.htm > > ------------------------------ > > Message: 4 > Date: Fri, 28 Jan 2011 15:01:02 +0700 > From: Tom Hoar <[email protected]> > Subject: Re: [Moses-support] running moses on a cluster with sge > To: "Noubours, Sandra" <[email protected]> > Cc: [email protected] > Message-ID: > <[email protected]> > Content-Type: text/plain; charset="utf-8" > > > > Sandra, > > What kind of capacity do you need to support? I just > finished translating 21,000 pages, over 1/2 million phrases, in 22 hours > on an old Intel Core2Quad, 2.4 Ghz with 4 GB RAM and a 4-disk RAID-0. > Moses was configured with binarized phrase/reordering tables and kenlm > binarized language model. The advances in Moses supporting efficient > binarized tables/models are great! > > We're planning tests for a 2-socket > host with two Intel Xeon 5680 6-core 3.33 Ghz CPU's, 48 GB RAM and 4 > 1-TB disks as RAID0. With 12 cores (totaling 24 simultaneous threads > according to Intel specs), we're expecting to boot capacity to well over > 15 million phrases per day on one host. > > What's the advantage of > running Moses on a grid or cluster? > > Tom > > On Fri, 28 Jan 2011 08:40:22 > +0100, "Noubours, Sandra" wrote: > > Hello, > > I would like to run Moses > on a cluster. I am yet inexperienced in using Sun Grid as well as > clusters in common. Could you give me any instructions or tips for > implementing a Linux-Cluster with Sun Grid Engine for running Moses? > > > a) What kind of cluster would you recommend, i.e. how many machines, > how many cpus, what memory, etc.? > > b) When tuning is performed with the > multicore option it does not use more than one cpu. Does the tuning step > use more than one cpu when run on a cluster? > > c) Can Sun Grid > implement a cluster virtually on one computer, so that jobs are spread > locally to different cpus of one computer? > > Thank you and best regards! > > > Sandra > > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20110128/dc93aa91/attachment.htm > > ------------------------------ > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > > End of Moses-support Digest, Vol 51, Issue 32 > ********************************************* > -- Thanks & Regards, nakul
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
