Hi Lefteris, I commented in the issue you opened on github. The OS I'm running MGIZA on is openSUSE 12.2
Best, Hala On 19 November 2014 10:43, Eleftherios Avramidis < [email protected]> wrote: > Hi Hala, > > I never found a solution to this since I had a strict deadline so I > stopped using mgiza and went back to IBM-model1. Thanks for reminding, > cause I may need it in the future. In case it helps. I have opened this > issue here https://github.com/moses-smt/mgiza/issues/2 > > Please go there and add you feedback as well. > > What is your operating system? I have some suspicion that this may be due > to some outdated Ubuntu libraries. > > best > Lefteris > > > On 19.11.2014 12:34, Hala Maghout wrote: > > Hi, > > I'm facing a segmentation fault problem when loading big N tables during > forced alignment using MGIZA, which was posted previously on moses list > (thread below) but no solution was suggested. As Lefteris explained, it's > due to big N table size. Any suggestion on how to solve it other than > cutting our entries from the N table? > > Many thanks, > > Best, > > Hala > > > On 11 August 2014 11:03, Hieu Hoang <[email protected]> wrote: > >> did you manage to solve this issue? I tried contacting Qin Gao but >> there's been no reply so far. >> >> From my experience with mgiza a while ago, force alignment works ok >> >> >> On 3 August 2014 23:34, Eleftherios Avramidis < >> [email protected]> wrote: >> >>> Hi, >>> >>> I am trying to produce word alignment for individual sentences. For this >>> purpose I am using the "force align" functionality of mgiza++ Unfortunately >>> when I am loading a big N table (fertility), mgiza crashes with a >>> segmentation fault. >>> >>> In particular, I have initially run mgiza on the full training parallel >>> corpus using the default settings of the Moses script: >>> >>> /project/qtleap/software/moses-2.1.1/bin/training-tools/mgiza >>> -CoocurrenceFile >>> /local/tmp/elav01/selection-mechanism/systems/de-en/training/giza.1/en-de.cooc >>> -c >>> /local/tmp/elav01/selection-mechanism/systems/de-en/training/prepared.1/en-de-int-train.snt >>> -m1 5 -m2 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 >>> -ncpus 24 -nodumps 0 -nsmooth 4 -o >>> /local/tmp/elav01/selection-mechanism/systems/de-en/training/giza.1/en-de >>> -onlyaldumps 0 -p0 0.999 -s >>> /local/tmp/elav01/selection-mechanism/systems/de-en/training/prepared.1/de.vcb >>> -t >>> /local/tmp/elav01/selection-mechanism/systems/de-en/training/prepared.1/en.vcb >>> >>> Afterwards, by executing the mgiza force-align script, I run the >>> following command >>> >>> /project/qtleap/software/moses-2.1.1/mgizapp-code/mgizapp//bin/mgiza >>> giza.en-de/en-de.gizacfg -c >>> /local/tmp/elav01/selection-mechanism/systems/de-en/falign/qtmp_SOVBrE/prepared./en-de.snt >>> -o >>> /local/tmp/elav01/selection-mechanism/systems/de-en/falign/qtmp_SOVBrE/giza./en-de >>> -s >>> /local/tmp/elav01/selection-mechanism/systems/de-en/falign/qtmp_SOVBrE/prepared./de.vcb >>> -t >>> /local/tmp/elav01/selection-mechanism/systems/de-en/falign/qtmp_SOVBrE/prepared./en.vcb >>> -m1 0 -m2 0 -mh 0 -coocurrence >>> /local/tmp/elav01/selection-mechanism/systems/de-en/falign/qtmp_SOVBrE/giza./en-de.cooc >>> -restart 11 -previoust giza.en-de/en-de.t3.final -previousa >>> giza.en-de/en-de.a3.final -previousd giza.en-de/en-de.d3.final -previousn >>> giza.en-de/en-de.n3.final -previousd4 giza.en-de/en-de.d4.final >>> -previousd42 giza.en-de/en-de.D4.final -m3 0 -m4 1 >>> >>> This runs fine, until I get the following error: >>> >>> We are going to load previous N model from giza.en-de/en-de.n3.final >>> >>> Reading fertility table from giza.en-de/en-de.n3.final >>> >>> Segmentation fault (core dumped) >>> >>> >>> The n-table that is failing has about 300k entries. For this reason, I >>> thought I should try to see if the size is a problem. So I concatenated the >>> table to 60k entries. And it works! But the alignments are not good. >>> >>> I am struggling to fix this, so any help would be appreciated. I am >>> running a freshly installed mgiza, on Ubuntu 12.04 >>> >>> cheers, >>> Lefteris >>> >>> -- >>> MSc. Inf. Eleftherios Avramidis >>> DFKI GmbH, Alt-Moabit 91c, 10559 Berlin >>> Tel. +49-30 238 95-1806 >>> >>> Fax. +49-30 238 95-1810 >>> >>> ------------------------------------------------------------------------------------------- >>> Deutsches Forschungszentrum fuer Kuenstliche Intelligenz GmbH >>> Firmensitz: Trippstadter Strasse 122, D-67663 Kaiserslautern >>> >>> Geschaeftsfuehrung: >>> Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender) >>> Dr. Walter Olthoff >>> >>> Vorsitzender des Aufsichtsrats: >>> Prof. Dr. h.c. Hans A. Aukes >>> >>> Amtsgericht Kaiserslautern, HRB 2313 >>> ------------------------------------------------------------------------------------------- >>> >>> >>> >>> _______________________________________________ >>> Moses-support mailing list >>> [email protected] >>> http://mailman.mit.edu/mailman/listinfo/moses-support >>> >>> >> >> >> -- >> Hieu Hoang >> Research Associate >> University of Edinburgh >> http://www.hoang.co.uk/hieu >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
