Hi Hala,
I never found a solution to this since I had a strict deadline so I
stopped using mgiza and went back to IBM-model1. Thanks for reminding,
cause I may need it in the future. In case it helps. I have opened this
issue here https://github.com/moses-smt/mgiza/issues/2
Please go there and add you feedback as well.
What is your operating system? I have some suspicion that this may be
due to some outdated Ubuntu libraries.
best
Lefteris
On 19.11.2014 12:34, Hala Maghout wrote:
Hi,
I'm facing a segmentation fault problem when loading big N tables
during forced alignment using MGIZA, which was posted previously on
moses list (thread below) but no solution was suggested. As Lefteris
explained, it's due to big N table size. Any suggestion on how to
solve it other than cutting our entries from the N table?
Many thanks,
Best,
Hala
On 11 August 2014 11:03, Hieu Hoang <[email protected]
<mailto:[email protected]>> wrote:
did you manage to solve this issue? I tried contacting Qin Gao but
there's been no reply so far.
From my experience with mgiza a while ago, force alignment works ok
On 3 August 2014 23:34, Eleftherios Avramidis
<[email protected]
<mailto:[email protected]>> wrote:
Hi,
I am trying to produce word alignment for individual
sentences. For this purpose I am using the "force align"
functionality of mgiza++ Unfortunately when I am loading a big
N table (fertility), mgiza crashes with a segmentation fault.
In particular, I have initially run mgiza on the full training
parallel corpus using the default settings of the Moses script:
/project/qtleap/software/moses-2.1.1/bin/training-tools/mgiza
-CoocurrenceFile
/local/tmp/elav01/selection-mechanism/systems/de-en/training/giza.1/en-de.cooc
-c
/local/tmp/elav01/selection-mechanism/systems/de-en/training/prepared.1/en-de-int-train.snt
-m1 5 -m2 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -ncpus
24 -nodumps 0 -nsmooth 4 -o
/local/tmp/elav01/selection-mechanism/systems/de-en/training/giza.1/en-de
-onlyaldumps 0 -p0 0.999 -s
/local/tmp/elav01/selection-mechanism/systems/de-en/training/prepared.1/de.vcb
-t
/local/tmp/elav01/selection-mechanism/systems/de-en/training/prepared.1/en.vcb
Afterwards, by executing the mgiza force-align script, I run
the following command
/project/qtleap/software/moses-2.1.1/mgizapp-code/mgizapp//bin/mgiza
giza.en-de/en-de.gizacfg -c
/local/tmp/elav01/selection-mechanism/systems/de-en/falign/qtmp_SOVBrE/prepared./en-de.snt
-o
/local/tmp/elav01/selection-mechanism/systems/de-en/falign/qtmp_SOVBrE/giza./en-de
-s
/local/tmp/elav01/selection-mechanism/systems/de-en/falign/qtmp_SOVBrE/prepared./de.vcb
-t
/local/tmp/elav01/selection-mechanism/systems/de-en/falign/qtmp_SOVBrE/prepared./en.vcb
-m1 0 -m2 0 -mh 0 -coocurrence
/local/tmp/elav01/selection-mechanism/systems/de-en/falign/qtmp_SOVBrE/giza./en-de.cooc
-restart 11 -previoust giza.en-de/en-de.t3.final -previousa
giza.en-de/en-de.a3.final -previousd giza.en-de/en-de.d3.final -previousn
giza.en-de/en-de.n3.final -previousd4 giza.en-de/en-de.d4.final -previousd42
giza.en-de/en-de.D4.final -m3 0 -m4 1
This runs fine, until I get the following error:
We are going to load previous N model from
giza.en-de/en-de.n3.final
Reading fertility table from giza.en-de/en-de.n3.final
Segmentation fault (core dumped)
The n-table that is failing has about 300k entries. For this
reason, I thought I should try to see if the size is a
problem. So I concatenated the table to 60k entries. And it
works! But the alignments are not good.
I am struggling to fix this, so any help would be appreciated.
I am running a freshly installed mgiza, on Ubuntu 12.04
cheers,
Lefteris
--
MSc. Inf. Eleftherios Avramidis
DFKI GmbH, Alt-Moabit 91c, 10559 Berlin
Tel.+49-30 238 95-1806 <tel:%2B49-30%20238%2095-1806>
Fax.+49-30 238 95-1810 <tel:%2B49-30%20238%2095-1810>
-------------------------------------------------------------------------------------------
Deutsches Forschungszentrum fuer Kuenstliche Intelligenz GmbH
Firmensitz: Trippstadter Strasse 122, D-67663 Kaiserslautern
Geschaeftsfuehrung:
Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender)
Dr. Walter Olthoff
Vorsitzender des Aufsichtsrats:
Prof. Dr. h.c. Hans A. Aukes
Amtsgericht Kaiserslautern, HRB 2313
-------------------------------------------------------------------------------------------
_______________________________________________
Moses-support mailing list
[email protected] <mailto:[email protected]>
http://mailman.mit.edu/mailman/listinfo/moses-support
--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
_______________________________________________
Moses-support mailing list
[email protected] <mailto:[email protected]>
http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
