Lewis John McGibbney created JOSHUA-304:
-------------------------------------------
Summary: word-align.conf alignment template file not compatable
with berkeley aligner
Key: JOSHUA-304
URL: https://issues.apache.org/jira/browse/JOSHUA-304
Project: Joshua
Issue Type: Bug
Components: templates, berkeley, alignment
Affects Versions: 6.0.5
Reporter: Lewis John McGibbney
Priority: Blocker
Fix For: 6.1
It takes me quite some time to debug what was going on and why pipeline's were
failing when using the berkeley aligner.
It turns out that the word-align.conf template provided at
https://github.com/apache/incubator-joshua/blob/master/scripts/training/templates/alignment/word-align.conf
is not compatible with the berkeley aligner.
In particular the following lines are non compatible
https://github.com/apache/incubator-joshua/blob/master/scripts/training/templates/alignment/word-align.conf#L12-L15
Evidence of this is provided below
{code}
lmcgibbn@LMC-032857 /usr/local/incubator-joshua/lib(master) $ java -d64 -Xmx10g
-jar /usr/local/incubator-joshua/lib/berkeleyaligner.jar
++/usr/local/incubator-joshua/experiments/fisher_callhome_experiment/6/alignments/0/word-align.conf
Invalid enum: 'MODEL1 HMM'; valid choices: MODEL1|MODEL2|HMM|SYNTACTIC|NONE
lmcgibbn@LMC-032857 /usr/local/incubator-joshua/lib(master) $ java -d64 -Xmx10g
-jar /usr/local/incubator-joshua/lib/berkeleyaligner.jar
++/usr/local/incubator-joshua/experiments/fisher_callhome_experiment/6/alignments/0/word-align.conf
Invalid enum: 'MODEL1, HMM'; valid choices: MODEL1|MODEL2|HMM|SYNTACTIC|NONE
lmcgibbn@LMC-032857 /usr/local/incubator-joshua/lib(master) $ java -d64 -Xmx10g
-jar /usr/local/incubator-joshua/lib/berkeleyaligner.jar
++/usr/local/incubator-joshua/experiments/fisher_callhome_experiment/6/alignments/0/word-align.conf
Invalid enum: 'MODEL1 HMM'; valid choices: MODEL1|MODEL2|HMM|SYNTACTIC|NONE
lmcgibbn@LMC-032857 /usr/local/incubator-joshua/lib(master) $ java -d64 -Xmx10g
-jar /usr/local/incubator-joshua/lib/berkeleyaligner.jar
++/usr/local/incubator-joshua/experiments/fisher_callhome_experiment/6/alignments/0/word-align.conf
Invalid enum: 'JOINT JOINT'; valid choices: FORWARD|REVERSE|BOTH_INDEP|JOINT
lmcgibbn@LMC-032857 /usr/local/incubator-joshua/lib(master) $ java -d64 -Xmx10g
-jar /usr/local/incubator-joshua/lib/berkeleyaligner.jar
++/usr/local/incubator-joshua/experiments/fisher_callhome_experiment/6/alignments/0/word-align.conf
Exception in thread "main" java.lang.NumberFormatException: For input string:
"5 5"
at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Integer.parseInt(Integer.java:580)
at java.lang.Integer.parseInt(Integer.java:615)
at
edu.berkeley.nlp.fig.basic.OptInfo.interpretValue(OptionsParser.java:143)
at
edu.berkeley.nlp.fig.basic.OptInfo.interpretValue(OptionsParser.java:240)
at edu.berkeley.nlp.fig.basic.OptInfo.set(OptionsParser.java:294)
at
edu.berkeley.nlp.fig.basic.OptionsParser.readOptionsFile(OptionsParser.java:555)
at
edu.berkeley.nlp.fig.basic.OptionsParser.doParse(OptionsParser.java:604)
at edu.berkeley.nlp.fig.exec.Execution.init(Execution.java:293)
at edu.berkeley.nlp.wordAlignment.Main.main(Main.java:149)
lmcgibbn@LMC-032857 /usr/local/incubator-joshua/lib(master) $ java -d64 -Xmx10g
-jar /usr/local/incubator-joshua/lib/berkeleyaligner.jar
++/usr/local/incubator-joshua/experiments/fisher_callhome_experiment/6/alignments/0/word-align.conf
Cannot create directory: alignments/0
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
