Hi Josh,

I tried your solution back to my solaris machine, and it failed in extract
phase, with a coredump. For now, I will use Moses in Ubuntu/coLinux.

Here is the last part of the output when I tried it in solaris:

Executing: cat model/model/extract.0-0.o.part* > model/model/extract.0-0.o
Executing: rm -f model/model/extract.0-0.o.gz
Executing: gzip model/model/extract.0-0.o
Executing: rm -f model/model/extract.0-0.o.part*
Executing: cat model/model/extract.0-0.part* > model/model/extract.0-0
Executing: rm -f model/model/extract.0-0.part*
Executing: cat model/model/extract.0-0.inv.part* >
model/model/extract.0-0.inv
Executing: rm -f model/model/extract.0-0.inv.part*
(6) score phrases @ Mon Aug 18 14:16:14 SGT 2008
(6) [0-0] score phrases @ Mon Aug 18 14:16:14 SGT 2008
Executing: gunzip < model/model/extract.0-0.gz > model/model/extract.0-0
(6.1) [0-0]  sorting @ Mon Aug 18 14:16:14 SGT 2008
Executing: LC_ALL=C sort -T model/model model/model/extract.0-0 >
model/model/extract.0-0.sorted
Executing: rm -f model/model/extract.0-0.gz
Executing: gzip model/model/extract.0-0
Executing: rm -f model/model/extract.0-0.sorted.gz
Executing: gzip model/model/extract.0-0.sorted
Executing: gunzip < model/model/extract.0-0.inv.gz >
model/model/extract.0-0.inv
(6.2) [0-0]  sorting inv @ Mon Aug 18 14:16:14 SGT 2008
Executing: LC_ALL=C sort -T model/model model/model/extract.0-0.inv >
model/model/extract.0-0.inv.sorted
Executing: rm -f model/model/extract.0-0.inv.gz
Executing: gzip model/model/extract.0-0.inv
Executing: rm -f model/model/extract.0-0.inv.sorted.gz
Executing: gzip model/model/extract.0-0.inv.sorted
(6.3) [0-0]  creating table half model/model/phrase-table.0-0.half.f2n @ Mon
Aug 18 14:16:14 SGT 2008
model/model/extract.0-0.sorted.gz.Z: No such file or directory
/usr/local/bin/scripts-20080801-2109/training/phrase-extract/score
model/model/extract.0-0.sorted.part0000 model/model/lex.0-0.f2n
model/model/phrase-table.0-0.half.f2n.part0000
Executing:
/usr/local/bin/scripts-20080801-2109/training/phrase-extract/score
model/model/extract.0-0.sorted.part0000 model/model/lex.0-0.f2n
model/model/phrase-table.0-0.half.f2n.part0000
PhraseScore v1.2.1, written by Philipp Koehn
phrase scoring methods for extracted phrases
Loading lexical translation table from model/model/lex.0-0.f2n
Execution of:
/usr/local/bin/scripts-20080801-2109/training/phrase-extract/score
model/model/extract.0-0.sorted.part0000 model/model/lex.0-0.f2n
model/model/phrase-table.0-0.half.f2n.part0000
  died with signal 11, with coredump


Regards,
Anung


On Sat, Aug 16, 2008 at 12:29 AM, Josh Schroeder <[EMAIL PROTECTED]>wrote:

> I was able to regenerate the bug below on my Mac. As expected, it's a
> problem with OS X needing to use "gzcat" instead of "zcat", and train-
> factored-phrase-model.perl being hard-coded to zcat. OS X has a dumbed-
> down version of zcat that won't work with the script. The failure is
> actually a few steps earlier, in word alignment extraction. An empty
> word alignment file gets generated and things go downhill from there.
>
> There's a $ZCAT variable in the file you can set to "gzcat", but there
> was one instance that doesn't use it. I've checked in a change with
> $ZCAT used exclusively, but left the value as 'zcat' instead of
> 'gzcat' to keep the linux majority happy.
>
>
> http://mosesdecoder.svn.sourceforge.net/viewvc/mosesdecoder/trunk/scripts/training/train-factored-phrase-model.perl?r1=1865&r2=1875&pathrev=1875
>
> change
> my $ZCAT = "zcat";
> to
> my $ZCAT = "gzcat";
>
> in the new file and it should work for all the Mac folks.
>
> There are a few other training scripts that do this, it's pretty easy
> to do a find and replace in them.
>
> -Josh
>
> On 13 Aug 2008, at 11:53, Josh Schroeder wrote:
>
> >> you may have already received my email on the following problem when
> >> building the language model:
> >>
> >> Executing: cat ./model/extract.0-0.o.part* > ./model/extract.0-0.o
> >> cat: ./model/extract.0-0.o.part*: No such file or directory
> >> Exit code: 1
> >
> > That's building the phrase table, not the language model. It seems
> > like several people on the list are having problems with this step,
> > so I'm going to take a look at the training process and post
> > something to the list in the next day or two.
>
>
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
> _______________________________________________
> Moses-support mailing list
> [email protected]
> http://mailman.mit.edu/mailman/listinfo/moses-support
>



-- 
barliant at {gmail.com, yahoo.com}
Starting July 2008, barliant at cbn.net.id is no longer active
Visit my Blog at barliant dot blogspot dot com
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to