Re: [Moses-support] Moses Training Error - died with signal 6, without coredump

Thu, 10 Sep 2015 02:27:03 -0700 

whats the exact command you ran? Can you also attach the config file you use

On 09/09/2015 23:44, Thoudam Doren Singh wrote:

Hi


I am not sure why I am getting this error. Can someone help me out?
I am sending part of the Moses training messages.
/doren/Workspace/mosesdecoder/scripts/generic/extract-parallel.perl 4 split "sort " /doren/Workspace/mosesdecoder/scripts/../bin/extract /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract 7 orientation --model hier-mslr --GZOutput Executing: /doren/Workspace/mosesdecoder/scripts/generic/extract-parallel.perl 4 split "sort " /doren/Workspace/mosesdecoder/scripts/../bin/extract /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract 7 orientation --model hier-mslr --GZOutput 
MAX 7 1 0
Started Tue Sep  8 15:21:49 2015
which: no pigz in (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin) 
using gzip
Usage: split [OPTION]... [INPUT [PREFIX]]
Output fixed-size pieces of INPUT to PREFIXaa, PREFIXab, ...; default
size is 1000 lines, and default PREFIX is `x'. With no INPUT, or when INPUT 
is -, read standard input.

Mandatory arguments to long options are mandatory for short options too.
  -a, --suffix-length=N   use suffixes of length N (default 2)
  -b, --bytes=SIZE        put SIZE bytes per output file
  -C, --line-bytes=SIZE   put at most SIZE bytes of lines per output file
  -d, --numeric-suffixes  use numeric suffixes instead of alphabetic
  -l, --lines=NUMBER      put NUMBER lines per output file
      --verbose           print a diagnostic just before each
                            output file is opened
      --help     display this help and exit
      --version  output version information and exit
SIZE may be (or may be an integer optionally followed by) one of following: KB 1000, K 1024, MB 1000*1000, M 1024*1024, and so on for G, T, P, E, Z, Y. 

Report split bugs to [email protected] <mailto:[email protected]>
GNU coreutils home page: <http://www.gnu.org/software/coreutils/>
General help using GNU software: <http://www.gnu.org/gethelp/>
Report split translation bugs to <http://translationproject.org/team/>
For complete documentation, run: info coreutils 'split invocation'
isBSDSplit=0
Executing: mkdir -p /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970; ls -l /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970 
total=20000 line-per-split=5001
split -d -l 5001 -a 7 /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/target.split -d -l 5001 -a 7 /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/source.split -d -l 5001 -a 7 /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/align.sh: /dev/stderr: Not a directory 
sh: /dev/stderr: Not a directory
sh: /dev/stderr: Not a directory
sh: /dev/stderr: Not a directory
merging extract / extract.inv
gunzip -c /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.gz /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.gz /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.gz /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.gz | LC_ALL=C sort -T /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970 2>> /dev/stderr | gzip -c > /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz 2>> /dev/stderr gunzip -c /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.inv.gz /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.inv.gz /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.inv.gz /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.inv.gz | LC_ALL=C sort -T /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970 2>> /dev/stderr | gzip -c > /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz 2>> /dev/stderr 
sh: /dev/stderr: Not a directory
gzip: /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.gz: No such file or directory 
sh: /dev/stderr: Not a directory
sh: /dev/stderr: Not a directory
sh: /dev/stderr: Not a directory
gzip: /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.inv.gz: No such file or directory gzip: gzip: /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.gz: No such file or directory /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.inv.gz: No such file or directory gzip: /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.gz: No such file or directory gzip: /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.inv.gz: No such file or directory gzip: /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.gz: No such file or directory gzip: /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.inv.gz: No such file or directory 
Finished Tue Sep  8 15:21:50 2015
(6) score phrases @ Tue Sep  8 15:21:50 CDT 2015
(6.1) creating table half /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e @ Tue Sep 8 15:21:50 CDT 2015 /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4 "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz 0 Executing: /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4 "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz 0 (6.1) creating table half /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f @ Tue Sep 8 15:21:50 CDT 2015 /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4 "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz --Inverse 1 Executing: /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4 "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz --Inverse 1 which: no pigz in (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin) which: no pigz in (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin) 
using gzip
Started Tue Sep  8 15:21:50 2015
using gzip
Started Tue Sep  8 15:21:50 2015
gzip: /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz: unexpected end of file
gzip: /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz: unexpected end of file /doren/Workspace/mosesdecoder/scripts/../bin/score /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/extract.0.gz /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/phrase-table.half.0000000.gz --Inverse 2>> /dev/stderr /doren/Workspace/mosesdecoder/scripts/../bin/score /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/extract.0.gz /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz 2>> /dev/stderr /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.0.sh <http://run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.0.sh>: line 1: /dev/stderr: Not a directory /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.0.sh <http://run.0.sh>: line 1: /dev/stderr: Not a directory mv /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gzmv: cannot stat `/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz': No such file or directory gunzip -c /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/phrase-table.half.*.gz 2>> /dev/stderr| LC_ALL=C sort -T /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018 | gzip -c > /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz 2>> /dev/stderr sh: /dev/stderr: Not a directory 
sh: /dev/stderr: Not a directory
Exit code: 1
ERROR: Scoring of phrases failed at /doren/Workspace/mosesdecoder/scripts/training/train-model.perl line 1773. 
Exit code: 1
ERROR: Scoring of phrases failed at /doren/Workspace/mosesdecoder/scripts/training/train-model.perl line 1773. 
(6.6) consolidating the two halves @ Tue Sep  8 15:21:50 CDT 2015
Executing: /doren/Workspace/mosesdecoder/scripts/../bin/consolidate /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz /dev/stdout | gzip -c > /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.gz 
Consolidate v2.0 written by Philipp Koehn
consolidating direct and indirect rule tables
terminate called after throwing an instance of 'std::runtime_error'
what(): Could not open /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz. Executing: rm -f /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.* 
(7) learn reordering model @ Tue Sep  8 15:21:51 CDT 2015
(7.1) [no factors] learn reordering model @ Tue Sep  8 15:21:51 CDT 2015
(7.2) building tables @ Tue Sep  8 15:21:51 CDT 2015
Executing: /doren/Workspace/mosesdecoder/scripts/../bin/lexical-reordering-score /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz 0.5 /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/reordering-table. --model "hier mslr hier-mslr-bidirectional-fe" 
Lexical Reordering Scorer
scores lexical reordering models of several types (hierarchical, phrase-based and word-based-extraction 
terminate called after throwing an instance of 'util::ErrnoException'
what(): util/file.cc:68 in int util::OpenReadOrThrow(const char*) threw ErrnoException because `-1 == (ret = open(name, 00))'. No such file or directory while opening /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz ERROR: Execution of: /doren/Workspace/mosesdecoder/scripts/../bin/lexical-reordering-score /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz 0.5 /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/reordering-table. --model "hier mslr hier-mslr-bidirectional-fe" 
  died with signal 6, without coredump
823.89user 55.26system 3:53.03elapsed 377%CPU (0avgtext+0avgdata 629344maxresident)k 
27176inputs+273160outputs (28major+2115194minor)pagefaults 0swaps




Best Regards


Thoudam Doren Singh


_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support


--
Hieu Hoang
http://www.hoang.co.uk/hieu


_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to