There are problem with using /dev/stderr, and there's problems with alternative methods of catching the errors. https://github.com/moses-smt/mosesdecoder/pull/131 Not sure if anyone has time to work out the optimal path through this. Otherwise just go with what we've got
Hieu Hoang http://www.hoang.co.uk/hieu On 23 November 2015 at 18:30, Thoudam Doren Singh <[email protected]> wrote: > Hi Nicholas > > Yes, I could figure out in my case. It was something to do with > > > /mosesdecoder/scripts/generic/score-parallel.perl > /mosesdecoder/scripts/generic/extract-parallel.per > > > I removed the parts that send errors to /dev/stderr. > > > > > Best Regards > > > Doren > > > > > > > On Mon, Nov 23, 2015 at 12:01 PM, Nicholas Ruiz <[email protected]> wrote: > >> Looks like this problem is operating system-specific. Here's a related >> problem. >> >> >> https://stackoverflow.com/questions/26623626/bash-redirect-to-dev-stdout-not-a-directory# >> >> Reproduced here: >> nruiz@cheetah:/n/w10-nruiz/mt/zh-en/experiment/toy$ (echo "hi" > >> /dev/stdout) > test.txt >> -bash: /dev/stdout: Not a directory >> nruiz@cheetah:/n/w10-nruiz/mt/zh-en/experiment/toy$ (echo "hi" > >> /dev/stdout) > /tmp/test.txt >> >> The problem appears here >> in mosesdecoder/scripts/generic/extract-parallel.perl: >> my $cmd = "$extractCmd $TMPDIR/target.$numStr $TMPDIR/source.$numStr >> $TMPDIR/align.$numStr $TMPDIR/extract.$numStr $glueArg $otherExtractArgs >> $weightsCmd --SentenceOffset ".($i*$linesPerSplit)." 2>> /dev/stderr \n"; >> >> zınɹ ʞɔıu >> >> On Mon, Nov 23, 2015 at 11:17 AM, Nicholas Ruiz <[email protected]> wrote: >> >>> Reviving this. Thoudam, were you able to figure out why you were getting >>> this error during the phrase extraction step? >>> sh: /dev/stderr: Not a directory >>> >>> I recently encountered a similar problem at the same step in training. >>> >>> $ cat /proc/version >>> Linux version 2.6.32-504.16.2.el6.x86_64 ( >>> [email protected]) (gcc version 4.4.7 20120313 (Red >>> Hat 4.4.7-11) (GCC) ) #1 SMP Wed Apr 22 06:48:29 UTC 2015 >>> >>> zınɹ ʞɔıu >>> >>> On Sun, Sep 13, 2015 at 11:37 PM, Jeroen Vermeulen < >>> [email protected]> wrote: >>> >>>> There was an error about a missing /dev/stderr in there... Did that >>>> special file get deleted? >>>> >>>> >>>> Jeroen >>>> >>>> >>>> On September 12, 2015 2:58:31 PM GMT+07:00, Hieu Hoang < >>>> [email protected]> wrote: >>>>> >>>>> i can't see where the problem is, the commands seems to be ok. >>>>> >>>>> what operating system are you using? where did you get the >>>>> moses-train.sh code from? >>>>> >>>>> On 10/09/2015 17:03, Thoudam Doren Singh wrote: >>>>> >>>>> Moses training command I use is moses-train.sh >>>>> >>>>> >>>>> #!/bin/bash >>>>> set -x >>>>> set -e >>>>> HOME=/doren/Workspace >>>>> MAIN_DIR=$HOME >>>>> # mgiza++ directory >>>>> TOOLS_DIR=$HOME/tools >>>>> #Moses directory >>>>> MOSES_DIR=$HOME/mosesdecoder >>>>> export SCRIPTS_ROOTDIR=$MOSES_DIR/scripts >>>>> WORKING_DIR=$HOME/SMT-Models >>>>> CORPUS_DIR=$HOME/Corpus/Parallel-Corpora >>>>> TMPDIR=$HOME/tmp >>>>> SRC_LANG=EN >>>>> TGT_LANG=HN >>>>> SENT_LEN=70 >>>>> MOSES_ALIGN="grow-diag-final" >>>>> MODEL_DIR_PREFIX="$WORKING_DIR/model-en-hn-grow-diag-final" >>>>> LM_ORDER=5 >>>>> LM=$HOME/kenlm/bin/New-Filtered-Mono.Hindiaa.binary >>>>> MAX_PHRASE_LEN=7 >>>>> CORPUS_PREFIX=$CORPUS_DIR/clean-corpus-part1 >>>>> MODEL_REORDER=hier-mslr-bidirectional-fe >>>>> MODEL_DIR=$MODEL_DIR_PREFIX"-"$MODEL_REORDER"-intlm2" >>>>> mkdir -p $MODEL_DIR >>>>> nohup time $SCRIPTS_ROOTDIR/training/train-model.perl \ >>>>> -external-bin-dir $TOOLS_DIR \ >>>>> -model-dir $MODEL_DIR \ >>>>> -corpus $CORPUS_PREFIX \ >>>>> -f $SRC_LANG -e $TGT_LANG \ >>>>> -max-phrase-length $MAX_PHRASE_LEN \ >>>>> -alignment $MOSES_ALIGN \ >>>>> -reordering $MODEL_REORDER \ >>>>> -lm 0:$LM_ORDER:$LM:5 \ >>>>> -mgiza -mgiza-cpus 12 \ >>>>> -parallel -cores 4 \ >>>>> -temp-dir $TMPDIR >>>>> >>>>> >>>>> >>>>> Best Regards >>>>> >>>>> Thoudam Doren Singh >>>>> >>>>> On Thu, Sep 10, 2015 at 4:23 AM, Hieu Hoang <[email protected]> >>>>> wrote: >>>>> >>>>>> whats the exact command you ran? Can you also attach the config file >>>>>> you use >>>>>> >>>>>> >>>>>> On 09/09/2015 23:44, Thoudam Doren Singh wrote: >>>>>> >>>>>> Hi >>>>>> >>>>>> >>>>>> I am not sure why I am getting this error. Can someone help me out? >>>>>> I am sending part of the Moses training messages. >>>>>> >>>>>> >>>>>> >>>>>> /doren/Workspace/mosesdecoder/scripts/generic/extract-parallel.perl 4 >>>>>> split "sort " /doren/Workspace/mosesdecoder/scripts/../bin/extract >>>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN >>>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract >>>>>> 7 orientation --model hier-mslr --GZOutput >>>>>> Executing: >>>>>> /doren/Workspace/mosesdecoder/scripts/generic/extract-parallel.perl 4 >>>>>> split >>>>>> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/extract >>>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN >>>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract >>>>>> 7 orientation --model hier-mslr --GZOutput >>>>>> MAX 7 1 0 >>>>>> Started Tue Sep 8 15:21:49 2015 >>>>>> which: no pigz in >>>>>> (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin) >>>>>> using gzip >>>>>> Usage: split [OPTION]... [INPUT [PREFIX]] >>>>>> Output fixed-size pieces of INPUT to PREFIXaa, PREFIXab, ...; default >>>>>> size is 1000 lines, and default PREFIX is `x'. With no INPUT, or >>>>>> when INPUT >>>>>> is -, read standard input. >>>>>> >>>>>> Mandatory arguments to long options are mandatory for short options >>>>>> too. >>>>>> -a, --suffix-length=N use suffixes of length N (default 2) >>>>>> -b, --bytes=SIZE put SIZE bytes per output file >>>>>> -C, --line-bytes=SIZE put at most SIZE bytes of lines per output >>>>>> file >>>>>> -d, --numeric-suffixes use numeric suffixes instead of alphabetic >>>>>> -l, --lines=NUMBER put NUMBER lines per output file >>>>>> --verbose print a diagnostic just before each >>>>>> output file is opened >>>>>> --help display this help and exit >>>>>> --version output version information and exit >>>>>> >>>>>> SIZE may be (or may be an integer optionally followed by) one of >>>>>> following: >>>>>> KB 1000, K 1024, MB 1000*1000, M 1024*1024, and so on for G, T, P, E, >>>>>> Z, Y. >>>>>> >>>>>> Report split bugs to [email protected] >>>>>> GNU coreutils home page: < <http://www.gnu.org/software/coreutils/> >>>>>> http://www.gnu.org/software/coreutils/> >>>>>> General help using GNU software: < <http://www.gnu.org/gethelp/> >>>>>> http://www.gnu.org/gethelp/> >>>>>> Report split translation bugs to < >>>>>> <http://translationproject.org/team/> >>>>>> http://translationproject.org/team/> >>>>>> For complete documentation, run: info coreutils 'split invocation' >>>>>> isBSDSplit=0 >>>>>> Executing: mkdir -p >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970; >>>>>> ls -l >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970 >>>>>> total=20000 line-per-split=5001 >>>>>> split -d -l 5001 -a 7 >>>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/target.split >>>>>> -d -l 5001 -a 7 >>>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/source.split >>>>>> -d -l 5001 -a 7 >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/align.sh: >>>>>> /dev/stderr: Not a directory >>>>>> sh: /dev/stderr: Not a directory >>>>>> sh: /dev/stderr: Not a directory >>>>>> sh: /dev/stderr: Not a directory >>>>>> merging extract / extract.inv >>>>>> gunzip -c >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.gz >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.gz >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.gz >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.gz >>>>>> | LC_ALL=C sort -T >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970 >>>>>> 2>> /dev/stderr | gzip -c > >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz >>>>>> 2>> /dev/stderr >>>>>> gunzip -c >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.inv.gz >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.inv.gz >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.inv.gz >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.inv.gz >>>>>> | LC_ALL=C sort -T >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970 >>>>>> 2>> /dev/stderr | gzip -c > >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz >>>>>> 2>> /dev/stderr >>>>>> sh: /dev/stderr: Not a directory >>>>>> gzip: >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.gz: >>>>>> No such file or directory >>>>>> sh: /dev/stderr: Not a directory >>>>>> sh: /dev/stderr: Not a directory >>>>>> sh: /dev/stderr: Not a directory >>>>>> gzip: >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.inv.gz: >>>>>> No such file or directory >>>>>> gzip: gzip: >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.gz: >>>>>> No such file or directory >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.inv.gz: >>>>>> No such file or directory >>>>>> gzip: >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.gz: >>>>>> No such file or directory >>>>>> gzip: >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.inv.gz: >>>>>> No such file or directory >>>>>> gzip: >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.gz: >>>>>> No such file or directory >>>>>> gzip: >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.inv.gz: >>>>>> No such file or directory >>>>>> Finished Tue Sep 8 15:21:50 2015 >>>>>> (6) score phrases @ Tue Sep 8 15:21:50 CDT 2015 >>>>>> (6.1) creating table half >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e >>>>>> @ Tue Sep 8 15:21:50 CDT 2015 >>>>>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4 >>>>>> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz >>>>>> 0 >>>>>> Executing: >>>>>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4 >>>>>> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz >>>>>> 0 >>>>>> (6.1) creating table half >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f >>>>>> @ Tue Sep 8 15:21:50 CDT 2015 >>>>>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4 >>>>>> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz >>>>>> --Inverse 1 >>>>>> Executing: >>>>>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4 >>>>>> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz >>>>>> --Inverse 1 >>>>>> which: no pigz in >>>>>> (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin) >>>>>> which: no pigz in >>>>>> (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin) >>>>>> using gzip >>>>>> Started Tue Sep 8 15:21:50 2015 >>>>>> using gzip >>>>>> Started Tue Sep 8 15:21:50 2015 >>>>>> >>>>>> gzip: >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz: >>>>>> unexpected end of file >>>>>> >>>>>> gzip: >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz: >>>>>> unexpected end of file >>>>>> /doren/Workspace/mosesdecoder/scripts/../bin/score >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/extract.0.gz >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/phrase-table.half.0000000.gz >>>>>> --Inverse 2>> /dev/stderr >>>>>> /doren/Workspace/mosesdecoder/scripts/../bin/score >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/extract.0.gz >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz >>>>>> 2>> /dev/stderr >>>>>> >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/ >>>>>> run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.0.sh: >>>>>> line 1: /dev/stderr: Not a directory >>>>>> >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/ >>>>>> run.0.sh: line 1: /dev/stderr: Not a directory >>>>>> mv >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gzmv: >>>>>> cannot stat >>>>>> `/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz': >>>>>> No such file or directory >>>>>> gunzip -c >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/phrase-table.half.*.gz >>>>>> 2>> /dev/stderr| LC_ALL=C sort -T >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018 >>>>>> | gzip -c > >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz >>>>>> 2>> /dev/stderr sh: /dev/stderr: Not a directory >>>>>> sh: /dev/stderr: Not a directory >>>>>> Exit code: 1 >>>>>> ERROR: Scoring of phrases failed at >>>>>> /doren/Workspace/mosesdecoder/scripts/training/train-model.perl line >>>>>> 1773. >>>>>> Exit code: 1 >>>>>> ERROR: Scoring of phrases failed at >>>>>> /doren/Workspace/mosesdecoder/scripts/training/train-model.perl line >>>>>> 1773. >>>>>> (6.6) consolidating the two halves @ Tue Sep 8 15:21:50 CDT 2015 >>>>>> Executing: /doren/Workspace/mosesdecoder/scripts/../bin/consolidate >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz >>>>>> /dev/stdout | gzip -c > >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.gz >>>>>> Consolidate v2.0 written by Philipp Koehn >>>>>> consolidating direct and indirect rule tables >>>>>> terminate called after throwing an instance of 'std::runtime_error' >>>>>> what(): Could not open >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz. >>>>>> Executing: rm -f >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.* >>>>>> (7) learn reordering model @ Tue Sep 8 15:21:51 CDT 2015 >>>>>> (7.1) [no factors] learn reordering model @ Tue Sep 8 15:21:51 CDT >>>>>> 2015 >>>>>> (7.2) building tables @ Tue Sep 8 15:21:51 CDT 2015 >>>>>> Executing: >>>>>> /doren/Workspace/mosesdecoder/scripts/../bin/lexical-reordering-score >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz >>>>>> 0.5 >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/reordering-table. >>>>>> --model "hier mslr hier-mslr-bidirectional-fe" >>>>>> Lexical Reordering Scorer >>>>>> scores lexical reordering models of several types (hierarchical, >>>>>> phrase-based and word-based-extraction >>>>>> terminate called after throwing an instance of 'util::ErrnoException' >>>>>> what(): util/file.cc:68 in int util::OpenReadOrThrow(const char*) >>>>>> threw ErrnoException because `-1 == (ret = open(name, 00))'. >>>>>> No such file or directory while opening >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz >>>>>> ERROR: Execution of: >>>>>> /doren/Workspace/mosesdecoder/scripts/../bin/lexical-reordering-score >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz >>>>>> 0.5 >>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/reordering-table. >>>>>> --model "hier mslr hier-mslr-bidirectional-fe" >>>>>> died with signal 6, without coredump >>>>>> 823.89user 55.26system 3:53.03elapsed 377%CPU (0avgtext+0avgdata >>>>>> 629344maxresident)k >>>>>> 27176inputs+273160outputs (28major+2115194minor)pagefaults 0swaps >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> Best Regards >>>>>> >>>>>> >>>>>> Thoudam Doren Singh >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Moses-support mailing >>>>>> [email protected]http://mailman.mit.edu/mailman/listinfo/moses-support >>>>>> >>>>>> >>>>>> -- >>>>>> Hieu Hoanghttp://www.hoang.co.uk/hieu >>>>>> >>>>>> >>>>> >>>>> -- >>>>> Hieu Hoanghttp://www.hoang.co.uk/hieu >>>>> >>>>> ------------------------------ >>>>> >>>>> Moses-support mailing list >>>>> [email protected] >>>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>>> >>>>> >>>> _______________________________________________ >>>> Moses-support mailing list >>>> [email protected] >>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>> >>>> >>> >> >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
