if phrase-table.1.gz is empty, then look in TRAINING_build-ttable.1.STDERR or TRAINING_extract-phrases.1.STDERR to see if you can find any clues. My guess is that you've run out of disk space, or a command unix command (sort, cat, gzip etc) hasn't been installed on your cygwin installation.
On 15 May 2013 18:19, A.E.M. Koenraadt <[email protected]> wrote: > Barry, you're right, TUNING_filter.1.STDERR: > > Using SCRIPTS_ROOTDIR: > /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts > (9) create moses.ini @ Tue May 14 22:22:19 CEST 2013 > Executing: mkdir -p > /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.1 > Considering factor 0 > Considering factor 0 > filtering > /cygdrive/c/Users/<user>/Desktop/moses/experiment/model/phrase-table.1 > -> > > /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.1/phrase-table.0-0.1.1... > No phrases found in > /cygdrive/c/Users/<user>/Desktop/moses/experiment/model/phrase-table.1! > at > /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/ > filter-model-given-input.pl > line 271. > > And that's correct, because > 1) there's no phrase-table.1 > 2) phrase-table.1.gz is empty. > > I've gone through the other STDERR files but I don't know what I'm > looking for. The only one that stood out was one with a huge amount of > exclamation marks, TRAINING_build-lex-trans.1.STDERR: > > Using SCRIPTS_ROOTDIR: > /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts > (4) generate lexical translation table 0-0 @ Tue May 14 22:12:54 CEST 2013 > Use of uninitialized value $_BASELINE_CORPUS in concatenation (.) or > string at > > /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/train-model.perl > line 1250. > Use of uninitialized value $_BASELINE_CORPUS in concatenation (.) or > string at > > /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/train-model.perl > line 1250. > (/cygdrive/c/Users/<user>/Desktop/moses/experiment/training/corpus.1.fr > ,/cygdrive/c/Users/<user>/Desktop/moses/experiment/training/corpus.1.en,/cygdrive/c/Users/<user>/Desktop/moses/experiment/model/lex.1) > > !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! > Saved: /cygdrive/c/Users/<user>/Desktop/moses/experiment/model/lex.1.f2e > and /cygdrive/c/Users/<user>/Desktop/moses/experiment/model/lex.1.e2f > > But the resulting file, lex.1.e2f is not empty, it is 15118kb. > > What should I be looking for? > > Kind regards, > Diana > > On 5/15/2013 8:32 AM, Barry Haddow wrote: > > Hi Diana > > > > It sounds like the TUNING_filter step failed, so you need to look at > > its STDERR file, > > > > cheers - Barry > > > > On 15/05/13 06:41, A.E.M. Koenraadt wrote: > >> Clear and re-run didn't help. > >> What can I do to fix this? > >> > >> Kind regards, > >> Diana > >> > >> On 5/14/2013 8:10 PM, A.E.M. Koenraadt wrote: > >>> Hi Barry, > >>> > >>> the directory tuning/filtered.2 contains the empty file > >>> phrase-table.0-0.1.1 and a moses.ini which I've attached here. The > >>> folder contains no other files. > >>> > >>> I've cleared the entire experiment directory and am running the > >>> steps from scratch again. Not sure if it'll help, but we're probably > >>> in a different time zone anyway so it won't matter ;) > >>> > >>> Thanks for your help and quick replies so far!! > >>> > >>> Kind regards, > >>> Diana > >>> > >>> > >>> On 5/14/2013 9:46 AM, Barry Haddow wrote: > >>>> Hi Diana > >>>> > >>>> This time the existence check that fails is in the decoder itself, > >>>> ie in C++, as opposed to in perl. So it's probably not the same > >>>> problem. > >>>> > >>>> It could be that TUNING:filter failed. Can you check the logs for > >>>> that? What is in the directory > >>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.2 ? > >>>> > >>>> cheers - Barry > >>>> > >>>> > >>>> > >>>> On 14/05/13 07:06, A.E.M. Koenraadt wrote: > >>>>> Hi Barry, > >>>>> > >>>>> This has indeed solved the problem I had. > >>>>> However, a new problem occurs, in the tuning step. All other steps > >>>>> pass now, so I think and hope this is the final hurdle. > >>>>> > >>>>> Attached you may find the graph again. > >>>>> > >>>>> In the log: > >>>>> > >>>>> number of steps doable or running: 1 at Mon, May 13, 2013 11:05:32 PM > >>>>> doable: TUNING:tune > >>>>> executing > >>>>> > /cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/2/TUNING_tune.2 > >>>>> via sh (1 active) > >>>>> step TUNING:tune crashed > >>>>> number of steps doable or running: 0 at Mon, May 13, 2013 11:05:41 PM > >>>>> > >>>>> In steps/2/TUNING_tune.2.STDERR: > >>>>> > >>>>> Using SCRIPTS_ROOTDIR: > >>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts > >>>>> Asking moses for feature names and values from > >>>>> > /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.filtered.ini.2 > >>>>> Executing: /cygdrive/c/Users/<user>/Desktop/moses/cygwin/bin/moses > >>>>> -threads 4 -v 0 -config > >>>>> > /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.filtered.ini.2 > >>>>> -inputtype 0 -show-weights > ./features.list > >>>>> ERROR:File > >>>>> > /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.2/reordering-table.2.wbe-msd-bidirectional-fe > >>>>> does not exist > >>>>> Exit code: 1 > >>>>> Failed to run moses with the config > >>>>> > /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.filtered.ini.2 > >>>>> at > >>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/ > mert-moses.pl > >>>>> line 1169. > >>>>> cp: cannot stat > >>>>> > `/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/tmp.2/moses.ini': > >>>>> No such file or directory > >>>>> > >>>>> Again, the specified file indeed doesn't exist.. I'm unfortunately > >>>>> not able to investigate this in detail myself at the moment. Could > >>>>> it be a similar problem in mert-moses.pl? > >>>>> > >>>>> Kind regards, > >>>>> Diana > >>>>> > >>>>> On 5/13/2013 9:21 PM, A.E.M. Koenraadt wrote: > >>>>>> Hi Barry, > >>>>>> > >>>>>> thank you for your quick reply. Yes, I replaced my user name with > >>>>>> <user> for my e-mail to this list. The path does exist, so I > >>>>>> replaced the single occurrence of "if ! -s $filename" in > >>>>>> train-model.perl by "if ! -e $filename" like you said. The new > >>>>>> test is running right now, I'll report back when I have some new > >>>>>> results! I hope this brings me one step closer to finishing the > >>>>>> baseline system :) > >>>>>> > >>>>>> Kind regards, > >>>>>> Diana > >>>>>> > >>>>>> On 5/13/2013 10:37 AM, Barry Haddow wrote: > >>>>>>> Hi Diana > >>>>>>> > >>>>>>> Training is failing because the existence check for > >>>>>>> > >>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment > >>>>>>> > >>>>>>> is failing. Is this the actual path that Moses is looking for, > >>>>>>> or did you replace your user name with <user> in order to mail > >>>>>>> support? > >>>>>>> > >>>>>>> If the path that it is looking for indeed exists, it could be > >>>>>>> because train-model.perl is using > >>>>>>> > >>>>>>> if ! -s $filename # exists and has non-zero length > >>>>>>> > >>>>>>> instead of > >>>>>>> > >>>>>>> if ! -e $filename # exists > >>>>>>> > >>>>>>> and the results differ between Linux and cygwin. > >>>>>>> > >>>>>>> Could you try replacing the "-s" with a "-e" and see if it works? > >>>>>>> > >>>>>>> cheers - Barry > >>>>>>> > >>>>>>> > >>>>>>> > >>>>>>> On 12/05/13 20:29, A.E.M. Koenraadt wrote: > >>>>>>>> Hi all, > >>>>>>>> > >>>>>>>> I've been trying to get EMS (experiment.perl) working, at least > >>>>>>>> for the Baseline system > >>>>>>>> (http://www.statmt.org/moses/?n=moses.baseline). I started > >>>>>>>> using EMS because I ran into some problems and had hoped that > >>>>>>>> using EMS and the sample config would relieve me from supplying > >>>>>>>> too many commandline arguments. It has helped me so far. > >>>>>>>> > >>>>>>>> Unfortunately, I run into errors for the 'evaluation' and > >>>>>>>> 'tuning' steps. I'm not yet familiar with the details of each > >>>>>>>> step, so I'm hoping I can find some help here with these errors > >>>>>>>> because I couldn't find it online so far. > >>>>>>>> > >>>>>>>> I'm running Cygwin under Win7 and when executing the baseline > >>>>>>>> example, I have the following errors. > >>>>>>>> > >>>>>>>> In the log: > >>>>>>>> > >>>>>>>> number of steps doable or running: 3 at Sun, May 12, 2013 > >>>>>>>> 8:21:08 PM > >>>>>>>> doable: TRAINING:create-config > >>>>>>>> doable: EVALUATION:newstest2010:filter > >>>>>>>> doable: TUNING:filter > >>>>>>>> executing > >>>>>>>> > /cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/1/TRAINING_create-config.1 > >>>>>>>> via sh (1 active) > >>>>>>>> executing > >>>>>>>> > /cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/1/EVALUATION_newstest2010_filter.1 > >>>>>>>> via sh (2 active) > >>>>>>>> step EVALUATION:newstest2010:filter crashed > >>>>>>>> number of steps doable or running: 1 at Sun, May 12, 2013 > >>>>>>>> 8:21:23 PM > >>>>>>>> doable: TUNING:filter > >>>>>>>> executing > >>>>>>>> > /cygdrive/c/Users/<user>/Desktop/moses/experiment/steps/1/TUNING_filter.1 > >>>>>>>> via sh (1 active) > >>>>>>>> step TUNING:filter crashed > >>>>>>>> number of steps doable or running: 0 at Sun, May 12, 2013 > >>>>>>>> 8:21:33 PM > >>>>>>>> > >>>>>>>> In steps/1/EVALUATION_newstest2010_filter.1.STDERR > >>>>>>>> > >>>>>>>> Using SCRIPTS_ROOTDIR: > >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts > >>>>>>>> ERROR: Language model file not found or empty: > >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment at > >>>>>>>> > /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/train-model.perl > >>>>>>>> line 440. > >>>>>>>> Executing: mkdir -p > >>>>>>>> > /cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.filtered.1 > >>>>>>>> Can't read > >>>>>>>> > /cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.moses.table.ini.1 > >>>>>>>> at > >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/ > filter-model-given-input.pl > >>>>>>>> line 89. > >>>>>>>> rm: cannot remove > >>>>>>>> > `/cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.moses.table.ini.1': > >>>>>>>> No such file or directory > >>>>>>>> > >>>>>>>> In steps/1/TUNING_filter.1.STDERR > >>>>>>>> > >>>>>>>> Using SCRIPTS_ROOTDIR: > >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts > >>>>>>>> ERROR: Language model file not found or empty: > >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/experiment at > >>>>>>>> > /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/train-model.perl > >>>>>>>> line 440. > >>>>>>>> Executing: mkdir -p > >>>>>>>> > /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/filtered.1 > >>>>>>>> Can't read > >>>>>>>> > /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.table.ini.1 > >>>>>>>> at > >>>>>>>> /cygdrive/c/Users/<user>/Desktop/moses/cygwin/scripts/training/ > filter-model-given-input.pl > >>>>>>>> line 89. > >>>>>>>> rm: cannot remove > >>>>>>>> > `/cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.table.ini.1': > >>>>>>>> No such file or directory > >>>>>>>> > >>>>>>>> The files it seems to concern (although I'm not sure given that > >>>>>>>> they occur after the 'not found or empty' notification) > >>>>>>>> > /cygdrive/c/Users/<user>/Desktop/moses/experiment/evaluation/newstest2010.moses.table.ini.1 > >>>>>>>> and > >>>>>>>> > /cygdrive/c/Users/<user>/Desktop/moses/experiment/tuning/moses.table.ini.1 > >>>>>>>> indeed don't exist... > >>>>>>>> > >>>>>>>> Attached also the current graph.1.png. > >>>>>>>> > >>>>>>>> I've been able to fix other issues so far with the help of > >>>>>>>> messages on this support mailinglist, so I'm hoping someone can > >>>>>>>> help me fix this as well so that I can run the baseline example. > >>>>>>>> > >>>>>>>> Thank you kindly in advance. > >>>>>>>> > >>>>>>>> Diana Koenraadt > >>>>>>>> > >>>>>>>> > >>>>>>>> _______________________________________________ > >>>>>>>> Moses-support mailing list > >>>>>>>> [email protected] > >>>>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support > >>>>>>> > >>>>>>> > >>>>>> > >>>>> > >>>> > >>>> > >>> > >> > >> > > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > -- Hieu Hoang Research Associate University of Edinburgh http://www.hoang.co.uk/hieu
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
