So, I had deleted the 'evaluation' folder, in hopes that it would re-run the test portion and regenerate the output. It generates an entire plan (the graphical ghostview plan thing), and looking through the log (attached) it appears to think that the report is there, and it doesn't need to generate it, but it's not there.
So how do I tell it that it needs to generate the report? Thanks! Craig On Thu, May 3, 2012 at 11:23 PM, Philipp Koehn <[email protected]> wrote: > Hi, > > you did the right thing here: > > [EVALUATION:europarl-small] > raw-input = $test-dir/newstest2009.$input-extension > raw-reference = $test-dir/newstest2009.$output-extension > > [EVALUATION:wasp0] > raw-input = $data-dir/0/test/test.$input-extension > raw-reference = $data-dir/0/test/test.$output-extension > > [EVALUATION:wasp1] > raw-input = $data-dir/1/test/test.$input-extension > raw-reference = $data-dir/1/test/test.$output-extension > > Why did this not work? What happened? > > The results will be summarize in one report file. > > If you run with different settings (different language models), > then this will need to be a different run of the experiment, but it > will be able to re-use much from the first run (such as the entire > translation model training pipeline). > > -phi > > On Thu, May 3, 2012 at 6:21 PM, Craig Wampler <[email protected]> > wrote: > > Hi, > > > > I've followed the EMS walkthrough, and I was able to run an experiment. > The > > training/tuning took about 6 hours. I would now like to test it against > > multiple test sets. How do I either > > > > a) modify the config file > > b) delete the right files/folders in my evaluation folder > > > > To get it to re-run and re-report. > > > > Ideally, I'd run the command once against my 10 test sets, and end up > with > > 10 reports (with different names), without having to re-train and re-tune > > against he same training and tuning sets. > > > > I'd also like to be able to use two different language models (so a > total of > > 20 evaluations). > > > > I've attached a copy of my config. If you look in the evaluation > section, on > > line 198 is the evaluation that ran. I then tried adding the two more > test > > evaluations (lines 202 and 206), but that didn't work. I also tried > deleting > > the steps folder. All it does is pop up an execution plan that says it's > > going to regenerate the report, but it doesn't even regenerate the > report. > > > > Thanks! > > > > _______________________________________________ > > Moses-support mailing list > > [email protected] > > http://mailman.mit.edu/mailman/listinfo/moses-support > > >
STARTING UP AS PROCESS 5187 ON craig-VirtualBox AT Fri May 4 09:10:18 EDT 2012 LOAD CONFIG... working directory is /home/craig/working/experiments cp: cannot stat `config': No such file or directory running experimenal run number 6 ESTABLISH WHICH STEPS NEED TO BE RUN FIND DEPENDENCIES BETWEEN STEPS CHECKING IF OLD STEPS ARE RE-USABLE STEP SUMMARY: 48 CORPUS:project-syndicate:tokenize -> re-using (1) 47 CORPUS:project-syndicate:clean -> re-using (1) 43 CORPUS:project-syndicate:truecase -> re-using (1) 39 TRUECASER:consolidate -> re-using (1) 38 TRUECASER:train -> re-using (1) 37 TRAINING:consolidate -> re-using (1) 36 TRAINING:prepare-data -> re-using (1) 35 TRAINING:run-giza -> re-using (1) 34 TRAINING:run-giza-inverse -> re-using (1) 33 TRAINING:symmetrize-giza -> re-using (1) 32 TRAINING:build-lex-trans -> re-using (1) 30 TRAINING:extract-phrases -> re-using (1) 29 TRAINING:build-reordering -> re-using (1) 28 TRAINING:build-ttable -> re-using (1) 27 TRAINING:create-config -> re-using (1) 26 TUNING:tokenize-input -> re-using (1) 22 TUNING:truecase-input -> re-using (1) 20 TUNING:tokenize-reference -> re-using (1) 19 TUNING:truecase-reference -> re-using (1) 17 TUNING:filter -> re-using (1) 16 TUNING:apply-filter -> re-using (1) 15 TUNING:tune -> re-using (1) 14 TUNING:apply-weights -> re-using (1) 13 EVALUATION:wasp1:tokenize-input -> re-using (1) 9 EVALUATION:wasp1:truecase-input -> re-using (1) 7 EVALUATION:wasp1:filter -> re-using (1) 6 EVALUATION:wasp1:apply-filter -> re-using (1) 5 EVALUATION:wasp1:decode -> re-using (1) 3 EVALUATION:wasp1:tokenize-reference -> re-using (1) 1 EVALUATION:wasp1:multi-bleu -> re-using (1) 0 REPORTING:report -> re-using (1) Warning: Cannot convert string "-*-Helvetica-Medium-R-Normal--*-140-*-*-P-*-ISO8859-1" to type FontStruct Warning: Cannot convert string "-*-Helvetica-Medium-R-Normal--*-120-*-*-P-*-ISO8859-1" to type FontStruct Warning: Cannot convert string "-*-Helvetica-Medium-R-Normal--*-100-*-*-P-*-ISO8859-1" to type FontStruct Warning: Cannot convert string "-*-Helvetica-Bold-R-Normal--*-120-*-*-P-*-ISO8859-1" to type FontStruct EXECUTE STEPS number of steps doable or running: 0
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
