Hi, I would have to see the experiment.meta that you defined to get a sense of what could be done.
In the meantime, what Matthias suggested works for sure - just point to files that have been generated by steps that you do not want to rerun. -phi On Fri, Jun 19, 2015 at 2:42 PM, Matthias Huck <[email protected]> wrote: > Hi Evgeny, > > If setting TRAINING:config won't help, then it might get a bit tricky. > Another thing you can try is setting filtered-config or filtered-dir in > the [TUNING] section. > > The next workaround I can think of is pointing to existing files in all > the [CORPUS:*] sections by setting tokenized-stem, clean-stem, > truecased-stem ... > > Similarly in the [LM:*] sections with tokenized-corpus and > truecased-corpus etc., if defining lm and/or binlm doesn't make it skip > those steps. > > Cheers, > Matthias > > > On Fri, 2015-06-19 at 16:41 +0000, Evgeny Matusov wrote: > > Hi, > > > > > > to those of you using Experiment.perl for experiments, maybe you can > > help me solve the following problem: > > > > > > I added a step to filter full segment overlap of evaluation and tuning > > data with the training data. This steps removes all sentences from > > each CORPUS which are also found in EVALUATION and TUNING sentences. > > Thus, one of the CORPUS steps depend on EVALUATION and TUNING. > > > > > > Now, I want to exchange the tuning corpus I am using, picking another > > one which was already declared in the EVALUATION section. Thus, the > > filter against which the overlap is checked does not change, and hence > > the training data does not need to be filtered again, and therefore > > neither the alignment training nor LM training or anything else should > > be repeated, just the tuning step should re-start. However, > > Experiment.perl is not smart enough to realize this. I tried to add > > "pass-if" or "ignore-if" step on the filter-overlap step that I > > declared and set a variable to pass it, but this did not help - all > > steps after it are still executed. Setting TRAINING:config to a valid > > moses.ini file helps to prevent the alignment training from running, > > but not the LM training, nor (more importantly), the several > > cleaning/lowercasing steps that follow the overlap step for each > > training corpus. > > > > > > Is there an easy way to block everything below tuning from being > > repeated, even if the tuning data changes? > > > > > > Thanks, > > > > Evgeny. > > > > > > > > > > _______________________________________________ > > Moses-support mailing list > > [email protected] > > http://mailman.mit.edu/mailman/listinfo/moses-support > > > > -- > The University of Edinburgh is a charitable body, registered in > Scotland, with registration number SC005336. > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
