Hi Lane, multi-threading in Moses works the same: different sentences are distributed to different threads.
Adding stateful feature functions has two costs: one is the calculation of the function and one is the additional state splitting which hurts recombination is the beam search. The first cost is easy to measure, but the second one is more tricky - a different trade-off between search errors and speed has to be found. -phi On Tue, Mar 30, 2010 at 8:36 PM, Lane Schwartz <[email protected]> wrote: > Barry, > > Hieu may have mentioned that I'm working on a (more or less) stateful new > feature that uses an incremental parser as a syntactic language model. > > In this feature, calculating the next state from a word and the previous > state is not ridiculously expensive, but it certainly takes longer than most > feature calculations. > > I'm wondering what parts of the decoding process are sped up when > multithreading is enabled. In Joshua, we handle this by simply giving each > thread a different sentence to translate. > > Thanks, > Lane > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
