Hi Karlis In both moses and mosesserver, the unit of work is the sentence. So moses processes each sentence in its own thread, and does not split it up as you suggest.
I think the difference in semantics is reasonable, as multi-threading has different aims in moses and mosesserver. In moses, multi-threading allows the decoder to split a file into parts, and process each part in a separate thread, but sharing language and translation models. However in mosesserver, multithreading allows several clients to connect simultaneously, wirhout blocking each other. The moses server API only accepts one sentence at a time, so it doesn't have the opportunity to split the input into sentences. If you're building an online translation system, then you probably have another component sitting in front of mosesserver which handles tokenisation, casing and splitting, which can take care of parallelisation. hope that helps - best regards - Barry On Friday 11 February 2011 12:42, Kārlis Goba wrote: > Hi, > > I'm observing different semantics of --threads option in moses vs > mosesserver. > > In moses this speeds up decoding by splitting the decoding of single > sentence into multiple threads (top reports x*100% CPU usage). In > mosesserver, on the other hand, I'm observing a single-threaded decoding > (top reporting 100% CPU usage), and the --threads option seems to mean the > number of XML-RPC server threads, which sets the maximum number of > simultaneously processed translation requests. > > I hope someone from moses developers can confirm this. In that case the > option is a bit misleading. Is there a way to run mosesserver with > multithreaded decoding? > > Regards, > Karlis > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
