The unstable state can be caused by the fact that Moses create a new thread to translate each new sentence, so when translating a large file, Moses frequently creates threads and then OS has to reschedule frequently also.
Even in single-thread Moses, given each input sentence, it also needs to load phrase table, language model, etc. which may also be blocked due to IO operations, if you use binarized models. Just for your reference. Best wishes! Pidong On 14 January 2014 23:24, Hansung Cho <[email protected]> wrote: > hello. > > To change the option "-threads 64" then monitoring at server CPUs status. > but, result is the same.. > Try the other way? > > Attach the CPUs status picture > > thank you > Hansung Cho > > [image: 본문 이미지 1] > > > 2014/1/15 Tom Hoar <[email protected]> > >> To change the threads, run with '-threads x' added to your command line: >> >> moses -f /path/to/moses.ini -threads 20 >> >> >> >> >> On 01/14/2014 11:41 PM, Philipp Koehn wrote: >> >> Hi, >> >> you can try specifying more threads than the number of CPUs. >> I have no idea if this speeds things up or causes blockage in >> your setup. Just try it out and see what happens. >> >> -phi >> >> >> On Tue, Jan 14, 2014 at 4:31 AM, Hansung Cho <[email protected]> wrote: >> >>> My server configuration are multiple CPUs 16 core and running thread 16. >>> >>> How do I adjust the moses running thread? >>> >>> I need your help... >>> >>> Thank you >>> >>> >>> 2014/1/14 Tom Hoar <[email protected]> >>> >>>> With a system as complex as Moses, why would you think the CPU usage >>>> would be steady? Each sentence task goes through many stages with different >>>> CPU demands which probably map to the variation in each cycle. >>>> >>>> You can also look first at your threading configuration. If your system >>>> has multiple CPUs (cores) and Moses is running multi-threaded, I suspect >>>> the cycles' frequencies are related to the activities on each thread. >>>> >>>> >>>> >>>> On 01/14/2014 01:09 PM, Hansung Cho wrote: >>>> >>>> hello.. >>>> >>>> I'm using mosesdecoding >>>> >>>> When monitoring a physical server, Server cpu is not very stable. >>>> However, the state is constantly moving cpu >>>> >>>> Look at the picture below >>>> [image: 본문 이미지 1] >>>> >>>> Is it because the moses system cache?? >>>> Should any part option of the adjustment? >>>> >>>> My moses commit a1584c608f8bbd83921896bac9eac97d9effc0c8 >>>> Options related to the cache are "clean-lm-cache" ( default ==1 ) >>>> >>>> Will be waiting for your input. >>>> >>>> Thank you >>>> Hansung cho >>>> >>>> >>>> _______________________________________________ >>>> Moses-support mailing >>>> [email protected]http://mailman.mit.edu/mailman/listinfo/moses-support >>>> >>>> >>>> >>>> _______________________________________________ >>>> Moses-support mailing list >>>> [email protected] >>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>> >>>> >>> >>> _______________________________________________ >>> Moses-support mailing list >>> [email protected] >>> http://mailman.mit.edu/mailman/listinfo/moses-support >>> >>> >> >> >> _______________________________________________ >> Moses-support mailing >> [email protected]http://mailman.mit.edu/mailman/listinfo/moses-support >> >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > -- > Wang Pidong > > Department of Computer Science > School of Computing > National University of Singapore > >
<<image/png>>
<<2014-01-15 15;59;16.PNG>>
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
