Thanks for your head ups, Barry! Yes, in moses (not moseserver), there is a thread pool containing fixed number of threads to avoid the overhead of thread creations.
Then I would think the model loading may be the main reason for the unstable CPU usage, if Hansung is using moses, not mosesserver. Best wishes! Pidong On 15 January 2014 02:53, Barry Haddow <[email protected]> wrote: > Hi Wang > > That's only true for mosserver. For regular moses and moses_chart, a fixed > size thread pool is used. > > Cheers - Barry > > Wang Pidong <[email protected]> wrote: > > >The unstable state can be caused by the fact that Moses create a new > thread > >to translate each new sentence, so when translating a large file, Moses > >frequently creates threads and then OS has to reschedule frequently also. > > > >Even in single-thread Moses, given each input sentence, it also needs to > >load phrase table, language model, etc. which may also be blocked due to > IO > >operations, if you use binarized models. > > > >Just for your reference. > > > >Best wishes! > >Pidong > > > > > > > >On 14 January 2014 23:24, Hansung Cho <[email protected]> wrote: > > > >> hello. > >> > >> To change the option "-threads 64" then monitoring at server CPUs > status. > >> but, result is the same.. > >> Try the other way? > >> > >> Attach the CPUs status picture > >> > >> thank you > >> Hansung Cho > >> > >> [image: 본문 이미지 1] > >> > >> > >> 2014/1/15 Tom Hoar <[email protected]> > >> > >>> To change the threads, run with '-threads x' added to your command > line: > >>> > >>> moses -f /path/to/moses.ini -threads 20 > >>> > >>> > >>> > >>> > >>> On 01/14/2014 11:41 PM, Philipp Koehn wrote: > >>> > >>> Hi, > >>> > >>> you can try specifying more threads than the number of CPUs. > >>> I have no idea if this speeds things up or causes blockage in > >>> your setup. Just try it out and see what happens. > >>> > >>> -phi > >>> > >>> > >>> On Tue, Jan 14, 2014 at 4:31 AM, Hansung Cho <[email protected]> wrote: > >>> > >>>> My server configuration are multiple CPUs 16 core and running thread > 16. > >>>> > >>>> How do I adjust the moses running thread? > >>>> > >>>> I need your help... > >>>> > >>>> Thank you > >>>> > >>>> > >>>> 2014/1/14 Tom Hoar <[email protected]> > >>>> > >>>>> With a system as complex as Moses, why would you think the CPU usage > >>>>> would be steady? Each sentence task goes through many stages with > different > >>>>> CPU demands which probably map to the variation in each cycle. > >>>>> > >>>>> You can also look first at your threading configuration. If your > system > >>>>> has multiple CPUs (cores) and Moses is running multi-threaded, I > suspect > >>>>> the cycles' frequencies are related to the activities on each thread. > >>>>> > >>>>> > >>>>> > >>>>> On 01/14/2014 01:09 PM, Hansung Cho wrote: > >>>>> > >>>>> hello.. > >>>>> > >>>>> I'm using mosesdecoding > >>>>> > >>>>> When monitoring a physical server, Server cpu is not very stable. > >>>>> However, the state is constantly moving cpu > >>>>> > >>>>> Look at the picture below > >>>>> [image: 본문 이미지 1] > >>>>> > >>>>> Is it because the moses system cache?? > >>>>> Should any part option of the adjustment? > >>>>> > >>>>> My moses commit a1584c608f8bbd83921896bac9eac97d9effc0c8 > >>>>> Options related to the cache are "clean-lm-cache" ( default ==1 ) > >>>>> > >>>>> Will be waiting for your input. > >>>>> > >>>>> Thank you > >>>>> Hansung cho > >>>>> > >>>>> > >>>>> _______________________________________________ > >>>>> Moses-support mailing [email protected]:// > mailman.mit.edu/mailman/listinfo/moses-support > >>>>> > >>>>> > >>>>> > >>>>> _______________________________________________ > >>>>> Moses-support mailing list > >>>>> [email protected] > >>>>> http://mailman.mit.edu/mailman/listinfo/moses-support > >>>>> > >>>>> > >>>> > >>>> _______________________________________________ > >>>> Moses-support mailing list > >>>> [email protected] > >>>> http://mailman.mit.edu/mailman/listinfo/moses-support > >>>> > >>>> > >>> > >>> > >>> _______________________________________________ > >>> Moses-support mailing [email protected]:// > mailman.mit.edu/mailman/listinfo/moses-support > >>> > >>> > >>> > >>> _______________________________________________ > >>> Moses-support mailing list > >>> [email protected] > >>> http://mailman.mit.edu/mailman/listinfo/moses-support > >>> > >>> > >> > >> _______________________________________________ > >> Moses-support mailing list > >> [email protected] > >> http://mailman.mit.edu/mailman/listinfo/moses-support > >> > >> -- > >> Wang Pidong > >> > >> Department of Computer Science > >> School of Computing > >> National University of Singapore > >> > >> > > > >_______________________________________________ > >Moses-support mailing list > >[email protected] > >http://mailman.mit.edu/mailman/listinfo/moses-support > > -- > The University of Edinburgh is a charitable body, registered in > Scotland, with registration number SC005336. > > -- Wang Pidong Department of Computer Science School of Computing National University of Singapore
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
