Hi Arezki,
Your shell environment is also important. For example, from Python's
subprocess.Popen() with shell=False and without the moses '-i' option,
you need to use the threading module to feed subprocess.Popen.stdin on
one thread and collect the output on another thread.
On 02/22/2013 07:22 PM, Barry Haddow wrote:
Hi Arezki
Moses operates a simple "thread-per-sentence" model for
multi-threading. So the only way you will see CPU usage rise above
100% is to give it multiple sentences simultaneously using the methods
that Hieu suggested. If you give it a single sentence, it will use a
single thread.
cheers - Barry
On 22/02/13 11:38, Arezki Sadoune wrote:
Hi Barry
Is the (-i ) option *indispensable* for a multi-threded running of
moses
I am trying to run moses multi core directlyon a screen, without
creating intermediate files.
Thanks a lot
Arezki
--- En date de : *Jeu 21.2.13, Barry Haddow
/<[email protected]>/* a écrit :
De: Barry Haddow <[email protected]>
Objet: Re: [Moses-support] How to run a multi-threaded Moses
À: "Arezki Sadoune" <[email protected]>
Cc: [email protected]
Date: Jeudi 21 février 2013, 18h04
Hi Arezki
Moses will only multi-thread if it is given a batch of sentences
to translate (with the -i option). Also, you will only see it
using multiple CPUs after it has loaded its models and started to
translate,
cheers - Barry
On 21/02/13 13:49, Arezki Sadoune wrote:
> Dear all,
>
> I have trained a few Moses systems on IRSTLM which were unable
to be run using multi-threading (which is normal according to the
Manual)
>
> So, I have built a new SRILM based Moses system, and I have
also recompilded Moses using the following request : (./bjam
-j24 --with-srilm=/root/srilm --with-irstlm=/root/irstlm)
>
>
> And despit of that Moses decoder is still running on a single CPU,
>
> I have also tried to run it by adding on the request the
following : "-threads 16", which didn't work too
>
> Many Thanks
>
> Arezki SADOUNE
>
>
>
> _______________________________________________
> Moses-support mailing list
> [email protected] </mc/[email protected]>
> http://mailman.mit.edu/mailman/listinfo/moses-support
-- The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
