Hi, Thanks. This seems to be the script: https://github.com/moses-smt/mosesdecoder/blob/82527fc8b247ed34947c33ba808a92a1c07b054b/scripts/generic/moses-parallel.pl
Looks like can be modified to use other scheduling systems. Benson On 12/3/15 5:18 PM, Philipp Koehn wrote: > Hi, > > the MPI support is only for MIRA training and I do not know how well > maintained it is. It is not in active use. > > Since machine translation of large documents is easily parallelizable > (one sentence per thread), there was never a strong push for even more > parallelization. > > -phi > > On Thu, Dec 3, 2015 at 6:35 AM, Hieu Hoang <[email protected]> wrote: >> There is support for multithreaded and distributed processing using grid >> engines. This works for both training, tuning & decoding. But I don't think >> there's wide support for MPI in Moses >> >> Hieu Hoang >> http://www.hoang.co.uk/hieu >> >> On 25 November 2015 at 12:28, Benson Muite <[email protected]> wrote: >>> Hi, >>> >>> IS there any information on performance improvement that can be obtained >>> using Moses + MPI? Source code seems to have some MPI available for >>> training using MIRA: >>> >>> >>> >>> https://github.com/moses-smt/mosesdecoder/blob/82527fc8b247ed34947c33ba808a92a1c07b054b/contrib/mira/Main.cpp >>> >>> It would be helpful to know how useful this is if anyone has tried it. >>> >>> Thanks, >>> Benson >>> _______________________________________________ >>> Moses-support mailing list >>> [email protected] >>> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> -- Hajussüsteemide Teadur Arvutiteaduse Instituut Tartu Ülikool J.Liivi 2, 50409 Tartu http://kodu.ut.ee/~benson ---- Research Fellow of Distributed Systems Institute of Computer Science University of Tartu J.Liivi 2, 50409 Tartu, Estonia http://kodu.ut.ee/~benson _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
