My tests with a quad-core dual threaded (8 virtual cores) i7 with 16 GB RAM shows have shown the Intel is pretty good at managing throughput when you configure with full CPU count for each value.
-mgiza -mgiza-cpus 8 -cores 8 -parallel I've experienced a 5% to 10% reduction in processing time (steps 1-9) with this configuration compared to either no -parallel or halving the count for -mgiza-cpus. I have no idea what happens with 24 cores. You might want to test. Tom On 6/26/2015 9:57 PM, [email protected] wrote: > Date: Fri, 26 Jun 2015 14:57:35 +0000 > From: Davood Mohammadifar<[email protected]> > Subject: [Moses-support] FW: Number of CPUs and cores in training for > server with 24 cores? > To:"[email protected]" <[email protected]>,"[email protected]" > <[email protected]> > Message-ID:<[email protected]> > Content-Type: text/plain; charset="iso-8859-1" > > > Thanks a lot Mr Koehn. > > >> >Date: Fri, 26 Jun 2015 09:06:24 -0400 >> >Subject: Re: [Moses-support] Number of CPUs and cores in training for >> >server with 24 cores? >> >From:[email protected] >> >To:[email protected] >> >CC:[email protected] >> > >> >Hi, >> > >> >if you have 24 cores, then >> > >> >-mgiza -mgiza-cpus 12 -cores 24 -parallel >> > >> >sounds plausible to me. >> > >> >The "parallel" will parallelize the 2 mgiza runs, so you should use 12 >> >CPUs for each. >> > >> >The 24 cores setting is relevant for phrase table building. >> > >> >-phi >> > >> > >> >On Fri, Jun 26, 2015 at 6:45 AM, Davood Mohammadifar >> ><[email protected]> wrote: >>> > >Hello everyone >>> > > >>> > >I want to use mgiza for training. What is your recommendation for number >>> > >of >>> > >cores and CPUs, for good performance and quality in train-model command? >>> > >Is >>> > >24 suitable for both? what is your recommendation for other options >>> > >(such as >>> > >-parallel,...)? >>> > > >>> > >train-model.perl -mgiza -mgiza-cpus ?? -cores ?? ... >>> > > >>> > > >>> > >System: >>> > >Number of cores: 24 >>> > >RAM: 40GB >>> > >OS: Ubuntu 12.04 >>> > > >>> > >Thanks >>> > > >>> > >_______________________________________________ >>> > >Moses-support mailing list >>> > >[email protected] >>> > >http://mailman.mit.edu/mailman/listinfo/moses-support >>> > > > _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
