Re: [Libmesh-users] mesh refinement in parallel

2011-08-31 Thread robert
Am Mittwoch, den 31.08.2011, 16:55 +0200 schrieb robert: > Am Mittwoch, den 31.08.2011, 08:46 -0600 schrieb John Peterson: > > On Wed, Aug 31, 2011 at 1:31 AM, robert wrote: > > > > > > running the job with --enable-parmesh doesn't change. I run only one > > > mpi-job per node but it is still quit

Re: [Libmesh-users] mesh refinement in parallel

2011-08-31 Thread robert
Am Mittwoch, den 31.08.2011, 08:46 -0600 schrieb John Peterson: > On Wed, Aug 31, 2011 at 1:31 AM, robert wrote: > > > > running the job with --enable-parmesh doesn't change. I run only one > > mpi-job per node but it is still quite slow. > > You need to **reconfigure libmesh** with --enable-parm

Re: [Libmesh-users] mesh refinement in parallel

2011-08-31 Thread John Peterson
On Wed, Aug 31, 2011 at 1:31 AM, robert wrote: > > running the job with --enable-parmesh doesn't change. I run only one > mpi-job per node but it is still quite slow. You need to **reconfigure libmesh** with --enable-parmesh and then recompile it. -- John --

Re: [Libmesh-users] mesh refinement in parallel

2011-08-31 Thread robert
Am Dienstag, den 30.08.2011, 21:19 +0200 schrieb robert: > > > > > It is possible to run 1, 2 or 4 processes per node. If I run 2 or 4 > > > processes I get: > > > Error! ***Memory allocation failed for SetUpCoarseGraph: gdata. > > > Requested size: 107754020 bytesError! ***Memory allocation fail

Re: [Libmesh-users] mesh refinement in parallel

2011-08-30 Thread robert
> > > It is possible to run 1, 2 or 4 processes per node. If I run 2 or 4 > > processes I get: > > Error! ***Memory allocation failed for SetUpCoarseGraph: gdata. > > Requested size: 107754020 bytesError! ***Memory allocation failed for > > SetUpCoarseGraph: gdata. Requested size: 107754020 byte

Re: [Libmesh-users] mesh refinement in parallel

2011-08-30 Thread John Peterson
On Tue, Aug 30, 2011 at 12:34 PM, John Peterson wrote: > On Tue, Aug 30, 2011 at 12:23 PM, robert wrote: >> >>> 32 nodes or 32 cores?  I don't know the details of your cluster so it >>> may be obvious, but make sure you aren't accidentally running too many >>> MPI processes on a given node. >>> >

Re: [Libmesh-users] mesh refinement in parallel

2011-08-30 Thread robert
Am Dienstag, den 30.08.2011, 12:34 -0600 schrieb John Peterson: > On Tue, Aug 30, 2011 at 12:23 PM, robert wrote: > > > >> 32 nodes or 32 cores? I don't know the details of your cluster so it > >> may be obvious, but make sure you aren't accidentally running too many > >> MPI processes on a given

Re: [Libmesh-users] mesh refinement in parallel

2011-08-30 Thread John Peterson
On Tue, Aug 30, 2011 at 12:23 PM, robert wrote: > >> 32 nodes or 32 cores?  I don't know the details of your cluster so it >> may be obvious, but make sure you aren't accidentally running too many >> MPI processes on a given node. >> > As far as I understood it it is: > > 1 node = 4cores > > 4GB/n

Re: [Libmesh-users] mesh refinement in parallel

2011-08-30 Thread robert
Am Dienstag, den 30.08.2011, 10:48 -0600 schrieb John Peterson: > It will be extremely slow if it goes into swap. > > > Would this option just work with the existing code or do I have to > > change to ParallelMesh? > > Should work with existing code. Hopefully. > > > > > – SMP mode : 4 GB of

Re: [Libmesh-users] mesh refinement in parallel

2011-08-30 Thread John Peterson
On Tue, Aug 30, 2011 at 10:36 AM, robert wrote: > Am Dienstag, den 30.08.2011, 10:08 -0600 schrieb John Peterson: >> On Tue, Aug 30, 2011 at 9:56 AM, robert wrote: >> > >> > The mesh.uniformly_refine(1) takes some minutes when I do it in serial >> > on my PC. However, on the BlueGene/P it doesn't

Re: [Libmesh-users] mesh refinement in parallel

2011-08-30 Thread robert
Am Dienstag, den 30.08.2011, 10:08 -0600 schrieb John Peterson: > On Tue, Aug 30, 2011 at 9:56 AM, robert wrote: > > > > The mesh.uniformly_refine(1) takes some minutes when I do it in serial > > on my PC. However, on the BlueGene/P it doesn't come to an end (I > > aborted after 15 min). Do I have

Re: [Libmesh-users] mesh refinement in parallel

2011-08-30 Thread John Peterson
On Tue, Aug 30, 2011 at 9:56 AM, robert wrote: > > The mesh.uniformly_refine(1) takes some minutes when I do it in serial > on my PC. However, on the BlueGene/P it doesn't come to an end (I > aborted after 15 min). Do I have to prepare my mesh in a special way for > use in parallel? One thing I ha