Re: [OMPI devel] [BUG?] OpenMPI with openib on SPARC64: Signal: Bus error (10)

2011-11-23 Thread Lukas Razik
Hello Larry, I thank you for this helpful tip! Regards and have a nice day, Lukas > > Von: Larry Baker >An: Open MPI Developers >Cc: Lukas Razik ; Roland Dreier >Gesendet: 20:10 Mittwoch, 23.November 2011 >Betreff: Re: [OMPI devel] [BUG?] OpenMPI with open

Re: [OMPI devel] [BUG?] OpenMPI with openib on SPARC64: Signal: Bus error (10)

2011-11-23 Thread Lukas Razik
TERRY DONTJE wrote: >>>Can you build OMPI as a 32 bit library and see if that works any better? >>So you mean I shall leave the whole OFED stack as 64 bit and build only >>openmpi as 32 bit? >I believe the OFED user libraries will need to be 32 bit also or the 32 bit >MPI libraries will not be a

Re: [OMPI devel] [BUG?] OpenMPI with openib on SPARC64: Signal: Bus error (10)

2011-11-23 Thread Larry Baker
I think of -m32 (and -m64) as really selecting a different compiler. My practice is to put those flags in the compiler/linker environment variables. For example: # ./configure >configure.log 2>&1 \ --prefix=/usr/local/openmpi --with-sge \ CC="gcc -m32" \ CFLAGS="-g -O3" \ CXX="

Re: [OMPI devel] [BUG?] OpenMPI with openib on SPARC64: Signal: Bus error (10)

2011-11-23 Thread TERRY DONTJE
On 11/23/2011 1:45 PM, Lukas Razik wrote: TERRY DONTJE wrote Can you build OMPI as a 32 bit library and see if that works any better? So you mean I shall leave the whole OFED stack as 64 bit and build only openmpi as 32 bit? I believe the OFED user libraries will need to be 32 bit also or th

Re: [OMPI devel] [BUG?] OpenMPI with openib on SPARC64: Signal: Bus error (10)

2011-11-23 Thread Lukas Razik
TERRY DONTJE wrote >Can you build OMPI as a 32 bit library and see if that works any better? So you mean I shall leave the whole OFED stack as 64 bit and build only openmpi as 32 bit? How must I configure openmpi that it'll be definitely built as 32bit? Regards, Lukas

Re: [OMPI devel] [BUG?] OpenMPI with openib on SPARC64: Signal: Bus error (10)

2011-11-23 Thread TERRY DONTJE
On 11/23/2011 11:05 AM, Lukas Razik wrote: TERRY DONTJE wrote: Nuts!!! Ok I am going to have to think about this a little more. Do you have the ability to configure and remake your ompi install? I might want to have you add some stuff to help me track this down some more if you can recompi

Re: [OMPI devel] [BUG?] OpenMPI with openib on SPARC64: Signal: Bus error (10)

2011-11-23 Thread Lukas Razik
Lukas Razik wrote >T ERRY DONTJE wrote: >> Nuts!!! Ok I am going to have to think about this a little more.  Do you > have the ability to configure and remake your ompi install? I might want to > have > you add some stuff to help me track this down some more if you can recompile > your ompi

Re: [OMPI devel] [BUG?] OpenMPI with openib on SPARC64: Signal: Bus error (10)

2011-11-23 Thread Lukas Razik
TERRY DONTJE wrote: > Nuts!!! Ok I am going to have to think about this a little more.  Do you have > the ability to configure and remake your ompi install? I might want to have > you add some stuff to help me track this down some more if you can recompile > your ompi. As I wrote you I've alr

Re: [OMPI devel] [BUG?] OpenMPI with openib on SPARC64: Signal: Bus error (10)

2011-11-23 Thread TERRY DONTJE
On 11/23/2011 10:11 AM, Lukas Razik wrote: TERRY DONTJE wrote: Can you try running the benchmark with coalescing off? To do that add the following option to your mpirun line "-mca btl_openib_use_message_coalescing 0". I've tried this: # /usr/mpi/gcc/openmpi-1.4.4/bin/mpirun -np

Re: [OMPI devel] [BUG?] OpenMPI with openib on SPARC64: Signal: Bus error (10)

2011-11-23 Thread Lukas Razik
TERRY DONTJE wrote: >Can you try running the benchmark with coalescing off?  To do that add the following option to your mpirun line "-mca btl_openib_use_message_coalescing 0". I've tried this: # /usr/mpi/gcc/openmpi-1.4.4/bin/mpirun -np 2   --mca btl_openib_use_message_coalescing 0   --

Re: [OMPI devel] [BUG?] OpenMPI with openib on SPARC64: Signal: Bus error (10)

2011-11-23 Thread TERRY DONTJE
On 11/23/2011 9:57 AM, Lukas Razik wrote: TERRY DONTJE wrote: On 11/22/2011 6:59 PM, Lukas Razik wrote: Roland Dreier wrote: On Tue, Nov 22, 2011 at 3:05 PM, Lukas Razik wrote: #0 0xf8010229ba9c in mca_pml_ob1_send_request_start_copy (sendreq=0xb23200, bml_btl=0xb29050, size=0)

Re: [OMPI devel] [BUG?] OpenMPI with openib on SPARC64: Signal: Bus error (10)

2011-11-23 Thread Lukas Razik
TERRY DONTJE wrote: > On 11/22/2011 6:59 PM, Lukas Razik wrote: >> Roland Dreier  wrote: >> >>> On Tue, Nov 22, 2011 at 3:05 PM, Lukas Razik > wrote:    #0  0xf8010229ba9c in mca_pml_ob1_send_request_start_copy >>> (sendreq=0xb23200, bml_btl=0xb29050, size=0) at pml_ob1_sendreq.c:551

Re: [OMPI devel] [BUG?] OpenMPI with openib on SPARC64: Signal: Bus error (10)

2011-11-23 Thread TERRY DONTJE
On 11/22/2011 6:59 PM, Lukas Razik wrote: Roland Dreier wrote: On Tue, Nov 22, 2011 at 3:05 PM, Lukas Razik wrote: #0 0xf8010229ba9c in mca_pml_ob1_send_request_start_copy (sendreq=0xb23200, bml_btl=0xb29050, size=0) at pml_ob1_sendreq.c:551 551 hdr->hdr_match.hdr_ctx = s