Re: [OMPI users] Redusing libmpi.so size....

2016-11-01 Thread Gilles Gouaillardet
Did you strip the libraries already ? the script will show the list of frameworks and components used by MPI helloworld. from that, you can deduce a list of components that are not required, exclude them via the configure command line, and rebuild a trimmed Open MPI. note this is pretty

Re: [OMPI users] Redusing libmpi.so size....

2016-11-01 Thread Mahesh Nanavalla
HI George, Thanks for reply, By that above script ,how can i reduce* libmpi.so* size. On Tue, Nov 1, 2016 at 11:27 PM, George Bosilca wrote: > Let's try to coerce OMPI to dump all modules that are still loaded after > MPI_Init. We are still having a superset of the

Re: [OMPI users] Slurm binding not propagated to MPI jobs

2016-11-01 Thread r...@open-mpi.org
Ah crumby!! We already solved this on master, but it cannot be backported to the 1.10 series without considerable pain. For some reason, the support for it has been removed from the 2.x series as well. I’ll try to resolve that issue and get the support reinstated there (probably not until 2.1).

Re: [OMPI users] OpenMPI + InfiniBand

2016-11-01 Thread Nathan Hjelm
UDCM does not require IPoIB. It should be working for you. Can you build Open MPI with --enable-debug and run with -mca btl_base_verbose 100 and create a gist with the output. -Nathan On Nov 01, 2016, at 07:50 AM, Sergei Hrushev wrote: I haven't worked with InfiniBand

Re: [OMPI users] Slurm binding not propagated to MPI jobs

2016-11-01 Thread Riebs, Andy
To close the thread here… I got the following information: Looking at SLURM_CPU_BIND is the right idea, but there are quite a few more options. It misses map_cpu, rank, plus the NUMA-based options: rank_ldom, map_ldom, and mask_ldom. See the srun man pages for documentation. From: Riebs,

Re: [OMPI users] Redusing libmpi.so size....

2016-11-01 Thread George Bosilca
Let's try to coerce OMPI to dump all modules that are still loaded after MPI_Init. We are still having a superset of the needed modules, but at least everything unnecessary in your particular environment has been trimmed as during a normal OMPI run. George. PS: It's a shell script that needs ag

Re: [OMPI users] mpi4py+OpenMPI: Qs about submitting bugs and examples

2016-11-01 Thread Jason Maldonis
Thanks for the responses, and it's great to know that you found the OMPIP bug in 2.x for dynamic process management. I tried some of the other MPI libraries for my project as well, but Open MPI seemed to be by far the best in terms of being bug-free for my code! Lisandro, I will subscribe and

Re: [OMPI users] mpi4py+OpenMPI: Qs about submitting bugs and examples

2016-11-01 Thread Lisandro Dalcin
On 31 October 2016 at 20:39, Jason Maldonis wrote: > I may also submit bugs to mpi4py, but I don't yet know exactly where the > bugs are originating from. Do any of you know if github is the correct > place to submit bugs for mpi4py? > >

Re: [OMPI users] OpenMPI + InfiniBand

2016-11-01 Thread Sergei Hrushev
> > I actually just filed a Github issue to ask this exact question: > > https://github.com/open-mpi/ompi/issues/2326 > > Good idea, thanks! ___ users mailing list users@lists.open-mpi.org https://rfd.newmexicoconsortium.org/mailman/listinfo/users

Re: [OMPI users] MCA compilation later

2016-11-01 Thread Sean Ahern
That's useful. Thank you. It sounds like, as long as the component exists for OpenMPI already, it's just a matter of compiling OpenMPI on a machine that has the headers and libraries (with appropriate configure flags), and grabbing the individual component from there. -Sean -- Sean Ahern

Re: [OMPI users] OpenMPI + InfiniBand

2016-11-01 Thread Jeff Squyres (jsquyres)
I actually just filed a Github issue to ask this exact question: https://github.com/open-mpi/ompi/issues/2326 > On Nov 1, 2016, at 9:49 AM, Sergei Hrushev wrote: > > > I haven't worked with InfiniBand for years, but I do believe that yes: you > need IPoIB enabled on

Re: [OMPI users] OpenMPI + InfiniBand

2016-11-01 Thread Sergei Hrushev
> > > I haven't worked with InfiniBand for years, but I do believe that yes: you > need IPoIB enabled on your IB devices to get the RDMA CM support to work. > > Yes, I saw too that RDMA CM requires IP, but in my case OpenMPI reports that UD CM can't be used too. Is it also require IPoIB? Is it

Re: [OMPI users] OpenMPI + InfiniBand

2016-11-01 Thread Jeff Squyres (jsquyres)
On Nov 1, 2016, at 2:40 AM, Sergei Hrushev wrote: > > Yes, I tried to get this info already. > And I saw in log that rdmacm wants IP address on port. > So my question in topc start message was: > Is it enough for OpenMPI to have RDMA only or IPoIB should also be > installed?

Re: [OMPI users] OpenMPI + InfiniBand

2016-11-01 Thread Sergei Hrushev
Hi John ! I'm experimenting now with a head node and single compute node, all the rest of cluster is switched off. can you run : > > ibhosts > # ibhosts Ca : 0x7cfe900300bddec0 ports 1 "MT25408 ConnectX Mellanox Technologies" Ca : 0xe41d2d030050caf0 ports 1 "MT25408 ConnectX Mellanox

Re: [OMPI users] OpenMPI + InfiniBand

2016-11-01 Thread John Hearns via users
Segei, can you run : ibhosts ibstat ibdiagnet Lord help me for being so naive, but do you have a subnet manager running? On 1 November 2016 at 06:40, Sergei Hrushev wrote: > Hi Jeff ! > > What does "ompi_info | grep openib" show? >> >> > $ ompi_info | grep openib >

Re: [OMPI users] Redusing libmpi.so size....

2016-11-01 Thread Jeff Squyres (jsquyres)
Run ompi_info; it will tell you all the plugins that are installed. > On Nov 1, 2016, at 2:13 AM, Mahesh Nanavalla > wrote: > > Hi Jeff Squyres, > > Thank you for your reply... > > My problem is i want to reduce library size by removing unwanted plugin's. > >

Re: [OMPI users] OpenMPI + InfiniBand

2016-11-01 Thread Sergei Hrushev
Hi Jeff ! What does "ompi_info | grep openib" show? > > $ ompi_info | grep openib MCA btl: openib (MCA v2.0.0, API v2.0.0, Component v1.10.2) Additionally, Mellanox provides alternate support through their MXM > libraries, if you want to try that. > Yes, I know. But we already

Re: [OMPI users] Redusing libmpi.so size....

2016-11-01 Thread Mahesh Nanavalla
Hi all, Thank you for your reply... My problem is i want to *reduce library* size by removing unwanted plugin's. Here *libmpi.so.12.0.3 *size is 2.4MB. How can i know what are the* pluggin's *included to* build the* *libmpi.so.12.0.3* and how can remove. Thanks, Mahesh N On Tue, Nov 1, 2016

Re: [OMPI users] Redusing libmpi.so size....

2016-11-01 Thread Mahesh Nanavalla
Hi Jeff Squyres, Thank you for your reply... My problem is i want to *reduce library* size by removing unwanted plugin's. Here *libmpi.so.12.0.3 *size is 2.4MB. How can i know what are the* pluggin's *included to* build the* *libmpi.so.12.0.3* and how can remove. Thanks, Mahesh N On Fri, Oct