Hi Ralph, I am able to run the program.. Thanks a lot for your help.
Regards, Chaitra On Thu, Jul 31, 2014 at 1:10 AM, Chaitra Kumar <chaitragku...@gmail.com> wrote: > Yes, both machines have same prm's installed. > > When I add --level 9 to ompi_info, it listed many openib components. > Thanks. > > Should I add any other flag to 'mpirun *--mca btl self,sm,openib'* to > make openib components visible to mpirun. > I set PATH and LD_LIBRARY_PATH before running these commands. so it is not > environment issue*.* > > > On Wed, Jul 30, 2014 at 7:26 PM, Ralph Castain <r...@open-mpi.org> wrote: > >> Does "polaris" have the same rpm's as the host where you checked in your >> prior email? >> >> Try adding "--level 9" to your ompi_info command line - the MCA param >> system changed somewhat and the params may just not be getting shown by >> default >> >> >> On Jul 30, 2014, at 2:35 AM, Chaitra Kumar <chaitragku...@gmail.com> >> wrote: >> >> The command: 'ompi_info --param btl openib' doesnt return any openib >> component. >> >> When I try to use command like: ' mpirun *--mca btl self,sm,openib* ...' >> it throws an error: >> -------------------------------------------------------------------------- >> A requested component was not found, or was unable to be opened. This >> means that this component is either not installed or is unable to be >> used on your system (e.g., sometimes this means that shared libraries >> that the component requires are unable to be found/loaded). Note that >> Open MPI stopped checking at the first component that it did not find. >> >> Host: polaris >> Framework: btl >> Component: openib >> -------------------------------------------------------------------------- >> >> Regards, >> Chaitra >> >> >> >> >> On Wed, Jul 30, 2014 at 2:40 PM, Ralph Castain <r...@open-mpi.org> wrote: >> >>> According to your output, you *do* have the IB components available: >>> >>> MCA btl: openib (MCA v2.0, API v2.0, Component v1.8.1) >>> >>> >>> What made you think that you don't have them? >>> >>> >>> On Jul 30, 2014, at 12:10 AM, Chaitra Kumar <chaitragku...@gmail.com> >>> wrote: >>> >>> Hi Howard, >>> >>> The attached file "config,out" has the output of configure. >>> >>> Output of ompi_info command: >>> Package: Open MPI padmanac@polaris-4 Distribution >>> Open MPI: 1.8.1 >>> Open MPI repo revision: r31483 >>> Open MPI release date: Apr 22, 2014 >>> Open RTE: 1.8.1 >>> Open RTE repo revision: r31483 >>> Open RTE release date: Apr 22, 2014 >>> OPAL: 1.8.1 >>> OPAL repo revision: r31483 >>> OPAL release date: Apr 22, 2014 >>> MPI API: 3.0 >>> Ident string: 1.8.1 >>> Prefix: /home/padmanac/openmpi181 >>> Configured architecture: x86_64-unknown-linux-gnu >>> Configure host: polaris-4 >>> Configured by: padmanac >>> Configured on: Tue Jul 29 11:41:12 PDT 2014 >>> Configure host: polaris-4 >>> Built by: padmanac >>> Built on: Tue Jul 29 11:57:53 PDT 2014 >>> Built host: polaris-4 >>> C bindings: yes >>> C++ bindings: yes >>> Fort mpif.h: yes (all) >>> Fort use mpi: yes (limited: overloading) >>> Fort use mpi size: deprecated-ompi-info-value >>> Fort use mpi_f08: no >>> Fort mpi_f08 compliance: The mpi_f08 module was not built >>> Fort mpi_f08 subarrays: no >>> Java bindings: no >>> Wrapper compiler rpath: runpath >>> C compiler: gcc >>> C compiler absolute: /opt/gcc/bin/gcc >>> C compiler family name: GNU >>> C compiler version: 4.8.2 >>> C++ compiler: g++ >>> C++ compiler absolute: /opt/gcc/bin/g++ >>> Fort compiler: gfortran >>> Fort compiler abs: /opt/gcc/bin/gfortran >>> Fort ignore TKR: no >>> Fort 08 assumed shape: no >>> Fort optional args: no >>> Fort BIND(C) (all): no >>> Fort ISO_C_BINDING: no >>> Fort SUBROUTINE BIND(C): no >>> Fort TYPE,BIND(C): no >>> Fort T,BIND(C,name="a"): no >>> Fort PRIVATE: no >>> Fort PROTECTED: no >>> Fort ABSTRACT: no >>> Fort ASYNCHRONOUS: no >>> Fort PROCEDURE: no >>> Fort f08 using wrappers: no >>> C profiling: yes >>> C++ profiling: yes >>> Fort mpif.h profiling: yes >>> Fort use mpi profiling: yes >>> Fort use mpi_f08 prof: no >>> C++ exceptions: no >>> Thread support: posix (MPI_THREAD_MULTIPLE: no, OPAL support: >>> yes, >>> OMPI progress: no, ORTE progress: yes, Event >>> lib: >>> yes) >>> Sparse Groups: no >>> Internal debug support: no >>> MPI interface warnings: yes >>> MPI parameter check: runtime >>> Memory profiling support: no >>> Memory debugging support: no >>> libltdl support: yes >>> Heterogeneous support: no >>> mpirun default --prefix: no >>> MPI I/O support: yes >>> MPI_WTIME support: gettimeofday >>> Symbol vis. support: yes >>> Host topology support: yes >>> MPI extensions: >>> FT Checkpoint support: no (checkpoint thread: no) >>> C/R Enabled Debugging: no >>> VampirTrace support: yes >>> MPI_MAX_PROCESSOR_NAME: 256 >>> MPI_MAX_ERROR_STRING: 256 >>> MPI_MAX_OBJECT_NAME: 64 >>> MPI_MAX_INFO_KEY: 36 >>> MPI_MAX_INFO_VAL: 256 >>> MPI_MAX_PORT_NAME: 1024 >>> MPI_MAX_DATAREP_STRING: 128 >>> MCA backtrace: execinfo (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA compress: bzip (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA compress: gzip (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA crs: none (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA db: hash (MCA v2.0, API v1.0, Component v1.8.1) >>> MCA db: print (MCA v2.0, API v1.0, Component v1.8.1) >>> MCA event: libevent2021 (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> MCA hwloc: hwloc172 (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA if: posix_ipv4 (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> MCA if: linux_ipv6 (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> MCA installdirs: env (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA installdirs: config (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA memory: linux (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA pstat: linux (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA sec: basic (MCA v2.0, API v1.0, Component v1.8.1) >>> MCA shmem: mmap (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA shmem: posix (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA shmem: sysv (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA timer: linux (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA dfs: app (MCA v2.0, API v1.0, Component v1.8.1) >>> MCA dfs: orted (MCA v2.0, API v1.0, Component v1.8.1) >>> MCA dfs: test (MCA v2.0, API v1.0, Component v1.8.1) >>> MCA errmgr: default_app (MCA v2.0, API v3.0, Component >>> v1.8.1) >>> MCA errmgr: default_hnp (MCA v2.0, API v3.0, Component >>> v1.8.1) >>> MCA errmgr: default_orted (MCA v2.0, API v3.0, Component >>> v1.8.1) >>> MCA errmgr: default_tool (MCA v2.0, API v3.0, Component >>> v1.8.1) >>> MCA ess: env (MCA v2.0, API v3.0, Component v1.8.1) >>> MCA ess: hnp (MCA v2.0, API v3.0, Component v1.8.1) >>> MCA ess: singleton (MCA v2.0, API v3.0, Component >>> v1.8.1) >>> MCA ess: slurm (MCA v2.0, API v3.0, Component v1.8.1) >>> MCA ess: tool (MCA v2.0, API v3.0, Component v1.8.1) >>> MCA filem: raw (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA grpcomm: bad (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA iof: hnp (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA iof: mr_hnp (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA iof: mr_orted (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA iof: orted (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA iof: tool (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA odls: default (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA oob: tcp (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA plm: isolated (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA plm: rsh (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA plm: slurm (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA ras: loadleveler (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> MCA ras: simulator (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> MCA ras: slurm (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA rmaps: lama (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA rmaps: mindist (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA rmaps: ppr (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA rmaps: rank_file (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> MCA rmaps: resilient (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> MCA rmaps: round_robin (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> MCA rmaps: seq (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA rmaps: staged (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA rml: oob (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA routed: binomial (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA routed: debruijn (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA routed: direct (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA routed: radix (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA state: app (MCA v2.0, API v1.0, Component v1.8.1) >>> MCA state: hnp (MCA v2.0, API v1.0, Component v1.8.1) >>> MCA state: novm (MCA v2.0, API v1.0, Component v1.8.1) >>> MCA state: orted (MCA v2.0, API v1.0, Component v1.8.1) >>> MCA state: staged_hnp (MCA v2.0, API v1.0, Component >>> v1.8.1) >>> MCA state: staged_orted (MCA v2.0, API v1.0, Component >>> v1.8.1) >>> MCA state: tool (MCA v2.0, API v1.0, Component v1.8.1) >>> MCA allocator: basic (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA allocator: bucket (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA bcol: basesmuma (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> MCA bcol: ptpcoll (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA bml: r2 (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA btl: openib (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA btl: self (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA btl: sm (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA btl: tcp (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA btl: vader (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA coll: basic (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA coll: hierarch (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA coll: inter (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA coll: libnbc (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA coll: ml (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA coll: self (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA coll: sm (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA coll: tuned (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA dpm: orte (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA fbtl: posix (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA fcoll: dynamic (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA fcoll: individual (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> MCA fcoll: static (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA fcoll: two_phase (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> MCA fcoll: ylib (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA fs: ufs (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA io: ompio (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA io: romio (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA mpool: grdma (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA mpool: sm (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA mtl: psm (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA osc: rdma (MCA v2.0, API v3.0, Component v1.8.1) >>> MCA osc: sm (MCA v2.0, API v3.0, Component v1.8.1) >>> MCA pml: v (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA pml: bfo (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA pml: cm (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA pml: ob1 (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA pubsub: orte (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA rcache: vma (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA rte: orte (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA sbgp: basesmsocket (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> MCA sbgp: basesmuma (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> MCA sbgp: p2p (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA sharedfp: individual (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> MCA sharedfp: lockedfile (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> MCA sharedfp: sm (MCA v2.0, API v2.0, Component v1.8.1) >>> MCA topo: basic (MCA v2.0, API v2.1, Component v1.8.1) >>> MCA vprotocol: pessimist (MCA v2.0, API v2.0, Component >>> v1.8.1) >>> >>> >>> >>> The command 'rpm -qa | grep ibverbs' lists following libraries. >>> libibverbs-devel-static-1.1.7-1.x86_64 >>> libibverbs-devel-1.1.7-1.x86_64 >>> libibverbs-1.1.7-1.x86_64 >>> libibverbs-debuginfo-1.1.7-1.x86_64 >>> libibverbs-utils-1.1.7-1.x86_64 >>> >>> Please let me know what i am missing. >>> >>> Regards, >>> Chaitra >>> >>> >>> On Wed, Jul 30, 2014 at 8:13 AM, Howard Pritchard <hpprit...@gmail.com> >>> wrote: >>> >>>> Hi Chaitra, >>>> >>>> Could you send the output from your configure and output from ompi_info? >>>> Could you also send the output from the node where you are building ompi >>>> of >>>> >>>> rpm -qa | grep ibverbs >>>> >>>> If this command indicates an libibverbs-devel was installed on the >>>> system, >>>> you should check to see if it was installed in the default location or >>>> for some >>>> reason was relocated. If you don't see that a libibverbs-devel rpm was >>>> installed, >>>> then you need a sysadmin to install it. >>>> >>>> >>>> >>>> >>>> 2014-07-29 19:35 GMT-06:00 Chaitra Kumar <chaitragku...@gmail.com>: >>>> >>>>> Hi Team, >>>>> >>>>> I am trying to setup openmpi 1.8.1 on a system with infiniband. >>>>> >>>>> Am using the default configure options. I am not using any >>>>> multithreading option. >>>>> >>>>> After installation, no openib components are available. >>>>> >>>>> >>>>> I tried even with flag: '--with-verbs', still no use. >>>>> >>>>> >>>>> Should i use any other flag to enable openib? am I missing any step? >>>>> >>>>> Regards, >>>>> Chaitra >>>>> >>>>> _______________________________________________ >>>>> users mailing list >>>>> us...@open-mpi.org >>>>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >>>>> Link to this post: >>>>> http://www.open-mpi.org/community/lists/users/2014/07/24889.php >>>>> >>>> >>>> >>>> _______________________________________________ >>>> users mailing list >>>> us...@open-mpi.org >>>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >>>> Link to this post: >>>> http://www.open-mpi.org/community/lists/users/2014/07/24891.php >>>> >>> >>> <config.out>_______________________________________________ >>> >>> users mailing list >>> us...@open-mpi.org >>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >>> Link to this post: >>> http://www.open-mpi.org/community/lists/users/2014/07/24892.php >>> >>> >>> >>> _______________________________________________ >>> users mailing list >>> us...@open-mpi.org >>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >>> Link to this post: >>> http://www.open-mpi.org/community/lists/users/2014/07/24893.php >>> >> >> _______________________________________________ >> users mailing list >> us...@open-mpi.org >> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >> Link to this post: >> http://www.open-mpi.org/community/lists/users/2014/07/24894.php >> >> >> >> _______________________________________________ >> users mailing list >> us...@open-mpi.org >> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >> Link to this post: >> http://www.open-mpi.org/community/lists/users/2014/07/24895.php >> > >