Hi,
Is it possible to disable ptmalloc2 at runtime by disabling the component?
Thanks,
Sajjad Tabib
Jeff Squyres <jsquy...@cisco.com>
Sent by: users-boun...@open-mpi.org
12/06/07 07:44 AM
Please respond to
Open MPI Users <us...@open-mpi.org>
To
Open MPI Users <us...@open-mpi.org>
cc
Subject
Re: [OMPI users] Using mtrace with openmpi segfaults
I have not tried to use mtrace myself. But I can see how it would be
problematic with OMPI's internal use of ptmalloc2. If you are not
using InfiniBand or Myrinet over GM, you don't need OMPI to have an
internal copy of ptmalloc2. You can disable OMPI's ptmalloc2 by
configuring with:
./configure --without-memory-manager
On Dec 3, 2007, at 6:23 PM, Jeffrey M Ceason wrote:
>
> Having trouble using mtrace with openmpi. Whenever I use the mtrace
> call before or after MPI_Init the application terminates. This only
> seems to happen using mpi. Is there a way to disable the open-mpi
> memory wrappers? Is there known issues with users applications
> using mallopts and the mallopts used by open-mpi?
>
> Machine is AMD64 Fedora Core 7
> [ceason@n01-044-0 minib]$ uname -a
> Linux n01-044-0 2.6.22-rr #1 SMP Fri Nov 16 15:28:53 CST 2007 x86_64
> x86_64 x86_64 GNU/Linux
> [ceason@n01-044-0 minib]$
>
>
> Test source.
> #include <stdio.h>
> #include <sys/types.h>
> #include <unistd.h>
> #include <malloc.h>
> #include <mcheck.h>
> #include <mpi.h>
> #include <iostream>
>
> using namespace std;
>
> int main (int argc,char * argv[]) {
> mtrace();
> MPI_Init(NULL,NULL);
>
> MPI_Finalize();
> }
>
>
> [ceason@n01-044-0 minib]$ mpiCC dacs_test.cc -o trace_test
> [ceason@n01-044-0 minib]$ mpirun -np 1 trace_test
> mpirun noticed that job rank 0 with PID 7078 on node n01-044-0
> exited on signal 8 (Floating point exception).
> [ceason@n01-044-0 minib]$
>
>
> backtrace of core
>
> Core was generated by `trace_test'.
> Program terminated with signal 8, Arithmetic exception.
> #0 0x00002b33169d4abc in sYSTRIm () from /lib64/libc.so.6
> (gdb) bt
> #0 0x00002b33169d4abc in sYSTRIm () from /lib64/libc.so.6
> #1 0x00002b33169d71c2 in _int_free () from /lib64/libc.so.6
> #2 0x00002b33169dab1c in free () from /lib64/libc.so.6
> #3 0x00002b33169dcee8 in tr_freehook () from /lib64/libc.so.6
> #4 0x00002b33157674f3 in free () from /usr/local/openmpi/lib64/
> libopen-pal.so.0
> #5 0x00002b33169ceaf1 in vasprintf () from /lib64/libc.so.6
> #6 0x00002b33169b3088 in asprintf () from /lib64/libc.so.6
> #7 0x00002b3315760c7d in opal_output_init () from /usr/local/
> openmpi/lib64/libopen-pal.so.0
> #8 0x00002b3315760a2a in do_open () from /usr/local/openmpi/lib64/
> libopen-pal.so.0
> #9 0x00002b331575f958 in opal_malloc_init () from /usr/local/
> openmpi/lib64/libopen-pal.so.0
> #10 0x00002b331574ac27 in opal_init_util () from /usr/local/openmpi/
> lib64/libopen-pal.so.0
> #11 0x00002b331574ad06 in opal_init () from /usr/local/openmpi/lib64/
> libopen-pal.so.0
> #12 0x00002b3315283edf in ompi_mpi_init () from /usr/local/openmpi/
> lib64/libmpi.so.0
> #13 0x00002b33152a54f0 in PMPI_Init () from /usr/local/openmpi/lib64/
> libmpi.so.0
> #14 0x0000000000408397 in main ()
> (gdb)
>
> Shouldn't involve communications between machines but here is the IB
> Info.
>
> [ceason@n01-044-0 minib]$ ibv_devinfo
> hca_id: mlx4_0
> fw_ver: 2.2.000
> node_guid: 0002:c903:0000:17d0
> sys_image_guid: 0002:c903:0000:17d3
> vendor_id: 0x02c9
> vendor_part_id: 25418
> hw_ver: 0xA0
> board_id: MT_04A0110002
> phys_port_cnt: 2
> port: 1
> state: PORT_ACTIVE (4)
> max_mtu: 2048 (4)
> active_mtu: 2048 (4)
> sm_lid: 1
> port_lid: 8
> port_lmc: 0x00
>
> port: 2
> state: PORT_DOWN (1)
> max_mtu: 2048 (4)
> active_mtu: 2048 (4)
> sm_lid: 0
> port_lid: 0
> port_lmc: 0x00
>
> [ceason@n01-044-0 minib]$
>
> [ceason@n01-044-0 minib]$ ulimit -l
> unlimited
>
>
>
>
> ompi_info -all output
>
> Open MPI: 1.2.4
> Open MPI SVN revision: r16187
> Open RTE: 1.2.4
> Open RTE SVN revision: r16187
> OPAL: 1.2.4
> OPAL SVN revision: r16187
> MCA backtrace: execinfo (MCA v1.0, API v1.0, Component
> v1.2.4)
> MCA memory: ptmalloc2 (MCA v1.0, API v1.0, Component
> v1.2.4)
> MCA paffinity: linux (MCA v1.0, API v1.0, Component v1.2.4)
> MCA maffinity: first_use (MCA v1.0, API v1.0, Component
> v1.2.4)
> MCA maffinity: libnuma (MCA v1.0, API v1.0, Component
> v1.2.4)
> MCA timer: linux (MCA v1.0, API v1.0, Component v1.2.4)
> MCA installdirs: env (MCA v1.0, API v1.0, Component v1.2.4)
> MCA installdirs: config (MCA v1.0, API v1.0, Component
> v1.2.4)
> MCA allocator: basic (MCA v1.0, API v1.0, Component v1.0)
> MCA allocator: bucket (MCA v1.0, API v1.0, Component v1.0)
> MCA coll: basic (MCA v1.0, API v1.0, Component v1.2.4)
> MCA coll: self (MCA v1.0, API v1.0, Component v1.2.4)
> MCA coll: sm (MCA v1.0, API v1.0, Component v1.2.4)
> MCA coll: tuned (MCA v1.0, API v1.0, Component v1.2.4)
> MCA io: romio (MCA v1.0, API v1.0, Component v1.2.4)
> MCA mpool: rdma (MCA v1.0, API v1.0, Component v1.2.4)
> MCA mpool: sm (MCA v1.0, API v1.0, Component v1.2.4)
> MCA pml: cm (MCA v1.0, API v1.0, Component v1.2.4)
> MCA pml: ob1 (MCA v1.0, API v1.0, Component v1.2.4)
> MCA bml: r2 (MCA v1.0, API v1.0, Component v1.2.4)
> MCA rcache: vma (MCA v1.0, API v1.0, Component v1.2.4)
> MCA btl: openib (MCA v1.0, API v1.0.1, Component
> v1.2.4)
> MCA btl: self (MCA v1.0, API v1.0.1, Component
> v1.2.4)
> MCA btl: sm (MCA v1.0, API v1.0.1, Component v1.2.4)
> MCA btl: tcp (MCA v1.0, API v1.0.1, Component v1.0)
> MCA topo: unity (MCA v1.0, API v1.0, Component v1.2.4)
> MCA osc: pt2pt (MCA v1.0, API v1.0, Component v1.2.4)
> MCA errmgr: hnp (MCA v1.0, API v1.3, Component v1.2.4)
> MCA errmgr: orted (MCA v1.0, API v1.3, Component v1.2.4)
> MCA errmgr: proxy (MCA v1.0, API v1.3, Component v1.2.4)
> MCA gpr: null (MCA v1.0, API v1.0, Component v1.2.4)
> MCA gpr: proxy (MCA v1.0, API v1.0, Component v1.2.4)
> MCA gpr: replica (MCA v1.0, API v1.0, Component
> v1.2.4)
> MCA iof: proxy (MCA v1.0, API v1.0, Component v1.2.4)
> MCA iof: svc (MCA v1.0, API v1.0, Component v1.2.4)
> MCA ns: proxy (MCA v1.0, API v2.0, Component v1.2.4)
> MCA ns: replica (MCA v1.0, API v2.0, Component
> v1.2.4)
> MCA oob: tcp (MCA v1.0, API v1.0, Component v1.0)
> MCA ras: dash_host (MCA v1.0, API v1.3, Component
> v1.2.4)
> MCA ras: gridengine (MCA v1.0, API v1.3, Component
> v1.2.4)
> MCA ras: localhost (MCA v1.0, API v1.3, Component
> v1.2.4)
> MCA ras: slurm (MCA v1.0, API v1.3, Component v1.2.4)
> MCA ras: tm (MCA v1.0, API v1.3, Component v1.2.4)
> MCA rds: hostfile (MCA v1.0, API v1.3, Component
> v1.2.4)
> MCA rds: proxy (MCA v1.0, API v1.3, Component v1.2.4)
> MCA rds: resfile (MCA v1.0, API v1.3, Component
> v1.2.4)
> MCA rmaps: round_robin (MCA v1.0, API v1.3, Component
> v1.2.4)
> MCA rmgr: proxy (MCA v1.0, API v2.0, Component v1.2.4)
> MCA rmgr: urm (MCA v1.0, API v2.0, Component v1.2.4)
> MCA rml: oob (MCA v1.0, API v1.0, Component v1.2.4)
> MCA pls: gridengine (MCA v1.0, API v1.3, Component
> v1.2.4)
> MCA pls: proxy (MCA v1.0, API v1.3, Component v1.2.4)
> MCA pls: rsh (MCA v1.0, API v1.3, Component v1.2.4)
> MCA pls: slurm (MCA v1.0, API v1.3, Component v1.2.4)
> MCA pls: tm (MCA v1.0, API v1.3, Component v1.2.4)
> MCA sds: env (MCA v1.0, API v1.0, Component v1.2.4)
> MCA sds: pipe (MCA v1.0, API v1.0, Component v1.2.4)
> MCA sds: seed (MCA v1.0, API v1.0, Component v1.2.4)
> MCA sds: singleton (MCA v1.0, API v1.0, Component
> v1.2.4)
> MCA sds: slurm (MCA v1.0, API v1.0, Component v1.2.4)
> Prefix: /usr/local/openmpi
> Bindir: /usr/local/openmpi/bin
> Libdir: /usr/local/openmpi/lib64
> Incdir: /usr/local/openmpi/include
> Pkglibdir: /usr/local/openmpi/lib64/openmpi
> Sysconfdir: /usr/local/openmpi/etc
> Configured architecture: x86_64-redhat-linux-gnu
> Configured by: root
> Configured on: Sun Nov 18 14:44:52 CST 2007
> Configure host: wwim0-0
> Built by: root
> Built on: Sun Nov 18 14:51:43 CST 2007
> Built host: wwim0-0
> C bindings: yes
> C++ bindings: yes
> Fortran77 bindings: yes (all)
> Fortran90 bindings: no
> Fortran90 bindings size: na
> C compiler: gcc
> C compiler absolute: /usr/lib64/ccache/gcc
> C char size: 1
> C bool size: 1
> C short size: 2
> C int size: 4
> C long size: 8
> C float size: 4
> C double size: 8
> C pointer size: 8
> C char align: 1
> C bool align: 1
> C int align: 4
> C float align: 4
> C double align: 8
> C++ compiler: g++
> C++ compiler absolute: /usr/lib64/ccache/g++
> Fortran77 compiler: gfortran
> Fortran77 compiler abs: /usr/bin/gfortran
> Fortran90 compiler: none
> Fortran90 compiler abs: none
> Fort integer size: 4
> Fort logical size: 4
> Fort logical value true: 1
> Fort have integer1: yes
> Fort have integer2: yes
> Fort have integer4: yes
> Fort have integer8: yes
> Fort have integer16: no
> Fort have real4: yes
> Fort have real8: yes
> Fort have real16: no
> Fort have complex8: yes
> Fort have complex16: yes
> Fort have complex32: no
> Fort integer1 size: 1
> Fort integer2 size: 2
> Fort integer4 size: 4
> Fort integer8 size: 8
> Fort integer16 size: -1
> Fort real size: 4
> Fort real4 size: 4
> Fort real8 size: 8
> Fort real16 size: -1
> Fort dbl prec size: 4
> Fort cplx size: 4
> Fort dbl cplx size: 4
> Fort cplx8 size: 8
> Fort cplx16 size: 16
> Fort cplx32 size: -1
> Fort integer align: 4
> Fort integer1 align: 1
> Fort integer2 align: 2
> Fort integer4 align: 4
> Fort integer8 align: 8
> Fort integer16 align: -1
> Fort real align: 4
> Fort real4 align: 4
> Fort real8 align: 8
> Fort real16 align: -1
> Fort dbl prec align: 4
> Fort cplx align: 4
> Fort dbl cplx align: 4
> Fort cplx8 align: 4
> Fort cplx16 align: 8
> Fort cplx32 align: -1
> C profiling: yes
> C++ profiling: yes
> Fortran77 profiling: yes
> Fortran90 profiling: no
> C++ exceptions: no
> Thread support: posix (mpi: no, progress: no)
> Build CFLAGS: -O3 -DNDEBUG -m64 -I/usr/local/OFED/
> include -finline-functions -fno-strict-aliasing -pthread
> Build CXXFLAGS: -O3 -DNDEBUG -m64 -I/usr/local/OFED/
> include -finline-functions -pthread
> Build FFLAGS: -m64
> Build FCFLAGS: -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2
> -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -
> mtune=generic
> Build LDFLAGS: -export-dynamic -m64 -L/lib64 -L/usr/lib64
> -L/usr/local/OFED/lib64
> Build LIBS: -lnsl -lutil -lm
> Wrapper extra CFLAGS: -pthread
> Wrapper extra CXXFLAGS: -pthread
> Wrapper extra FFLAGS: -pthread
> Wrapper extra FCFLAGS: -pthread
> Wrapper extra LDFLAGS:
> Wrapper extra LIBS: -ldl -Wl,--export-dynamic -lnsl -lutil
> -lm -ldl
> Internal debug support: no
> MPI parameter check: runtime
> Memory profiling support: no
> Memory debugging support: no
> libltdl support: yes
> Heterogeneous support: yes
> mpirun default --prefix: no
> MCA mca: parameter "mca_param_files" (current
> value: "/home/usr1/ceason/.openmpi/mca-params.conf:/usr/local/
> openmpi/etc/openmpi-mca-params.conf")
> Path for MCA configuration files
> containing default parameter values
> MCA mca: parameter "mca_component_path" (current
> value: "/usr/local/openmpi/lib64/openmpi:/home/usr1/ceason/.openmpi/
> components")
> Path where to look for Open MPI and ORTE
> components
> MCA mca: parameter "mca_verbose" (current value:
> <none>)
> Top-level verbosity parameter
> MCA mca: parameter
> "mca_component_show_load_errors" (current value: "1")
> Whether to show errors for components that
> failed to load or not
> MCA mca: parameter
> "mca_component_disable_dlopen" (current value: "0")
> Whether to attempt to disable opening
> dynamic components or not
> MCA mpi: parameter "mpi_param_check" (current
> value: "1")
> Whether you want MPI API parameters
> checked at run-time or not. Possible values are 0 (no checking) and
> 1 (perform checking at run-time)
> MCA mpi: parameter "mpi_yield_when_idle" (current
> value: "0")
> Yield the processor when waiting for MPI
> communication (for MPI processes, will default to 1 when
> oversubscribing nodes)
> MCA mpi: parameter "mpi_event_tick_rate" (current
> value: "-1")
> How often to progress TCP communications
> (0 = never, otherwise specified in microseconds)
> MCA mpi: parameter "mpi_show_handle_leaks" (current
> value: "0")
> Whether MPI_FINALIZE shows all MPI handles
> that were not freed or not
> MCA mpi: parameter "mpi_no_free_handles" (current
> value: "0")
> Whether to actually free MPI objects when
> their handles are freed
> MCA mpi: parameter "mpi_show_mca_params" (current
> value: "0")
> Whether to show all MCA parameter value
> during MPI_INIT or not (good for reproducability of MPI jobs)
> MCA mpi: parameter
> "mpi_show_mca_params_file" (current value: <none>)
> If mpi_show_mca_params is true, setting
> this string to a valid filename tells Open MPI to dump all the MCA
> parameter values into a file suitable for reading via the
> mca_param_files parameter (good for reproducability of MPI jobs)
> MCA mpi: parameter "mpi_paffinity_alone" (current
> value: "1")
> If nonzero, assume that this job is the
> only (set of) process(es) running on each node and bind processes to
> processors, starting with processor ID 0
> MCA mpi: parameter
> "mpi_keep_peer_hostnames" (current value: "1")
> If nonzero, save the string hostnames of
> all MPI peer processes (mostly for error / debugging output
> messages). This can add quite a bit of memory usage to each MPI
> process.
> MCA mpi: parameter "mpi_abort_delay" (current
> value: "0")
> If nonzero, print out an identifying
> message when MPI_ABORT is invoked (hostname, PID of the process that
> called MPI_ABORT) and delay for that many seconds before exiting (a
> negative delay value means to never abort). This allows attaching
> of a debugger before quitting the job.
> MCA mpi: parameter "mpi_abort_print_stack" (current
> value: "0")
> If nonzero, print out a stack trace when
> MPI_ABORT is invoked
> MCA mpi: parameter "mpi_preconnect_all" (current
> value: "0")
> Whether to force MPI processes to create
> connections / warmup with *all* peers during MPI_INIT (vs. making
> connections lazily -- upon the first MPI traffic between each
> process peer pair)
> MCA mpi: parameter "mpi_preconnect_oob" (current
> value: "0")
> Whether to force MPI processes to fully
> wire-up the OOB system between MPI processes.
> MCA mpi: parameter "mpi_leave_pinned" (current
> value: "0")
> Whether to use the "leave pinned" protocol
> or not. Enabling this setting can help bandwidth performance when
> repeatedly sending and receiving large messages with the same
> buffers over RDMA-based networks.
> MCA mpi: parameter
> "mpi_leave_pinned_pipeline" (current value: "0")
> Whether to use the "leave pinned pipeline"
> protocol or not.
> MCA orte: parameter "orte_debug" (current value: "0")
> Top-level ORTE debug switch
> MCA orte: parameter "orte_no_daemonize" (current
> value: "0")
> Whether to properly daemonize the ORTE
> daemons or not
> MCA orte: parameter
> "orte_base_user_debugger" (current value: "totalview @mpirun@ -a
> @mpirun_args@ : ddt -n @np@ -start @executable@ @executable_argv@
> @single_app@ : fxp @mpirun@ -a @mpirun_args@")
> Sequence of user-level debuggers to search
> for in orterun
> MCA orte: parameter "orte_abort_timeout" (current
> value: "10")
> Time to wait [in seconds] before giving up
> on aborting an ORTE operation
> MCA orte: parameter "orte_timing" (current value: "0")
> Request that critical timing loops be
> measured
> MCA opal: parameter "opal_signal" (current value:
> "6,7,8,11")
> If a signal is received, display the stack
> trace frame
> MCA backtrace: parameter "backtrace" (current value:
> <none>)
> Default selection set of components for
> the backtrace framework (<none> means "use all components that can
> be found")
> MCA backtrace: parameter
> "backtrace_base_verbose" (current value: "0")
> Verbosity level for the backtrace
> framework (0 = no verbosity)
> MCA backtrace: parameter
> "backtrace_execinfo_priority" (current value: "0")
> MCA memory: parameter "memory" (current value: <none>)
> Default selection set of components for
> the memory framework (<none> means "use all components that can be
> found")
> MCA memory: parameter "memory_base_verbose" (current
> value: "0")
> Verbosity level for the memory framework
> (0 = no verbosity)
> MCA memory: parameter
> "memory_ptmalloc2_priority" (current value: "0")
> MCA paffinity: parameter
> "paffinity_base_verbose" (current value: "0")
> Verbosity level of the paffinity framework
> MCA paffinity: parameter "paffinity" (current value:
> <none>)
> Default selection set of components for
> the paffinity framework (<none> means "use all components that can
> be found")
> MCA paffinity: parameter
> "paffinity_linux_priority" (current value: "10")
> Priority of the linux paffinity component
> MCA paffinity: information
> "paffinity_linux_have_cpu_set_t" (value: "1")
> Whether this component was compiled on a
> system with the type cpu_set_t or not (1 = yes, 0 = no)
> MCA paffinity: information
> "paffinity_linux_CPU_ZERO_ok" (value: "1")
> Whether this component was compiled on a
> system where CPU_ZERO() is functional or broken (1 = functional, 0 =
> broken/not available)
> MCA paffinity: information
> "paffinity_linux_sched_setaffinity_num_params" (value: "3")
> The number of parameters that
> sched_set_affinity() takes on the machine where this component was
> compiled
> MCA maffinity: parameter
> "maffinity_base_verbose" (current value: "0")
> Verbosity level of the maffinity framework
> MCA maffinity: parameter "maffinity" (current value:
> <none>)
> Default selection set of components for
> the maffinity framework (<none> means "use all components that can
> be found")
> MCA maffinity: parameter
> "maffinity_first_use_priority" (current value: "10")
> Priority of the first_use maffinity
> component
> MCA maffinity: parameter
> "maffinity_libnuma_priority" (current value: "25")
> Priority of the libnuma maffinity component
> MCA timer: parameter "timer" (current value: <none>)
> Default selection set of components for
> the timer framework (<none> means "use all components that can be
> found")
> MCA timer: parameter "timer_base_verbose" (current
> value: "0")
> Verbosity level for the timer framework (0
> = no verbosity)
> MCA timer: parameter "timer_linux_priority" (current
> value: "0")
> MCA allocator: parameter "allocator" (current value:
> <none>)
> Default selection set of components for
> the allocator framework (<none> means "use all components that can
> be found")
> MCA allocator: parameter
> "allocator_base_verbose" (current value: "0")
> Verbosity level for the allocator
> framework (0 = no verbosity)
> MCA allocator: parameter
> "allocator_basic_priority" (current value: "0")
> MCA allocator: parameter
> "allocator_bucket_num_buckets" (current value: "30")
> MCA allocator: parameter
> "allocator_bucket_priority" (current value: "0")
> MCA coll: parameter "coll" (current value: <none>)
> Default selection set of components for
> the coll framework (<none> means "use all components that can be
> found")
> MCA coll: parameter "coll_base_verbose" (current
> value: "0")
> Verbosity level for the coll framework (0
> = no verbosity)
> MCA coll: parameter "coll_basic_priority" (current
> value: "10")
> Priority of the basic coll component
> MCA coll: parameter "coll_basic_crossover" (current
> value: "4")
> Minimum number of processes in a
> communicator before using the logarithmic algorithms
> MCA coll: parameter "coll_self_priority" (current
> value: "75")
> MCA coll: parameter "coll_sm_priority" (current
> value: "0")
> Priority of the sm coll component
> MCA coll: parameter "coll_sm_control_size" (current
> value: "4096")
> Length of the control data -- should
> usually be either the length of a cache line on most SMPs, or the
> size of a page on machines that support direct memory affinity page
> placement (in bytes)
> MCA coll: parameter
> "coll_sm_bootstrap_filename" (current value:
> "shared_mem_sm_bootstrap")
> Filename (in the Open MPI session
> directory) of the coll sm component bootstrap rendezvous mmap file
> MCA coll: parameter
> "coll_sm_bootstrap_num_segments" (current value: "8")
> Number of segments in the bootstrap file
> MCA coll: parameter "coll_sm_fragment_size" (current
> value: "8192")
> Fragment size (in bytes) used for passing
> data through shared memory (will be rounded up to the nearest
> control_size size)
> MCA coll: parameter "coll_sm_mpool" (current value:
> "sm")
> Name of the mpool component to use
> MCA coll: parameter
> "coll_sm_comm_in_use_flags" (current value: "2")
> Number of "in use" flags, used to mark a
> message passing area segment as currently being used or not (must be
> >= 2 and <= comm_num_segments)
> MCA coll: parameter
> "coll_sm_comm_num_segments" (current value: "8")
> Number of segments in each communicator's
> shared memory message passing area (must be >= 2, and must be a
> multiple of comm_in_use_flags)
> MCA coll: parameter "coll_sm_tree_degree" (current
> value: "4")
> Degree of the tree for tree-based
> operations (must be => 1 and <= min(control_size, 255))
> MCA coll: information
> "coll_sm_shared_mem_used_bootstrap" (value: "216")
> Amount of shared memory used in the shared
> memory bootstrap area (in bytes)
> MCA coll: parameter
> "coll_sm_info_num_procs" (current value: "4")
> Number of processes to use for the
> calculation of the shared_mem_size MCA information parameter (must
> be => 2)
> MCA coll: information
> "coll_sm_shared_mem_used_data" (value: "548864")
> Amount of shared memory used in the shared
> memory data area for info_num_procs processes (in bytes)
> MCA coll: parameter "coll_tuned_priority" (current
> value: "30")
> Priority of the tuned coll component
> MCA coll: parameter
> "coll_tuned_pre_allocate_memory_comm_size_limit" (current value:
> "32768")
> Size of communicator were we stop pre-
> allocating memory for the fixed internal buffer used for message
> requests etc that is hung off the communicator data segment. I.e. if
> you have a 100'000 nodes you might not want to pre-allocate 200'000
> request handle slots per communicator instance!
> MCA coll: parameter
> "coll_tuned_init_tree_fanout" (current value: "4")
> Inital fanout used in the tree topologies
> for each communicator. This is only an initial guess, if a tuned
> collective needs a different fanout for an operation, it build it
> dynamically. This parameter is only for the first guess and might
> save a little time
> MCA coll: parameter
> "coll_tuned_init_chain_fanout" (current value: "4")
> Inital fanout used in the chain (fanout
> followed by pipeline) topologies for each communicator. This is only
> an initial guess, if a tuned collective needs a different fanout for
> an operation, it build it dynamically. This parameter is only for
> the first guess and might save a little time
> MCA coll: parameter
> "coll_tuned_use_dynamic_rules" (current value: "0")
> Switch used to decide if we use static
> (compiled/if statements) or dynamic (built at runtime) decision
> function rules
> MCA io: parameter
> "io_base_freelist_initial_size" (current value: "16")
> Initial MPI-2 IO request freelist size
> MCA io: parameter
> "io_base_freelist_max_size" (current value: "64")
> Max size of the MPI-2 IO request freelist
> MCA io: parameter
> "io_base_freelist_increment" (current value: "16")
> Increment size of the MPI-2 IO request
> freelist
> MCA io: parameter "io" (current value: <none>)
> Default selection set of components for
> the io framework (<none> means "use all components that can be found")
> MCA io: parameter "io_base_verbose" (current
> value: "0")
> Verbosity level for the io framework (0 =
> no verbosity)
> MCA io: parameter "io_romio_priority" (current
> value: "10")
> Priority of the io romio component
> MCA io: parameter
> "io_romio_delete_priority" (current value: "10")
> Delete priority of the io romio component
> MCA io: parameter
> "io_romio_enable_parallel_optimizations" (current value: "0")
> Enable set of Open MPI-added options to
> improve collective file i/o performance
> MCA mpool: parameter "mpool" (current value: <none>)
> Default selection set of components for
> the mpool framework (<none> means "use all components that can be
> found")
> MCA mpool: parameter "mpool_base_verbose" (current
> value: "0")
> Verbosity level for the mpool framework (0
> = no verbosity)
> MCA mpool: parameter
> "mpool_rdma_rcache_name" (current value: "vma")
> The name of the registration cache the
> mpool should use
> MCA mpool: parameter
> "mpool_rdma_rcache_size_limit" (current value: "0")
> the maximum size of registration cache in
> bytes. 0 is unlimited (default 0)
> MCA mpool: parameter
> "mpool_rdma_print_stats" (current value: "0")
> print pool usage statistics at the end of
> the run
> MCA mpool: parameter "mpool_rdma_priority" (current
> value: "0")
> MCA mpool: parameter "mpool_sm_allocator" (current
> value: "bucket")
> Name of allocator component to use with sm
> mpool
> MCA mpool: parameter "mpool_sm_max_size" (current
> value: "536870912")
> Maximum size of the sm mpool shared memory
> file
> MCA mpool: parameter "mpool_sm_min_size" (current
> value: "134217728")
> Minimum size of the sm mpool shared memory
> file
> MCA mpool: parameter
> "mpool_sm_per_peer_size" (current value: "33554432")
> Size (in bytes) to allocate per local peer
> in the sm mpool shared memory file, bounded by min_size and max_size
> MCA mpool: parameter "mpool_sm_verbose" (current
> value: "0")
> Enable verbose output for mpool sm component
> MCA mpool: parameter "mpool_sm_priority" (current
> value: "0")
> MCA mpool: parameter
> "mpool_base_use_mem_hooks" (current value: "0")
> use memory hooks for deregistering freed
> memory
> MCA mpool: parameter "mpool_use_mem_hooks" (current
> value: "0")
> (deprecated, use mpool_base_use_mem_hooks)
> MCA mpool: parameter
> "mpool_base_disable_sbrk" (current value: "0")
> use mallopt to override calling sbrk
> (doesn't return memory to OS!)
> MCA mpool: parameter "mpool_disable_sbrk" (current
> value: "0")
> (deprecated, use
> mca_mpool_base_disable_sbrk)
> MCA pml: parameter "pml" (current value: <none>)
> Default selection set of components for
> the pml framework (<none> means "use all components that can be
> found")
> MCA pml: parameter "pml_base_verbose" (current
> value: "0")
> Verbosity level for the pml framework (0 =
> no verbosity)
> MCA pml: parameter "pml_cm_free_list_num" (current
> value: "4")
> Initial size of request free lists
> MCA pml: parameter "pml_cm_free_list_max" (current
> value: "-1")
> Maximum size of request free lists
> MCA pml: parameter "pml_cm_free_list_inc" (current
> value: "64")
> Number of elements to add when growing
> request free lists
> MCA pml: parameter "pml_cm_priority" (current
> value: "30")
> CM PML selection priority
> MCA pml: parameter "pml_ob1_free_list_num" (current
> value: "4")
> MCA pml: parameter "pml_ob1_free_list_max" (current
> value: "-1")
> MCA pml: parameter "pml_ob1_free_list_inc" (current
> value: "64")
> MCA pml: parameter "pml_ob1_priority" (current
> value: "20")
> MCA pml: parameter "pml_ob1_eager_limit" (current
> value: "131072")
> MCA pml: parameter
> "pml_ob1_send_pipeline_depth" (current value: "3")
> MCA pml: parameter
> "pml_ob1_recv_pipeline_depth" (current value: "4")
> MCA bml: parameter "bml" (current value: <none>)
> Default selection set of components for
> the bml framework (<none> means "use all components that can be
> found")
> MCA bml: parameter "bml_base_verbose" (current
> value: "0")
> Verbosity level for the bml framework (0 =
> no verbosity)
> MCA bml: parameter
> "bml_r2_show_unreach_errors" (current value: "1")
> Show error message when procs are
> unreachable
> MCA bml: parameter "bml_r2_priority" (current
> value: "0")
> MCA rcache: parameter "rcache" (current value: <none>)
> Default selection set of components for
> the rcache framework (<none> means "use all components that can be
> found")
> MCA rcache: parameter "rcache_base_verbose" (current
> value: "0")
> Verbosity level for the rcache framework
> (0 = no verbosity)
> MCA rcache: parameter "rcache_vma_priority" (current
> value: "0")
> MCA btl: parameter "btl_base_debug" (current value:
> "0")
> If btl_base_debug is 1 standard debug is
> output, if > 1 verbose debug is output
> MCA btl: parameter "btl" (current value: <none>)
> Default selection set of components for
> the btl framework (<none> means "use all components that can be
> found")
> MCA btl: parameter "btl_base_verbose" (current
> value: "0")
> Verbosity level for the btl framework (0 =
> no verbosity)
> MCA btl: parameter "btl_openib_verbose" (current
> value: "0")
> Output some verbose OpenIB BTL information
> (0 = no output, nonzero = output)
> MCA btl: parameter
> "btl_openib_warn_no_hca_params_found" (current value: "1")
> Warn when no HCA-specific parameters are
> found in the INI file specified by the btl_openib_hca_param_files
> MCA parameter (0 = do not warn; any other value = warn)
> MCA btl: parameter
> "btl_openib_warn_default_gid_prefix" (current value: "1")
> Warn when there is more than one active
> ports and at least one of them connected to the network with only
> default GID prefix configured (0 = do not warn; any other value =
> warn)
> MCA btl: parameter
> "btl_openib_want_fork_support" (current value: "-1")
> Whether fork support is desired or not
> (negative = try to enable fork support, but continue even if it is
> not available, 0 = do not enable fork support, positive = try to
> enable fork support and fail if it is not available)
> MCA btl: parameter
> "btl_openib_hca_param_files" (current value: "/usr/local/openmpi/
> share/openmpi/mca-btl-openib-hca-params.ini")
> Colon-delimited list of INI-style files
> that contain HCA vendor/part-specific parameters
> MCA btl: parameter "btl_openib_max_btls" (current
> value: "-1")
> Maximum number of HCA ports to use (-1 =
> use all available, otherwise must be >= 1)
> MCA btl: parameter
> "btl_openib_free_list_num" (current value: "8")
> Intial size of free lists (must be >= 1)
> MCA btl: parameter
> "btl_openib_free_list_max" (current value: "-1")
> Maximum size of free lists (-1 = infinite,
> otherwise must be >= 0)
> MCA btl: parameter
> "btl_openib_free_list_inc" (current value: "32")
> Increment size of free lists (must be >= 1)
> MCA btl: parameter "btl_openib_mpool" (current
> value: "rdma")
> Name of the memory pool to be used (it is
> unlikely that you will ever want to change this
> MCA btl: parameter
> "btl_openib_reg_mru_len" (current value: "16")
> Length of the registration cache most
> recently used list (must be >= 1)
> MCA btl: parameter "btl_openib_ib_cq_size" (current
> value: "1000")
> Size of the IB completion queue (will
> automatically be set to a minimum of (2 * number_of_peers *
> btl_openib_rd_num))
> MCA btl: parameter
> "btl_openib_ib_sg_list_size" (current value: "4")
> Size of IB segment list (must be >= 1)
> MCA btl: parameter "btl_openib_ib_pkey_ix" (current
> value: "0")
> InfiniBand pkey index (must be >= 0)
> MCA btl: parameter
> "btl_openib_ib_pkey_val" (current value: "0")
> InfiniBand pkey value(must be > 0 and <
> 0xffff)
> MCA btl: parameter "btl_openib_ib_psn" (current
> value: "0")
> InfiniBand packet sequence starting number
> (must be >= 0)
> MCA btl: parameter
> "btl_openib_ib_qp_ous_rd_atom" (current value: "4")
> InfiniBand outstanding atomic reads (must
> be >= 0)
> MCA btl: parameter "btl_openib_ib_mtu" (current
> value: "3")
> IB MTU, in bytes (if not specified in INI
> files). Valid values are: 1=256 bytes, 2=512 bytes, 3=1024 bytes,
> 4=2048 bytes, 5=4096 bytes
> MCA btl: parameter
> "btl_openib_ib_min_rnr_timer" (current value: "5")
> InfiniBand minimum "receiver not ready"
> timer, in seconds (must be >= 0 and <= 31)
> MCA btl: parameter "btl_openib_ib_timeout" (current
> value: "10")
> InfiniBand transmit timeout, plugged into
> formula: 4.096 microseconds * (2^btl_openib_ib_timeout)(must be >= 0
> and <= 31)
> MCA btl: parameter
> "btl_openib_ib_retry_count" (current value: "7")
> InfiniBand transmit retry count (must be
> >= 0 and <= 7)
> MCA btl: parameter
> "btl_openib_ib_rnr_retry" (current value: "7")
> InfiniBand "receiver not ready" retry
> count (must be >= 0 and <= 7)
> MCA btl: parameter
> "btl_openib_ib_max_rdma_dst_ops" (current value: "4")
> InfiniBand maximum pending RDMA
> destination operations (must be >= 0)
> MCA btl: parameter
> "btl_openib_ib_service_level" (current value: "0")
> InfiniBand service level (must be >= 0)
> MCA btl: parameter
> "btl_openib_ib_static_rate" (current value: "0")
> InfiniBand static rate (must be >= 0;
> defulat: %d)
> MCA btl: parameter
> "btl_openib_exclusivity" (current value: "1024")
> OpenIB BTL exclusivity (must be >= 0)
> MCA btl: parameter "btl_openib_rd_num" (current
> value: "8")
> Number of receive descriptors to post to a
> queue pair (must be >= 1)
> MCA btl: parameter "btl_openib_rd_low" (current
> value: "6")
> Low water mark before reposting occurs
> (must be >= 1)
> MCA btl: parameter "btl_openib_rd_win" (current
> value: "4")
> Window size at which generate explicit
> credit message (must be >= 1)
> MCA btl: parameter "btl_openib_use_srq" (current
> value: "0")
> If nonzero, use the InfiniBand shared
> receive queue ("SRQ")
> MCA btl: parameter "btl_openib_srq_rd_max" (current
> value: "1000")
> Maxium number of receive descriptors
> posted per SRQ (only relevant if btl_openib_use_srq is true; must be
> >= 1)
> MCA btl: parameter
> "btl_openib_srq_rd_per_peer" (current value: "16")
> Number of receive descriptors posted per
> peer in the SRQ (only relevant if btl_openib_use_srq is true; must
> be >= 1)
> MCA btl: parameter "btl_openib_srq_sd_max" (current
> value: "8")
> Maximum number of send descriptors posted
> (only relevant if btl_openib_use_srq is true; must be >= 1)
> MCA btl: parameter
> "btl_openib_use_eager_rdma" (current value: "1")
> Use RDMA for eager messages
> MCA btl: parameter
> "btl_openib_eager_rdma_threshold" (current value: "16")
> Use RDMA for short messages after this
> number of messages are received from a given peer (must be >= 1)
> MCA btl: parameter
> "btl_openib_max_eager_rdma" (current value: "16")
> Maximum number of peers allowed to use
> RDMA for short messages (RDMA is used for all long messages, except
> if explicitly disabled, such as with the "dr" pml) (must be >= 0)
> MCA btl: parameter
> "btl_openib_eager_rdma_num" (current value: "16")
> Number of RDMA buffers to allocate for
> small messages(must be >= 1)
> MCA btl: parameter
> "btl_openib_btls_per_lid" (current value: "1")
> Number of BTLs to create for each
> InfiniBand LID (must be >= 1)
> MCA btl: parameter "btl_openib_max_lmc" (current
> value: "0")
> Maximum number of LIDs to use for each HCA
> port (must be >= 0, where 0 = use all available)
> MCA btl: parameter
> "btl_openib_buffer_alignment" (current value: "64")
> Prefered communication buffer alignment,
> in bytes (must be >= 0)
> MCA btl: parameter
> "btl_openib_eager_limit" (current value: "12288")
> Eager send limit, in bytes (must be >= 1)
> MCA btl: parameter
> "btl_openib_min_send_size" (current value: "32768")
> Minimum send size, in bytes (must be >= 1)
> MCA btl: parameter
> "btl_openib_max_send_size" (current value: "65536")
> Maximum send size, in bytes (must be >= 1)
> MCA btl: parameter
> "btl_openib_min_rdma_size" (current value: "1048576")
> Minimum RDMA size, in bytes (must be >= 1)
> MCA btl: parameter
> "btl_openib_max_rdma_size" (current value: "1048576")
> Maximium RDMA size, in bytes (must be >= 1)
> MCA btl: parameter "btl_openib_flags" (current
> value: "54")
> BTL flags, added together: SEND=1, PUT=2,
> GET=4 (cannot be 0)
> MCA btl: parameter "btl_openib_bandwidth" (current
> value: "0")
> Approximate maximum bandwidth of each
> network interface in megabits per second (if 0, filled in at run-
> time by querying the HCA, otherwise must be > 0)
> MCA btl: information
> "btl_openib_have_fork_support" (value: "1")
> Whether the OpenFabrics stack supports
> applications that invoke the "fork()" system call or not (0 = no, 1
> = yes). Note that this value does NOT indicate whether the system
> being run on supports "fork()" with OpenFabrics applications or not.
> MCA btl: parameter "btl_openib_priority" (current
> value: "0")
> MCA btl: parameter
> "btl_self_free_list_num" (current value: "0")
> Number of fragments by default
> MCA btl: parameter
> "btl_self_free_list_max" (current value: "-1")
> Maximum number of fragments
> MCA btl: parameter
> "btl_self_free_list_inc" (current value: "32")
> Increment by this number of fragments
> MCA btl: parameter "btl_self_eager_limit" (current
> value: "131072")
> Eager size fragmeng (before the rendez-
> vous ptotocol)
> MCA btl: parameter
> "btl_self_min_send_size" (current value: "262144")
> Minimum fragment size after the rendez-vous
> MCA btl: parameter
> "btl_self_max_send_size" (current value: "262144")
> Maximum fragment size after the rendez-vous
> MCA btl: parameter
> "btl_self_min_rdma_size" (current value: "2147483647")
> Maximum fragment size for the RDMA transfer
> MCA btl: parameter
> "btl_self_max_rdma_size" (current value: "2147483647")
> Maximum fragment size for the RDMA transfer
> MCA btl: parameter "btl_self_exclusivity" (current
> value: "65536")
> Device exclusivity
> MCA btl: parameter "btl_self_flags" (current value:
> "10")
> Active behavior flags
> MCA btl: parameter "btl_self_priority" (current
> value: "0")
> MCA btl: parameter "btl_sm_free_list_num" (current
> value: "8")
> MCA btl: parameter "btl_sm_free_list_max" (current
> value: "-1")
> MCA btl: parameter "btl_sm_free_list_inc" (current
> value: "64")
> MCA btl: parameter "btl_sm_exclusivity" (current
> value: "65535")
> MCA btl: parameter "btl_sm_latency" (current value:
> "100")
> MCA btl: parameter "btl_sm_max_procs" (current
> value: "-1")
> MCA btl: parameter "btl_sm_sm_extra_procs" (current
> value: "2")
> MCA btl: parameter "btl_sm_mpool" (current value:
> "sm")
> MCA btl: parameter "btl_sm_eager_limit" (current
> value: "4096")
> MCA btl: parameter "btl_sm_max_frag_size" (current
> value: "32768")
> MCA btl: parameter
> "btl_sm_size_of_cb_queue" (current value: "128")
> MCA btl: parameter
> "btl_sm_cb_lazy_free_freq" (current value: "120")
> MCA btl: parameter "btl_sm_priority" (current
> value: "0")
> MCA btl: parameter "btl_tcp_if_include" (current
> value: <none>)
> MCA btl: parameter "btl_tcp_if_exclude" (current
> value: "apnet0,apnet1,apnet2,apnet3")
> MCA btl: parameter "btl_tcp_free_list_num" (current
> value: "8")
> MCA btl: parameter "btl_tcp_free_list_max" (current
> value: "-1")
> MCA btl: parameter "btl_tcp_free_list_inc" (current
> value: "32")
> MCA btl: parameter "btl_tcp_sndbuf" (current value:
> "131072")
> MCA btl: parameter "btl_tcp_rcvbuf" (current value:
> "131072")
> MCA btl: parameter
> "btl_tcp_endpoint_cache" (current value: "30720")
> MCA btl: parameter "btl_tcp_exclusivity" (current
> value: "0")
> MCA btl: parameter "btl_tcp_eager_limit" (current
> value: "65536")
> MCA btl: parameter "btl_tcp_min_send_size" (current
> value: "65536")
> MCA btl: parameter "btl_tcp_max_send_size" (current
> value: "131072")
> MCA btl: parameter "btl_tcp_min_rdma_size" (current
> value: "131072")
> MCA btl: parameter "btl_tcp_max_rdma_size" (current
> value: "2147483647")
> MCA btl: parameter "btl_tcp_flags" (current value:
> "122")
> MCA btl: parameter "btl_tcp_priority" (current
> value: "0")
> MCA btl: parameter "btl_base_include" (current
> value: <none>)
> MCA btl: parameter "btl_base_exclude" (current
> value: <none>)
> MCA btl: parameter
> "btl_base_warn_component_unused" (current value: "1")
> This parameter is used to turn on warning
> messages when certain NICs are not used
> MCA mtl: parameter "mtl" (current value: <none>)
> Default selection set of components for
> the mtl framework (<none> means "use all components that can be
> found")
> MCA mtl: parameter "mtl_base_verbose" (current
> value: "0")
> Verbosity level for the mtl framework (0 =
> no verbosity)
> MCA topo: parameter "topo" (current value: <none>)
> Default selection set of components for
> the topo framework (<none> means "use all components that can be
> found")
> MCA topo: parameter "topo_base_verbose" (current
> value: "0")
> Verbosity level for the topo framework (0
> = no verbosity)
> MCA osc: parameter "osc" (current value: <none>)
> Default selection set of components for
> the osc framework (<none> means "use all components that can be
> found")
> MCA osc: parameter "osc_base_verbose" (current
> value: "0")
> Verbosity level for the osc framework (0 =
> no verbosity)
> MCA osc: parameter "osc_pt2pt_no_locks" (current
> value: "0")
> Enable optimizations available only if
> MPI_LOCK is not used.
> MCA osc: parameter "osc_pt2pt_eager_limit" (current
> value: "16384")
> Max size of eagerly sent data
> MCA osc: parameter "osc_pt2pt_priority" (current
> value: "0")
> MCA errmgr: parameter "errmgr_base_verbose" (current
> value: "0")
> Verbosity level for the errmgr framework
> MCA errmgr: parameter "errmgr" (current value: <none>)
> Default selection set of components for
> the errmgr framework (<none> means "use all components that can be
> found")
> MCA errmgr: parameter "errmgr_hnp_debug" (current
> value: "0")
> MCA errmgr: parameter "errmgr_hnp_priority" (current
> value: "0")
> MCA errmgr: parameter "errmgr_orted_debug" (current
> value: "0")
> MCA errmgr: parameter "errmgr_orted_priority" (current
> value: "0")
> MCA errmgr: parameter "errmgr_proxy_debug" (current
> value: "0")
> MCA errmgr: parameter "errmgr_proxy_priority" (current
> value: "0")
> MCA gpr: parameter "gpr_base_verbose" (current
> value: "0")
> Verbosity level for the gpr framework
> MCA gpr: parameter "gpr_base_maxsize" (current
> value: "2147483647")
> MCA gpr: parameter "gpr_base_blocksize" (current
> value: "512")
> MCA gpr: parameter "gpr" (current value: <none>)
> Default selection set of components for
> the gpr framework (<none> means "use all components that can be
> found")
> MCA gpr: parameter "gpr_null_priority" (current
> value: "0")
> MCA gpr: parameter "gpr_proxy_debug" (current
> value: "0")
> MCA gpr: parameter "gpr_proxy_priority" (current
> value: "0")
> MCA gpr: parameter "gpr_replica_debug" (current
> value: "0")
> MCA gpr: parameter "gpr_replica_isolate" (current
> value: "0")
> MCA gpr: parameter "gpr_replica_priority" (current
> value: "0")
> MCA iof: parameter "iof_base_window_size" (current
> value: "4096")
> MCA iof: parameter "iof_base_service" (current
> value: "0.0.0")
> MCA iof: parameter "iof_base_verbose" (current
> value: "0")
> Verbosity level for the iof framework
> MCA iof: parameter "iof" (current value: <none>)
> Default selection set of components for
> the iof framework (<none> means "use all components that can be
> found")
> MCA iof: parameter "iof_proxy_priority" (current
> value: "0")
> MCA iof: parameter "iof_svc_priority" (current
> value: "0")
> MCA ns: parameter "ns_base_verbose" (current
> value: "0")
> Verbosity level for the ns framework
> MCA ns: parameter "ns" (current value: <none>)
> Default selection set of components for
> the ns framework (<none> means "use all components that can be found")
> MCA ns: parameter "ns_proxy_debug" (current value:
> "0")
> MCA ns: parameter "ns_proxy_maxsize" (current
> value: "2147483647")
> MCA ns: parameter "ns_proxy_blocksize" (current
> value: "512")
> MCA ns: parameter "ns_proxy_priority" (current
> value: "0")
> MCA ns: parameter "ns_replica_debug" (current
> value: "0")
> MCA ns: parameter "ns_replica_isolate" (current
> value: "0")
> MCA ns: parameter "ns_replica_maxsize" (current
> value: "2147483647")
> MCA ns: parameter "ns_replica_blocksize" (current
> value: "512")
> MCA ns: parameter "ns_replica_priority" (current
> value: "0")
> MCA oob: parameter "oob" (current value: <none>)
> Default selection set of components for
> the oob framework (<none> means "use all components that can be
> found")
> MCA oob: parameter "oob_base_verbose" (current
> value: "0")
> Verbosity level for the oob framework (0 =
> no verbosity)
> MCA oob: parameter "oob_tcp_peer_limit" (current
> value: "-1")
> MCA oob: parameter "oob_tcp_peer_retries" (current
> value: "60")
> MCA oob: parameter "oob_tcp_debug" (current value:
> "0")
> MCA oob: parameter "oob_tcp_sndbuf" (current value:
> "131072")
> MCA oob: parameter "oob_tcp_rcvbuf" (current value:
> "131072")
> MCA oob: parameter "oob_tcp_if_include" (current
> value: <none>)
> Comma-delimited list of TCP interfaces to
> use
> MCA oob: parameter "oob_tcp_if_exclude" (current
> value: "apnet0,apnet1,apnet2,apnet3")
> Comma-delimited list of TCP interfaces to
> exclude
> MCA oob: parameter "oob_tcp_connect_sleep" (current
> value: "1")
> Enable (1) / disable (0) random sleep for
> connection wireup
> MCA oob: parameter "oob_tcp_listen_mode" (current
> value: "event")
> Mode for HNP to accept incoming
> connections: event, listen_thread
> MCA oob: parameter
> "oob_tcp_listen_thread_max_queue" (current value: "10")
> High water mark for queued accepted socket
> list size
> MCA oob: parameter
> "oob_tcp_listen_thread_max_time" (current value: "10")
> Maximum amount of time (in milliseconds)
> to wait between processing accepted socket list
> MCA oob: parameter
> "oob_tcp_accept_spin_count" (current value: "10")
> Number of times to let accept return
> EWOULDBLOCK before updating accepted socket list
> MCA oob: parameter "oob_tcp_priority" (current
> value: "0")
> MCA oob: parameter "oob_base_include" (current
> value: <none>)
> Components to include for oob framework
> selection
> MCA oob: parameter "oob_base_exclude" (current
> value: <none>)
> Components to exclude for oob framework
> selection
> MCA ras: parameter "ras_base_verbose" (current
> value: "0")
> Enable debugging for the RAS framework
> (nonzero = enabled)
> MCA ras: parameter "ras" (current value: <none>)
> MCA ras: parameter
> "ras_dash_host_priority" (current value: "5")
> Selection priority for the dash_host RAS
> component
> MCA ras: parameter "ras_gridengine_debug" (current
> value: "0")
> Enable debugging output for the gridengine
> ras component
> MCA ras: parameter
> "ras_gridengine_priority" (current value: "100")
> Priority of the gridengine ras component
> MCA ras: parameter
> "ras_gridengine_verbose" (current value: "0")
> Enable verbose output for the gridengine
> ras component
> MCA ras: parameter
> "ras_gridengine_show_jobid" (current value: "0")
> Show the JOB_ID of the Grid Engine job
> MCA ras: parameter
> "ras_localhost_priority" (current value: "0")
> Selection priority for the localhost RAS
> component
> MCA ras: parameter "ras_slurm_priority" (current
> value: "75")
> Priority of the slurm ras component
> MCA ras: parameter "ras_tm_priority" (current
> value: "100")
> Priority of the tm ras component
> MCA ras: parameter "ras_tm_nodefile_dir" (current
> value: "/var/torque/aux")
> The directory where the PBS nodefile can
> be found
> MCA rds: parameter "rds_base_verbose" (current
> value: "0")
> Verbosity level for the rds framework
> MCA rds: parameter "rds" (current value: <none>)
> MCA rds: parameter "rds_hostfile_debug" (current
> value: "0")
> Toggle debug output for hostfile RDS
> component
> MCA rds: parameter "rds_hostfile_path" (current
> value: "/usr/local/openmpi/etc/openmpi-default-hostfile")
> ORTE Host filename
> MCA rds: parameter "rds_hostfile_priority" (current
> value: "0")
> MCA rds: parameter "rds_proxy_priority" (current
> value: "0")
> MCA rds: parameter "rds_resfile_debug" (current
> value: "0")
> Toggle debug output for resfile RDS
> component
> MCA rds: parameter "rds_resfile_name" (current
> value: <none>)
> ORTE Resource filename
> MCA rds: parameter "rds_resfile_priority" (current
> value: "0")
> MCA rmaps: parameter "rmaps_base_verbose" (current
> value: "0")
> Verbosity level for the rmaps framework
> MCA rmaps: parameter
> "rmaps_base_schedule_policy" (current value: "unspec")
> Scheduling Policy for RMAPS. [slot | node]
> MCA rmaps: parameter "rmaps_base_pernode" (current
> value: "0")
> Launch one ppn as directed
> MCA rmaps: parameter "rmaps_base_n_pernode" (current
> value: "-1")
> Launch n procs/node
> MCA rmaps: parameter
> "rmaps_base_no_schedule_local" (current value: "0")
> If false, allow scheduling MPI
> applications on the same node as mpirun (default). If true, do not
> schedule any MPI applications on the same node as mpirun
> MCA rmaps: parameter
> "rmaps_base_no_oversubscribe" (current value: "0")
> If true, then do not allow
> oversubscription of nodes - mpirun will return an error if there
> aren't enough nodes to launch all processes without oversubscribing
> MCA rmaps: parameter
> "rmaps_base_display_map" (current value: "0")
> Whether to display the process map after
> it is computed
> MCA rmaps: parameter "rmaps" (current value: <none>)
> Default selection set of components for
> the rmaps framework (<none> means "use all components that can be
> found")
> MCA rmaps: parameter
> "rmaps_round_robin_debug" (current value: "1")
> Toggle debug output for Round Robin RMAPS
> component
> MCA rmaps: parameter
> "rmaps_round_robin_priority" (current value: "1")
> Selection priority for Round Robin RMAPS
> component
> MCA rmgr: parameter "rmgr_base_verbose" (current
> value: "0")
> Verbosity level for the rmgr framework
> MCA rmgr: parameter "rmgr" (current value: <none>)
> Default selection set of components for
> the rmgr framework (<none> means "use all components that can be
> found")
> MCA rmgr: parameter "rmgr_proxy_priority" (current
> value: "0")
> MCA rmgr: parameter "rmgr_urm_priority" (current
> value: "0")
> MCA rml: parameter "rml_base_debug" (current value:
> "0")
> Verbosity level for the rml famework
> MCA rml: parameter "rml" (current value: <none>)
> Default selection set of components for
> the rml framework (<none> means "use all components that can be
> found")
> MCA rml: parameter "rml_base_verbose" (current
> value: "0")
> Verbosity level for the rml framework (0 =
> no verbosity)
> MCA rml: parameter "rml_oob_priority" (current
> value: "0")
> MCA pls: parameter
> "pls_base_reuse_daemons" (current value: "0")
> If nonzero, reuse daemons to launch
> dynamically spawned processes. If zero, do not reuse daemons
> (default)
> MCA pls: parameter "pls" (current value: <none>)
> Default selection set of components for
> the pls framework (<none> means "use all components that can be
> found")
> MCA pls: parameter "pls_base_verbose" (current
> value: "0")
> Verbosity level for the pls framework (0 =
> no verbosity)
> MCA pls: parameter "pls_gridengine_debug" (current
> value: "0")
> Enable debugging of gridengine pls component
> MCA pls: parameter
> "pls_gridengine_verbose" (current value: "0")
> Enable verbose output of the gridengine
> qrsh -inherit command
> MCA pls: parameter
> "pls_gridengine_priority" (current value: "100")
> Priority of the gridengine pls component
> MCA pls: parameter "pls_gridengine_orted" (current
> value: "orted")
> The command name that the gridengine pls
> component will invoke for the ORTE daemon
> MCA pls: parameter "pls_proxy_priority" (current
> value: "0")
> MCA pls: parameter "pls_rsh_debug" (current value:
> "0")
> Whether or not to enable debugging output
> for the rsh pls component (0 or 1)
> MCA pls: parameter
> "pls_rsh_num_concurrent" (current value: "128")
> How many pls_rsh_agent instances to invoke
> concurrently (must be > 0)
> MCA pls: parameter "pls_rsh_force_rsh" (current
> value: "0")
> Force the launcher to always use rsh, even
> for local daemons
> MCA pls: parameter "pls_rsh_orted" (current value:
> "orted")
> The command name that the rsh pls
> component will invoke for the ORTE daemon
> MCA pls: parameter "pls_rsh_priority" (current
> value: "10")
> Priority of the rsh pls component
> MCA pls: parameter "pls_rsh_delay" (current value:
> "1")
> Delay (in seconds) between invocations of
> the remote agent, but only used when the "debug" MCA parameter is
> true, or the top-level MCA debugging is enabled (otherwise this
> value is ignored)
> MCA pls: parameter "pls_rsh_reap" (current value:
> "1")
> If set to 1, wait for all the processes to
> complete before exiting. Otherwise, quit immediately -- without
> waiting for confirmation that all other processes in the job have
> completed.
> MCA pls: parameter
> "pls_rsh_assume_same_shell" (current value: "1")
> If set to 1, assume that the shell on the
> remote node is the same as the shell on the local node. Otherwise,
> probe for what the remote shell.
> MCA pls: parameter "pls_rsh_agent" (current value:
> "ssh : rsh")
> The command used to launch executables on
> remote nodes (typically either "ssh" or "rsh")
> MCA pls: parameter "pls_slurm_debug" (current
> value: "0")
> Enable debugging of slurm pls
> MCA pls: parameter "pls_slurm_priority" (current
> value: "75")
> Default selection priority
> MCA pls: parameter "pls_slurm_orted" (current
> value: "orted")
> Command to use to start proxy orted
> MCA pls: parameter "pls_slurm_args" (current value:
> <none>)
> Custom arguments to srun
> MCA pls: parameter "pls_tm_debug" (current value:
> "0")
> Enable debugging of the TM pls
> MCA pls: parameter "pls_tm_verbose" (current value:
> "0")
> Enable verbose output of the TM pls
> MCA pls: parameter "pls_tm_priority" (current
> value: "75")
> Default selection priority
> MCA pls: parameter "pls_tm_orted" (current value:
> "orted")
> Command to use to start proxy orted
> MCA pls: parameter
> "pls_tm_want_path_check" (current value: "1")
> Whether the launching process should check
> for the pls_tm_orted executable in the PATH before launching (the TM
> API does not give an idication of failure; this is a somewhat-lame
> workaround; non-zero values enable this check)
> MCA sds: parameter "sds" (current value: <none>)
> Default selection set of components for
> the sds framework (<none> means "use all components that can be
> found")
> MCA sds: parameter "sds_base_verbose" (current
> value: "0")
> Verbosity level for the sds framework (0 =
> no verbosity)
> MCA sds: parameter "sds_env_priority" (current
> value: "0")
> MCA sds: parameter "sds_pipe_priority" (current
> value: "0")
> MCA sds: parameter "sds_seed_priority" (current
> value: "0")
> MCA sds: parameter
> "sds_singleton_priority" (current value: "0")
> MCA sds: parameter "sds_slurm_priority" (current
> value: "0")
>
>
>
>
>
>
>
> Thank you,
> Jeff Ceason
> _______________________________________________
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
--
Jeff Squyres
Cisco Systems
_______________________________________________
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users
