FYI, this causes build failures in OTF code in our Jenkins installation. It's probably caused by this commit:
https://svn.open-mpi.org/trac/ompi/changeset/32265 I don't have time to track it down myself, unfortunately. -Dave Begin forwarded message: > From: <dgood...@cisco.com> > Subject: Build failed in Jenkins: ompi_upstream_v1.8_build_debug #265 > Date: July 22, 2014 12:08:34 PM CDT > To: <usnic-jenk...@cisco.com> > > See > <https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/265/changes> > > Changes: > > [rhc] Fixes #4799: Move r32261 to v1.8 branch (Improve verbose message for > which devices are being used) > > ---svn-pre-commit-ignore-below--- > > r32261 [[BR]] > Improve verbose message which says which device:ports are being used. Also > move where message is generated. > > [rhc] Fixes #4798: Move r32260 to v1.8 branch (common/verbs: fix usnic > detection) > > ---svn-pre-commit-ignore-below--- > > r32260 [[BR]] > common/verbs: fix usnic detection > > The logic was mishandling the case of a newer kernel and an older > libusnic_verbs. Simplify usnic_transport() to return constants in the > 2 known cases (not a usNIC device and the TRANSPORT_USNIC_UDP case), > and call the magic probe in all other cases. > > Reviewed-by: Dave Goodell <dgood...@cisco.com> > > cmr=v1.8.2:reviewer=ompi-rm1.8 > > [rhc] Fixes #4797: Move r32259 to v1.8 branch (usnic: explicitly handle case > when) > > ---svn-pre-commit-ignore-below--- > > r32259 [[BR]] > usnic: explicitly handle case when both endpoints are NULL > > If we don't explicitly declare that (a == NULL && b == NULL) is > equivalent to qsort, we could end up with wonky sorting order. I.e., > it's *possible* that some NULLs could end up in the middle of the > array. > > Regardless of whether it will ever happen in practice, it makes the > code more clear to also handle the "both are NULL" case. > > Also fix the 2-spacing indents. > > Reviewed by Dave Goodell. > > cmr=v1.8.2:reviewer=ompi-rm1.8 > > [rhc] Fixes #4795: Move r32257 to v1.8 branch (OSHMEM: Set SMA_SYMMETRIC_SIZE > to default) > > ---svn-pre-commit-ignore-below--- > > r32257 [[BR]] > OSHMEM: Set SMA_SYMMETRIC_SIZE to default value > > OpenSHMEMspec 1.1 introduces a set of environment variables that allows users > to configure the Open-SHMEM implementation, and receive information about the > implementation. > - Add SMA_SYMMETRIC_SIZE - number of bytes to allocate for symmetric heap > - SHMEM_SYMMETRIC_HEAP_SIZE (Mellanox extension) is used by a user to provide > a size of symmetric area. This change sets this env variable in case a user > does not set this variable > directly. > > fixed by Igor, reviewed by Miked > > cmr=v1.8.2:reviwer=ompi-rm1.8 > > [rhc] Fixes #4794: Move r32256 to v1.8 branch (MXM: use builk connection > establishment) > > ---svn-pre-commit-ignore-below--- > > r32256 [[BR]] > MXM: use builk connection establishment API > > fixed by Vasily, reviewed by Yossi/Miked > > cmr=v1.8.2:reviwer=ompi-rm1.8 > > [rhc] Fixes #4793: Move r32253 to v1.8 branch (configure.ac: use the portable > '=') > > ---svn-pre-commit-ignore-below--- > > r32253 [[BR]] > configure.ac: use the portable '=' operator for the 'test' command > > Thanks to Kevin M. Buckley for providing the patch > > cmr=v1.8.2:reviewer=rhc > > [rhc] Fixes #4791: Move r32245 to v1.8 branch (oshmem: remove automatically > generated files) > > ---svn-pre-commit-ignore-below--- > > r32245 [[BR]] > oshmem: remove automatically generated files from the tarball > > cmr=v1.8.2:reviewer=miked > > [rhc] Fixes #4790: Move r32244 to v1.8 branch (mpi: remove automatically > generated file) > > ---svn-pre-commit-ignore-below--- > > r32244 [[BR]] > mpi: remove automatically generated file from the tarball > > cmr=v1.8.2:reviewer=jsquyres > > [rhc] Fixes #4789: Move r32243 to v1.8 branch (vt: remove automatically > generated files) > > ---svn-pre-commit-ignore-below--- > > r32243 [[BR]] > vt: remove automatically generated files from the tarball > > cmr=v1.8.2:reviewer=jurenz > > [rhc] Fixes #4788: Move r32231 to v1.8 branch (Silence warning) > > ---svn-pre-commit-ignore-below--- > > r32231 [[BR]] > Silence warning > > cmr=v1.8.2:reviewer=hjelmn > > [rhc] Fixes #4786: Move r29732 to v1.8 branch (BUILD: support new automake) > > ---svn-pre-commit-ignore-below--- > > r29732 [[BR]] > Changes to VT/OTF: > Fixed warnings about the need of the 'subdir-objects' option when using > Automake v1.14. > Due to a bug in Automake (see > http://debbugs.gnu.org/cgi/bugreport.cgi?bug=13928) the 'subdir-objects' > option cannot be enabled. > To get around this problem external sources files are sym linked in the > current build directory (as done in ompi/mpi/c/profile) to lead Automake to > believe that all source files are in the same directory. > > ------------------------------------------ > [...truncated 10830 lines...] > CC prget_f.lo > CC pget_accumulate_f.lo > CC prget_accumulate_f.lo > CC pput_f.lo > CC prput_f.lo > CC pcompare_and_swap_f.lo > CC pfetch_and_op_f.lo > CC pwin_allocate_shared_f.lo > CC pwin_call_errhandler_f.lo > CC pwin_complete_f.lo > CC pwin_create_errhandler_f.lo > CC pwin_create_f.lo > CC pwin_create_keyval_f.lo > CC pwin_delete_attr_f.lo > CC pwin_fence_f.lo > CC pwin_free_f.lo > CC pwin_free_keyval_f.lo > CC pwin_get_attr_f.lo > CC pwin_get_errhandler_f.lo > CC pwin_get_group_f.lo > CC pwin_get_name_f.lo > CC pwin_lock_f.lo > CC pwin_post_f.lo > CC pwin_set_attr_f.lo > CC pwin_set_errhandler_f.lo > CC pwin_set_name_f.lo > CC pwin_shared_query_f.lo > CC pwin_start_f.lo > CC pwin_test_f.lo > CC pwin_unlock_f.lo > CC pwin_wait_f.lo > CC pwin_flush_f.lo > CC pwin_flush_all_f.lo > CC pwin_flush_local_f.lo > CC pwin_flush_local_all_f.lo > CC pfile_call_errhandler_f.lo > CC pfile_close_f.lo > CC pfile_create_errhandler_f.lo > CC pfile_delete_f.lo > CC pfile_get_amode_f.lo > CC pfile_get_atomicity_f.lo > CC pfile_get_byte_offset_f.lo > CC pfile_get_errhandler_f.lo > CC pfile_get_group_f.lo > CC pfile_get_info_f.lo > CC pfile_get_position_f.lo > CC pfile_get_position_shared_f.lo > CC pfile_get_size_f.lo > CC pfile_get_type_extent_f.lo > CC pfile_get_view_f.lo > CC pfile_iread_at_f.lo > CC pfile_iread_f.lo > CC pfile_iread_shared_f.lo > CC pfile_iwrite_at_f.lo > CC pfile_iwrite_f.lo > CC pfile_iwrite_shared_f.lo > CC pfile_open_f.lo > CC pfile_preallocate_f.lo > CC pfile_read_all_begin_f.lo > CC pfile_read_all_end_f.lo > CC pfile_read_all_f.lo > CC pfile_read_at_all_begin_f.lo > CC pfile_read_at_all_end_f.lo > CC pfile_read_at_all_f.lo > CC pfile_read_at_f.lo > CC pfile_read_f.lo > CC pfile_read_ordered_begin_f.lo > CC pfile_read_ordered_end_f.lo > CC pfile_read_ordered_f.lo > CC pfile_read_shared_f.lo > CC pfile_seek_f.lo > CC pfile_seek_shared_f.lo > CC pfile_set_atomicity_f.lo > CC pfile_set_errhandler_f.lo > CC pfile_set_info_f.lo > CC pfile_set_size_f.lo > CC pfile_set_view_f.lo > CC pfile_sync_f.lo > CC pfile_write_all_begin_f.lo > CC pfile_write_all_end_f.lo > CC pfile_write_all_f.lo > CC pfile_write_at_all_begin_f.lo > CC pfile_write_at_all_end_f.lo > CC pfile_write_at_all_f.lo > CC pfile_write_at_f.lo > CC pfile_write_f.lo > CC pfile_write_ordered_begin_f.lo > CC pfile_write_ordered_end_f.lo > CC pfile_write_ordered_f.lo > CC pfile_write_shared_f.lo > CC pregister_datarep_f.lo > CCLD libmpi_mpifh_pmpi.la > make[3]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/mpi/fortran/mpif-h/profile'> > make[3]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/mpi/fortran/mpif-h'> > CCLD libmpi_mpifh.la > make[3]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/mpi/fortran/mpif-h'> > make[2]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/mpi/fortran/mpif-h'> > Making all in mpi/fortran/use-mpi-tkr > make[2]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/mpi/fortran/use-mpi-tkr'> > PPFC mpi.lo > FCLD libmpi_usempi.la > make[2]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/mpi/fortran/use-mpi-tkr'> > Making all in mpi/fortran/mpiext > make[2]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/mpi/fortran/mpiext'> > make[2]: Nothing to be done for `all'. > make[2]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/mpi/fortran/mpiext'> > Making all in contrib/vt > make[2]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt'> > Making all in vt > make[3]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt'> > /usr/bin/make all-recursive > make[4]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt'> > Making all in extlib > make[5]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib'> > Making all in otf > make[6]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf'> > /usr/bin/make all-recursive > make[7]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf'> > Making all in vendor/jenkins_hash > make[8]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/vendor/jenkins_hash'> > CC libjenkins_hash_la-jenkins_hash.lo > CCLD libjenkins_hash.la > make[8]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/vendor/jenkins_hash'> > Making all in otflib > make[8]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/otflib'> > CC libopen_trace_format_la-OTF_CopyHandler.lo > CC libopen_trace_format_la-OTF_CopyHandler_stream.lo > CC libopen_trace_format_la-OTF_File.lo > CC libopen_trace_format_la-OTF_File_iofsl.lo > CC libopen_trace_format_la-OTF_FileManager.lo > CC libopen_trace_format_la-OTF_Filenames.lo > CC libopen_trace_format_la-OTF_HandlerArray.lo > CC libopen_trace_format_la-OTF_KeyValue.lo > CC libopen_trace_format_la-OTF_MasterControl.lo > CC libopen_trace_format_la-OTF_Parse.lo > CC libopen_trace_format_la-OTF_RBuffer.lo > CC libopen_trace_format_la-OTF_Reader.lo > CC libopen_trace_format_la-OTF_RStream.lo > CC libopen_trace_format_la-OTF_WBuffer.lo > CC libopen_trace_format_la-OTF_Writer.lo > CC libopen_trace_format_la-OTF_WStream.lo > CC libopen_trace_format_la-OTF_inttypes.lo > CCLD libopen-trace-format.la > make[8]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/otflib'> > Making all in otfauxlib > make[8]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/otfauxlib'> > CC libotfaux_la-OTFAUX_MsgMatching.lo > CC libotfaux_la-OTFAUX_Thumbnail.lo > CC libotfaux_la-OTFAUX_Process.lo > CC libotfaux_la-OTFAUX_State.lo > CCLD libotfaux.la > make[8]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/otfauxlib'> > Making all in tools > make[8]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools'> > Making all in otfaux > make[9]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfaux'> > CXX otfaux.o > CXX Control.o > CXX Handler.o > CXX Stats.o > CXXLD otfaux > make[9]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfaux'> > Making all in otfconfig > make[9]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfconfig'> > CC otfconfig.o > CCLD otfconfig > make[9]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfconfig'> > Making all in otfdump > make[9]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfdump'> > CXX Handler.o > CXX otfdump.o > CXXLD otfprint > make[9]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfdump'> > Making all in otfinfo > make[9]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfinfo'> > CC handler.o > CC hash.o > CC otfinfo.o > CCLD otfinfo > make[9]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfinfo'> > Making all in otfmerge > make[9]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfmerge'> > Making all in . > make[10]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfmerge'> > CC otfmerge-handler.o > CC otfmerge-otfmerge.o > CCLD otfmerge > make[10]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfmerge'> > Making all in mpi > make[10]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfmerge/mpi'> > ln -s ../../../tools/otfmerge/handler.c handler.c > ln -s ../../../tools/otfmerge/otfmerge.c otfmerge.c > CC otfmerge_mpi-handler.o > CC otfmerge_mpi-otfmerge.o > CCLD otfmerge-mpi > make[10]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfmerge/mpi'> > make[9]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfmerge'> > Making all in otfprofile > make[9]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfprofile'> > Making all in . > make[10]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfprofile'> > CXX otfprofile-clustering.o > CXX otfprofile-collect_data.o > CXX otfprofile-collect_dispersion.o > CXX otfprofile-comparison_clinkage.o > CXX otfprofile-comparison_kmeans.o > CXX otfprofile-create_csv.o > CXX otfprofile-create_marker.o > CXX otfprofile-create_latex.o > CXX otfprofile-create_filter.o > CXX otfprofile-otfprofile.o > CXX otfprofile-process_dispersion.o > CXX otfprofile-summarize_data.o > CXXLD otfprofile > make[10]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfprofile'> > Making all in mpi > make[10]: Entering directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfprofile/mpi'> > make[10]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfprofile/mpi'> > make[10]: *** No rule to make target `../reduce_data.cpp', needed by > `otfprofile_mpi-reduce_data.o'. Stop. > make[9]: *** [all-recursive] Error 1 > make[9]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools/otfprofile'> > make[8]: *** [all-recursive] Error 1 > make[8]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf/tools'> > make[7]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf'> > make[7]: *** [all-recursive] Error 1 > make[6]: *** [all] Error 2 > make[6]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib/otf'> > make[5]: *** [all-recursive] Error 1 > make[5]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt/extlib'> > make[4]: *** [all-recursive] Error 1 > make[4]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt'> > make[3]: *** [all] Error 2 > make[3]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt/vt'> > make[2]: *** [all-recursive] Error 1 > make[2]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi/contrib/vt'> > make[1]: *** [all-recursive] Error 1 > make[1]: Leaving directory > `<https://savbu-usnic.cisco.com/jenkins/job/ompi_upstream_v1.8_build_debug/ws/ompi'> > make: *** [all-recursive] Error 1 > srun: error: mpi001: task 0: Exited with exit code 2 > +/home/dgoodell/git/savbu-usnic-cluster/jenkins/jenkins-build-ompi.zsh:36> > check_status > +check_status:1> eval return 2 > +(eval):1> return 2 > salloc: Relinquishing job allocation 824885 > +/home/dgoodell/git/savbu-usnic-cluster/jenkins/jenkins-submit.zsh:59> > salloc_status=2 > +/home/dgoodell/git/savbu-usnic-cluster/jenkins/jenkins-submit.zsh:61> grep > 'salloc: error: Failed to allocate resources: More processors requested than > permitted' salloc_err.out > +/home/dgoodell/git/savbu-usnic-cluster/jenkins/jenkins-submit.zsh:65> rm -f > salloc_err.out > +/home/dgoodell/git/savbu-usnic-cluster/jenkins/jenkins-submit.zsh:66> return > 2 > Build step 'Execute shell' marked build as failure > Archiving artifacts
