Re: [OMPI devel] r25470 (hwloc CMR) breaks v1.5

[Jeff Squyres]

On Nov 14, 2011, at 10:17 PM, Eugene Loh wrote:

> I tried building v1.5.  r25469 builds for me, r25470 does not.  This is 
> Friday's hwloc putback of CMR 2866.  I'm on Solaris11/x86.  The problem is 
> basically:

Doh!

> Making all in tools/ompi_info
>  CC ompi_info.o
> "../../../opal/include/opal/sys/ia32/atomic.h", line 173: warning: parameter 
> in inline asm statement unused: %2

Have these warnings always been there for you?  r25470 should not have changed 
any of the assembly stuff.

>  CCLD   ompi_info
> Undefined   first referenced
> symbol in file
> opal_hwloc122_hwloc_bitmap_dup  components.o
> opal_hwloc122_hwloc_bitmap_weight   components.o
> ld: fatal: symbol referencing errors. No output written to .libs/ompi_info

I do notice some minor differences between ompi-trunk/ompi-1.5 in the 
opal/mca/hwloc/hwloc122ompi/hwloc trees.  

Terry: did you add some stuff to the trunk in topology-solaris-chiptype.c, for 
example?

If so, the right solution might just be to copy from 
trunk/opal/mca/hwloc/hwloc122ompi/hwloc/* to 
ompi-1.5/opal/mca/hwloc/hwloc122ompi/hwloc/.

-- 
Jeff Squyres
jsquy...@cisco.com
For corporate legal information go to:
http://www.cisco.com/web/about/doing_business/legal/cri/

Re: [OMPI devel] PGI error invoked when svnversion is unavailable

[Thomas Rothrock CTR SMDC SimCtr/GaN Corporation]

Thank you for the reply and attachments.  I searched the archive before
sending my own email and did find a couple of the previous messages, but
believe mine is a different situation.  The macro expansion is working (I'm
using PGI 11.10) but the macro is set to "" instead of "1.7a1? (no
svnversion) MM-DD-" by an error in the configure script generation.
Installing subversion is a cheap workaround that makes the svnversion
command available and the macro gets set to "1.7a1r25476M" or whatever repo
version you are at.

I did not mention it before but this happens when I try to build the trunk
or the 1.5 development branch.  The 1.4 branch's configure code doesn't even
bother to test for svnversion failing and just ends up setting OMPI_VERSION
to "1.4.4rc5r"

The problem is with configure's with_ident_string assignment:

with_ident_string="`echo $with_ident_string | sed -e
's/%VERSION%/'$OMPI_VERSION/`"

OMPI_VERSION is set to "1.7a1? (no svnversion) MM-DD-" but the spaces in
OMPI_VERSION break the expression because sed sees the rest of the version
string as extra arguments instead of part of the -e script.  It doesn't show
up in config.log, but the configure output to the terminal at this point is:

checking if want ident string... sed: -e expression #1, char 18:
unterminated `s' command

The config.status shows:

D["OPAL_IDENT_STRING"]=" \"\""

If I patch config/opal_get_version.m4 to remove the spaces:



diff -Naurd openmpi-trunk.a/config/opal_get_version.m4
openmpi-trunk.b/config/opal_get_version.m4
--- openmpi-trunk.a/config/opal_get_version.m4  2011-09-21
23:17:36.0 -0500
+++ openmpi-trunk.b/config/opal_get_version.m4  2011-11-15
17:36:09.0 -0600
@@ -81,7 +81,7 @@
 if test $? != 0; then
 # The following is too long for Fortran
 # $2_REPO_REV="unknown svn version (svnversion not
found); $d"
-$2_REPO_REV="? (no svnversion); $d"
+$2_REPO_REV="?(nosvnversion);$d"
 fi
 elif test -d "$srcdir/.hg" ; then
 # Check to see if we can find the hg command



it verifies that the spaces were the problem.  OMPI_VERSION gets set to
"1.7a1?(nosvnversion);11-15-2011", configure runs without an sed error, and
config.status shows:

D["OPAL_IDENT_STRING"]=" \"1.7a1?(nosvnversion);11-15-2011\""

and opal/runtime/opal_init.c compiles without triggering the misleading PGI
error, but doesn't look quite as pretty.  Perhaps a better solution is to
modify the with_ident_string assignment to work correclty with spaces in
OMPI_VERSION intact:



diff -Naurd openmpi-trunk.a/opal/config/opal_configure_options.m4
openmpi-trunk.b/opal/config/opal_configure_options.m4
--- openmpi-trunk.a/opal/config/opal_configure_options.m4   2011-11-15
17:55:36.0 -0600
+++ openmpi-trunk.b/opal/config/opal_configure_options.m4   2011-11-15
18:29:43.0 -0600
@@ -489,7 +489,7 @@
 if test "$with_ident_string" = "" -o "$with_ident_string" = "no"; then
 with_ident_string="%VERSION%"
 fi
-with_ident_string="`echo $with_ident_string | sed -e
's/%VERSION%/'$OMPI_VERSION/`"
+with_ident_string="`echo $with_ident_string | sed -e
's/%VERSION%/'"$OMPI_VERSION"'/'`"
 AC_DEFINE_UNQUOTED([OPAL_IDENT_STRING], ["$with_ident_string"],
  [ident string for Open MPI])
 AC_MSG_RESULT([$with_ident_string])


In this case the resulting config.status has:

D["OPAL_IDENT_STRING"]=" \"1.7a1? (no svnversion); 11-15-2011\""

and the compile works.  I have attached the second patch for both trunk and
1.5 as it is probably the better solution (don't assume OMPI_VERSION has no
spaces) and I have not found other instances of spaces in the version string
breaking anything.  As for OpenMPI 1.4's development branch, I'll leave the
choice to patch or leave as-is for someone else to discuss.

FYI, PGI has assigned my support request TPR #18274.  I'm curious what they
will come back with.

  ---
   Tom Rothrock  
   US Army Space & Missile Defense Command Simulation Center
   256-955-3382 (DSN 645)   FAX 256-955-1231
    Main SimCtr Phone:  256-955-3750
  ---
  This email capability is supported by Department of Defense
  systems and is subject to monitoring.  Please refrain from
  using this address for non-Government purposes.
  ---

-Original Message-
From: Larry Baker [mailto:ba...@usgs.gov] 
Sent: Tuesday, November 15, 2011 4:08 PM
To: Thomas Rothrock CTR SMDC SimCtr/GaN Corporation
Cc: Open MPI Developers; Eugene Loh
Subject: Re: [OMPI devel] PGI error invoked when svnversion is 

Re: [OMPI devel] PGI error invoked when svnversion is unavailable

[Larry Baker]

Tom,This is because the code in OpenMPI presumes macros will be expanded in pragmas, but that is not required by the C standard.  (See my e-mails below from last year with PGI, TPR 17186.)  I fixed OpenMPI 1.4.3 configure in the attached patch.  My patch also disables inline assembly for PGI C++, the same as for PGI C.  (Something similar may also have to be done to solve Eugene's asm statement warnings on Solaris 11.)  It also fixes detection of support for marshaling Fortran REAL16 and COMPLEX32 data types. Larry BakerUS Geological Survey650-329-5608ba...@usgs.gov On 15 Nov 2011, at 12:49 PM, Thomas Rothrock CTR SMDC SimCtr/GaN Corporation wrote:I am building on a separate (unnetworked) system than the one I check outSVN sources from, thus subversion was never installed on this system and the"svnversion" command is unavailable.  After configure, this eventuallyresults in OPAL_IDENT_STRING getting set to an empty string ("").  Thisseems to invoke an odd error in the Portland Group (PGI) C compiler (pgcc),such that	#pragma ident ""results in:	PGC-F-0010-File write error occurred (temporary pragma .s file)which is is a bit misleading and took me a while to track down the problem.My testing has shown that the C++ compiler (pgCC) does not fail with thesame error (or any error at all) and completes, but pgcc fails this case inat least all versions since 8.0-6 and probably earlier.  I have filed asupport request with PGI to see what they say about it, but of course thisdoes nothing for current and older versions.  My quick workaround was tojust install subversion so that the empty string never gets set to beginwith.  Ultimately though should OPAL_IDENT_STRING be ending up empty whenthe "svnversion" command is not available?  ---   Tom Rothrock     US Army Space & Missile Defense Command Simulation Center   256-955-3382 (DSN 645)   FAX 256-955-1231    Main SimCtr Phone:  256-955-3750  ---  This email capability is supported by Department of Defense  systems and is subject to monitoring.  Please refrain from  using this address for non-Government purposes.  ---___devel mailing listde...@open-mpi.orghttp://www.open-mpi.org/mailman/listinfo.cgi/develLarry Baker wrote:Dave,I too read the C99 standard and found that macro substitution is not required in pragmas.  I complained to the OpenMPI folks that they are relying a non-standard feature.  The reason I brought this to your attention is to point out that pgcc and pgCC behave differently (puzzling), neither one describes their behavior, and ident is not documented as a recognized pragma.  Please make sure the documentation is updated to describe whatever the behavior is for pgcc and pgCC.Thanks,Larry BakerUS Geological Survey650-329-5608ba...@usgs.govLarry,Thank you. I have added your remarks to the FTO, and included documentation into itsresolution.daveOn Oct 7, 2010, at 10:46 AM, PGI Technical Support wrote:Larry,An update to TPR 17186. =For c99, it is not required to perform macro replacement in pragmas.However, there are a few exceptions in pgc, such as within 'omp', 'pgi' & 'acc' pragmas.c99 does define a method which effects replacement within pragmas; themethod uses the _Pragma operator; e.g.,#define FOO "foo"#define IDENT(x) _Pragma("ident") xIDENT(FOO)will generate#pragma ident "foo"We will add allowing macro replacement within'#pragma ident'  in our 11.0 release.==regards,davePGI Technical Support wrote:TPR 17186.thanks again,daveLarry Baker wrote:Customer information:Larry BakerUS Geological Survey650-329-5608ba...@usgs.govProduct: 2183-WSPIN: 507549Problem description:pgcc issues the warning Pragma ignored – string expected after #pragma ident when compiling openmpi-1.4.2 from http://www.open-mpi.org.The source of this problem is that OpenMPI #defines the string it wants to use in a #pragma ident instead of using a literal string value.  However, pgcc does not perform macro substitution on #pragma ident statements.  Curiously, pgCC does!  This is not documented anywhere.  Also, #pragma ident is not listed as a recognized pragma, even though it seems to be properly compiled into the ELF object file.  It would be consistent with gcc and pgCC if pgcc would perform macro substitution in pragmas.Larry BakerUS Geological Survey650-329-5608ba...@usgs.gov-- Dave Borer    Customer Service Manager, The Portland Groupemail    dave.bo...@st.comphone    (503)-431-7113-- Dave Borer	Customer Service Manager, The Portland Groupemail		dave.bo...@st.comphone		(503)-431-7113

[OMPI devel] PGI error invoked when svnversion is unavailable

[Thomas Rothrock CTR SMDC SimCtr/GaN Corporation]

I am building on a separate (unnetworked) system than the one I check out
SVN sources from, thus subversion was never installed on this system and the
"svnversion" command is unavailable.  After configure, this eventually
results in OPAL_IDENT_STRING getting set to an empty string ("").  This
seems to invoke an odd error in the Portland Group (PGI) C compiler (pgcc),
such that

#pragma ident ""

results in:

PGC-F-0010-File write error occurred (temporary pragma .s file)

which is is a bit misleading and took me a while to track down the problem.
My testing has shown that the C++ compiler (pgCC) does not fail with the
same error (or any error at all) and completes, but pgcc fails this case in
at least all versions since 8.0-6 and probably earlier.  I have filed a
support request with PGI to see what they say about it, but of course this
does nothing for current and older versions.  My quick workaround was to
just install subversion so that the empty string never gets set to begin
with.  Ultimately though should OPAL_IDENT_STRING be ending up empty when
the "svnversion" command is not available?

  ---
   Tom Rothrock  
   US Army Space & Missile Defense Command Simulation Center
   256-955-3382 (DSN 645)   FAX 256-955-1231
    Main SimCtr Phone:  256-955-3750
  ---
  This email capability is supported by Department of Defense
  systems and is subject to monitoring.  Please refrain from
  using this address for non-Government purposes.
  ---




smime.p7s
Description: S/MIME cryptographic signature

[hwloc-devel] Fwd: Announcing Grid Engine 2011.11 and SC11 demo & presentation

[Rayson Ho]

This is the first official release with hwloc (we previously released
upgrade packages with hwloc for older versions). Thanks everyone with
the help on hwloc, especially Brice Goglin, Jeff Squyres, and
Prakashan Korambath (I've put your names in the release notes as
well).

http://gridscheduler.sourceforge.net/

http://www.scalablelogic.com/home/ReleaseNotes.pdf

Rayson



-- Forwarded message --
From: Rayson Ho 
List-Post: hwloc-devel@lists.open-mpi.org
Date: Mon, Nov 14, 2011 at 2:41 PM
Subject: Announcing Grid Engine 2011.11 and SC11 demo & presentation
To: Beowulf List 

The Open Grid Scheduler Project is releasing a new major release: Grid
Engine 2011.11. We are using the open source model that was used by
Sun Grid Engine (2001 - 2009), and we offer open source (not open
core) Grid Engine with *optional* technical support. We have a growing
Grid Engine Community and joined by companies and system integrators
in the Grid Engine ecosystem.


New features


* Berkeley DB Spooling Directory can now be placed on NFS (NFSv3 or
older, basically any modern network filesystems)

* Portable Hardware Locality Library (was under alpha/beta since April 2011)

* CUDA GPU load sensor - uses NVIDIA Management Library (NVML)

* User notification mails can be sent from a configurable user ID

* Job exit status available to epilog - via $SGE_JOBEXIT_STAT

* ARM Linux support - ARMv7.

* qmake upgraded to version 3.82

* Support for Linux 3.0

* Perfstat library used on AIX, retiring ibm-loadsensor

* Support for newer AIX versions

* Tango qmon icons

* Code quality improvements - static code verifier used for testing

PQS API code cleaned up and we are releasing the PQS API Scheduler
Plugin Interface as technology preview.


SC11 Demo
=
Gridcore/Gompute is kind enough to offer part of their 20x20 booth for
the Grid Engine 2011.11 demo. I am going to remotely give a
presentation on the new features of Grid Engine 2011.11, and also the
future of open source Grid Engine.

The proposed time slots are: 12:00 and 15:00 on Tuesday and Wedneday.

Please sign up for the presentation at the Gridcore/Gompute booth (#6002).


Download links
==
Download the latest release from sourceforge:
http://gridscheduler.sourceforge.net/

Download release notes from the Scalable Logic homepage:
http://www.scalablelogic.com/

We are offering pre-compiled binaries. The temp. download site (before
we can upload everything to Sourceforge) for x64 Linux is:
http://dl.dropbox.com/u/47200624/ge2011.11-x64.tar.gz

Rayson

==
Open Grid Scheduler - The Official Open Source Grid Engine
http://gridscheduler.sourceforge.net/

Re: [OMPI devel] VT issue

[Matthias Jurenz]

I'll look on it asap. Thanks for the hint, George!

Matthias

On Monday 14 November 2011 23:39:08 George Bosilca wrote:
> This is supposed to be an intrinsic, automatically replaced by GCC during
> the compilation process. If I do the same configure as you (on the same
> machine) I have in my opal_config.h:
> 
> /* Whether C compiler supports __builtin_expect */
> #define OPAL_C_HAVE_BUILTIN_EXPECT 1
> /* Whether C++ compiler supports __builtin_expect */
> #define OMPI_CXX_HAVE_BUILTIN_EXPECT 0
> 
> This means that the C compiler supports __builtin_expect while the C++
> compiler doesn't. I guess the VT-folks should fix their usage of the
> BUILTIN_EXPECT macro …
> 
>   george.
> 
> On Nov 14, 2011, at 12:22 , Ralph Castain wrote:
> > Hi VT-folks
> > 
> > I'm building the devel trunk on a Mac, using a vanilla configure line:
> > ./configure --prefix=foo. When I try to compile, I get this error:
> > 
> > undefined symbols for architecture x86_64:
> >  "___builtin_expect", referenced from:
> >  _main.omp_fn.0 in otfprofile-otfprofile.o
> > 
> > ld: symbol(s) not found for architecture x86_64
> > collect2: ld returned 1 exit status
> > 
> > 
> > I believe this comes from your VT code. Can you take a look?
> > 
> > Thanks
> > Ralph
> > 
> > 
> > ___
> > devel mailing list
> > de...@open-mpi.org
> > http://www.open-mpi.org/mailman/listinfo.cgi/devel
> 
> ___
> devel mailing list
> de...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/devel

[OMPI devel] r25470 (hwloc CMR) breaks v1.5

[Eugene Loh]

I tried building v1.5.  r25469 builds for me, r25470 does not.  This is 
Friday's hwloc putback of CMR 2866.  I'm on Solaris11/x86.  The problem 
is basically:


Making all in tools/ompi_info
  CC ompi_info.o
"../../../opal/include/opal/sys/ia32/atomic.h", line 173: warning: 
parameter in inline asm statement unused: %2
"../../../opal/include/opal/sys/ia32/atomic.h", line 193: warning: 
parameter in inline asm statement unused: %2

  CC output.o
"../../../opal/include/opal/sys/ia32/atomic.h", line 173: warning: 
parameter in inline asm statement unused: %2
"../../../opal/include/opal/sys/ia32/atomic.h", line 193: warning: 
parameter in inline asm statement unused: %2

  CC param.o
"../../../opal/include/opal/sys/ia32/atomic.h", line 173: warning: 
parameter in inline asm statement unused: %2
"../../../opal/include/opal/sys/ia32/atomic.h", line 193: warning: 
parameter in inline asm statement unused: %2

  CC components.o
"../../../opal/include/opal/sys/ia32/atomic.h", line 173: warning: 
parameter in inline asm statement unused: %2
"../../../opal/include/opal/sys/ia32/atomic.h", line 193: warning: 
parameter in inline asm statement unused: %2

  CC version.o
"../../../opal/include/opal/sys/ia32/atomic.h", line 173: warning: 
parameter in inline asm statement unused: %2
"../../../opal/include/opal/sys/ia32/atomic.h", line 193: warning: 
parameter in inline asm statement unused: %2

  CCLD   ompi_info
Undefined   first referenced
 symbol in file
opal_hwloc122_hwloc_bitmap_dup  components.o
opal_hwloc122_hwloc_bitmap_weight   components.o
ld: fatal: symbol referencing errors. No output written to .libs/ompi_info

Blood and gore are attached to this e-mail.


ompi-output.tar.bz2
Description: application/bzip