Tim/All, Thanks ... !! ... your response is on target, version 12.1.0.233 of the Intel compiler has a vectorization bug.
Moreover, this problem has been addressed with the following go-around in the 1.5.5 OpenMPI release with the following fix in opal/mca/memory/linux/malloc.c: /* With Intel Composer XE V12.1.0, release 2011.6.233, any launch */ /* fails, even before main(), due to a bug in the vectorizer (see */ /* https://svn.open-mpi.org/trac/ompi/changeset/25290). The fix is */ /* to disable vectorization by reducing the optimization level to */ /* -O1 for _int_malloc(). The only reliable method to identify */ /* release 2011.6.233 is the predefined __INTEL_COMPILER_BUILD_DATE */ /* macro, which will have the value 20110811 (Linux, Windows, and */ /* Mac OS X). (The predefined __INTEL_COMPILER macro is nonsense, */ /* 9999, and both the 2011.6.233 and 2011.7.256 releases identify */ /* themselves as V12.1.0 from the -v command line option.) */ #ifdef __INTEL_COMPILER_BUILD_DATE # if __INTEL_COMPILER_BUILD_DATE == 20110811 # pragma GCC optimization_level 1 # endif #endif So, anyone with the NEWEST Intel compiler should either use the 1.5.5 release or add the above section to the malloc.c code. Note earlier releases have a slightly different directory location for the 'memory.c' code, but it is easy to find. Thanks Tim ... !! Sincerely, rbw Richard Walsh Parallel Applications and Systems Manager CUNY HPC Center, Staten Island, NY W: 718-982-3319 M: 612-382-4620 Right, as the world goes, is only in question between equals in power, while the strong do what they can and the weak suffer what they must. -- Thucydides, 400 BC ________________________________________ From: users-boun...@open-mpi.org [users-boun...@open-mpi.org] on behalf of Tim Carlson [tim.carl...@pnl.gov] Sent: Tuesday, January 03, 2012 4:52 PM To: Open MPI Users Subject: Re: [OMPI users] Latest Intel Compilers (ICS, version 12.1.0.233 Build 20110811) issues ... On Tue, 3 Jan 2012, Richard Walsh wrote: OPAL has problems with the default optimization. See this thread on one of the Intel lists. vi opal/mca/memory/linux/malloc.c add #pragma optimize("", off) http://software.intel.com/en-us/forums/showthread.php?t=87132 > > Gus/All, > > Perhaps there is some confusion as to which 'new' Intel compiler > release/version I > am using. I am not using '12.0' ... I am using '12.1' ... > > OLD one that builds a working opal_wrapper: > > [richard.walsh@athena ~]$ icc -V > Intel(R) C Intel(R) 64 Compiler XE for applications running on Intel(R) 64, > Version 12.0.0.084 Build 20101006 > Copyright (C) 1985-2010 Intel Corporation. All rights reserved. > ^^^^^^^^^ > > NEW one that FAILS to build a working opal_wrapper: > > [root@zeus .libs]# icc -V > Intel(R) C Intel(R) 64 Compiler XE for applications running on Intel(R) 64, > Version 12.1.0.233 Build 20110811 > Copyright (C) 1985-2011 Intel Corporation. All rights reserved. > ^^^^^^^^^ > > This was in my original email. NOTE: that the non-working version is 12.1 > >>NOT<< 12.0 This '12.1' > version was released by Intel JUST BEFORE SC11 in October of 2011. > > Thanks, > > rbw > > > Richard Walsh > Parallel Applications and Systems Manager > CUNY HPC Center, Staten Island, NY > W: 718-982-3319 > M: 612-382-4620 > > Right, as the world goes, is only in question between equals in power, while > the strong do what they can and the weak suffer what they must. -- > Thucydides, 400 BC > > ________________________________________ > From: users-boun...@open-mpi.org [users-boun...@open-mpi.org] on behalf of > Gustavo Correa [g...@ldeo.columbia.edu] > Sent: Tuesday, January 03, 2012 4:28 PM > To: Open MPI Users > Subject: Re: [OMPI users] Latest Intel Compilers (ICS, version 12.1.0.233 > Build 20110811) issues ... > > Hi Richard > > I have 1.4.4 built with Intel 12.0. It works. > > Any chance that your Intel-based OpenMPI was built from a source > directory that had been previously used to build the PGI-based OpenMPI, > and no 'make distclean' was issued in between the two builds, > nor a fresh build done from a brand new tarball? > Just a wild guess. > > I hope it helps, > Gus Correa > > On Jan 3, 2012, at 11:23 AM, Richard Walsh wrote: > >> >> Jonathan/All, >> >> Thanks for the information, but I continue to have problems. I dropped the >> 'openib' option to simplify things and focused my attention only on OpenMPI >> version 1.4.4 because you suggested it works. >> >> On the strength of the fact that the PGI 11.10 compiler works fine (all >> systems >> and all versions of OpenMPI), I ran a PGI build of 1.4.4 with the '-showme' >> option (Intel fails immediately, even with '-showme' ... ). I then >> substituted all >> the PGI-related strings with Intel-related strings to compile directly and >> explicitly >> outside the 'opal' wrapper using code and libraries in the Intel build tree >> of 1.4.4, >> as follows: >> >> pgcc -o ./hw2.exe hw2.c -I/share/apps/openmpi-pgi/1.4.4/include >> -L/share/apps/openmpi-pgi/1.4.4/lib -lmpi -lopen-rte -lopen-pal -ldl >> -Wl,--export-dynamic -lnsl -lutil -ldl >> >> becomes ... >> >> icc -o ./hw2.exe hw2.c -I/share/apps/openmpi-intel/1.4.4/include >> -L/share/apps/openmpi-intel/1.4.4/lib -lmpi -lopen-rte -lopen-pal -ldl >> -Wl,--export-dynamic -lnsl -lutil -ldl >> >> Interestingly, this direct-explicit Intel compile >>WORKS FINE<< (no segment >> fault like with the wrapped version) >> and the executable produced also >>RUNS FINE<<. So ... it looks to me like >> there is something wrong with using >> the 'opal' wrappper generated-used in the Intel build. >> >> Can someone make a suggestion ... ?? I would like to use the wrappers of >> course. >> >> Thanks, >> >> rbw >> >> Richard Walsh >> Parallel Applications and Systems Manager >> CUNY HPC Center, Staten Island, NY >> W: 718-982-3319 >> M: 612-382-4620 >> >> Right, as the world goes, is only in question between equals in power, while >> the strong do what they can and the weak suffer what they must. -- >> Thucydides, 400 BC >> >> ________________________________________ >> From: users-boun...@open-mpi.org [users-boun...@open-mpi.org] on behalf of >> Jonathan Dursi [ljdu...@scinet.utoronto.ca] >> Sent: Tuesday, December 20, 2011 4:48 PM >> To: Open Users >> Subject: Re: [OMPI users] Latest Intel Compilers (ICS, version 12.1.0.233 >> Build 20110811) issues ... >> >> For what it's worth, 1.4.4 built with the intel 12.1.0.233 compilers has >> been the default mpi at our centre for over a month and we haven't had any >> problems... >> >> - jonathan >> -- >> Jonathan Dursi; SciNet, Compute/Calcul Canada >> >> -----Original Message----- >> From: Richard Walsh <richard.wa...@csi.cuny.edu> >> Sender: users-boun...@open-mpi.org >> Date: Tue, 20 Dec 2011 21:14:44 >> To: Open MPI Users<us...@open-mpi.org> >> Reply-To: Open MPI Users <us...@open-mpi.org> >> Subject: Re: [OMPI users] Latest Intel Compilers (ICS, >> version 12.1.0.233 Build 20110811) issues ... >> >> >> All, >> >> I have not heard anything back on the inquiry below, so I take it >> that no one has had any issues with Intel's latest compiler release, >> or perhaps has not tried it yet. >> >> Thanks, >> >> rbw >> >> Richard Walsh >> Parallel Applications and Systems Manager >> CUNY HPC Center, Staten Island, NY >> W: 718-982-3319 >> M: 612-382-4620 >> >> Right, as the world goes, is only in question between equals in power, while >> the strong do what they can and the weak suffer what they must. -- >> Thucydides, 400 BC >> >> ________________________________________ >> From: users-boun...@open-mpi.org [users-boun...@open-mpi.org] on behalf of >> Richard Walsh [richard.wa...@csi.cuny.edu] >> Sent: Friday, December 16, 2011 3:12 PM >> To: Open MPI Users >> Subject: [OMPI users] Latest Intel Compilers (ICS, version 12.1.0.233 Build >> 20110811) issues ... >> >> All, >> >> Working through a stock rebuild of OpenMPI 1.5.4 and 1.4.4 with >> the most current compiler suites from both PGI and Intel: >> >> 1. PGI, Version 11.10 >> >> 2. Intel, Version 12.1.0.233 Build 20110811 >> >> My 1.5.4 'config.log' header looks like this for Intel: >> >> ./configure CC=icc CXX=icpc F77=ifort FC=ifort --with-openib >> --prefix=/share/apps/openmpi-intel/1.5.4 >> --with-tm=/share/apps/pbs/11.1.0.111761 >> >> and this for PGI: >> >> ./configure CC=pgcc CXX=pgCC F77=pgf77 FC=pgf90 --with-openib >> --prefix=/share/apps/openmpi-pgi/1.5.4 >> --with-tm=/share/apps/pbs/11.1.0.111761 >> >> This configure line has been used successfully before. Configuration, >> build, and install >> for BOTH compilers seems to work OK; however, my 'mpicc' build of my basic >> test >> program ONLY works with the PGI built version of 'mpicc' for either the >> 1.4.4 or the 1.5.4 >> will compile the code. >> >> The Intel 1.4.4 and 1.5.4 'mpicc' wrapper-compilers produce an immediate >> segmentation >> fault: >> >> .[richard.walsh@bob pbs]$ ./compile_it >> ./compile_it: line 10: 19163 Segmentation fault >> /share/apps/openmpi-intel/1.5.4/bin/mpicc -o ./hello_mpi.exe hello_mpi.c >> [richard.walsh@bob pbs]$ >> [richard.walsh@bob pbs]$ ./compile_it >> ./compile_it: line 10: 19515 Segmentation fault >> /share/apps/openmpi-intel/1.4.4/bin/mpicc -o ./hello_mpi.exe hello_mpi.c >> >> This Intel stack is from the most recent release of their ICS released >> in late October before SC11: >> >> [richard.walsh@bob pbs]$ icc -V >> Intel(R) C Intel(R) 64 Compiler XE for applications running on Intel(R) 64, >> Version 12.1.0.233 Build 20110811 >> Copyright (C) 1985-2011 Intel Corporation. All rights reserved. >> >> [richard.walsh@bob pbs]$ ifort -V >> Intel(R) Fortran Intel(R) 64 Compiler XE for applications running on >> Intel(R) 64, Version 12.1.0.233 Build 20110811 >> Copyright (C) 1985-2011 Intel Corporation. All rights reserved. >> >> Has anyone else encountered this problem ... ?? Suggestions ... ?? >> >> Thanks, >> >> rbw >> >> >> Richard Walsh >> Parallel Applications and Systems Manager >> CUNY HPC Center, Staten Island, NY >> W: 718-982-3319 >> M: 612-382-4620 >> >> Right, as the world goes, is only in question between equals in power, while >> the strong do what they can and the weak suffer what they must. -- >> Thucydides, 400 BC >> >> >> ________________________________ >> >> Change is in the Air - Smoking in Designated Areas Only in >> effect.<http://www.csi.cuny.edu/tobaccofree> >> Tobacco-Free Campus as of July 1, 2012. >> >> _______________________________________________ >> users mailing list >> us...@open-mpi.org >> http://www.open-mpi.org/mailman/listinfo.cgi/users >> >> ________________________________ >> >> Change is in the Air - Smoking in Designated Areas Only in >> effect.<http://www.csi.cuny.edu/tobaccofree> >> Tobacco-Free Campus as of July 1, 2012. >> >> _______________________________________________ >> users mailing list >> us...@open-mpi.org >> http://www.open-mpi.org/mailman/listinfo.cgi/users >> >> _______________________________________________ >> users mailing list >> us...@open-mpi.org >> http://www.open-mpi.org/mailman/listinfo.cgi/users >> >> ________________________________ >> >> Change is in the Air - Smoking in Designated Areas Only in >> effect.<http://www.csi.cuny.edu/tobaccofree> >> Tobacco-Free Campus as of July 1, 2012. >> >> _______________________________________________ >> users mailing list >> us...@open-mpi.org >> http://www.open-mpi.org/mailman/listinfo.cgi/users > > > _______________________________________________ > users mailing list > us...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/users > > ________________________________ > > Change is in the Air - Smoking in Designated Areas Only in > effect.<http://www.csi.cuny.edu/tobaccofree> > Tobacco-Free Campus as of July 1, 2012. > > _______________________________________________ > users mailing list > us...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/users > -- ------------------------------------------- Tim Carlson, PhD Senior Research Scientist Environmental Molecular Sciences Laboratory _______________________________________________ users mailing list us...@open-mpi.org http://www.open-mpi.org/mailman/listinfo.cgi/users ________________________________ Change is in the Air - Smoking in Designated Areas Only in effect.<http://www.csi.cuny.edu/tobaccofree> Tobacco-Free Campus as of July 1, 2012.
