Re: [OMPI devel] Open-MPI backwards compatibility and library version changes

2018-11-18 Thread Christopher Samuel
unately that's something that Easybuild makes (relatively) easy. Thanks for your time everyone - this is my last week at Swinburne before I leave Australia to start at NERSC in December! All the best, Chris -- Christopher Samuel OzGrav Senior Data Science Support ARC Centre of Excellence for Grav

Re: [OMPI devel] Open-MPI backwards compatibility and library version changes

2018-11-14 Thread Christopher Samuel
On 15/11/18 12:10 pm, Christopher Samuel wrote: > I wonder if it's because they use libtool instead? Yup, it's libtool - using it compile my toy example shows the same behaviour with "readelf -d" pulling in the private libraries directly. :-( [csamuel@farnarkle2 libtool]$ cat

Re: [OMPI devel] Open-MPI backwards compatibility and library version changes

2018-11-14 Thread Christopher Samuel
On 15/11/18 11:45 am, Christopher Samuel wrote: > Unfortunately that's not the case, just creating a shared library > that only links in libmpi.so will create dependencies on the private > libraries too in the final shared library. :-( Hmm, I might be misinterpreting the outpu

Re: [OMPI devel] Open-MPI backwards compatibility and library version changes

2018-11-14 Thread Christopher Samuel
000) /lib64/ld-linux-x86-64.so.2 (0x7f018a46b000) libnuma.so.1 => /lib64/libnuma.so.1 (0x7f0188e52000) libltdl.so.7 => /lib64/libltdl.so.7 (0x7f0188c48000) libgcc_s.so.1 => /apps/skylake/software/core/gcccore/6.4.0/lib64/libgcc_s.so.1 (0x7f018a499000)

[OMPI devel] Open-MPI backwards compatibility and library version changes

2018-11-14 Thread Christopher Samuel
you folks have come across before? All the best, Chris -- Christopher Samuel OzGrav Senior Data Science Support ARC Centre of Excellence for Gravitational Wave Discovery http://www.ozgrav.org/ http://twitter.com/ozgrav ___ devel mai

Re: [OMPI devel] subcommunicator OpenMPI issues on K

2017-11-07 Thread Christopher Samuel
On 08/11/17 12:30, Kawashima, Takahiro wrote: > As other people said, Fujitsu MPI used in K is based on old > Open MPI (v1.6.3 with bug fixes). I guess the obvious question is will the vanilla Open-MPI work on K? -- Christopher SamuelSenior Systems Administrator Mel

Re: [OMPI devel] Open-MPI killing nodes with mlx5 drivers?

2017-11-05 Thread Christopher Samuel
On 30/10/17 14:07, Christopher Samuel wrote: > We have an issue where codes compiled with Open-MPI kill nodes with > ConnectX-4 and ConnectX-5 cards connected to Mellanox Ethernet switches > using the mlx5 driver from the latest Mellanox OFED For the record, this crash is fixed in Mell

[OMPI devel] Open-MPI killing nodes with mlx5 drivers?

2017-10-29 Thread Christopher Samuel
-- Christopher SamuelSenior Systems Administrator Melbourne Bioinformatics - The University of Melbourne Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 ___ devel mailing list devel@lists.open-mpi.org https://lists.open-mpi.org/mailman

Re: [OMPI devel] Segfault on MPI init

2017-02-21 Thread Christopher Samuel
t a backtrace from all threads at once with: thread apply all bt It's not just limited to 'bt' either: (gdb) help thread apply Apply a command to a list of threads. List of thread apply subcommands: thread apply all -- Apply a command to all threads -- Christopher SamuelSenior Sys

Re: [OMPI devel] RFC: Rename nightly snapshot tarballs

2016-10-17 Thread Christopher Samuel
pened before then I'd suggest allow for it to happen again by adding HHMM. Otherwise looks sensible to me (YMMV). -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.

Re: [OMPI devel] Off-topic re: supporting old systems

2016-08-31 Thread Christopher Samuel
On 31/08/16 14:01, Paul Hargrove wrote: > So, the sparc platform is a bit more orphaned that it already was when > support stopped at Wheezy. Ah sorry, I didn't realise you were on a non-LTS Wheezy architecture. -- Christopher SamuelSenior Systems Administrator VLSCI - Victoria

Re: [OMPI devel] Off-topic re: supporting old systems

2016-08-30 Thread Christopher Samuel
===>] 8,192,091 1.75M/s in 7.3s 2016-08-31 12:12:08 (1.07 MB/s) - `openmpi-2.0.1rc2.tar.bz2' saved [8192091/8192091] All the best, Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb

Re: [OMPI devel] Off-topic re: supporting old systems

2016-08-30 Thread Christopher Samuel
GNU/Linux 7 \n \l cheers, Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci

Re: [OMPI devel] Migration of mailman mailing lists

2016-07-18 Thread Christopher Samuel
On 19/07/16 02:05, Brice Goglin wrote: > Yes, kill all netloc lists. Will the archives be preserved somewhere for historical reference? All the best, Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email:

Re: [OMPI devel] [1.10.3rc4] testing results

2016-06-06 Thread Christopher Samuel
l involved with this. -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci

Re: [OMPI devel] RFC: Public Test Repo

2016-05-19 Thread Christopher Samuel
think it sends the right message about openness and hopefully allows a community to build around MPI testing in general. Certainly happy to try it out! All the best, Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Emai

Re: [OMPI devel] Github pricing plan changes announced today

2016-05-17 Thread Christopher Samuel
On 18/05/16 09:59, Gilles Gouaillardet wrote: > the (main) reason is none of us are lawyers and none of us know whether > all test suites can be redistributed for general public use or not. Thanks Gilles, All the best, Chris -- Christopher SamuelSenior Systems Administrator

Re: [OMPI devel] Github pricing plan changes announced today

2016-05-17 Thread Christopher Samuel
ool and found MTT but commented: # OpenMPI has the MPI Testing Tool which looks like it would work, # but most of there tests seem private. and so moved on to look at other options instead. All the best, Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Scien

Re: [OMPI devel] [2.0.0rc2] xlc-13.1.0 ICE (hwloc)

2016-05-05 Thread Christopher Samuel
On 03/05/16 18:11, Paul Hargrove wrote: > xlc-13.1.0 on Linux dies compiling the embedded hwloc in this rc > (details below). In case it's useful xlc 12.1.0.9-140729 (yay for BGQ living in the past) doesn't ICE on RHEL6 on Power7. All the best, Chris -- Christopher Samuel

Re: [OMPI devel] mpif.h on Intel build when run with OMPI_FC=gfortran

2016-03-03 Thread Christopher Samuel
ebug why their code wouldn't compile. :-) Apologies for the noise. All the best, Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci

Re: [OMPI devel] mpif.h on Intel build when run with OMPI_FC=gfortran

2016-03-03 Thread Christopher Samuel
sers (who happened to be our director) tried to use it it failed because the mpi.mod module created during the build is compiler dependent. :-( So ever since we've done separate builds for GCC and for Intel. All the best! Chris -- Christopher SamuelSenior Systems Administrator VLSCI -

Re: [OMPI devel] Problem with the 1.8.8 version

2015-12-06 Thread Christopher Samuel
Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci

Re: [OMPI devel] Slides from the Open MPI SC'15 State of the Union BOF

2015-11-19 Thread Christopher Samuel
open fine for me at the moment (using KDE's Okular PDF viewer). Thanks for putting them up Jeff! All the best, Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55

Re: [OMPI devel] PMI2 in Slurm 14.11.8

2015-09-02 Thread Christopher Samuel
On 02/09/15 13:09, Christopher Samuel wrote: > Instead PMI2 is in a contrib directory which appears to need manual > intervention to install. Confirming from the Slurm list that PMI2 is not built by default, it's only the RPM build process that will include it without intervention.

[OMPI devel] PMI2 in Slurm 14.11.8

2015-09-02 Thread Christopher Samuel
dering in case anyone had run into this here too? All the best, Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci

Re: [OMPI devel] 1.10.0rc6 - slightly different mx problem

2015-08-25 Thread Christopher Samuel
an HPC company no longer exists. INRIA does have Open-MX (Myrinet Express over Generic Ethernet Hardware), last release December 2014. No idea if it's still developed or used.. http://open-mx.gforge.inria.fr/ Brice? Open-MPI is listed as working with it there. ;-) -- Christopher Samuel

Re: [OMPI devel] 1.8.7rc1 testing results

2015-07-14 Thread Christopher Samuel
On 14/07/15 01:49, Ralph Castain wrote: > Okay, 1.8.7rc3 (we already had an rc2) is now out with all these changes > - please take one last look. Looks OK for XRC here, thanks! -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Init

Re: [OMPI devel] Error in ./configure for Yocto

2015-07-09 Thread Christopher Samuel
tps://software.intel.com/en-us/articles/intelr-mpss-transition-to-yocto-faq All the best, Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.

Re: [OMPI devel] Proposal: update Open MPI's version number and release process

2015-05-20 Thread Christopher Samuel
$USER just broke the build at VMWare"; for example: https://twitter.com/vmwarepbs/status/4634524702 :-) -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 htt

Re: [OMPI devel] Proposal: update Open MPI's version number and release process

2015-05-18 Thread Christopher Samuel
Thanks! Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci

Re: [OMPI devel] Chris Yeoh

2015-04-30 Thread Christopher Samuel
e with lungs can get # it. We hope that further funding to research will one day # provide a cure and better trials for others. Valē Chris. All the best, Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.e

Re: [OMPI devel] RFC: Remove embedded libltdl

2015-02-02 Thread Christopher Samuel
a convenient server with a not-so-mainstream architecture (and an older RHEL release through necessity). Sorry to get your hopes up! :-) All the best, Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au P

Re: [OMPI devel] RFC: Remove embedded libltdl

2015-02-01 Thread Christopher Samuel
cript of gdb doing "thread apply all bt full" in case that's helpful. All the best, Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/

Re: [OMPI devel] mlx4 QP operation err

2015-01-28 Thread Christopher Samuel
E (though of course may not be relevant) - "The first Read response was not treated as implicit ACK" (discovered in 2.30.8000). All the best, Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au

Re: [hwloc-devel] Using hwloc to detect Hard Disks

2014-09-23 Thread Christopher Samuel
rts this: 3405 open("/dev/mem", O_RDONLY)= -1 EACCES (Permission denied) FWIW dmidecode does the same. samuel@haswell:~$ dmidecode # dmidecode 2.12 /dev/mem: Permission denied All the best, Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Science

[OMPI devel] Grammar error in git master: 'You job will now abort'

2014-08-13 Thread Christopher Samuel
-mirror$ I'm using https://github.com/open-mpi/ompi-svn-mirror.git so let me know if I should be using something else now. cheers, Chris -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3

Re: [OMPI devel] RFC: Force Slurm to use PMI-1 unless PMI-2 is specifically requested

2014-05-08 Thread Christopher Samuel
s work on an alternative solution that we will be able to use. Thanks! Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci

Re: [OMPI devel] RFC: Force Slurm to use PMI-1 unless PMI-2 is specifically requested

2014-05-08 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 08/05/14 23:45, Ralph Castain wrote: > Artem and I are working on a new PMIx plugin that will resolve it > for non-Mellanox cases. Ah yes of course, sorry my bad! - -- Christopher SamuelSenior Systems Administrator VLSCI - Vic

Re: [OMPI devel] RFC: Force Slurm to use PMI-1 unless PMI-2 is specifically requested

2014-05-08 Thread Christopher Samuel
ted on then is flat out at the moment but I'll try and sneak a 64-core job using identical configs and compare mpirun, srun on its own and srun with PMI2. All the best, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative

Re: [OMPI devel] RFC: Force Slurm to use PMI-1 unless PMI-2 is specifically requested

2014-05-07 Thread Christopher Samuel
luster that those tests were run on has 70 nodes, each with 16 cores, so I suspect we're a long long way away from that pain point. All the best! Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au

Re: [OMPI devel] RFC: Force Slurm to use PMI-1 unless PMI-2 is specifically requested

2014-05-07 Thread Christopher Samuel
to enable PMI2 by default so that only those who requested it got it then I'd be more than happy - we'd just add it to our script to build it. All the best! Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.ed

Re: [OMPI devel] RFC: Force Slurm to use PMI-1 unless PMI-2 is specifically requested

2014-05-07 Thread Christopher Samuel
CPUs 0.280824 s/step 1.62514 days/ns 904.91 MB memory WallClock: 7522.677246 CPUTime: 7522.677246 Memory: 969.433594 MB So to me it looks like (for NAMD on our system at least) that PMI2 does seem to give better scalability. All the best! Chris - -- Christopher SamuelSenior Systems Admin

Re: [OMPI devel] RFC: Force Slurm to use PMI-1 unless PMI-2 is specifically requested

2014-05-07 Thread Christopher Samuel
t; > Average of 563 seconds. > > So that's about 23% slower. > > Everything is identical (they're all symlinks to the same golden > master) *except* for the srun / mpirun which is modified by > copying the batch script and substituting mpirun for srun. - -- Christopher Samuel

Re: [hwloc-devel] GIT: hwloc branch master updated. 0e6fe307c10d47efee3fb95c50aee9c0f01bc8ec

2014-03-30 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 30/03/14 02:04, Ralph Castain wrote: > turns out that some linux distro's automatically set LS_COLORS in > your environment when running old versions of csh/tcsh via their > default dot files For example RHEL6 does this.. - -- Ch

Re: [OMPI devel] SC13 birds of a feather

2013-12-05 Thread Christopher Samuel
hanks for the idea, Samuel!) My pleasure! All the best, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci -B

Re: [OMPI devel] SC13 birds of a feather

2013-12-03 Thread Christopher Samuel
ag of jobs it's not likely useful, but if you had a system dedicated to running an in house code then you could conceive of situations where you might want to react to over-temperature cores, nodes, etc. cheers, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victoria

Re: [OMPI devel] Openmpi 1.6.5 is freezing under GNU/Linux ia64

2013-12-03 Thread Christopher Samuel
occurs, ia64 will be removed from testing on # Friday 24th January 2014. - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com

Re: [OMPI devel] [OMPI svn-full] svn:open-mpi r29615 - in trunk: . contrib contrib/dist/linux debian debian/source

2013-11-06 Thread Christopher Samuel
er way to assist would be to help out Sylvestre and the other Debian maintainers? This might be a handy place to start: http://qa.debian.org/developer.php?login=pkg-openmpi-maintainers%40lists.alioth.debian.org All the best, Chris - -- Christopher SamuelSenior Systems Administrator

Re: [OMPI devel] 1.6.5 large matrix test doesn't pass (decode) ?

2013-10-16 Thread Christopher Samuel
occurs with plain v1.6.5 and it doesn't > occur with patched v1.6.5. Perfect, thanks! Sorry for the delay, been away on holiday. All the best, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.e

[OMPI devel] 1.6.5 large matrix test doesn't pass (decode) ?

2013-10-04 Thread Christopher Samuel
est, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.12

Re: [OMPI devel] Openmpi 1.6.5 is freezing under GNU/Linux ia64

2013-09-21 Thread Christopher Samuel
ebug info hadn't shown it getting to the point of launching the executable. Mea culpa. I blame jet-lag. ;-) cheers, Chris (about to get a second dose) - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phon

Re: [OMPI devel] Openmpi 1.6.5 is freezing under GNU/Linux ia64

2013-09-20 Thread Christopher Samuel
ris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.12 (GNU/Linux) Comm

Re: [OMPI devel] Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun

2013-09-06 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 06/09/13 14:14, Christopher Samuel wrote: > However, modifying the test program confirms that variable is getting > propagated as expected with both mpirun and srun for 1.6.5 and the 1.7 > snapshot. :-( Investigating further by setting

Re: [OMPI devel] Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun

2013-09-06 Thread Christopher Samuel
samuel@barcoo ~]$ module show openmpi 2>&1 | grep binding setenv OMPI_MCA_orte_process_binding core However, modifying the test program confirms that variable is getting propagated as expected with both mpirun and srun for 1.6.5 and the 1.7 snapshot. :-( cheers, Chris - -- Chris

Re: [OMPI devel] Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun

2013-09-05 Thread Christopher Samuel
has: envar 64 whereas srun has: envar NULL Are these differences significant? I'm intrigued that the problem child (srun 1.6.5) is the only one where number is 1. All the best, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Comput

Re: [OMPI devel] Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun

2013-09-04 Thread Christopher Samuel
e. Hope this is useful! All the best, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci -BEGIN PGP

Re: [OMPI devel] Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun

2013-09-04 Thread Christopher Samuel
a lot more than that and has a reputation for being a *very* chatty MPI code. For comparison whilst users see GROMACS also suffer with srun under 1.6.5 they don't see anything like the slow down that NAMD gets. All the best, Chris - -- Christopher SamuelSenior Systems Administrator VL

Re: [OMPI devel] Possible OMPI 1.6.5 bug? SEGV in malloc.c

2013-09-03 Thread Christopher Samuel
ith-slurm --with-openib --enable-static --enable-shared make -j - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci -

Re: [OMPI devel] Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun

2013-09-03 Thread Christopher Samuel
nds Open-MPI 1.7.3a1r29103 with srun - 7476 seconds So that's about 11% faster, and the mpirun speed has decreased though of course that's built using PMI so perhaps that's the cause? cheers, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computat

Re: [OMPI devel] Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun

2013-09-02 Thread Christopher Samuel
y release > it soon. Stupid question, but never having played with PMI before is it just the case of appending the --with-pmi option to our current configure? thanks, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation

Re: [hwloc-devel] lstopo - please add the information about the kernel to the graphical output

2013-09-02 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 03/09/13 02:03, Jiri Hladky wrote: > I vote for --append-legend I like that too, though the idea of an additional undocumented --jirka option also appeals. :-) - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian L

Re: [OMPI devel] Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun

2013-09-02 Thread Christopher Samuel
out! All the best, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci -BEGIN PGP SIGNATURE- Version: GnuPG v1

Re: [OMPI devel] Possible OMPI 1.6.5 bug? SEGV in malloc.c

2013-09-02 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 30/08/13 16:01, Christopher Samuel wrote: > Thanks for this, I'll take a look further next week.. The code where it's SEGV'ing is here: /* check that one of the above allocation paths succeeded */ if ((unsigned long)(size) >= (unsigne

Re: [OMPI devel] Possible OMPI 1.6.5 bug? SEGV in malloc.c

2013-08-30 Thread Christopher Samuel
all, or the spin with the Intel compiler build. Nice! Thanks for this, I'll take a look further next week.. Very much obliged, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone:

Re: [hwloc-devel] lstopo - please add the information about the kernel to the graphical output

2013-08-29 Thread Christopher Samuel
image. cheers, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci -BEGIN PGP SIGNATURE- Version: GnuPG v1.

Re: [hwloc-devel] hwloc-distrib - please add the option to distribute the jobs in the reverse direction

2013-08-27 Thread Christopher Samuel
ws the node to which the device using the IRQ reports itself as being attached. This hardware locality information does not include information about any possible driver locality preference." cheers, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Scie

[OMPI devel] How to deal with F90 mpi.mod with single stack and multiple compiler suites?

2013-08-22 Thread Christopher Samuel
this done before I need to leave for the day). :-( cheers, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci

Re: [OMPI devel] [slurm-dev] slurm-dev Memory accounting issues with mpirun (was Re: Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun)

2013-08-19 Thread Christopher Samuel
it so far. In the long term I suspect the jobacct_gather/cgroup plugin will give better numbers once it's had more work. All the best, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61

Re: [OMPI devel] [slurm-dev] slurm-dev Memory accounting issues with mpirun (was Re: Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun)

2013-08-07 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 07/08/13 16:19, Christopher Samuel wrote: > Anyone seen anything similar, or any ideas on what could be going > on? Sorry, this was with: # ACCOUNTING JobAcctGatherType=jobacct_gather/linux JobAcctGatherFrequency=30 Since those initial

Re: [OMPI devel] Memory accounting issues with mpirun (was Re: [slurm-dev] Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun)

2013-08-07 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 07/08/13 16:18, Christopher Samuel wrote: > Anyone seen anything similar, or any ideas on what could be going > on? Apologies, forgot to mention that Slurm is set up with: # ACCOUNTING JobAcctGatherType=jobacct_gather

[OMPI devel] Memory accounting issues with mpirun (was Re: [slurm-dev] Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun)

2013-08-07 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 23/07/13 17:06, Christopher Samuel wrote: > Bringing up a new IBM SandyBridge cluster I'm running a NAMD test > case and noticed that if I run it with srun rather than mpirun it > goes over 20% slower. Following on from this issue, we

Re: [OMPI devel] Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun

2013-07-24 Thread Christopher Samuel
ng to see if it resolves the difference. When I've got the current rush out of the way I'll try a private build of 1.7 and see how that goes with NAMD. cheers! Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative E

Re: [OMPI devel] Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun

2013-07-23 Thread Christopher Samuel
ystems and to only use srun if the code requires it (one or two commercial apps that use Intel MPI). Can I ask, if the PMI2 ideas work out is that likely to get backported to OMPI 1.6.x ? All the best, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victoria

Re: [OMPI devel] Any plans to support Intel MIC (Xeon Phi) in Open-MPI?

2013-05-02 Thread Christopher Samuel
o the Phis appear in the hwloc topology object? They appear in lstopo as mic0 and mic1. > Chris: can you run lstopo on one of the nodes and send me the > output (off-list)? One of the hosts? Not a problem, will do. All the best! Chris - -- Christopher SamuelSenior Systems Administra

[OMPI devel] Any plans to support Intel MIC (Xeon Phi) in Open-MPI?

2013-05-02 Thread Christopher Samuel
the best, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.11 (GNU

Re: [OMPI devel] Choosing an Open-MPI release for a new cluster

2013-05-02 Thread Christopher Samuel
hanks so much to you all! All the best, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci -BEGIN PGP SIGNA

[OMPI devel] Choosing an Open-MPI release for a new cluster

2013-05-02 Thread Christopher Samuel
? All the best, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci -BEGIN PGP SIGNATURE- Version: GnuPG

Re: [hwloc-devel] [hwloc-svn] svn:hwloc r5324 - branches/libpciaccess/doc

2013-02-18 Thread Christopher Samuel
s library development package License : MIT Description : Development package for libpciaccess. If they're not enabled then you won't see it. cheers, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu

Re: [hwloc-devel] libpci: GPL

2013-02-18 Thread Christopher Samuel
than they appear, etc, etc, etc... Of course it might be possible to ask the pciutils maintainer to split out libpci from pciutils and LGPL it. Interestingly, Steam for Linux appears to have linked to libpci.. http://steamcommunity.com/app/221410/discussions/1/846938351130480716/ cheers! Chris - --

[OMPI devel] CRIU checkpoint support in Open-MPI?

2012-12-05 Thread Christopher Samuel
y=thursday Is there interest from OMPI in supporting this, given it looks like it's quite likely to make it into the mainline kernel? Or is better to wait for it to be merged, and then take a look? All the best, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Lif

Re: [hwloc-devel] Cgroup resource limits

2012-11-05 Thread Christopher Samuel
d also much harder to maintain. Does anyone know of a good # library for cgroups? So I've pointed them at this thread and strongly encouraged them to get involved. cheers, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative

Re: [hwloc-devel] Cgroup resource limits

2012-11-05 Thread Christopher Samuel
ce it's started asking for many more cores or RAM.. :-) > So we need the capability in ORTE to support the non-direct-launch > cases. I'm pretty sure we're agreeing here, just in different ways of expressing ourselves.. :-) cheers! Chris - -- Christopher SamuelSenior System

Re: [hwloc-devel] Cgroup resource limits

2012-11-05 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 06/11/12 01:43, Ralph Castain wrote: > On Nov 4, 2012, at 7:28 PM, Christopher Samuel > <sam...@unimelb.edu.au> wrote: > >> I would argue that the resource managers *should* be doing it > > No argument from me - I wou

Re: [hwloc-devel] Cgroup resource limits

2012-11-04 Thread Christopher Samuel
if all tasks lives in # the root memcg. cheers, Chris - -- Christopher SamuelSenior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci -BEG

Re: [hwloc-devel] backends and plugins

2012-08-13 Thread Christopher Samuel
" when a new "PCI device" is > added by the PCI backend. That could also be useful to some folks for non-PCI devices, say if a CPU gets hotplugged in/out (or more likely added/removed from a cpuset/cgroup you're in). - -- Christopher SamuelSenior Systems Administrator V

Re: [hwloc-devel] [PATCH] Use plain "inline" in C++

2012-05-10 Thread Christopher Samuel
/autoconf-2.67/html_node/C-Compiler.html But not for C++: http://www.gnu.org/savannah-checkouts/gnu/autoconf/manual/autoconf-2.69/html_node/C_002b_002b-Compiler.html So perhaps the fact that they've never needed to implement such a test is in itself a good guide ? cheers, Chris - -- Christoph

Re: [hwloc-devel] lstopo-nox strikes back

2012-04-26 Thread Christopher Samuel
ariant of lstopo and use the alternatives system to select which to use. cheers, Chris -- Christopher Samuel - Senior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.unimelb.edu.au/

Re: [hwloc-devel] lstopo-nox strikes back

2012-04-26 Thread Christopher Samuel
On 25/04/12 23:44, Jeffrey Squyres wrote: > FWIW: Having lstopo plugins for output would obviate the need for > having two executable names. IIRC that's generally handled via the alternatives system (or diversions if you don't like alternatives) in Debian/Ubuntu. -- Christopher

Re: [hwloc-devel] interoperability with X displays

2012-03-29 Thread Christopher Samuel
don't see that reported as a bug in the BTS, so I'd suggest reporting it and seeing what happens. http://bugs.debian.org/cgi-bin/pkgreport.cgi?src=nvidia-settings cheers! Chris - -- Christopher Samuel - Senior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative E

Re: [hwloc-devel] Fwd: BGQ empty topology with MPI

2012-03-26 Thread Christopher Samuel
attributes. OK, please find attached both lstopo -v (with debug enabled) and also the XML file requested. This is BG/P, not BG/Q of course! cheers! Chris - -- Christopher Samuel - Senior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu

Re: [hwloc-devel] Fwd: BGQ empty topology with MPI

2012-03-26 Thread Christopher Samuel
Chris - -- Christopher Samuel - Senior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.unimelb.edu.au/ -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with M

Re: [hwloc-devel] Fwd: BGQ empty topology with MPI

2012-03-26 Thread Christopher Samuel
ode to see what /proc or /sys look like in each case. cheers, Chris - -- Christopher Samuel - Senior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.unimelb.edu.au/ -BEGI

Re: [hwloc-devel] PCI device name question

2012-03-22 Thread Christopher Samuel
uot; Net L#3 "ib0" OpenFabrics L#4 "mlx4_0" Looks OK to me. - -- Christopher Samuel - Senior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.unime

Re: [hwloc-devel] BGQ empty topology with MPI

2012-03-22 Thread Christopher Samuel
ut BG/P uses code derived from MPICH2 according to: http://wiki.bg.anl-external.org/index.php/Main_Page Our BG/P seems to claim it's from MPICH2 1.1: samuel@tambo:~> mpicc -v mpicc for 1.1 cheers, Chris - -- Christopher Samuel - Senior Systems Administrator VLSCI - Victorian Life Scien

Re: [hwloc-devel] BGQ empty topology with MPI

2012-03-22 Thread Christopher Samuel
't implement fork() or execve(), they're designed to start your code and just keep running it until it dies. [1] - http://wiki.bg.anl-external.org/index.php/Cnk cheers! Chris - -- Christopher Samuel - Senior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative

Re: [hwloc-devel] BGQ empty topology with MPI

2012-03-20 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 21/03/12 13:37, Daniel Ibanez wrote: > Please let me know if theres a hint of what could be causing it, > where to post, and what info to provide. Are you running Linux or CNK on the compute nodes for this? cheers! Chris - -- Chris

Re: [OMPI devel] [OMPI svn] svn:open-mpi r26077 (fwd)

2012-03-01 Thread Christopher Samuel
r > 1.6.0). What symptoms would an affected job show? Does it fail with an OMPI error or does it just hang using 0% CPU? cheers, Chris - -- Christopher Samuel - Senior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0

Re: [OMPI devel] Open MPI nightly tarballs suspended / 1.5.5rc3

2012-02-28 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 29/02/12 07:44, Jeffrey Squyres wrote: > - BlueGene fixes rc3 fixes the builds on our front end node, thanks! - -- Christopher Samuel - Senior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email:

Re: [OMPI devel] poor btl sm latency

2012-02-28 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 13/02/12 22:11, Matthias Jurenz wrote: > Do you have any idea? Please help! Do you see the same bad latency in the old branch (1.4.5) ? cheers, Chris - -- Christopher Samuel - Senior Systems Administrator VLSCI - Victorian Life Scien

Re: [OMPI devel] 1.5.5rc2

2012-02-23 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 24/02/12 15:12, Christopher Samuel wrote: > I suspect this is irrelevant, but I got a build failure trying to > compile it on our BG/P front end node (login node) with the IBM XL > compilers. Oops, forgot how I built it.. export

  1   2   >