Re: [OMPI users] [EXTERNAL] Re: Newbie With Issues

2021-03-30 Thread Prentice Bisbal via users
This should handle modifying his LD_LIBRARY_PATH correctly but doing a intel setvars.sh How are you doing 'intel setvars.sh'? I believe you need to source that rather than execute it. Also, there might be other files you need to source. I have access to 2019.u3, and in the install_root, I

Re: [OMPI users] [External] Re: Newbie With Issues

2021-03-30 Thread Prentice Bisbal via users
That error message is right in your original post, and I didn't even see it: configure:6541: icc -O2 conftest.c >&5 ld: cannot find -lstdc++ Well, that's an easy fix. I guess my eyes stopped when I got to this: configure: error: C compiler cannot create executables See `config.log' for

Re: [OMPI users] [External] Re: Newbie With Issues

2021-03-30 Thread Prentice Bisbal via users
No, icc is there: configure:6488: icc -qversion >&5 icc: command line warning #10006: ignoring unknown option '-qversion' icc: command line error: no files specified; for help type "icc -help" Those error messages are coming directly from icc. Prentice On 3/30/21 12:52 PM, Heinz, Michael

Re: [OMPI users] [External] Newbie With Issues

2021-03-30 Thread Prentice Bisbal via users
Is this your own Linux system, or a work/school system? Some security guidelines, like the CIS Security benchmarks, recommending making /tmp its own filesystem and mount it with the 'noexec' option. That can cause this error. The configure script works by seeing if it can compile and/or run

Re: [OMPI users] [External] Help with MPI and macOS Firewall

2021-03-18 Thread Prentice Bisbal via users
OpenMPI should only be using shared memory on the local host automatically, but maybe you need to force it. I think mpirun -mca btl self,vader ... should do that. or you can exclude tcp instead mpirun -mca btl ^tcp See https://www.open-mpi.org/faq/?category=sm for more info. Prentice

Re: [OMPI users] [External] Re: Error intialising an OpenFabrics device.

2021-03-18 Thread Prentice Bisbal via users
If you disable it with -mtl ^openib the warning goes away. And the performance of openib goes away right along with it. Prentice On 3/13/21 5:43 PM, Heinz, Michael William via users wrote: I’ve begun getting this annoyingly generic warning, too. It appears to be coming from the openib

Re: [OMPI users] [External] Re: mpi/pmix: ERROR: Error handler invoked: status = -25: No such file or directory (2)

2020-11-12 Thread Prentice Bisbal via users
). On Nov 12, 2020, at 8:16 AM, Prentice Bisbal via users wrote: I should give more background. In the slurm error log for this job, there was another error about a memcpy operation failing listed first, so that caused the job to fail. I suspect these errors below are the result of the other MPI

Re: [OMPI users] [External] Re: mpi/pmix: ERROR: Error handler invoked: status = -25: No such file or directory (2)

2020-11-12 Thread Prentice Bisbal via users
, 2020, at 10:03 AM, Prentice Bisbal via users wrote: One of my users recently reported a failed job that was using OpenMPI 4.0.4 compiled with PGI 20.4. There two different errors reported. One was reported once, and I think had nothing to do with OpenMPI or PMIX, and then this error

[OMPI users] mpi/pmix: ERROR: Error handler invoked: status = -25: No such file or directory (2)

2020-11-11 Thread Prentice Bisbal via users
One of my users recently reported a failed job that was using OpenMPI 4.0.4 compiled with PGI 20.4. There  two different errors reported. One was reported once, and I think had nothing to do with OpenMPI or PMIX, and then this error was repeated multiple times in the Slurm error output for the

Re: [OMPI users] [External] Re: mpirun on Kubuntu 20.4.1 hangs

2020-10-22 Thread Prentice Bisbal via users
 Could SELinux or AppArmor be active by default for a new install and be causing this problem? Prentice On 10/21/20 12:22 PM, Jorge SILVA via users wrote: Hello Gus,  Thank you for your answer..  Unfortunately my problem is much more basic. I  didn't try to run the program in both

Re: [OMPI users] [External] Re: MPI is still dominantparadigm?

2020-08-07 Thread Prentice Bisbal via users
lding applications. I am not saying MPI in C/C++/Fortran should go away, however, sometimes we don't need the low-level stuff to express a concept :-). It may also open a whole new world for people on large clusters... Thank you! -- Prentice Bisbal Lead Software Engineer Research

Re: [OMPI users] [External] Books/resources to learn (open)MPI from

2020-08-06 Thread Prentice Bisbal via users
MPI: Modern Features of the Message-Passing Interface" which was published in 2015 but it too has no reviews on Amazon and is upwards of $110+ (!). Any suggestions welcome. Thank you! -- Prentice Bisbal Lead Software Engineer Research Computing Princeton Plasma Physics Laboratory http://www.pppl.gov

Re: [OMPI users] [External] Correct mpirun Options for Hybrid OpenMPI/OpenMP

2020-08-03 Thread Prentice Bisbal via users
OpenMPI/OpenMP setup would be appreciated. Kind regards -- Prentice Bisbal Lead Software Engineer Research Computing Princeton Plasma Physics Laboratory http://www.pppl.gov

Re: [OMPI users] WARNING: There was an error initializing an OpenFabrics device

2020-07-29 Thread Prentice Bisbal via users
Okay, I got this fixed. Apparently, 'make install' wasn't overwriting the previous install, so I had to manually delete my previous install before doing 'make install'. Once I did that, using UCX 1.8.1 and specifying --without-verbs worked. Prentice On 7/28/20 2:03 PM, Prentice Bisbal wrote

Re: [OMPI users] WARNING: There was an error initializing an OpenFabrics device

2020-07-28 Thread Prentice Bisbal via users
One more bit of information: These are QLogic IB cards, not Mellanox: $ lspci | grep QL 05:00.0 InfiniBand: QLogic Corp. IBA7322 QDR InfiniBand HCA (rev 02) On 7/28/20 2:03 PM, Prentice Bisbal wrote: Last week I posted on here that I was getting immediate segfaults when I ran MPI programs

[OMPI users] WARNING: There was an error initializing an OpenFabrics device

2020-07-28 Thread Prentice Bisbal via users
Last week I posted on here that I was getting immediate segfaults when I ran MPI programs, and the system logs shows that the segfaults were occuring in libibverbs.so, and that the problem was still occurring even if I specified '-mca btl ^openib'. Since then, I've made a lot of progress on

Re: [OMPI users] [External] Re: segfault in libibverbs.so

2020-07-28 Thread Prentice Bisbal via users
a difference in the two. Prentice On 7/23/20 3:34 PM, Prentice Bisbal wrote: I manage a cluster that is very heterogeneous. Some nodes have InfiniBand, while others have 10 Gb/s Ethernet. We recently upgraded to CentOS 7, and built a new software stack for CentOS 7. We are using OpenMPI 4.0.3

Re: [OMPI users] segfault in libibverbs.so

2020-07-27 Thread Prentice Bisbal via users
/23/20 3:34 PM, Prentice Bisbal wrote: I manage a cluster that is very heterogeneous. Some nodes have InfiniBand, while others have 10 Gb/s Ethernet. We recently upgraded to CentOS 7, and built a new software stack for CentOS 7. We are using OpenMPI 4.0.3, and we are using Slurm 19.05.5 as our

[OMPI users] segfault in libibverbs.so

2020-07-23 Thread Prentice Bisbal via users
I manage a cluster that is very heterogeneous. Some nodes have InfiniBand, while others have 10 Gb/s Ethernet. We recently upgraded to CentOS 7, and built a new software stack for CentOS 7. We are using OpenMPI 4.0.3, and we are using Slurm 19.05.5 as our job scheduler. We just noticed that

Re: [OMPI users] [External] Re: choosing network: infiniband vs. ethernet

2020-07-20 Thread Prentice Bisbal via users
usr/local. I did forget to ldconfig initially, which confused me. Other than that it just worked. John -- Jeff Squyres jsquy...@cisco.com <mailto:jsquy...@cisco.com> -- Prentice Bisbal Lead Software Engineer Research Computing Princeton Plasma Physics Laboratory http://www.pppl.gov

Re: [OMPI users] [External] Re: Signal code: Non-existant physical address (2)

2020-07-07 Thread Prentice Bisbal via users
ctions, too, but it can be difficult to track down the precise flags that you need. On Jul 2, 2020, at 10:22 AM, Prentice Bisbal via users wrote: I manage a very heterogeneous cluster. I have nodes of different ages with different processors, different amounts of RAM, etc. One user is report

[OMPI users] Signal code: Non-existant physical address (2)

2020-07-02 Thread Prentice Bisbal via users
I manage a very heterogeneous cluster. I have nodes of different ages with different processors, different amounts of RAM, etc. One user is reporting that on certain nodes, his jobs keep crashing with the errors below. His application is using OpenMPI 1.10.3, which I know is an ancient version

Re: [OMPI users] [External] Re: can't open /dev/ipath, network down (err=26)

2020-05-11 Thread Prentice Bisbal via users
Thanks. I'm going to give this solution a try. On 5/9/20 9:51 AM, Patrick Bégou via users wrote: Le 08/05/2020 à 21:56, Prentice Bisbal via users a écrit : We often get the following errors when more than one job runs on the same compute node. We are using Slurm with OpenMPI. The IB cards

Re: [OMPI users] [External] can't open /dev/ipath, network down (err=26)

2020-05-11 Thread Prentice Bisbal via users
at the modinfo output for the device driver to see if there are any likely looking suspects. Honestly, chances are better that you’ll get a hint from modinfo than that I’ll find a tuning guide laying around. Are these cards DDR or QDR? Sent from my iPad -- Prentice Bisbal Lead Software

[OMPI users] can't open /dev/ipath, network down (err=26)

2020-05-08 Thread Prentice Bisbal via users
We often get the following errors when more than one job runs on the same compute node. We are using Slurm with OpenMPI. The IB cards are QLogic using PSM: 10698ipath_userinit: assign_context command failed: Network is down node01.10698can't open /dev/ipath, network down (err=26)

Re: [OMPI users] [External] Re: Can't start jobs with srun.

2020-05-06 Thread Prentice Bisbal via users
and slurm against same pmix? That is - first build pmix, than build slurm with-pmix, and than ompi with both slurm and pmix=external ? On 23/04/2020 17:00, Prentice Bisbal via users wrote: $ ompi_info | grep slurm   Configure command line: '--prefix=/usr/pppl/intel/2019-pkgs/openmpi-4.0.3

Re: [OMPI users] [External] RE: Re: Can't start jobs with srun.

2020-05-06 Thread Prentice Bisbal via users
 ompi_info  |&  grep  "MPI repo" to confirm that all nodes are running the same version of OMPI. *From:*users [mailto:users-boun...@lists.open-mpi.org] *On Behalf Of *Prentice Bisbal via users *Sent:* Monday, April 27, 2020 10:25 AM *To:* users@lists.open-mpi.org *Cc:* Prentice Bi

Re: [OMPI users] [External] Re: Can't start jobs with srun.

2020-04-27 Thread Prentice Bisbal via users
to:users-boun...@lists.open-mpi.org] On Behalf Of Prentice Bisbal via users Sent: Friday, April 24, 2020 2:19 PM To: Ralph Castain mailto:r...@open-mpi.org>>; Open MPI Users mailto:users@lists.open-mpi.org>> Cc: Prentice Bisbal mailto:pbis...@pppl.gov>> Subject: Re: [OMPI users] [Exter

Re: [OMPI users] [External] RE: Re: Can't start jobs with srun.

2020-04-27 Thread Prentice Bisbal via users
OMPI problems? Andy -Original Message- From: users [mailto:users-boun...@lists.open-mpi.org] On Behalf Of Prentice Bisbal via users Sent: Friday, April 24, 2020 2:19 PM To: Ralph Castain ; Open MPI Users Cc: Prentice Bisbal Subject: Re: [OMPI users] [External] Re: Can't start jobs with srun. Okay.

Re: [OMPI users] [External] Re: Can't start jobs with srun.

2020-04-24 Thread Prentice Bisbal via users
:59 AM, Prentice Bisbal via users wrote: --mpi=list shows pmi2 and openmpi as valid values, but if I set --mpi= to either of them, my job still fails. Why is that? Can I not trust the output of --mpi=list? Prentice On 4/23/20 10:43 AM, Ralph Castain via users wrote: No, but you do have

Re: [OMPI users] [External] Re: Can't start jobs with srun.

2020-04-23 Thread Prentice Bisbal via users
if that is what you are going to use. In this case, you need to configure OMPI --with-pmi2= You can leave off the path if Slurm (i.e., just "--with-pmi2") was installed in a standard location as we should find it there. On Apr 23, 2020, at 7:39 AM, Prentice Bisbal via use

Re: [OMPI users] [External] Re: Can't start jobs with srun.

2020-04-23 Thread Prentice Bisbal via users
support? Did you tell srun to use it? On Apr 23, 2020, at 7:00 AM, Prentice Bisbal via users wrote: I'm using OpenMPI 4.0.3 with Slurm 19.05.5 I'm testing the software with a very simple hello, world MPI program that I've used reliably for years. When I submit the job through slurm and use

[OMPI users] Can't start jobs with srun.

2020-04-23 Thread Prentice Bisbal via users
I'm using OpenMPI 4.0.3 with Slurm 19.05.5  I'm testing the software with a very simple hello, world MPI program that I've used reliably for years. When I submit the job through slurm and use srun to launch the job, I get these errors: *** An error occurred in MPI_Init *** on a NULL

Re: [OMPI users] [External] Re: AMD EPYC 7281: does NOT, support binding memory to the process location

2020-01-10 Thread Prentice Bisbal via users
Raymond, Thanks for the info. Since we are still at CentOS 6, that is most likely the problem. Prentice On 1/8/20 8:52 PM, Raymond Muno via users wrote: AMD, list the minimum supported kernel for EPYC/NAPLES as RHEL/Centos kernel 3.10-862, which is RHEL/CentOS 7.5 or later. Upgraded kernels

Re: [OMPI users] [External] Re: AMD EPYC 7281: does NOT, support binding memory to the process location

2020-01-08 Thread Prentice Bisbal via users
On 1/8/20 3:30 PM, Brice Goglin via users wrote: Le 08/01/2020 à 21:20, Prentice Bisbal via users a écrit : We just added about a dozen nodes to our cluster, which have AMD EPYC 7281 processors. When a particular users jobs fall on one of these nodes, he gets these error messages

[OMPI users] AMD EPYC 7281: does NOT, support binding memory to the process location

2020-01-08 Thread Prentice Bisbal via users
We just added about a dozen nodes to our cluster, which have AMD EPYC 7281 processors. When a particular users jobs fall on one of these nodes, he gets these error messages: -- WARNING: a request was made to bind a

[OMPI users] hwloc support for Power9/IBM AC922 servers

2019-04-16 Thread Prentice Bisbal via users
OpenMPI Users, Are any of you using hwloc on Power9 hardware, specifically the IBM AC922 servers? If so, have you encountered any issues? I checked the documentation for the latest version (2.03), and found this: Since it uses standard Operating System information, hwloc's support is mostly

Re: [OMPI users] OpenMPI 2.1.0 + PGI 17.3 = asm test failures

2018-11-28 Thread Prentice Bisbal via users
Sylvain, I just ran into the same exact errors when compiling OpenMPI 3.0.0 with PGI 18.3 Prentice On 5/1/17 2:58 PM, Sylvain Jeaugey wrote: I also saw IBM and ignored the email :-) Thanks for reporting the issue, I passed it to the PGI team. On 05/01/2017 11:49 AM, Prentice Bisbal wrote

Re: [OMPI users] OpenMPI & Slurm: mpiexec/mpirun vs. srun

2017-12-19 Thread Prentice Bisbal
, at 2:18 PM, Prentice Bisbal <pbis...@pppl.gov> wrote: Greeting OpenMPI users and devs! We use OpenMPI with Slurm as our scheduler, and a user has asked me this: should they use mpiexec/mpirun or srun to start their MPI jobs through Slurm? My inclination is to use mpiexec, since that is th

[OMPI users] OpenMPI & Slurm: mpiexec/mpirun vs. srun

2017-12-18 Thread Prentice Bisbal
Greeting OpenMPI users and devs! We use OpenMPI with Slurm as our scheduler, and a user has asked me this: should they use mpiexec/mpirun or srun to start their MPI jobs through Slurm? My inclination is to use mpiexec, since that is the only method that's (somewhat) defined in the MPI

Re: [OMPI users] bind-to-core with AMD CMT?

2017-08-29 Thread Prentice Bisbal
; Prentice On 08/24/2017 03:11 PM, Prentice Bisbal wrote: OpenMPI Users, I am using AMD processocers with CMT, where two cores constitute a module, and there is only one FPU per module, so each pair of cores has to share a single FPU. I want to use only one core per module so there

[OMPI users] bind-to-core with AMD CMT?

2017-08-24 Thread Prentice Bisbal
here. -- Prentice Bisbal Lead Software Engineer Princeton Plasma Physics Laboratory http://www.pppl.gov ___ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users

Re: [OMPI users] Strange OpenMPI errors showing up in Caffe rc5 build

2017-05-08 Thread Prentice Bisbal
cker image). -William L. *From:* users <users-boun...@lists.open-mpi.org> on behalf of Prentice Bisbal <pbis...@pppl.gov> *Sent:* Friday, May 5, 2017 7:47:39 AM *To:* users@lists.open-mpi.org *Subject:* Re: [OMPI

Re: [OMPI users] Strange OpenMPI errors showing up in Caffe rc5 build

2017-05-05 Thread Prentice Bisbal
On 05/04/2017 09:08 PM, gil...@rist.or.jp wrote: William, the link error clearly shows libcaffe.so does require C++ bindings. did you build caffe from a fresh tree ? what if you ldd libcaffe.so nm libcaffe.so | grep -i ompi if libcaffe.so does require mpi c++ bindings, it should depend

Re: [OMPI users] Strange OpenMPI errors on building Caffe 1.0

2017-05-05 Thread Prentice Bisbal
This error should really be posted to the caffe mailing list. This is an error with caffe. Most likely, you are not specifying the location to your Open MPI installation properly. And Caffe definitely depends on OpenMPI you errors: .build_release/lib/libcaffe.so: undefined reference to

Re: [OMPI users] OpenMPI 2.1.0 + PGI 17.3 = asm test failures

2017-05-01 Thread Prentice Bisbal
. On May 1, 2017, at 11:21 AM, Prentice Bisbal <pbis...@pppl.gov> wrote: Jeff, Why IBM? This problem is caused by the PGI compilers, so shouldn't this be directed towards NVidia, which now owns PGI? Prentice On 04/29/2017 07:37 AM, Jeff Squyres (jsquyres) wrote: IBM: can someone check

Re: [OMPI users] OpenMPI 2.1.0 + PGI 17.3 = asm test failures

2017-05-01 Thread Prentice Bisbal
Bisbal <pbis...@pppl.gov> wrote: Update: removing the -fast switch caused this error to go away. Prentice On 04/27/2017 06:00 PM, Prentice Bisbal wrote: I'm building Open MPI 2.1.0 with PGI 17.3, and now I'm getting 'illegal instruction' errors during 'make check': ../../config/test-

Re: [OMPI users] OpenMPI 2.1.0 + PGI 17.3 = asm test failures

2017-04-28 Thread Prentice Bisbal
Update: removing the -fast switch caused this error to go away. Prentice On 04/27/2017 06:00 PM, Prentice Bisbal wrote: I'm building Open MPI 2.1.0 with PGI 17.3, and now I'm getting 'illegal instruction' errors during 'make check': ../../config/test-driver: line 107: 65169 Illegal

[OMPI users] OpenMPI 2.1.0 + PGI 17.3 = asm test failures

2017-04-27 Thread Prentice Bisbal
I'm building Open MPI 2.1.0 with PGI 17.3, and now I'm getting 'illegal instruction' errors during 'make check': ../../config/test-driver: line 107: 65169 Illegal instruction "$@" > $log_file 2>&1 FAIL: atomic_math - 1 threads: Passed That's just one example of the error output. See all

Re: [OMPI users] OpenMPI 2.1.0: FAIL: opal_path_nfs

2017-04-26 Thread Prentice Bisbal
That's what I figured, but I wanted to check first. Any idea of exactly what it's trying to check? Prentice On 04/26/2017 05:54 PM, r...@open-mpi.org wrote: You can probably safely ignore it. On Apr 26, 2017, at 2:29 PM, Prentice Bisbal <pbis...@pppl.gov> wrote: I'm trying to build O

Re: [OMPI users] OpenMPI 2.1.0 build error: yes/lib: No such file or director

2017-04-26 Thread Prentice Bisbal
not provide the --with-lustre argument. Thanks Edgar On 4/26/2017 4:18 PM, Prentice Bisbal wrote: I'm getting the following error when I build OpenMPI 2.1.0 with GCC 5.4.0: /bin/sh ../../../../libtool --tag=CC --mode=link gcc -O3 -DNDEBUG -finline-functions -fno-strict-aliasing -pthread

[OMPI users] OpenMPI 2.1.0: FAIL: opal_path_nfs

2017-04-26 Thread Prentice Bisbal
I'm trying to build OpenMPI 2.1.0 with GCC 5.4.0 on CentOS 6.8. After working around the '-Lyes/lib' errors I reported in my previous post, opal_path_nfs fails during 'make check' (see below). Is this failure critical, or is it something I can ignore and continue with my install? Googling only

[OMPI users] OpenMPI 2.1.0 build error: yes/lib: No such file or director

2017-04-26 Thread Prentice Bisbal
I'm getting the following error when I build OpenMPI 2.1.0 with GCC 5.4.0: /bin/sh ../../../../libtool --tag=CC --mode=link gcc -O3 -DNDEBUG -finline-functions -fno-strict-aliasing -pthread -module -avoid-version -Lyes/lib -o libmca_fs_lustre.la fs_lustre.lo fs_lustre_component.lo

Re: [OMPI users] Compiler error with PGI: pgcc-Error-Unknown switch: -pthread

2017-04-26 Thread Prentice Bisbal
er compilers, and I typed '-fPIC' out of habit. That's it! Those two changes allowed me to build and install OpenMPI 1.10.3 with PGI 17.3 Prentice On 04/03/2017 10:20 AM, Prentice Bisbal wrote: Greeting Open MPI users! After being off this list for several years, I'm back! And I need help:

Re: [OMPI users] Compiler error with PGI: pgcc-Error-Unknown switch: -pthread

2017-04-04 Thread Prentice Bisbal
Am 03.04.2017 um 23:07 schrieb Prentice Bisbal: > FYI - the proposed 'here-doc' solution below didn't work for me, it produced an error. Neither did printf. When I used printf, only the first arg was passed along: > > #!/bin/bash > > realcmd=/usr/pppl/pg

Re: [OMPI users] Compiler error with PGI: pgcc-Error-Unknown switch: -pthread

2017-04-03 Thread Prentice Bisbal
another colleague also suggested this expressions, which appears to work, too: newargs=${@/-pthread/} Although I don't know how portable that is. I'm guessing that's very bash-specific syntax. Prentice On 04/03/2017 04:26 PM, Prentice Bisbal wrote: A coworker came up with another idea that wor

Re: [OMPI users] Compiler error with PGI: pgcc-Error-Unknown switch: -pthread

2017-04-03 Thread Prentice Bisbal
A coworker came up with another idea that works, too: newargs=sed s/-pthread//g < Try $ printf -- "-E" ... On 04/03/2017 04:03 PM, Prentice Bisbal wrote: Okay. the additional -E doesn't work,either. :( Prentice Bisbal Lead Software Engineer Princeton Plasma Physics La

Re: [OMPI users] Compiler error with PGI: pgcc-Error-Unknown switch: -pthread

2017-04-03 Thread Prentice Bisbal
Okay. the additional -E doesn't work,either. :( Prentice Bisbal Lead Software Engineer Princeton Plasma Physics Laboratory http://www.pppl.gov On 04/03/2017 04:01 PM, Prentice Bisbal wrote: Nevermind. A coworker helped me figure this one out. Echo is treating the '-E' as an argument to echo

Re: [OMPI users] Compiler error with PGI: pgcc-Error-Unknown switch: -pthread

2017-04-03 Thread Prentice Bisbal
On 04/03/2017 03:54 PM, Prentice Bisbal wrote: I've decided to work around this problem by creating a wrapper script for pgcc that strips away the -pthread argument, but my sed expression works on the command-line, but not in the script. I'm essentially reproducing the workaround from https

Re: [OMPI users] Compiler error with PGI: pgcc-Error-Unknown switch: -pthread

2017-04-03 Thread Prentice Bisbal
sions of OpenMPI with multiple different compilers (and versions). On 04/03/2017 04:51 PM, Prentice Bisbal wrote: This is the second suggestion to rebuild Slurm The other from Åke Sandgren, who recommended this: This usually comes from slurm, so we always do perl -pi -e 's/-pthread//' /lap/

Re: [OMPI users] Compiler error with PGI: pgcc-Error-Unknown switch: -pthread

2017-04-03 Thread Prentice Bisbal
the slurm libmpi.la <http://libmpi.la> and/or libslurm.la <http://libslurm.la> Workarounds are - rebuild slurm with PGI - remove the .la files (*.so and/or *.a are enough) - wrap the PGI compiler to ignore the -pthread option Hope this helps Gilles On Monday, April 3, 2017, Prentice

[OMPI users] Compiler error with PGI: pgcc-Error-Unknown switch: -pthread

2017-04-03 Thread Prentice Bisbal
Greeting Open MPI users! After being off this list for several years, I'm back! And I need help: I'm trying to compile OpenMPI 1.10.3 with the PGI compilers, version 17.3. I'm using the following configure options: ./configure \ --prefix=/usr/pppl/pgi/17.3-pkgs/openmpi-1.10.3 \

Re: [OMPI users] Building openmpi from src rpm: rpmbuild --rebuild errors with 'cpio: MD5 sum mismatch' (since openmpi 1.4.5)

2012-06-06 Thread Prentice Bisbal
On 05/31/2012 07:26 AM, Jeff Squyres wrote: > On May 31, 2012, at 2:04 AM, livelfs wrote: > >> Since 1.4.5 openmpi release, it is no longer possible to build openmpi >> binary with rpmbuild --rebuild if system rpm package version is 4.4.x, like >> in SLES10, SLES11, RHEL/CentOS 5.x. >> >> For

Re: [OMPI users] Building openmpi from src rpm: rpmbuild --rebuild errors with 'cpio: MD5 sum mismatch' (since openmpi 1.4.5)

2012-06-06 Thread Prentice Bisbal
On 05/31/2012 02:04 AM, livelfs wrote: > Hi > Since 1.4.5 openmpi release, it is no longer possible to build openmpi > binary with rpmbuild --rebuild if system rpm package version is 4.4.x, > like in SLES10, SLES11, RHEL/CentOS 5.x. > > For instance, on CentOS 5.8 x86_64 with rpm 4.4.2.3-28.el5_8:

Re: [OMPI users] regarding the problem occurred while running anmpi programs

2012-04-26 Thread Prentice Bisbal
Actually, he should leave the ":$LD_LIBRARY_PATH" on the end. That way if LD_LIBRARY_PATH is already defined, the Open MPI directory is just prepended to LD_LIBRARY_PATH. Omitting ":$LD_LIBRARY_PATH" from his command could cause other needed elements of LD_LIBRARY_PATH to be lost, causing other

Re: [OMPI users] redirecting output

2012-04-02 Thread Prentice Bisbal
On 03/30/2012 11:12 AM, Tim Prince wrote: > On 03/30/2012 10:41 AM, tyler.bal...@huskers.unl.edu wrote: >> >> >> I am using the command mpirun -np nprocs -machinefile machines.arch >> Pcrystal and my output strolls across my terminal I would like to >> send this output to a file and I cannot

Re: [OMPI users] Simple question on GRID

2012-03-02 Thread Prentice Bisbal
On 03/01/2012 12:10 AM, Shaandar Nyamtulga wrote: > Hi > I have two Beowulf clusters (both Ubuntu 10.10, one is OpenMPI, one is > MPICH2). > They run separately in their local network environment.I know there is > a way to integrate them through Internet, presumably by Grid software, > I guess. Is

Re: [OMPI users] ssh between nodes

2012-03-02 Thread Prentice Bisbal
On 02/29/2012 04:51 PM, Martin Siegert wrote: > Hi, > > On Wed, Feb 29, 2012 at 09:09:27PM +, Denver Smith wrote: >>Hello, >>On my cluster running moab and torque, I cannot ssh without a password >>between compute nodes. I can however request multiple node jobs fine. I >>was

Re: [OMPI users] [EXTERNAL] Re: Question regarding osu-benchamarks 3.1.1

2012-03-02 Thread Prentice Bisbal
On 02/29/2012 03:15 PM, Jeffrey Squyres wrote: > On Feb 29, 2012, at 2:57 PM, Jingcha Joba wrote: > >> So if I understand correctly, if a message size is smaller than it will use >> the MPI way (non-RDMA, 2 way communication), if its larger, then it would >> use the Open Fabrics, by using the

Re: [OMPI users] [Open MPI Announce] Open MPI v1.4.5 released

2012-02-16 Thread Prentice Bisbal
On 02/15/2012 07:44 AM, Reuti wrote: > Hi, > > Am 15.02.2012 um 03:48 schrieb alexalex43210: > >> But I am a novice for the parallel computation, I often use Fortran to >> compile my program, now I want to use the Parallel, can you give me some >> help how to begin? >> PS: I learned about

Re: [OMPI users] OpenMPI: How many connections?

2012-01-27 Thread Prentice Bisbal
I would like to nominate the quote below for the best explanation of how a piece of software works that I've ever read. Kudos, Jeff. On 01/26/2012 04:38 PM, Jeff Squyres wrote: > You send a message, a miracle occurs, and the message is received on the > other side. -- Prentice

Re: [OMPI users] ompi + bash + GE + modules

2012-01-13 Thread Prentice Bisbal
On 01/12/2012 08:40 AM, Dave Love wrote: > Surely this should be on the gridengine list -- and it's in recent > archives -- but there's some ob-openmpi below. Can Notre Dame not get > the support they've paid Univa for? This is, in fact, in the recent gridengine archives. I brought up this

Re: [OMPI users] Installation of openmpi-1.4.4

2011-12-21 Thread Prentice Bisbal
Is the path to your opempi libraries in your LD_LIBRARY_PATH? -- Prentice On 12/21/2011 01:56 PM, amosl...@gmail.com wrote: > Dear OMPI Users, > I have just read the messages from Martin Rushton and Jeff > Squyres and have been having the same problem trying to get > openmp-1.4.4 to

Re: [OMPI users] openmpi - gfortran and ifort conflict

2011-12-14 Thread Prentice Bisbal
On 12/14/2011 03:39 PM, Jeff Squyres wrote: > On Dec 14, 2011, at 3:21 PM, Prentice Bisbal wrote: > >> For example, your configure command, >> >> ./configure --prefix=/opt/openmpi/intel CC=gcc CXX=g++ F77=ifort FC=ifort >> >> Doesn't tell Open MPI to use ifco

Re: [OMPI users] openmpi - gfortran and ifort conflict

2011-12-14 Thread Prentice Bisbal
On 12/14/2011 03:29 PM, Micah Sklut wrote: > Okay thanks Prentice. > > I understand what you are saying about specifying the compilers during > configure. > Perhaps, that alone would have solved the problem, but removing the > 1.4.2 ompi installation worked as well. > > Micah > Well, to clarify

Re: [OMPI users] openmpi - gfortran and ifort conflict

2011-12-14 Thread Prentice Bisbal
On 12/14/2011 01:20 PM, Fernanda Oliveira wrote: > Hi Micah, > > I do not know if it is exactly what you need but I know that there are > environment variables to use with intel mpi. They are: I_MPI_CC, > I_MPI_CXX, I_MPI_F77, I_MPI_F90. So, you can set this using 'export' > for bash, for

Re: [OMPI users] openmpi - gfortran and ifort conflict

2011-12-14 Thread Prentice Bisbal
On 12/14/2011 12:21 PM, Micah Sklut wrote: > Hi Gustav, > > I did read Price's email: > > When I do "which mpif90", i get: > /opt/openmpi/intel/bin/mpif90 > which is the desired directory/binary > > As I mentioned, the config log file indicated it was using ifort, and > had no mention of

Re: [OMPI users] wiki and "man mpirun" odds, and a question

2011-11-10 Thread Prentice Bisbal
Paul, I'm sure this isn't the response you want to hear, but I'll suggest it anyway: Queuing systems can forward the submitters environment if desired. For example, in SGE, the -V switch forwards all the environment variables to the job's environment, so if there's one you can use to launch your

Re: [OMPI users] Role of ethernet interfaces of startup of openmpi job using IB

2011-09-28 Thread Prentice Bisbal
On 09/27/2011 05:30 PM, Jeff Squyres wrote: > On Sep 27, 2011, at 5:03 PM, Prentice Bisbal wrote: > >> To clarify, is IP/Ethernet required, or will IPoIB be used if it's >> configured on the nodes? Would this make a difference. > > IPoIB is fine, although I've heard conc

Re: [OMPI users] Role of ethernet interfaces of startup of openmpi job using IB

2011-09-27 Thread Prentice Bisbal
On 09/27/2011 07:50 AM, Jeff Squyres wrote: > On Sep 27, 2011, at 6:35 AM, Salvatore Podda wrote: > >> We would like to know if the ethernet interfaces play any role in the >> startup phase of an opempi job using InfiniBand >> In this case, where we can found some literature on this topic?

Re: [OMPI users] Anyone with Visual Studio + MPI Experience

2011-07-07 Thread Prentice Bisbal
Miguel, Thanks for the assistance. I don't have the MPI options you spoke of, so I figured that might have been part of the HPC Pack. I found a couple of web pages that helped me make progress. I'm not 100% there, but I'm much closer, say 85% of the way there. Now I can get an Fortran+MPI

Re: [OMPI users] Anyone with Visual Studio + MPI Experience

2011-07-06 Thread Prentice Bisbal
Miguel, I'm using VS 2010 Professional + Intel Visual Fortran. I don't have the "Debugger to Launch" option in my version (or I'm looking in the wrong place), and don't see MPI options any where. Do you have any additional software installed, like the HPC Pack 2008? Prentice On 07/04/2011 04:32

Re: [OMPI users] mpi & mac

2011-07-06 Thread Prentice Bisbal
On 07/06/2011 10:42 AM, Constantinos Makassikis wrote: > On Tue, Jul 5, 2011 at 9:48 PM, Robert Sacker > wrote: > > Hi all, > > Hello ! > > I need some help. I'm trying to run C++ code in Xcode on a Mac Pro > Desktop (OS 10.6) and utilize

Re: [OMPI users] Anyone with Visual Studio + MPI Experience

2011-06-30 Thread Prentice Bisbal
t; -Original Message- > From: users-boun...@open-mpi.org [mailto:users-boun...@open-mpi.org] On > Behalf Of Prentice Bisbal > Sent: Thursday, June 30, 2011 1:42 PM > To: Open MPI Users > Subject: [OMPI users] Anyone with Visual Studio + MPI Experience > > Does anyone o

[OMPI users] Anyone with Visual Studio + MPI Experience

2011-06-30 Thread Prentice Bisbal
Does anyone on this list have experience using MS Visual Studio for MPI development? I'm supporting a Windows user who has been doing Fortran programming on Windows using an ANCIENT version of Digital Visual Fortran (I know, I know - using "ancient" and "Digital" in the same sentence is

Re: [OMPI users] SGE and openmpi

2011-04-07 Thread Prentice Bisbal
On 04/06/2011 07:09 PM, Jason Palmer wrote: > Hi, > I am having trouble running a batch job in SGE using openmpi. I have read > the faq, which says that openmpi will automatically do the right thing, but > something seems to be wrong. > > Previously I used MPICH1 under SGE without any

Re: [OMPI users] printf and scanf problem of C code compiled with Open MPI

2011-03-29 Thread Prentice Bisbal
On 03/29/2011 01:29 PM, Meilin Bai wrote: > Dear open-mpi users: > > I come across a little problem when running a MPI C program compiled > with Open MPI 1.4.3. A part of codes as follows: > > MPI_Init(, ); > MPI_Comm_size(MPI_COMM_WORLD, ); > MPI_Comm_rank(MPI_COMM_WORLD, ); >

Re: [OMPI users] OpenMPI 1.2.x segfault as regular user

2011-03-21 Thread Prentice Bisbal
On 03/20/2011 06:22 PM, kevin.buck...@ecs.vuw.ac.nz wrote: > >> It's not hard to test whether or not SELinux is the problem. You can >> turn SELinux off on the command-line with this command: >> >> setenforce 0 >> >> Of course, you need to be root in order to do this. >> >> After turning SELinux

Re: [OMPI users] What's wrong with this code?

2011-02-23 Thread Prentice Bisbal
Jeff Squyres wrote: > On Feb 23, 2011, at 3:36 PM, Prentice Bisbal wrote: > >> It's using MPI_STATUS_SIZE to dimension istatus before mpif.h is even >> read! Correcting the order of the include and declaration statements >> fixed the problem. D'oh! > > A pox on o

Re: [OMPI users] What's wrong with this code?

2011-02-23 Thread Prentice Bisbal
Jeff Squyres wrote: > On Feb 23, 2011, at 2:20 PM, Prentice Bisbal wrote: > >> I suspected that and checked for it earlier. I just double-checked, and >> that is not the problem. Out of the two source files, 'include mpif.h' >> appears once, and 'use mpi' does not appe

Re: [OMPI users] What's wrong with this code?

2011-02-23 Thread Prentice Bisbal
ut it's only about 1 year old. $ ifort --version ifort (IFORT) 11.1 20100203 Copyright (C) 1985-2010 Intel Corporation. All rights reserved. -- Prentice > > > On Feb 23, 2011, at 11:51 AM, Tim Prince wrote: > >> On 2/23/2011 8:27 AM, Prentice Bisbal wrote: >>> Jef

Re: [OMPI users] What's wrong with this code?

2011-02-23 Thread Prentice Bisbal
Tim Prince wrote: > On 2/23/2011 8:27 AM, Prentice Bisbal wrote: >> Jeff Squyres wrote: >>> On Feb 23, 2011, at 9:48 AM, Tim Prince wrote: >>> >>>>> I agree with your logic, but the problem is where the code containing >>>>> the error

Re: [OMPI users] What's wrong with this code?

2011-02-23 Thread Prentice Bisbal
Jeff Squyres wrote: > On Feb 23, 2011, at 9:48 AM, Tim Prince wrote: > >>> I agree with your logic, but the problem is where the code containing >>> the error is coming from - it's comping from a header files that's a >>> part of Open MPI, which makes me think this is a cmpiler error, since >>>

Re: [OMPI users] What's wrong with this code?

2011-02-23 Thread Prentice Bisbal
Tim Prince wrote: > On 2/22/2011 1:41 PM, Prentice Bisbal wrote: >> One of the researchers I support is writing some Fortran code that uses >> Open MPI. The code is being compiled with the Intel Fortran compiler. >> This one line of code: >> >> integer ierr,ist

[OMPI users] What's wrong with this code?

2011-02-22 Thread Prentice Bisbal
One of the researchers I support is writing some Fortran code that uses Open MPI. The code is being compiled with the Intel Fortran compiler. This one line of code: integer ierr,istatus(MPI_STATUS_SIZE) leads to these errors: $ mpif90 -o simplex simplexmain579m.for simplexsubs579

Re: [OMPI users] libmpi.so.0 not found during gdb debugging

2011-02-11 Thread Prentice Bisbal
swagat mishra wrote: > hello everyone, > i have a network of systems connected over lan with each computer > running ubuntu. openmpi 1.4.x is installed on 1 machine and the > installation is mounted on other nodes through Networking File > System(NFS). the source program and compiled file(a.out)

Re: [OMPI users] OpenMPI version syntax?

2011-02-03 Thread Prentice Bisbal
rpm -qi might give you more detailed information. If not, as a last resort, you can download and installed the SRPM and then look at the name of the tarball in /usr/src/redhat/SOURCES. Prentice Jeffrey A Cummings wrote: > The context was wrt the OpenMPI version that is bundled with a specific

Re: [OMPI users] How closely tied is a specific release of OpenMPI to the host operating system and other system software?

2011-02-02 Thread Prentice Bisbal
Jeffrey A Cummings wrote: > I use OpenMPI on a variety of platforms: stand-alone servers running > Solaris on sparc boxes and Linux (mostly CentOS) on AMD/Intel boxes, > also Linux (again CentOS) on large clusters of AMD/Intel boxes. These > platforms all have some version of the 1.3 OpenMPI

Re: [OMPI users] Method for worker to determine its "rank" on a single machine?

2010-12-10 Thread Prentice Bisbal
On 12/10/2010 07:55 AM, Ralph Castain wrote: Ick - I agree that's portable, but truly ugly. Would it make sense to implement this as an MPI extension, and then perhaps propose something to the Forum for this purpose? I think that makes sense. As core and socket counts go up, I imagine the

Re: [OMPI users] Help!!!!!!!!!!!!Openmpi instal for ubuntu 64 bits

2010-11-30 Thread Prentice Bisbal
Jeff Squyres wrote: > Please note that this is an English-speaking list. I don't know if Tim > speaks ?Spanish?, but I unfortunately don't. :-) > s/Spanish/Portuguese/ -- Prentice

  1   2   >