Re: [easybuild] iomkl-2018b toolchain availability?

[Åke Sandgren]

iomkl/2018b and gimkl/2018b are now pending PR's and should hopefully
show up in 3.6.3.

Recent changes to hwloc and openmpi for the 2018b toolchains are also
recommended (fixes libxml2/libpciaccess problems)

On 07/30/2018 03:37 PM, Åke Sandgren wrote:
> I'm still on vacation and it's sort of too hot to engage the brain,
> hence the unintended delay on this.
> (And we needed to discuss a few dependency changes before going forward)
> 
> I'll delay a bit further until Kenneth, and myself, are back from
> vacation next week.
> 
> On 07/30/2018 02:48 PM, Andrew Edmondson wrote:
>> Sorry – I missed the message from Åke. Looking forward to using it!


-- 
Ake Sandgren, HPC2N, Umea University, S-90187 Umea, Sweden
Internet: a...@hpc2n.umu.se   Phone: +46 90 7866134 Fax: +46 90-580 14
Mobile: +46 70 7716134 WWW: http://www.hpc2n.umu.se

Re: [easybuild] iomkl-2018b toolchain availability?

[Åke Sandgren]

I'm still on vacation and it's sort of too hot to engage the brain,
hence the unintended delay on this.
(And we needed to discuss a few dependency changes before going forward)

I'll delay a bit further until Kenneth, and myself, are back from
vacation next week.

On 07/30/2018 02:48 PM, Andrew Edmondson wrote:
> Sorry – I missed the message from Åke. Looking forward to using it!
> 
>  
> 
> *From:*easybuild-requ...@lists.ugent.be
>  *On Behalf Of *Andrew Edmondson
> *Sent:* 30 July 2018 13:36
> *To:* easybuild@lists.ugent.be
> *Subject:* RE: [easybuild] iomkl-2018b toolchain availability?
> 
>  
> 
> Hi all,
> 
>  
> 
> If iomkl/2018b doesn’t exist in a couple of months then we at Birmingham
> will be looking to make one. I’ve got a new starter coming in September,
> so won’t be doing it before then I’m afraid.
> 
>  
> 
> We need iomkl because we use Mellanox InfiniBand and IntelMPI isn’t
> supported for HPC-X*
> 
>  
> 
> Thanks,
> 
>  
> 
> Ed
> 
>  
> 
> * HPC-X also includes various acceleration packages to improve both the
> 
> performance and scalability of applications running on top of these
> libraries, including UCX
> 
> (Unified Communication X) and MXM (Mellanox Messaging), which accelerate
> the underlying
> 
> send/receive (or put/get) messages. It also includes FCA (Fabric
> Collectives Accelerations),
> 
> which accelerates the underlying collective operations used by the
> MPI/PGAS languages.
> 
>  
> 
> *From:*easybuild-requ...@lists.ugent.be
> <mailto:easybuild-requ...@lists.ugent.be>
>  <mailto:easybuild-requ...@lists.ugent.be>> *On Behalf Of
> *bart.olde...@calculquebec.ca <mailto:bart.olde...@calculquebec.ca>
> *Sent:* 16 July 2018 17:30
> *To:* easybuild@lists.ugent.be <mailto:easybuild@lists.ugent.be>
> *Subject:* Re: [easybuild] iomkl-2018b toolchain availability?
> 
>  
> 
> Hi Ole,
> 
>  
> 
> it says it there:
> 
> "Intel MPI Library is available as part of Intel® Parallel Studio XE
> Cluster Edition and as a free stand-alone version. A license purchase
> includes Priority Support."
> 
>  
> 
> it's a not a trial version any more if you click on the "Free Download"
> button. Instead it will bring you to:
> 
> https://software.intel.com/en-us/performance-libraries
> 
> which includes MKL, Intel MPI and some other things. So you can also
> construct "gimkl" without sending $$$ to Intel.
> 
>  
> 
> I haven't found any announcement but noted that since April this year,
> this has been updated:
> 
> https://software.intel.com/en-us/articles/end-user-license-agreement
> 
> =>
> 
> The EULA for Intel Software Development Products
> <https://software.intel.com/en-us/license/eula-for-intel-software-development-products>
> is the most commonly used license. Popular products it applies to include:
> 
>   * Intel® Parallel Studio XE
>   * Intel® System Studio
>   * Intel® VTune™ Amplifier
>   * Intel® Media Server Studio
> 
> The Intel Simplified Software License
> <https://software.intel.com/en-us/license/intel-simplified-software-license>
> applies to the following products:
> 
>   * Intel® Math Kernel Library (Intel® MKL)
>   * Intel® Integrated Performance Primitives (Intel® IPP) Library
>   * Intel® Machine Learning Scaling Library (Intel® MLSL)
>   * Intel® Data Analytics Acceleration Library (Intel® DAAL)
>   * Intel® Threading Building Blocks (Intel® TBB)
>   * Intel® Distribution for Python*
>   * Intel® MPI Library
>   * Intel® Cluster Checker
> 
> the first 4 you will need to buy licenses for (for typical HPC use that
> is, it is free for certain other use cases), but the last 8 not any more.
> 
>  
> 
> Bart
> 
>  
> 
> On Mon, 16 Jul 2018 at 11:59, Ole Holm Nielsen
> mailto:ole.h.niel...@fysik.dtu.dk>> wrote:
> 
> Hi Bart,
> On 07/16/2018 05:47 PM, Bart Oldeman wrote:
> > Hello Ole,
> >
> > as far as I can see Intel MPI is free beer now (unless you want
> priority
> > support of course), since 2018 update 2.
> > That doesn't mean iomkl is useless of course!
> 
> I don't see any free beer in the official Intel MPI homepage:
> https://software.intel.com/en-us/intel-mpi-library
> The trial version of the software doesn't count :-)
> 
> Do you have more details about Intel making Intel MPI freely available?
> 
> Thanks,
> Ole
> 
> 
> 
> -- 
> 
> Dr. Bart E. Oldeman | bart.olde...@mcgill.ca
> <mailto:bart.olde...@mcgill.ca> | bart.olde...@calculquebec.ca
> <mailto:bart.olde...@calculquebec.ca>
> Scientific Computing Analyst / Analyste en calcul scientifique
> McGill HPC Centre / Centre de Calcul Haute Performance de McGill |
> http://www.hpc.mcgill.ca
> Calcul Québec | http://www.calculquebec.ca
> Compute/Calcul Canada | http://www.computecanada.ca
> Tel/Tél: 514-396-8926 | Fax/Télécopieur: 514-396-8934
> 

-- 
Ake Sandgren, HPC2N, Umea University, S-90187 Umea, Sweden
Internet: a...@hpc2n.umu.se   Phone: +46 90 7866134 Fax: +46 90-580 14
Mobile: +46 70 7716134 WWW: http://www.hpc2n.umu.se

RE: [easybuild] iomkl-2018b toolchain availability?

[Andrew Edmondson]

Sorry – I missed the message from Åke. Looking forward to using it!

From: easybuild-requ...@lists.ugent.be  On 
Behalf Of Andrew Edmondson
Sent: 30 July 2018 13:36
To: easybuild@lists.ugent.be
Subject: RE: [easybuild] iomkl-2018b toolchain availability?

Hi all,

If iomkl/2018b doesn’t exist in a couple of months then we at Birmingham will 
be looking to make one. I’ve got a new starter coming in September, so won’t be 
doing it before then I’m afraid.

We need iomkl because we use Mellanox InfiniBand and IntelMPI isn’t supported 
for HPC-X*

Thanks,

Ed

* HPC-X also includes various acceleration packages to improve both the
performance and scalability of applications running on top of these libraries, 
including UCX
(Unified Communication X) and MXM (Mellanox Messaging), which accelerate the 
underlying
send/receive (or put/get) messages. It also includes FCA (Fabric Collectives 
Accelerations),
which accelerates the underlying collective operations used by the MPI/PGAS 
languages.

From: easybuild-requ...@lists.ugent.be<mailto:easybuild-requ...@lists.ugent.be> 
mailto:easybuild-requ...@lists.ugent.be>> On 
Behalf Of bart.olde...@calculquebec.ca<mailto:bart.olde...@calculquebec.ca>
Sent: 16 July 2018 17:30
To: easybuild@lists.ugent.be<mailto:easybuild@lists.ugent.be>
Subject: Re: [easybuild] iomkl-2018b toolchain availability?

Hi Ole,

it says it there:
"Intel MPI Library is available as part of Intel® Parallel Studio XE Cluster 
Edition and as a free stand-alone version. A license purchase includes Priority 
Support."

it's a not a trial version any more if you click on the "Free Download" button. 
Instead it will bring you to:
https://software.intel.com/en-us/performance-libraries
which includes MKL, Intel MPI and some other things. So you can also construct 
"gimkl" without sending $$$ to Intel.

I haven't found any announcement but noted that since April this year, this has 
been updated:
https://software.intel.com/en-us/articles/end-user-license-agreement
=>

The EULA for Intel Software Development 
Products<https://software.intel.com/en-us/license/eula-for-intel-software-development-products>
 is the most commonly used license. Popular products it applies to include:

  *   Intel® Parallel Studio XE
  *   Intel® System Studio
  *   Intel® VTune™ Amplifier
  *   Intel® Media Server Studio

The Intel Simplified Software 
License<https://software.intel.com/en-us/license/intel-simplified-software-license>
 applies to the following products:

  *   Intel® Math Kernel Library (Intel® MKL)
  *   Intel® Integrated Performance Primitives (Intel® IPP) Library
  *   Intel® Machine Learning Scaling Library (Intel® MLSL)
  *   Intel® Data Analytics Acceleration Library (Intel® DAAL)
  *   Intel® Threading Building Blocks (Intel® TBB)
  *   Intel® Distribution for Python*
  *   Intel® MPI Library
  *   Intel® Cluster Checker
the first 4 you will need to buy licenses for (for typical HPC use that is, it 
is free for certain other use cases), but the last 8 not any more.

Bart

On Mon, 16 Jul 2018 at 11:59, Ole Holm Nielsen 
mailto:ole.h.niel...@fysik.dtu.dk>> wrote:
Hi Bart,
On 07/16/2018 05:47 PM, Bart Oldeman wrote:
> Hello Ole,
>
> as far as I can see Intel MPI is free beer now (unless you want priority
> support of course), since 2018 update 2.
> That doesn't mean iomkl is useless of course!

I don't see any free beer in the official Intel MPI homepage:
https://software.intel.com/en-us/intel-mpi-library
The trial version of the software doesn't count :-)

Do you have more details about Intel making Intel MPI freely available?

Thanks,
Ole


--
Dr. Bart E. Oldeman | bart.olde...@mcgill.ca<mailto:bart.olde...@mcgill.ca> | 
bart.olde...@calculquebec.ca<mailto:bart.olde...@calculquebec.ca>
Scientific Computing Analyst / Analyste en calcul scientifique
McGill HPC Centre / Centre de Calcul Haute Performance de McGill | 
http://www.hpc.mcgill.ca
Calcul Québec | http://www.calculquebec.ca
Compute/Calcul Canada | http://www.computecanada.ca
Tel/Tél: 514-396-8926 | Fax/Télécopieur: 514-396-8934

RE: [easybuild] iomkl-2018b toolchain availability?

[Andrew Edmondson]

Hi all,

If iomkl/2018b doesn’t exist in a couple of months then we at Birmingham will 
be looking to make one. I’ve got a new starter coming in September, so won’t be 
doing it before then I’m afraid.

We need iomkl because we use Mellanox InfiniBand and IntelMPI isn’t supported 
for HPC-X*

Thanks,

Ed

* HPC-X also includes various acceleration packages to improve both the
performance and scalability of applications running on top of these libraries, 
including UCX
(Unified Communication X) and MXM (Mellanox Messaging), which accelerate the 
underlying
send/receive (or put/get) messages. It also includes FCA (Fabric Collectives 
Accelerations),
which accelerates the underlying collective operations used by the MPI/PGAS 
languages.

From: easybuild-requ...@lists.ugent.be  On 
Behalf Of bart.olde...@calculquebec.ca
Sent: 16 July 2018 17:30
To: easybuild@lists.ugent.be
Subject: Re: [easybuild] iomkl-2018b toolchain availability?

Hi Ole,

it says it there:
"Intel MPI Library is available as part of Intel® Parallel Studio XE Cluster 
Edition and as a free stand-alone version. A license purchase includes Priority 
Support."

it's a not a trial version any more if you click on the "Free Download" button. 
Instead it will bring you to:
https://software.intel.com/en-us/performance-libraries
which includes MKL, Intel MPI and some other things. So you can also construct 
"gimkl" without sending $$$ to Intel.

I haven't found any announcement but noted that since April this year, this has 
been updated:
https://software.intel.com/en-us/articles/end-user-license-agreement
=>

The EULA for Intel Software Development 
Products<https://software.intel.com/en-us/license/eula-for-intel-software-development-products>
 is the most commonly used license. Popular products it applies to include:

  *   Intel® Parallel Studio XE
  *   Intel® System Studio
  *   Intel® VTune™ Amplifier
  *   Intel® Media Server Studio

The Intel Simplified Software 
License<https://software.intel.com/en-us/license/intel-simplified-software-license>
 applies to the following products:

  *   Intel® Math Kernel Library (Intel® MKL)
  *   Intel® Integrated Performance Primitives (Intel® IPP) Library
  *   Intel® Machine Learning Scaling Library (Intel® MLSL)
  *   Intel® Data Analytics Acceleration Library (Intel® DAAL)
  *   Intel® Threading Building Blocks (Intel® TBB)
  *   Intel® Distribution for Python*
  *   Intel® MPI Library
  *   Intel® Cluster Checker
the first 4 you will need to buy licenses for (for typical HPC use that is, it 
is free for certain other use cases), but the last 8 not any more.

Bart

On Mon, 16 Jul 2018 at 11:59, Ole Holm Nielsen 
mailto:ole.h.niel...@fysik.dtu.dk>> wrote:
Hi Bart,
On 07/16/2018 05:47 PM, Bart Oldeman wrote:
> Hello Ole,
>
> as far as I can see Intel MPI is free beer now (unless you want priority
> support of course), since 2018 update 2.
> That doesn't mean iomkl is useless of course!

I don't see any free beer in the official Intel MPI homepage:
https://software.intel.com/en-us/intel-mpi-library
The trial version of the software doesn't count :-)

Do you have more details about Intel making Intel MPI freely available?

Thanks,
Ole


--
Dr. Bart E. Oldeman | bart.olde...@mcgill.ca<mailto:bart.olde...@mcgill.ca> | 
bart.olde...@calculquebec.ca<mailto:bart.olde...@calculquebec.ca>
Scientific Computing Analyst / Analyste en calcul scientifique
McGill HPC Centre / Centre de Calcul Haute Performance de McGill | 
http://www.hpc.mcgill.ca
Calcul Québec | http://www.calculquebec.ca
Compute/Calcul Canada | http://www.computecanada.ca
Tel/Tél: 514-396-8926 | Fax/Télécopieur: 514-396-8934

Re: [easybuild] iomkl-2018b toolchain availability?

[Bart Oldeman]

Hi Ole,

it says it there:
"Intel MPI Library is available as part of Intel® Parallel Studio XE
Cluster Edition and as a free stand-alone version. A license purchase
includes Priority Support."

it's a not a trial version any more if you click on the "Free Download"
button. Instead it will bring you to:
https://software.intel.com/en-us/performance-libraries
which includes MKL, Intel MPI and some other things. So you can also
construct "gimkl" without sending $$$ to Intel.

I haven't found any announcement but noted that since April this year, this
has been updated:
https://software.intel.com/en-us/articles/end-user-license-agreement
=>

The EULA for Intel Software Development Products

is the most commonly used license. Popular products it applies to include:

   - Intel® Parallel Studio XE
   - Intel® System Studio
   - Intel® VTune™ Amplifier
   - Intel® Media Server Studio

The Intel Simplified Software License

applies to the following products:

   - Intel® Math Kernel Library (Intel® MKL)
   - Intel® Integrated Performance Primitives (Intel® IPP) Library
   - Intel® Machine Learning Scaling Library (Intel® MLSL)
   - Intel® Data Analytics Acceleration Library (Intel® DAAL)
   - Intel® Threading Building Blocks (Intel® TBB)
   - Intel® Distribution for Python*
   - Intel® MPI Library
   - Intel® Cluster Checker

the first 4 you will need to buy licenses for (for typical HPC use that is,
it is free for certain other use cases), but the last 8 not any more.

Bart

On Mon, 16 Jul 2018 at 11:59, Ole Holm Nielsen 
wrote:

> Hi Bart,
> On 07/16/2018 05:47 PM, Bart Oldeman wrote:
> > Hello Ole,
> >
> > as far as I can see Intel MPI is free beer now (unless you want priority
> > support of course), since 2018 update 2.
> > That doesn't mean iomkl is useless of course!
>
> I don't see any free beer in the official Intel MPI homepage:
> https://software.intel.com/en-us/intel-mpi-library
> The trial version of the software doesn't count :-)
>
> Do you have more details about Intel making Intel MPI freely available?
>
> Thanks,
> Ole
>
>

-- 
Dr. Bart E. Oldeman | bart.olde...@mcgill.ca | bart.olde...@calculquebec.ca
Scientific Computing Analyst / Analyste en calcul scientifique
McGill HPC Centre / Centre de Calcul Haute Performance de McGill |
http://www.hpc.mcgill.ca
Calcul Québec | http://www.calculquebec.ca
Compute/Calcul Canada | http://www.computecanada.ca
Tel/Tél: 514-396-8926 | Fax/Télécopieur: 514-396-8934

Re: [easybuild] iomkl-2018b toolchain availability?

[Ole Holm Nielsen]

Hi Bart,
On 07/16/2018 05:47 PM, Bart Oldeman wrote:

Hello Ole,

as far as I can see Intel MPI is free beer now (unless you want priority 
support of course), since 2018 update 2.

That doesn't mean iomkl is useless of course!


I don't see any free beer in the official Intel MPI homepage:
https://software.intel.com/en-us/intel-mpi-library
The trial version of the software doesn't count :-)

Do you have more details about Intel making Intel MPI freely available?

Thanks,
Ole

Re: [easybuild] iomkl-2018b toolchain availability?

[Ole Holm Nielsen]

Hi Åke,

Thanks a lot, your work on iomkl will be highly appreciated!

/Ole

On 07/16/2018 05:45 PM, Åke Sandgren wrote:

I'm working on it at the moment.

On 07/16/2018 04:11 PM, Ole Holm Nielsen wrote:

Dear EasyBuilders,

Is anyone looking to create an EB file for the iomkl-2018b toolchain?

With iomkl-2018a and iomkl-2018.02.eb there were a couple of issues:
* https://github.com/easybuilders/easybuild-easyconfigs/issues/5805
* https://github.com/easybuilders/easybuild-easyconfigs/issues/6257
Hopefully these could be addressed some time soon?

We need the Intel compilers and MKL, but can't afford the Intel MPI
license.  The OpenMPI works very well for us, so iomkl is the obvious
toolchain to use.

Furthermore, we're planning an EU tender for a significant expansion of
our cluster, and the benchmarking cases are going to be based upon
EasyBuild!  Do other sites use EB in their procurement benchmarks as
well, and what are the experiences?

Re: [easybuild] iomkl-2018b toolchain availability?

[Bart Oldeman]

Hello Ole,

as far as I can see Intel MPI is free beer now (unless you want priority
support of course), since 2018 update 2.
That doesn't mean iomkl is useless of course!

>From what I can see 5805 was worked around by disabling ucx and the
upstream bug was fixed in OpenMPI 3.1.1:
commit b1bddf7642ac7a6fa6c8aac4b21861eb47a6eb03
Author: Kenneth Hoste 
Date:   Tue Jul 3 09:14:14 2018 +0200

no need to disable UCX support in OpenMPI 3.1.1 easyconfig, bug has
been fixed

6257 hasn't been addressed as far as I know, but as you noted can be easily
worked around.

Bart

On Mon, 16 Jul 2018 at 10:12, Ole Holm Nielsen 
wrote:

> Dear EasyBuilders,
>
> Is anyone looking to create an EB file for the iomkl-2018b toolchain?
>
> With iomkl-2018a and iomkl-2018.02.eb there were a couple of issues:
> * https://github.com/easybuilders/easybuild-easyconfigs/issues/5805
> * https://github.com/easybuilders/easybuild-easyconfigs/issues/6257
> Hopefully these could be addressed some time soon?
>
> We need the Intel compilers and MKL, but can't afford the Intel MPI
> license.  The OpenMPI works very well for us, so iomkl is the obvious
> toolchain to use.
>
> Furthermore, we're planning an EU tender for a significant expansion of
> our cluster, and the benchmarking cases are going to be based upon
> EasyBuild!  Do other sites use EB in their procurement benchmarks as
> well, and what are the experiences?
>
> Thanks,
> Ole
>
> --
> Ole Holm Nielsen
> PhD, Senior HPC Officer
> Department of Physics, Technical University of Denmark,
>


-- 
Dr. Bart E. Oldeman | bart.olde...@mcgill.ca | bart.olde...@calculquebec.ca
Scientific Computing Analyst / Analyste en calcul scientifique
McGill HPC Centre / Centre de Calcul Haute Performance de McGill |
http://www.hpc.mcgill.ca
Calcul Québec | http://www.calculquebec.ca
Compute/Calcul Canada | http://www.computecanada.ca
Tel/Tél: 514-396-8926 | Fax/Télécopieur: 514-396-8934

Re: [easybuild] iomkl-2018b toolchain availability?

[Åke Sandgren]

I'm working on it at the moment.

On 07/16/2018 04:11 PM, Ole Holm Nielsen wrote:
> Dear EasyBuilders,
> 
> Is anyone looking to create an EB file for the iomkl-2018b toolchain?
> 
> With iomkl-2018a and iomkl-2018.02.eb there were a couple of issues:
> * https://github.com/easybuilders/easybuild-easyconfigs/issues/5805
> * https://github.com/easybuilders/easybuild-easyconfigs/issues/6257
> Hopefully these could be addressed some time soon?
> 
> We need the Intel compilers and MKL, but can't afford the Intel MPI
> license.  The OpenMPI works very well for us, so iomkl is the obvious
> toolchain to use.
> 
> Furthermore, we're planning an EU tender for a significant expansion of
> our cluster, and the benchmarking cases are going to be based upon
> EasyBuild!  Do other sites use EB in their procurement benchmarks as
> well, and what are the experiences?
> 
> Thanks,
> Ole
> 

-- 
Ake Sandgren, HPC2N, Umea University, S-90187 Umea, Sweden
Internet: a...@hpc2n.umu.se   Phone: +46 90 7866134 Fax: +46 90-580 14
Mobile: +46 70 7716134 WWW: http://www.hpc2n.umu.se

[easybuild] iomkl-2018b toolchain availability?

[Ole Holm Nielsen]

Dear EasyBuilders,

Is anyone looking to create an EB file for the iomkl-2018b toolchain?

With iomkl-2018a and iomkl-2018.02.eb there were a couple of issues:
* https://github.com/easybuilders/easybuild-easyconfigs/issues/5805
* https://github.com/easybuilders/easybuild-easyconfigs/issues/6257
Hopefully these could be addressed some time soon?

We need the Intel compilers and MKL, but can't afford the Intel MPI 
license.  The OpenMPI works very well for us, so iomkl is the obvious 
toolchain to use.


Furthermore, we're planning an EU tender for a significant expansion of 
our cluster, and the benchmarking cases are going to be based upon 
EasyBuild!  Do other sites use EB in their procurement benchmarks as 
well, and what are the experiences?


Thanks,
Ole

--
Ole Holm Nielsen
PhD, Senior HPC Officer
Department of Physics, Technical University of Denmark,