RE: [easybuild] EB for Intel Distribution for Python?

[Siddiqui, Shahzeb]

Hi Jack,

Can you please send us the easyconfig file so that I can try it out.

Thanks,

-Original Message-
From: easybuild-requ...@lists.ugent.be 
[mailto:easybuild-requ...@lists.ugent.be] On Behalf Of Jack Perdue
Sent: Friday, January 20, 2017 9:54 AM
To: easybuild@lists.ugent.be
Subject: Re: [easybuild] EB for Intel Distribution for Python?

On 01/20/2017 08:01 AM, Kenneth Hoste wrote:
>
> On 20/01/2017 14:56, Jack Perdue wrote:
>> On 01/20/2017 07:31 AM, Siddiqui, Shahzeb wrote:
>>> Ken,
>>>
>>> Can you have your team look into this issue, try to build 
>>> Intel-Python I have provided and get a working solution.
>>>
>>> Thanks
>>>
>>> -Original Message-
>>> From: easybuild-requ...@lists.ugent.be 
>>> [mailto:easybuild-requ...@lists.ugent.be] On Behalf Of Ole Holm 
>>> Nielsen
>>> Sent: Thursday, January 19, 2017 10:00 AM
>>> To: easybuild@lists.ugent.be
>>> Subject: Re: [easybuild] EB for Intel Distribution for Python?
>>>
>>> On 01/19/2017 03:39 PM, Siddiqui, Shahzeb wrote:
>>>> Please see issue:
>>>>
>>>> https://github.com/hpcugent/easybuild-easyconfigs/issues/3922
>>>>
>>>> I tried to build intel-python with IntelBase, it seems to be a 
>>>> trivial issue with license. Not sure how to fix this.
>>>>
>>>> Can you please provide input on this
>>> Yes, I hit the same issue with Intel licenses a while ago, and the 
>>> configuration is described in my Wiki page:
>>> https://wiki.fysik.dtu.dk/niflheim/EasyBuild_modules#intel-compiler-
>>> toolchains
>>>
>>>
>>> I hope this helps,
>>> Ole
>>
>> I had no issue with the Intel Python easyconfig I posted two days ago 
>> but I have this setup:
>>
>> $ env | grep INTEL
>> INTEL_LICENSE_FILE=/sw/hprc/local/etc/licenses/intel
>>
>> $ ls -l /sw/hprc/local/etc/licenses/intel total 0
>> -r--r--r-- 1 j-perdue j-perdue 51 Nov  1 14:24 intel.lic
>>
>> Didn't realize the Intel Python needed that.
>
> I replied into Shahzeb's issue at
> https://github.com/hpcugent/easybuild-easyconfigs/issues/3922 .
>
> It seems like the Intel Python installer trips over having 
> ACTIVATION_TYPE or ACTIVATION_LICENSE_FILE in the slient.cfg.
>
> So, it probably does *not* require a license file at install time?
>

I guess I didn't hit that issue since I used the ConfigureMake easyblock (which 
is one of the bestest easyblocks in the world [along with CmakeMake] and just 
about all one really needs). ;)

jack (who hates hiding info in module specific easyblocks)

Re: [easybuild] EB for Intel Distribution for Python?

[Jack Perdue]

On 01/20/2017 08:01 AM, Kenneth Hoste wrote:


On 20/01/2017 14:56, Jack Perdue wrote:

On 01/20/2017 07:31 AM, Siddiqui, Shahzeb wrote:

Ken,

Can you have your team look into this issue, try to build 
Intel-Python I have provided and get a working solution.


Thanks

-Original Message-
From: easybuild-requ...@lists.ugent.be 
[mailto:easybuild-requ...@lists.ugent.be] On Behalf Of Ole Holm Nielsen

Sent: Thursday, January 19, 2017 10:00 AM
To: easybuild@lists.ugent.be
Subject: Re: [easybuild] EB for Intel Distribution for Python?

On 01/19/2017 03:39 PM, Siddiqui, Shahzeb wrote:

Please see issue:

https://github.com/hpcugent/easybuild-easyconfigs/issues/3922

I tried to build intel-python with IntelBase, it seems to be a 
trivial issue with license. Not sure how to fix this.


Can you please provide input on this
Yes, I hit the same issue with Intel licenses a while ago, and the 
configuration is described in my Wiki page:
https://wiki.fysik.dtu.dk/niflheim/EasyBuild_modules#intel-compiler-toolchains 



I hope this helps,
Ole


I had no issue with the Intel Python easyconfig I posted two days
ago but I have this setup:

$ env | grep INTEL
INTEL_LICENSE_FILE=/sw/hprc/local/etc/licenses/intel

$ ls -l /sw/hprc/local/etc/licenses/intel
total 0
-r--r--r-- 1 j-perdue j-perdue 51 Nov  1 14:24 intel.lic

Didn't realize the Intel Python needed that.


I replied into Shahzeb's issue at 
https://github.com/hpcugent/easybuild-easyconfigs/issues/3922 .


It seems like the Intel Python installer trips over having 
ACTIVATION_TYPE or ACTIVATION_LICENSE_FILE in the slient.cfg.


So, it probably does *not* require a license file at install time?



I guess I didn't hit that issue since I used the ConfigureMake
easyblock (which is one of the bestest easyblocks in the world
[along with CmakeMake] and just about all one really needs). ;)

jack (who hates hiding info in module specific easyblocks)

Re: [easybuild] EB for Intel Distribution for Python?

[Kenneth Hoste]

On 20/01/2017 14:56, Jack Perdue wrote:

On 01/20/2017 07:31 AM, Siddiqui, Shahzeb wrote:

Ken,

Can you have your team look into this issue, try to build 
Intel-Python I have provided and get a working solution.


Thanks

-Original Message-
From: easybuild-requ...@lists.ugent.be 
[mailto:easybuild-requ...@lists.ugent.be] On Behalf Of Ole Holm Nielsen

Sent: Thursday, January 19, 2017 10:00 AM
To: easybuild@lists.ugent.be
Subject: Re: [easybuild] EB for Intel Distribution for Python?

On 01/19/2017 03:39 PM, Siddiqui, Shahzeb wrote:

Please see issue:

https://github.com/hpcugent/easybuild-easyconfigs/issues/3922

I tried to build intel-python with IntelBase, it seems to be a 
trivial issue with license. Not sure how to fix this.


Can you please provide input on this
Yes, I hit the same issue with Intel licenses a while ago, and the 
configuration is described in my Wiki page:
https://wiki.fysik.dtu.dk/niflheim/EasyBuild_modules#intel-compiler-toolchains 



I hope this helps,
Ole


I had no issue with the Intel Python easyconfig I posted two days
ago but I have this setup:

$ env | grep INTEL
INTEL_LICENSE_FILE=/sw/hprc/local/etc/licenses/intel

$ ls -l /sw/hprc/local/etc/licenses/intel
total 0
-r--r--r-- 1 j-perdue j-perdue 51 Nov  1 14:24 intel.lic

Didn't realize the Intel Python needed that.


I replied into Shahzeb's issue at 
https://github.com/hpcugent/easybuild-easyconfigs/issues/3922 .


It seems like the Intel Python installer trips over having 
ACTIVATION_TYPE or ACTIVATION_LICENSE_FILE in the slient.cfg.


So, it probably does *not* require a license file at install time?


K.

Re: [easybuild] EB for Intel Distribution for Python?

[Jack Perdue]

On 01/20/2017 07:31 AM, Siddiqui, Shahzeb wrote:

Ken,

Can you have your team look into this issue, try to build Intel-Python I have 
provided and get a working solution.

Thanks

-Original Message-
From: easybuild-requ...@lists.ugent.be 
[mailto:easybuild-requ...@lists.ugent.be] On Behalf Of Ole Holm Nielsen
Sent: Thursday, January 19, 2017 10:00 AM
To: easybuild@lists.ugent.be
Subject: Re: [easybuild] EB for Intel Distribution for Python?

On 01/19/2017 03:39 PM, Siddiqui, Shahzeb wrote:

Please see issue:

https://github.com/hpcugent/easybuild-easyconfigs/issues/3922

I tried to build intel-python with IntelBase, it seems to be a trivial issue 
with license. Not sure how to fix this.

Can you please provide input on this

Yes, I hit the same issue with Intel licenses a while ago, and the 
configuration is described in my Wiki page:
https://wiki.fysik.dtu.dk/niflheim/EasyBuild_modules#intel-compiler-toolchains

I hope this helps,
Ole


I had no issue with the Intel Python easyconfig I posted two days
ago but I have this setup:

$ env | grep INTEL
INTEL_LICENSE_FILE=/sw/hprc/local/etc/licenses/intel

$ ls -l /sw/hprc/local/etc/licenses/intel
total 0
-r--r--r-- 1 j-perdue j-perdue 51 Nov  1 14:24 intel.lic

Didn't realize the Intel Python needed that.

jack

RE: [easybuild] EB for Intel Distribution for Python?

[Siddiqui, Shahzeb]

Ken,

Can you have your team look into this issue, try to build Intel-Python I have 
provided and get a working solution. 

Thanks

-Original Message-
From: easybuild-requ...@lists.ugent.be 
[mailto:easybuild-requ...@lists.ugent.be] On Behalf Of Ole Holm Nielsen
Sent: Thursday, January 19, 2017 10:00 AM
To: easybuild@lists.ugent.be
Subject: Re: [easybuild] EB for Intel Distribution for Python?

On 01/19/2017 03:39 PM, Siddiqui, Shahzeb wrote:
> Please see issue:
>
> https://github.com/hpcugent/easybuild-easyconfigs/issues/3922
>
> I tried to build intel-python with IntelBase, it seems to be a trivial issue 
> with license. Not sure how to fix this.
>
> Can you please provide input on this

Yes, I hit the same issue with Intel licenses a while ago, and the 
configuration is described in my Wiki page:
https://wiki.fysik.dtu.dk/niflheim/EasyBuild_modules#intel-compiler-toolchains

I hope this helps,
Ole

Re: [easybuild] EB for Intel Distribution for Python?

[Ole Holm Nielsen]

On 01/19/2017 03:39 PM, Siddiqui, Shahzeb wrote:

Please see issue:

https://github.com/hpcugent/easybuild-easyconfigs/issues/3922

I tried to build intel-python with IntelBase, it seems to be a trivial issue 
with license. Not sure how to fix this.

Can you please provide input on this


Yes, I hit the same issue with Intel licenses a while ago, and the 
configuration is described in my Wiki page:

https://wiki.fysik.dtu.dk/niflheim/EasyBuild_modules#intel-compiler-toolchains

I hope this helps,
Ole

RE: [easybuild] EB for Intel Distribution for Python?

[Siddiqui, Shahzeb]

Hi Kenneth & Ole,

Please see issue:

https://github.com/hpcugent/easybuild-easyconfigs/issues/3922

I tried to build intel-python with IntelBase, it seems to be a trivial issue 
with license. Not sure how to fix this.

Can you please provide input on this
-Original Message-
From: easybuild-requ...@lists.ugent.be 
[mailto:easybuild-requ...@lists.ugent.be] On Behalf Of Kenneth Hoste
Sent: Wednesday, January 18, 2017 10:10 AM
To: easybuild@lists.ugent.be
Subject: Re: [easybuild] EB for Intel Distribution for Python?

Hi Ole,

On 18/01/2017 09:51, Ole Holm Nielsen wrote:
> I would like to provide an EB module for "Intel Distribution for 
> Python", see 
> https://software.intel.com/en-us/intel-distribution-for-python.
> However, Intel Python isn't on the EB List of supported software.
>
> Question: Does anyone have EB files for creating modules of Intel 
> Python 2.7 and 3.5?

I haven't look into it, but my suspicion/hope is that you should be able to use 
the generic IntelBase easyblock to install Intel Python.

I'm interested to take a look into it, especially how it compares with the 
Python installations on top of Intel compilers & Intel MKL we do via EasyBuild.

Seems like https://github.com/IntelPython/ibench could be a good way of 
benchmarking performance there.

Funny story: I was helping out someone on the Intel Python team to get scipy to 
build (correctly) with Intel compilers a couple of months ago... ;-)


regards,

Kenneth

Re: [easybuild] EB for Intel Distribution for Python?

[Jack Perdue]

On 01/18/2017 09:09 AM, Kenneth Hoste wrote:
On 18/01/2017 09:51, Ole Holm Nielsen wrote:
I would like to provide an EB module for "Intel Distribution for 
Python", see 
https://software.intel.com/en-us/intel-distribution-for-python. 
However, Intel Python isn't on the EB List of supported software.


Question: Does anyone have EB files for creating modules of Intel 
Python 2.7 and 3.5?


I haven't look into it, but my suspicion/hope is that you should be 
able to use the generic IntelBase easyblock to install Intel Python.


I'm interested to take a look into it, especially how it compares with 
the Python installations on top of Intel compilers & Intel MKL we do 
via EasyBuild.


Seems like https://github.com/IntelPython/ibench could be a good way 
of benchmarking performance there.


Funny story: I was helping out someone on the Intel Python team to get 
scipy to build (correctly) with Intel compilers a couple of months 
ago... ;-)



Howdy Ole,

FWIW, attached is a quick hack that Kenneth would never ever
approve of for _SO_ many reasons (many of them quite right).  :)

But if you just want to slap the Intel Python on your system
using EB, it should work.  Just change the version from '2.7.12'
to '3.5.2' if you want the newer one.

jack (who see no reason for an easyblock [I did try rpm.py], but does
see LOTS of problems with all the libraries the Intel Python 
provides)
# Authors:: Jack Perdue  - TAMU HPRC - http://hprc.tamu.edu

easyblock = 'ConfigureMake'

name = 'Python'
version = '2.7.12'
pysver = ''.join(version.split('.')[:2])
relver = '2017.0.035'
versionsuffix = '-%s' % relver

homepage = 'https://software.intel.com/en-us/intel-distribution-for-python'
description = """
 Intel® Distribution for Python. Powered by Anaconda.
 Accelerating Python* performance on modern architectures from Intel.

 To activate virtual environment (for user modules), run: source $PYACTIVATE

"""

# l_python27_pu_2017.0.035.tgz
sources = ['l_python%s_pu_%s.tgz' % (pysver, relver)]

toolchain = {'name': 'dummy', 'version': 'dummy'}

skipsteps = ['configure', 'build']

preinstallopts = """
cat >> easybuild.cfg << EEOOFF
ACCEPT_EULA=accept
CONTINUE_WITH_OPTIONAL_ERROR=yes
PSET_INSTALL_DIR=%(installdir)s
CONTINUE_WITH_INSTALLDIR_OVERWRITE=yes
COMPONENTS=ALL
PSET_MODE=install
NONRPM_DB_DIR=%(installdir)s
SIGNING_ENABLED=yes
EEOOFF
echo -e "install:\n\t ./install.sh --SHARED_INSTALL -s ./easybuild.cfg" > 
Makefile
"""

# unfortunately, there isn't an obvious way to remove the intelpython27 part of 
the install path

sanity_check_paths = {
'dirs': ['intelpython%s/%s' % (pysver, x) for x in ['bin', 'etc', 
'include', 'lib']],
'files': ['intelpython%s/bin/ipython' % pysver],
}

modextravars = {
'CONDA_DEFAULT_ENV': 'root',
}

modextrapaths = {
'CONDA_PREFIX': 'intelpython%s' % pysver,
'PATH': 'intelpython%s/bin' % pysver,
'LD_LIBRARY_PATH': 'intelpython%s/lib' % pysver,
'PYACTIVATE': 'intelpython%s/bin/activate' % pysver,
}

moduleclass = 'lang'
# EOF

Re: [easybuild] EB for Intel Distribution for Python?

[Kenneth Hoste]

Hi Ole,

On 18/01/2017 09:51, Ole Holm Nielsen wrote:
I would like to provide an EB module for "Intel Distribution for 
Python", see 
https://software.intel.com/en-us/intel-distribution-for-python. 
However, Intel Python isn't on the EB List of supported software.


Question: Does anyone have EB files for creating modules of Intel 
Python 2.7 and 3.5?


I haven't look into it, but my suspicion/hope is that you should be able 
to use the generic IntelBase easyblock to install Intel Python.


I'm interested to take a look into it, especially how it compares with 
the Python installations on top of Intel compilers & Intel MKL we do via 
EasyBuild.


Seems like https://github.com/IntelPython/ibench could be a good way of 
benchmarking performance there.


Funny story: I was helping out someone on the Intel Python team to get 
scipy to build (correctly) with Intel compilers a couple of months 
ago... ;-)



regards,

Kenneth

[easybuild] EB for Intel Distribution for Python?

[Ole Holm Nielsen]

I would like to provide an EB module for "Intel Distribution for 
Python", see 
https://software.intel.com/en-us/intel-distribution-for-python. 
However, Intel Python isn't on the EB List of supported software.


Question: Does anyone have EB files for creating modules of Intel Python 
2.7 and 3.5?


Thanks,
Ole