Hello Todd, it seems like the python you are using to run EasyBuild has not been compiled with ssl support.
You can check this by checking if you can import the _ssl module import _ssl I just tested this on 3 different systems, and they seem to work. I noticed pypi has a 301 permanently moved in place for all the http requests, so https is mandatory. I'm not sure how recently that has happened. I also noticed we don't put OpenSSL as a dependency for the python easyconfigs we ship, so the pythons built with easybuild will have this behaviour if there is no libssl and header files on the system. maybe we should fix that? Regards Jens Timmerman ps http://stackoverflow.com/questions/2875402/does-urllib-or-urllib2-in-python-2-5-support-https On 02/11/2014 06:37 PM, Heywood, Todd wrote: > First, thanks for help on the earlier issue of module unloading, so that I > can give you guys another issue :-). > > I am trying to build new versions of Python and R, and have long lists of > required modules and packages. I¹m adding lines under the exts_list > section of .eb files. > > I often get crashes due to "unknown url type² errors, which I think come > from modules/packages trying to go find moudles/packages they depend on, > and download them. I have been able to get by some by finding exact URL¹s > and versions for dependencies and putting lines in the exts_list for these > before the module/package in question. However, this is not working for > one Python module I¹m trying to install now, and I figure I should ask > about the real issue here instead of just trying to work around it. > > So, trying to install the matplotlib Python module with (eb ‹robot) with > this: > > ('matplotlib', '1.3.1', { > 'source_urls': > ['https://downloads.sourceforge.net/project/matplotlib/matplotlib/matplotli > b-1.3.1/'], > }), > > The output, and log file excerpt are below. Matplotlib is apparently > trying to download the ³distribute² dependency module. So I put this line > above the matplotlib line: > > ('distribute', '0.6.28', { > 'source_urls': ['https://pypi.python.org/packages/source/d/distribute/'], > }), > > > But the eaasybuild install still crashes with the same error. > > Output from build: > > == taking care of extensions... > ERROR: EasyBuild encountered an exception (at > easybuild/software/EasyBuild/1.10.0/lib/python2.7/site-packages/easybuild_f > ramework-1.10.0-py2.7.egg/easybuild/main.py:809 in > build_and_install_software): autoBuild Failed (last 300 chars): > D/lib/python2.7/urllib2.py", line 382, in _call_chain > result = func(*args) > File > "/opt/eb/software/Python/2.7.5-goalf-1.5.12-no-OFED/lib/python2.7/urllib2.p > y", line 1247, in unknown_open > raise URLError('unknown url type: %s' % type) > urllib2.URLError: <urlopen error unknown url type: https> > > > > From the log file: > > == 2014-02-11 11:35:44,089 main.filetools ERROR EasyBuild crashed with an > error (at > easybuild/software/EasyBuild/1.10.0/lib/python2.7/site-packages/easybuild_f > ramework-1.10.0-py2.7.egg/easybuild/tools/fil\ > etools.py:799 in parse_cmd_output): cmd "python setup.py build" exited > with exitcode 1 and output: > Downloading > http://pypi.python.org/packages/source/d/distribute/distribute-0.6.28.tar.g > z > Traceback (most recent call last): > File "setup.py", line 10, in <module> > use_setuptools() > File > "/sonas-hs/it/hpc/home/eb/build/Python/2.7.5/goalf-1.5.12-no-OFED.10/matplo > tlib/matplotlib-1.3.1/distribute_setup.py", line 163, in use_setuptools > return _do_download(version, download_base, to_dir, download_delay) > File > "/sonas-hs/it/hpc/home/eb/build/Python/2.7.5/goalf-1.5.12-no-OFED.10/matplo > tlib/matplotlib-1.3.1/distribute_setup.py", line 132, in _do_download > to_dir, download_delay) > File > "/sonas-hs/it/hpc/home/eb/build/Python/2.7.5/goalf-1.5.12-no-OFED.10/matplo > tlib/matplotlib-1.3.1/distribute_setup.py", line 212, in > download_setuptools > src = urlopen(url) > File > "/opt/eb/software/Python/2.7.5-goalf-1.5.12-no-OFED/lib/python2.7/urllib2.p > y", line 127, in urlopen > return _opener.open(url, data, timeout) > File > "/opt/eb/software/Python/2.7.5-goalf-1.5.12-no-OFED/lib/python2.7/urllib2.p > y", line 410, in open > response = meth(req, response) > File > "/opt/eb/software/Python/2.7.5-goalf-1.5.12-no-OFED/lib/python2.7/urllib2.p > y", line 523, in http_response > 'http', request, response, code, msg, hdrs) > File > "/opt/eb/software/Python/2.7.5-goalf-1.5.12-no-OFED/lib/python2.7/urllib2.p > y", line 442, in error > result = self._call_chain(*args) > File > "/opt/eb/software/Python/2.7.5-goalf-1.5.12-no-OFED/lib/python2.7/urllib2.p > y", line 382, in _call_chain > result = func(*args) > File > "/opt/eb/software/Python/2.7.5-goalf-1.5.12-no-OFED/lib/python2.7/urllib2.p > y", line 629, in http_error_302 > return self.parent.open(new, timeout=req.timeout) > File > "/opt/eb/software/Python/2.7.5-goalf-1.5.12-no-OFED/lib/python2.7/urllib2.p > y", line 404, in open > response = self._open(req, data) > File > "/opt/eb/software/Python/2.7.5-goalf-1.5.12-no-OFED/lib/python2.7/urllib2.p > y", line 427, in _open > 'unknown_open', req) > File > "/opt/eb/software/Python/2.7.5-goalf-1.5.12-no-OFED/lib/python2.7/urllib2.p > y", line 382, in _call_chain > result = func(*args) > File > "/opt/eb/software/Python/2.7.5-goalf-1.5.12-no-OFED/lib/python2.7/urllib2.p > y", line 1247, in unknown_open > raise URLError('unknown url type: %s' % type) > urllib2.URLError: <urlopen error unknown url type: https> > > == 2014-02-11 11:35:44,090 main ERROR EasyBuild crashed with an error (at > easybuild/software/EasyBuild/1.10.0/lib/python2.7/site-packages/easybuild_f > ramework-1.10.0-py2.7.egg/easybuild/tools/build_log.py:\ > 96 in exception): EasyBuild encountered an exception (at > easybuild/software/EasyBuild/1.10.0/lib/python2.7/site-packages/easybuild_f > ramework-1.10.0-py2.7.egg/easybuild/main.py:809 in build_and_install_sof\ > tware): autoBuild Failed (last 300 chars): D/lib/python2.7/urllib2.py", > line 382, in _call_chain > result = func(*args) > File > "/opt/eb/software/Python/2.7.5-goalf-1.5.12-no-OFED/lib/python2.7/urllib2.p > y", line 1247, in unknown_open > raise URLError('unknown url type: %s' % type) > urllib2.URLError: <urlopen error unknown url type: https> > > > > > Any ideas? Both for this specific module, and the fact that ³unknown url > type² is very common? > > Thanks, > > Todd >
