Miguel Dias Costa <[email protected]> 于2020年2月19日周三 下午12:38写道： > > Hello Hongsheng, > > On 19/02/2020 11:23, Hongyi Zhao wrote: > > Hi, > > > > Say for the following: > > $ eb Python-3.7.0-foss-2018b.eb > > > > The above command depends on many tarballs, > > Do you already have the toolchain foss/2018b installed? If not, eb will > need to download and build it from scratch, and that will take some > time, but only for the first time.
Yes, I don' have the dependent toolchain installed at the moment of running this command. > > > and the downloading > > process with the eb is so slow. > It shouldn't be slower than any other process from the same system.... > maybe you are running from a node without internet access, or filtered? The internet access is good -- I've a 300 MiBps FTTH on this computer. > > Is there some method for me to let eb > > output all of the used source tarballs urls? > > "eb Python-3.7.0-foss-2018b.eb --fetch -x" might help, The install process has run for about one hour and still stuck on fetching, and I see the following error info finally: $ eb Python-3.7.0-foss-2018b.eb == temporary log file in case of crash /tmp/eb-zDpAwz/easybuild-vFt8Eh.log == processing EasyBuild easyconfig /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs/p/Python/Python-3.7.0-foss-2018b.eb == building and installing Python/3.7.0-foss-2018b... == fetching files... == FAILED: Installation ended unsuccessfully (build directory: /home/werner/.local/easybuild/build/Python/3.7.0/foss-2018b): build failed (first 300 chars): Couldn't find file pandas-0.23.3.tar.gz anywhere, and downloading it didn't work either... Paths attempted (in order): /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs/p/Python/p/Python/extensions/pandas-0.23.3.tar.gz, /home/werner/Public/ (took 38 min 33 sec) == Results of the build can be found in the log file(s) /tmp/eb-zDpAwz/easybuild-Python-3.7.0-20200219.121409.sozkk.log ERROR: Build of /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs/p/Python/Python-3.7.0-foss-2018b.eb failed (err: "build failed (first 300 chars): Couldn't find file pandas-0.23.3.tar.gz anywhere, and downloading it didn't work either... Paths attempted (in order): /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs/p/Python/p/Python/extensions/pandas-0.23.3.tar.gz, /home/werner/Public/") Furthermore, with the command you suggested, I get the following: To be note: this command running about 2 mins to get the output as following, so solw!!! $ eb Python-3.7.0-foss-2018b.eb --fetch -x == temporary log file in case of crash /tmp/eb-j5H_Ff/easybuild-60oZy3.log file /tmp/eb-j5H_Ff/fake_vsc_d8olSz removed == processing EasyBuild easyconfig /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs/p/Python/Python-3.7.0-foss-2018b.eb Important note: the actual build & install procedure that will be performed may diverge (slightly) from what is outlined below, due to conditions in the easyblock which are incorrectly handled in a dry run. Any errors that may occur are ignored and reported as warnings, on a per-step basis. Please be aware of this, and only use the information below for quick debugging purposes. *** DRY RUN using 'EB_Python' easyblock (easybuild.easyblocks.python @ /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyblocks/easybuild/easyblocks/p/python.pyo) *** == building and installing Python/3.7.0-foss-2018b... fetching files... [DRY RUN] [fetch_step method] Available download URLs for sources/patches: * https://www.python.org/ftp/python/3.7.0//$source List of sources: * Python-3.7.0.tgz found at /home/werner/.local/easybuild/sources/p/Python/Python-3.7.0.tgz List of patches: * Python-3.7-faulthandler.patch found at /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs/p/Python/Python-3.7-faulthandler.patch List of sources/patches for extensions: * setuptools-39.2.0.zip found at /home/werner/.local/easybuild/sources/p/Python/extensions/setuptools-39.2.0.zip * pip-10.0.1.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/pip-10.0.1.tar.gz * nose-1.3.7.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/nose-1.3.7.tar.gz * numpy-1.14.5.zip found at /home/werner/.local/easybuild/sources/p/Python/extensions/numpy-1.14.5.zip * scipy-1.1.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/scipy-1.1.0.tar.gz * blist-1.3.6.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/blist-1.3.6.tar.gz * mpi4py-3.0.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/mpi4py-3.0.0.tar.gz * paycheck-1.0.2.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/paycheck-1.0.2.tar.gz * paycheck-1.0.2_setup-open-README-utf8.patch found at /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs/p/Python/paycheck-1.0.2_setup-open-README-utf8.patch * pbr-4.0.4.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/pbr-4.0.4.tar.gz * Cython-0.28.3.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/Cython-0.28.3.tar.gz * six-1.11.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/six-1.11.0.tar.gz * setuptools_scm-3.2.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/setuptools_scm-3.2.0.tar.gz * python-dateutil-2.7.3.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/python-dateutil-2.7.3.tar.gz * deap-1.2.2.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/deap-1.2.2.tar.gz * decorator-4.3.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/decorator-4.3.0.tar.gz * liac-arff-2.2.2.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/liac-arff-2.2.2.tar.gz * pycrypto-2.6.1.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/pycrypto-2.6.1.tar.gz * ecdsa-0.13.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/ecdsa-0.13.tar.gz * pycparser-2.18.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/pycparser-2.18.tar.gz * cffi-1.11.5.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/cffi-1.11.5.tar.gz * asn1crypto-0.24.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/asn1crypto-0.24.0.tar.gz * idna-2.7.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/idna-2.7.tar.gz * cryptography-2.2.2.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/cryptography-2.2.2.tar.gz * pyasn1-0.4.3.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/pyasn1-0.4.3.tar.gz * PyNaCl-1.2.1.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/PyNaCl-1.2.1.tar.gz * bcrypt-3.1.4.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/bcrypt-3.1.4.tar.gz * paramiko-2.4.1.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/paramiko-2.4.1.tar.gz * pyparsing-2.2.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/pyparsing-2.2.0.tar.gz * netifaces-0.10.7.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/netifaces-0.10.7.tar.gz * netaddr-0.7.19.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/netaddr-0.7.19.tar.gz * mock-2.0.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/mock-2.0.0.tar.gz * pytz-2018.4.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/pytz-2018.4.tar.gz file written: /tmp/eb-j5H_Ff/tmpgaIUgV/pandas_urls.html !!! !!! WARNING: ignoring error [Errno 2] No such file or directory: '/tmp/eb-j5H_Ff/tmpgaIUgV/pandas_urls.html' !!! == COMPLETED: Installation ended successfully (took 1 min 2 sec) Important note: the actual build & install procedure that will be performed may diverge (slightly) from what is outlined above, due to conditions in the easyblock which are incorrectly handled in a dry run. Any errors that may occur are ignored and reported as warnings, on a per-step basis. Please be aware of this, and only use the information above for quick debugging purposes. !!! !!! WARNING: One or more errors were ignored, see warnings above !!! == Build succeeded for 1 out of 1 == Temporary log file(s) /tmp/eb-j5H_Ff/easybuild-60oZy3.log* have been removed. == Temporary directory /tmp/eb-j5H_Ff has been removed. werner@ubuntu-01:~$ eb Python-3.7.0-foss-2018b.eb --fetch -x == temporary log file in case of crash /tmp/eb-BdpDG5/easybuild-trtTqI.log file /tmp/eb-BdpDG5/fake_vsc_bWzGAF removed == processing EasyBuild easyconfig /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs/p/Python/Python-3.7.0-foss-2018b.eb Important note: the actual build & install procedure that will be performed may diverge (slightly) from what is outlined below, due to conditions in the easyblock which are incorrectly handled in a dry run. Any errors that may occur are ignored and reported as warnings, on a per-step basis. Please be aware of this, and only use the information below for quick debugging purposes. *** DRY RUN using 'EB_Python' easyblock (easybuild.easyblocks.python @ /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyblocks/easybuild/easyblocks/p/python.pyo) *** == building and installing Python/3.7.0-foss-2018b... fetching files... [DRY RUN] [fetch_step method] Available download URLs for sources/patches: * https://www.python.org/ftp/python/3.7.0//$source List of sources: * Python-3.7.0.tgz found at /home/werner/.local/easybuild/sources/p/Python/Python-3.7.0.tgz List of patches: * Python-3.7-faulthandler.patch found at /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs/p/Python/Python-3.7-faulthandler.patch List of sources/patches for extensions: * setuptools-39.2.0.zip found at /home/werner/.local/easybuild/sources/p/Python/extensions/setuptools-39.2.0.zip * pip-10.0.1.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/pip-10.0.1.tar.gz * nose-1.3.7.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/nose-1.3.7.tar.gz * numpy-1.14.5.zip found at /home/werner/.local/easybuild/sources/p/Python/extensions/numpy-1.14.5.zip * scipy-1.1.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/scipy-1.1.0.tar.gz * blist-1.3.6.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/blist-1.3.6.tar.gz * mpi4py-3.0.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/mpi4py-3.0.0.tar.gz * paycheck-1.0.2.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/paycheck-1.0.2.tar.gz * paycheck-1.0.2_setup-open-README-utf8.patch found at /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs/p/Python/paycheck-1.0.2_setup-open-README-utf8.patch * pbr-4.0.4.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/pbr-4.0.4.tar.gz * Cython-0.28.3.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/Cython-0.28.3.tar.gz * six-1.11.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/six-1.11.0.tar.gz * setuptools_scm-3.2.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/setuptools_scm-3.2.0.tar.gz * python-dateutil-2.7.3.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/python-dateutil-2.7.3.tar.gz * deap-1.2.2.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/deap-1.2.2.tar.gz * decorator-4.3.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/decorator-4.3.0.tar.gz * liac-arff-2.2.2.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/liac-arff-2.2.2.tar.gz * pycrypto-2.6.1.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/pycrypto-2.6.1.tar.gz * ecdsa-0.13.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/ecdsa-0.13.tar.gz * pycparser-2.18.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/pycparser-2.18.tar.gz * cffi-1.11.5.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/cffi-1.11.5.tar.gz * asn1crypto-0.24.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/asn1crypto-0.24.0.tar.gz * idna-2.7.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/idna-2.7.tar.gz * cryptography-2.2.2.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/cryptography-2.2.2.tar.gz * pyasn1-0.4.3.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/pyasn1-0.4.3.tar.gz * PyNaCl-1.2.1.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/PyNaCl-1.2.1.tar.gz * bcrypt-3.1.4.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/bcrypt-3.1.4.tar.gz * paramiko-2.4.1.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/paramiko-2.4.1.tar.gz * pyparsing-2.2.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/pyparsing-2.2.0.tar.gz * netifaces-0.10.7.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/netifaces-0.10.7.tar.gz * netaddr-0.7.19.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/netaddr-0.7.19.tar.gz * mock-2.0.0.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/mock-2.0.0.tar.gz * pytz-2018.4.tar.gz found at /home/werner/.local/easybuild/sources/p/Python/extensions/pytz-2018.4.tar.gz file written: /tmp/eb-BdpDG5/tmpejBxsc/pandas_urls.html !!! !!! WARNING: ignoring error [Errno 2] No such file or directory: '/tmp/eb-BdpDG5/tmpejBxsc/pandas_urls.html' !!! == COMPLETED: Installation ended successfully (took 1 min 9 sec) Important note: the actual build & install procedure that will be performed may diverge (slightly) from what is outlined above, due to conditions in the easyblock which are incorrectly handled in a dry run. Any errors that may occur are ignored and reported as warnings, on a per-step basis. Please be aware of this, and only use the information above for quick debugging purposes. !!! !!! WARNING: One or more errors were ignored, see warnings above !!! == Build succeeded for 1 out of 1 == Temporary log file(s) /tmp/eb-BdpDG5/easybuild-trtTqI.log* have been removed. == Temporary directory /tmp/eb-BdpDG5 has been removed. ps. I use the lastest git version of easybuild installed based on the following script: https://raw.githubusercontent.com/easybuilders/easybuild-framework/master/easybuild/scripts/install-EasyBuild-develop.sh The real-used script is slightly revised by me based on the above script. mainly for directly clone from the corresponding repos instead of fork them firstly. Regards > eventually with > "-r" to also see tarballs from dependencies > > (--fetch means download only, you can use this from another node with > internet access, if that's the problem, and -x means extended-dry-run, > show only what would be done) > > Best, > > Miguel > > -- Hongsheng Zhao <[email protected]> Institute of Semiconductors, Chinese Academy of Sciences GnuPG DSA: 0xD108493
