Regarding the download issues, although there are alternatives (manually
download, change source_urls and templates, etc.), if the issue is
simply that it's slow I'd recommend using "eb Python-3.7.0-foss-2018b.eb
-r --fetch" and leave it running for now
Regarding the problem with building GCCcore, the actual error should be
in the log file
(/tmp/eb-kp_C77/easybuild-GCCcore-7.3.0-20200219.153523.iobNF.log), can
you have a look there?
Miguel
On 19/02/2020 15:42, Hongyi Zhao wrote:
I try to use a locally http proxy to do the job as following, but
still failed as follows:
$ http_proxy="127.0.0.1:8118" eb Python-3.7.0-foss-2018b.eb -r --rebuild
== temporary log file in case of crash /tmp/eb-kp_C77/easybuild-PNMkIf.log
== resolving dependencies ...
== processing EasyBuild easyconfig
/home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs/g/GCCcore/GCCcore-7.3.0.eb
== building and installing GCCcore/7.3.0...
== fetching files...
== creating build dir, resetting environment...
== unpacking...
== patching...
== preparing...
== configuring...
== building...
== FAILED: Installation ended unsuccessfully (build directory:
/home/werner/.local/easybuild/build/GCCcore/7.3.0/system-system):
build failed (first 300 chars): cmd " make -j 48 " exited with exit
code 2 and output:
make[1]: Entering directory
'/home/werner/.local/easybuild/build/GCCcore/7.3.0/system-system/gcc-7.3.0/stage1_obj'
mkdir -p -- ./intl
mkdir -p -- ./gmp
mkdir -p -- ./libiberty
mkdir -p -- ./fixincludes
mkdir -p -- ./libdecnumber
mkdir -p -- ./lt (took 2 min 19 sec)
== Results of the build can be found in the log file(s)
/tmp/eb-kp_C77/easybuild-GCCcore-7.3.0-20200219.153523.iobNF.log
ERROR: Build of
/home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs/g/GCCcore/GCCcore-7.3.0.eb
failed (err: 'build failed (first 300 chars): cmd " make -j 48 "
exited with exit code 2 and output:\nmake[1]: Entering directory
\'/home/werner/.local/easybuild/build/GCCcore/7.3.0/system-system/gcc-7.3.0/stage1_obj\'\nmkdir
-p -- ./intl\nmkdir -p -- ./gmp\nmkdir -p -- ./libiberty\nmkdir -p --
./fixincludes\nmkdir -p -- ./libdecnumber\nmkdir -p -- ./lt')
Other info for my case:
werner@ubuntu-01:~$ eb --version
This is EasyBuild 4.1.2.dev0 (framework: 4.1.2.dev0, easyblocks:
4.1.2.dev0) on host ubuntu-01.
werner@ubuntu-01:~$ lmod --version
Modules based on Lua: Version 8.3.1 2020-02-16 19:46 :z
by Robert McLay [email protected]
werner@ubuntu-01:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 19.10
Release: 19.10
Codename: eoan
werner@ubuntu-01:~$ eb --show-config
#
# Current EasyBuild configuration
# (C: command line argument, D: default value, E: environment
variable, F: configuration file)
#
buildpath (D) = /home/werner/.local/easybuild/build
containerpath (D) = /home/werner/.local/easybuild/containers
installpath (D) = /home/werner/.local/easybuild
repositorypath (D) = /home/werner/.local/easybuild/ebfiles_repo
robot-paths (D) =
/home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs,
/home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild/easyconfigs
sourcepath (D) = /home/werner/.local/easybuild/sources
Regards
Miguel Dias Costa <[email protected]> 于2020年2月19日周三 下午12:38写道：
Hello Hongsheng,
On 19/02/2020 11:23, Hongyi Zhao wrote:
Hi,
Say for the following:
$ eb Python-3.7.0-foss-2018b.eb
The above command depends on many tarballs,
Do you already have the toolchain foss/2018b installed? If not, eb will
need to download and build it from scratch, and that will take some
time, but only for the first time.
and the downloading
process with the eb is so slow.
It shouldn't be slower than any other process from the same system....
maybe you are running from a node without internet access, or filtered?
Is there some method for me to let eb
output all of the used source tarballs urls?
"eb Python-3.7.0-foss-2018b.eb --fetch -x" might help, eventually with
"-r" to also see tarballs from dependencies
(--fetch means download only, you can use this from another node with
internet access, if that's the problem, and -x means extended-dry-run,
show only what would be done)
Best,
Miguel
