Miguel Dias Costa <[email protected]> 于2020年2月19日周三 下午3:56写道： > > Regarding the download issues, although there are alternatives (manually > download, change source_urls and templates, etc.), if the issue is > simply that it's slow I'd recommend using "eb Python-3.7.0-foss-2018b.eb > -r --fetch" and leave it running for now
But, the easybuild is based on urllib2 to do the job of downloading, which seems a fragile tool for doing the job. I often see the info from the log file like the following: == 2020-02-19 16:01:38,161 filetools.py:567 WARNING IOError occurred while trying to download https://github.com/westes/flex/releases/download/v2.6.3/flex-2.6.3.tar.gz to /home/werner/.local/easybuild/sources/f/flex/flex-2.6.3.tar.gz: ('The read operation timed out',) == 2020-02-19 16:01:38,162 filetools.py:576 INFO Attempt 1 of downloading https://github.com/westes/flex/releases/download/v2.6.3/flex-2.6.3.tar.gz to /home/werner/.local/easybuild/sources/f/flex/flex-2.6.3.tar.gz failed, trying again... > > Regarding the problem with building GCCcore, the actual error should be > in the log file > (/tmp/eb-kp_C77/easybuild-GCCcore-7.3.0-20200219.153523.iobNF.log), can > you have a look there? This file has 9607 lines. I take a look at it and still cannot figure out the issue. The following are the last 50 lines of this log file: ------------- $ tail -50 easybuild-GCCcore-7.3.0-20200219.153523.iobNF.log | isl_mat_alloc ../../gcc/graphite-sese-to-poly.c: In function isl_set* add_loop_constraints(scop_p, isl_set*, loop_p, loop_p): ../../gcc/graphite-sese-to-poly.c:760:53: error: isl_space_copy was not declared in this scope; did you mean isl_aff_copy? 760 | isl_local_space *ls = isl_local_space_from_space (isl_space_copy (space)); | ^~~~~~~~~~~~~~ | isl_aff_copy ../../gcc/graphite-sese-to-poly.c:812:7: error: isl_space_free was not declared in this scope; did you mean isl_aff_free? 812 | isl_space_free (space); | ^~~~~~~~~~~~~~ | isl_aff_free ../../gcc/graphite-sese-to-poly.c: In function void build_scop_context(scop_p): ../../gcc/graphite-sese-to-poly.c:902:22: error: isl_space_set_alloc was not declared in this scope; did you mean isl_map_list_alloc? 902 | isl_space *space = isl_space_set_alloc (scop->isl_context, nbp, 0); | ^~~~~~~~~~~~~~~~~~~ | isl_map_list_alloc ../../gcc/graphite-sese-to-poly.c:907:13: error: isl_space_set_dim_id was not declared in this scope; did you mean isl_aff_set_dim_id? 907 | space = isl_space_set_dim_id (space, isl_dim_param, i, | ^~~~~~~~~~~~~~~~~~~~ | isl_aff_set_dim_id ../../gcc/graphite-sese-to-poly.c: In function isl_schedule* add_loop_schedule(isl_schedule*, loop_p, scop_p): ../../gcc/graphite-sese-to-poly.c:1047:20: error: isl_space_dim was not declared in this scope; did you mean isl_aff_dim? 1047 | int loop_index = isl_space_dim (space, isl_dim_set) - 1; | ^~~~~~~~~~~~~ | isl_aff_dim ../../gcc/graphite-sese-to-poly.c:1061:19: error: isl_id_alloc was not declared in this scope; did you mean isl_mat_alloc? 1061 | isl_id *label = isl_id_alloc (isl_schedule_get_ctx (schedule), | ^~~~~~~~~~~~ | isl_mat_alloc make[2]: *** [Makefile:1100: graphite-sese-to-poly.o] Error 1 /bin/bash ../../gcc/../move-if-change tmp-attrtab.c insn-attrtab.c /bin/bash ../../gcc/../move-if-change tmp-dfatab.c insn-dfatab.c /bin/bash ../../gcc/../move-if-change tmp-latencytab.c insn-latencytab.c echo timestamp > s-attrtab /bin/bash ../../gcc/../move-if-change tmp-automata.c insn-automata.c echo timestamp > s-automata rm gfortran.pod gcc.pod make[2]: Leaving directory '/home/werner/.local/easybuild/build/GCCcore/7.3.0/system-system/gcc-7.3.0/stage1_obj/gcc' make[1]: *** [Makefile:4243: all-gcc] Error 2 make[1]: Leaving directory '/home/werner/.local/easybuild/build/GCCcore/7.3.0/system-system/gcc-7.3.0/stage1_obj' make: *** [Makefile:904: all] Error 2 (at easybuild/tools/run.py:533 in parse_cmd_output) == 2020-02-19 15:37:42,773 easyblock.py:3138 WARNING build failed (first 300 chars): cmd " make -j 48 " exited with exit code 2 and output: make[1]: Entering directory '/home/werner/.local/easybuild/build/GCCcore/7.3.0/system-system/gcc-7.3.0/stage1_obj' mkdir -p -- ./intl mkdir -p -- ./gmp mkdir -p -- ./libiberty mkdir -p -- ./fixincludes mkdir -p -- ./libdecnumber mkdir -p -- ./lt == 2020-02-19 15:37:42,773 easyblock.py:295 INFO Closing log for application name GCCcore version 7.3.0 ------------- > > Miguel > > On 19/02/2020 15:42, Hongyi Zhao wrote: > > I try to use a locally http proxy to do the job as following, but > > still failed as follows: > > > > $ http_proxy="127.0.0.1:8118" eb Python-3.7.0-foss-2018b.eb -r --rebuild > > == temporary log file in case of crash /tmp/eb-kp_C77/easybuild-PNMkIf.log > > == resolving dependencies ... > > == processing EasyBuild easyconfig > > /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs/g/GCCcore/GCCcore-7.3.0.eb > > == building and installing GCCcore/7.3.0... > > == fetching files... > > == creating build dir, resetting environment... > > == unpacking... > > == patching... > > == preparing... > > == configuring... > > == building... > > == FAILED: Installation ended unsuccessfully (build directory: > > /home/werner/.local/easybuild/build/GCCcore/7.3.0/system-system): > > build failed (first 300 chars): cmd " make -j 48 " exited with exit > > code 2 and output: > > make[1]: Entering directory > > '/home/werner/.local/easybuild/build/GCCcore/7.3.0/system-system/gcc-7.3.0/stage1_obj' > > mkdir -p -- ./intl > > mkdir -p -- ./gmp > > mkdir -p -- ./libiberty > > mkdir -p -- ./fixincludes > > mkdir -p -- ./libdecnumber > > mkdir -p -- ./lt (took 2 min 19 sec) > > == Results of the build can be found in the log file(s) > > /tmp/eb-kp_C77/easybuild-GCCcore-7.3.0-20200219.153523.iobNF.log > > ERROR: Build of > > /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs/g/GCCcore/GCCcore-7.3.0.eb > > failed (err: 'build failed (first 300 chars): cmd " make -j 48 " > > exited with exit code 2 and output:\nmake[1]: Entering directory > > \'/home/werner/.local/easybuild/build/GCCcore/7.3.0/system-system/gcc-7.3.0/stage1_obj\'\nmkdir > > -p -- ./intl\nmkdir -p -- ./gmp\nmkdir -p -- ./libiberty\nmkdir -p -- > > ./fixincludes\nmkdir -p -- ./libdecnumber\nmkdir -p -- ./lt') > > > > > > Other info for my case: > > > > werner@ubuntu-01:~$ eb --version > > This is EasyBuild 4.1.2.dev0 (framework: 4.1.2.dev0, easyblocks: > > 4.1.2.dev0) on host ubuntu-01. > > werner@ubuntu-01:~$ lmod --version > > > > Modules based on Lua: Version 8.3.1 2020-02-16 19:46 :z > > by Robert McLay [email protected] > > werner@ubuntu-01:~$ lsb_release -a > > No LSB modules are available. > > Distributor ID: Ubuntu > > Description: Ubuntu 19.10 > > Release: 19.10 > > Codename: eoan > > > > werner@ubuntu-01:~$ eb --show-config > > # > > # Current EasyBuild configuration > > # (C: command line argument, D: default value, E: environment > > variable, F: configuration file) > > # > > buildpath (D) = /home/werner/.local/easybuild/build > > containerpath (D) = /home/werner/.local/easybuild/containers > > installpath (D) = /home/werner/.local/easybuild > > repositorypath (D) = /home/werner/.local/easybuild/ebfiles_repo > > robot-paths (D) = > > /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild-easyconfigs/easybuild/easyconfigs, > > /home/werner/Public/EasyBuild-modules/EasyBuild/EasyBuild-develop/easybuild/easyconfigs > > sourcepath (D) = /home/werner/.local/easybuild/sources > > > > Regards > > > > Miguel Dias Costa <[email protected]> 于2020年2月19日周三 下午12:38写道： > >> Hello Hongsheng, > >> > >> On 19/02/2020 11:23, Hongyi Zhao wrote: > >>> Hi, > >>> > >>> Say for the following: > >>> $ eb Python-3.7.0-foss-2018b.eb > >>> > >>> The above command depends on many tarballs, > >> Do you already have the toolchain foss/2018b installed? If not, eb will > >> need to download and build it from scratch, and that will take some > >> time, but only for the first time. > >> > >>> and the downloading > >>> process with the eb is so slow. > >> It shouldn't be slower than any other process from the same system.... > >> maybe you are running from a node without internet access, or filtered? > >>> Is there some method for me to let eb > >>> output all of the used source tarballs urls? > >> "eb Python-3.7.0-foss-2018b.eb --fetch -x" might help, eventually with > >> "-r" to also see tarballs from dependencies > >> > >> (--fetch means download only, you can use this from another node with > >> internet access, if that's the problem, and -x means extended-dry-run, > >> show only what would be done) > >> > >> Best, > >> > >> Miguel > >> > >> > > -- Hongsheng Zhao <[email protected]> Institute of Semiconductors, Chinese Academy of Sciences GnuPG DSA: 0xD108493
