Dear Kenneth,
On 24-04-2020 20:38, Kenneth Hoste wrote:
Can you do a debug bootstrap, by also defining $EASYBUILD_BOOTSTRAP_DEBUG?
export EASYBUILD_BOOTSTRAP_DEBUG=1
The output is copied below. I hope you can make some sense of it...
Maybe you have an 'easybuild' folder in the directory where you're
running the bootstrap from?
No such folder:
$ ls -la
total 72
drwxr-xr-x. 3 ohni camdvip 77 Apr 24 08:43 .
drwxr-xr-x. 10 ohni camdvip 4096 Apr 24 08:16 ..
drwxr-xr-x. 2 ohni camdvip 4096 Apr 24 15:47 benchmarks
-rw-r--r--. 1 ohni camdvip 51564 Apr 24 08:43 bootstrap_eb.py
-rw-r--r--. 1 ohni camdvip 11529 Apr 24 08:16 README.md
Thanks,
Ole
Debug output
------------
$ python bootstrap_eb.py $EASYBUILD_PREFIX
[[INFO]] EasyBuild bootstrap script (version 20200203.01, MD5:
fcb6314d4e0747db9c28a71f8bb2870c)
[[INFO]] Found Python 2.7.5 (default, Aug 7 2019, 00:51:29) ; [GCC
4.8.5 20150623 (Red Hat 4.8.5-39)]
[[INFO]] Installation prefix /home/niflheim/ohni/modules
[[DEBUG]] Going to use /tmp/tmpgaI94A as temporary directory
[[INFO]] Using modules tool specified by $EASYBUILD_MODULES_TOOL: Lmod
[[DEBUG]] sys.path after cleaning:
['/home/niflheim/ohni/Git/GPAW-benchmark-2020',
'/usr/lib64/python27.zip', '/usr/lib64/python2.7',
'/usr/lib64/python2.7/plat-linux2', '/usr/lib64/python2.7/lib-tk',
'/usr/lib64/python2.7/lib-old', '/usr/lib64/python2.7/lib-dynload',
'/usr/lib64/python2.7/site-packages',
'/usr/lib64/python2.7/site-packages/gtk-2.0',
'/usr/lib/python2.7/site-packages']
[[DEBUG]] Checking whether suitable setuptools installation is available...
[[DEBUG]] Found setuptools version 0.9.8
[[DEBUG]] Location of setuptools' easy_install module:
/usr/lib/python2.7/site-packages/setuptools/command/easy_install.pyc
[[DEBUG]] Location of setuptools installation:
/usr/lib/python2.7/site-packages
[[INFO]] Suitable setuptools installation already found, skipping stage 0...
[[INFO]] +++ STAGE 1: installing EasyBuild in temporary dir with
easy_install...
[[DEBUG]] $ easy_install --help
[[DEBUG]] Active setuptools installation:
/usr/lib/python2.7/site-packages/setuptools/__init__.pyc
[[DEBUG]] stdout for 'easy_install --help':
Global options:
--verbose (-v) run verbosely (default)
--quiet (-q) run quietly (turns verbosity off)
--dry-run (-n) don't actually do anything
--help (-h) show detailed help message
--no-user-cfg ignore pydistutils.cfg in your home directory
Options for 'easy_install' command:
--prefix installation prefix
--zip-ok (-z) install package as a zipfile
--multi-version (-m) make apps have to require() a version
--upgrade (-U) force upgrade (searches PyPI for latest
versions)
--install-dir (-d) install package to DIR
--script-dir (-s) install scripts to DIR
--exclude-scripts (-x) Don't install scripts
--always-copy (-a) Copy all needed packages to install dir
--index-url (-i) base URL of Python Package Index
--find-links (-f) additional URL(s) to search for packages
--delete-conflicting (-D) no longer needed; don't use this
--ignore-conflicts-at-my-risk no longer needed; don't use this
--build-directory (-b) download/extract/build in DIR; keep the
results
--optimize (-O) also compile with optimization: -O1 for
"python -O", -O2 for "python -OO", and
-O0 to
disable [default: -O0]
--record filename in which to record list of
installed
files
--always-unzip (-Z) don't install as a zipfile, no matter what
--site-dirs (-S) list of directories where .pth files work
--editable (-e) Install specified packages in editable
form
--no-deps (-N) don't install dependencies
--allow-hosts (-H) pattern(s) that hostnames must match
--local-snapshots-ok (-l) allow building eggs from local checkouts
--version print version information and exit
--no-find-links Don't load find-links defined in packages
being installed
usage: bootstrap_eb.py [options] requirement_or_url ...
or: bootstrap_eb.py --help
[[DEBUG]] stderr for 'easy_install --help':
[[DEBUG]] Preparing for path /tmp/tmpgaI94A/eb_stage1
[[DEBUG]] os.environ['PYTHONPATH'] after reset:
[[DEBUG]] $PATH:
/tmp/tmpgaI94A/eb_stage1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/dell/srvadmin/bin:/opt/dell/srvadmin/iSM/bin:/home/niflheim/ohni/.local/bin:/home/niflheim/ohni/bin
[[DEBUG]] $PYTHONPATH:
/tmp/tmpgaI94A/eb_stage1/lib64/python2.7/site-packages:/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages
[[DEBUG]] $EASYBUILD_MODULES_TOOL set to Lmod
[[INFO]] running pre-install command 'easy_install --upgrade
--prefix=/tmp/tmpgaI94A/eb_stage1 vsc-install<0.11.4'
[[DEBUG]] Active setuptools installation:
/usr/lib/python2.7/site-packages/setuptools/__init__.pyc
[[DEBUG]] stdout for 'easy_install --upgrade
--prefix=/tmp/tmpgaI94A/eb_stage1 vsc-install<0.11.4':
Creating /tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/site.py
Searching for vsc-install<0.11.4
Reading https://pypi.python.org/simple/vsc-install/
Best match: vsc-install 0.11.3
Downloading
https://files.pythonhosted.org/packages/18/59/3274a58af6af84a87f7655735b452c06c769586ee73954f5ee15d303aa29/vsc-install-0.11.3.tar.gz#sha256=8b102ba585863769d974ad117764039ac3cea21372a3baa5cdb6b93166673ad6
Processing vsc-install-0.11.3.tar.gz
Writing /tmp/easy_install-u6RjGQ/vsc-install-0.11.3/setup.cfg
Running vsc-install-0.11.3/setup.py -q bdist_egg --dist-dir
/tmp/easy_install-u6RjGQ/vsc-install-0.11.3/egg-dist-tmp-9GzTTf
INFO: This is (based on) vsc.install.shared_setup 0.11.3
INFO: run_tests from base dir
/tmp/easy_install-u6RjGQ/vsc-install-0.11.3 (using executable
/tmp/easy_install-u6RjGQ/vsc-install-0.11.3/setup.py)
INFO: initial packages list: ['vsc.install', 'vsc']
INFO: generated list: ['vsc.install', 'vsc']
INFO: generated packages list: ['vsc.install', 'vsc']
INFO: makesetupcfg set to True, (re)creating setup.cfg
INFO: found license /tmp/easy_install-u6RjGQ/vsc-install-0.11.3/LICENSE
with md5sum 5f30f0716dfdd0d91eb439ebec522ec2
INFO: Found license name LGPLv2+ and classifier License :: OSI Approved
:: GNU Lesser General Public License v2 or later (LGPLv2+)
INFO: setting license LGPLv2+
INFO: found match url https://github.com/hpcugent/vsc-install in
/tmp/easy_install-u6RjGQ/vsc-install-0.11.3/PKG-INFO
INFO: found match name vsc-install in
/tmp/easy_install-u6RjGQ/vsc-install-0.11.3/PKG-INFO
INFO: Removing None download_url
INFO: get_name_url returns {'url':
'https://github.com/hpcugent/vsc-install', 'name': 'vsc-install'}
INFO: using long_description vsc-install provides shared setuptools
functions and classes for python libraries developed by UGent's HPC group
INFO: generated list: ['bin/python-noenv.sh', 'bin/python-stripped-env']
INFO: generated scripts list: ['bin/python-noenv.sh',
'bin/python-stripped-env']
INFO: adding prospector to tests_require
{'maintainer': 'Stijn De Weirdt;Andy Georges;Jens Timmerman',
'install_requires': ['setuptools'], 'setup_requires': ['setuptools'],
'maintainer_email': '[email protected], [email protected],
[email protected]', 'long_description':
'Description\n===========\nvsc-install provides shared setuptools
functions and classes for python libraries developed by UGent\'s HPC
group\n\nCommon pitfalls\n=========\nbdist_rpm will fail if your
install_requires = \'setuptools\' because it will fail to find a
setuptools rpm.\n```\nexport VSC_RPM_PYTHON=1\n```\nwill make sure the
`python-` prefix is added to the packages in install_requires for
building RPM\'s so python-setuptools will be used.\n\nAdd
tests\n=========\n\nTest are python modules in the `test` directory
which have subclass of `TestCase`\nand at least one method that has a
name starting with `test_`\n\nYou are advised to use\n```python\nfrom
vsc.install.testing import TestCase\n```\n(instead of basic `TestCase`
from `unittest`).\n\nAnd any `__main__` or `suite()` is not needed
(anymore).\n\nInitialise the test directory with\n\n```bash\nmkdir -p
test\necho \'\' > test/__init__.py\necho \'from vsc.install.commontest
import CommonTest\' > test/00-import.py\n```\n\nWhen the tests are run,
`test`, `lib` and `bin` (if relevant) are added to `sys.path`,\nso no
need to do so in the tets modules.\n\nRun
tests\n=========\n\n```bash\npython setup.py test\n```\n\nFilter tests
with `-F` (test module names) and `-f` (test method names)\n\nSee
also\n\n```bash\npython setup.py test --help\n```\n\nIn case following
error occurs, it means there is a test module `XYZ` that cannot be
imported.\n\n```txt\nFile "setup.py", line 499, in loadTestsFromModule\n
testsuites = ScanningLoader.loadTestsFromModule(self, module)\nFile
"build/bdist.linux-x86_64/egg/setuptools/command/test.py", line 37, in
loadTestsFromModule\nFile "/usr/lib64/python2.7/unittest/loader.py",
line 100, in loadTestsFromName\n parent, obj = obj, getattr(obj,
part)\nAttributeError: \'module\' object has no attribute
\'XYZ\'\n```\n\nYou can try get the actual import error for fixing the
issue with\n```bash\npython -c \'import sys;sys.path.insert(0,
"test");import XYZ;\'\n```\n\nFix failing tests\n=================\n\n*
Missing / incorrect `LICENSE`\n\n * Copy the appropirate license file
under `known_licenses` in the project directory and name the file
`LICENSE`\n\n* Missing `README.md`\n\n * Create a `README.md` file with
at least a `Description` section\n\n* Fix license headers as described
in
https://github.com/hpcugent/vsc-install/blob/master/lib/vsc/install/headers.py\n\n
```\n cd <project dir with .git folder>\n REPO_BASE_DIR=$PWD python
-m vsc.install.headers path/to/file script_or_not\n ```\n\n Fix them
all at once using find\n\n ```\n find ./{lib,test} -type f -name
\'*.py\' | REPO_BASE_DIR=$PWD xargs -I \'{}\' python -m
vsc.install.headers \'{}\'\n find ./bin -type f -name \'*.py\' |
REPO_BASE_DIR=$PWD xargs -I \'{}\' python -m vsc.install.headers \'{}\'
1\n ```\n\n Do not forget to check the diff\n* Python scripts (i.e.
with a python shebang and installed as scripts in setup) have to use
`#!/usr/bin/env python` as shebang\n* Remove any
`build_rpms_settings.sh` leftovers\n* The `TARGET` dict in `setup.py`
should be minimal unless you really know what you are doing (i.e. if it
is truly different from defaults)\n\n * Remove `name`, `scripts`,
...\n\n* `Exception: vsc namespace packages do not allow non-shared
namespace`\n\n * Add to the `__init__.py`\n\n ```python\n """\n Allow
other packages to extend this namespace, zip safe setuptools style\n
"""\n import pkg_resources\n pkg_resources.declare_namespace(__name__)\n
```\n\n\nbare-except\n-----------\n```python\ntry:\n #
something\nexcept:\n```\nThis is bad, because this except will also
catch sys.exit() or Keyboardinterupts, something you\ntypically do not
want, if you catch these the program will be in a weird state and then
continue on,\nwhilst the person who just pressed ctrl+c is wondering
what is going on and why it is not stopping.\n\nso at the very least
make this\nexcept Exception (which doesn\'t catch sys.exit and
KeyboardInterupt)\nand it would be appreciated if you could actually
figure out what exceptions to expect and only catch those\nand let your
program crash if something you did not intend happens\nbecause it helps
developers catch weird errors on their side better.\n\nif you do
something like\n```python\ntry:\n
open(int(somestring)).write(\'important data\')\nexcept Exception:\n
pass # if somestring is not an integer, we didn\'t need to write anyway,
but otherwise we do\n```\nbecause you know sometimes this string does
not contain an integer, so the int() call can fail\nyou should really
only catch ValueError, because this will also fail when your disk is
full, or you don\'t have permissions\nor xxx other reasons, and the
important data will not be written out and nobody will notice
anything!\n\n\n\nif not \'a\' in somelist -> if \'a\' not in
somelist\n-------------------------------------------------\n\nthis
isn\'t that big of a deal, but if everyone is consistent it\'s less
likely to introduce bugs when a not is added or removed where it didn\'t
need to.\nAlso helps code review, not in reads better, like
english.\n\n\narguments-differ\n-----------------\n\nthis will give you
errors if you override a function of a superclass but don\'t use the
same amount of arguments,\nusing less will surely give you errors, so
the linter catches this for you
now\n\nunused-argument\n-----------------\nif you have a function
definition witch accepts an argument that is never used in the function
body this will now give an error.\nclean up your function definition, or
fix the error where you actually do need to take this argument into
account\n\nunused-variable\n----------------\ndefining a variable and
then not using it anymore smells bad, why did you do that?\nsometimes
you do things like\n```python\nout, exit_code =
run_command(something)\n```\nbut you are not interested in the out, only
in the exit code,\nin this case, write\n```python\n_, exit_code =
run_command(something)\n```\n\nusing _ as a variable name lets pylint
and other readers know you do not intend to use that output in the first
place.\n\n\nreimported\n-------------\nwhen you re import a name
somewhere else,\nusually this is just an import to much, or 2 imports
with the same name, pay attention.\n```python\nimport six\nfrom django
import six\n```\n=>\n```python\nimport six\nfrom django import six as
django_six\n```\n\nredefinition of unused
name\n----------------------------\nthis usually also points to
something you did not expect\n```python\nfrom vsc.accountpageclient
import VscGroup\n<snip>\n\nclass VscGroup(object):\n pass\n```\n\n=>
do you need the import? use import as\ndid you mean to use the same
name? ...\n\nunpacking-in-except /
redefine-in-handler\n-----------------------------------------\n\nMultiple
exception have to be grouped in a tuple like\n\n```python\n
...\nexcept (ExceptionOne, ExceptionTwo) ...\n ...\n```\n\n(espcially
when used like `except A, B:` which should be `except (A,
B):`.\n\nturning off these errors\n-------------------------\n\nIf in
any of these cases you think: yes, I really needed to do this,\nI\'m
monkeypatching things, I\'m adding extra functionality that does indeed
have an extra(default) paramenter, etc, etc\nyou can let pylint know to
ignore this error in this one specific block of code\nby adding e.g. the
comment `# pylint: disable=<name or numeric id of pylint
code>`\n\n```python\nclass Something(object):\n def dosomething(self,
some, thing):\n # do something\n\nclass
MyFancyThing(SomeThing):\n # pylint: disable=arguments-differ\n
def dosomething(self, some, thing, fancy=None):\n # do something
fancy\n```\n\nFull list with all codes is available at
http://pylint-messages.wikidot.com/all-codes\n', 'tests_require':
['prospector >= 1.1.4'], 'package_dir': {'': 'lib'}, 'author': 'Stijn De
Weirdt;Andy Georges;Jens Timmerman', 'author_email':
'[email protected], [email protected],
[email protected]', 'download_url': '', 'version': '0.11.3',
'description': "vsc-install provides shared setuptools functions and
classes for python libraries developed by UGent's HPC group",
'namespace_packages': ['vsc'], 'scripts': ['bin/python-noenv.sh',
'bin/python-stripped-env'], 'command_packages':
['vsc.install.shared_setup', 'shared_setup_dist_only',
'setuptools.command', 'distutils.command'], 'packages': ['vsc.install',
'vsc'], 'classifiers': ['License :: OSI Approved :: GNU Lesser General
Public License v2 or later (LGPLv2+)'], 'dependency_links': [], 'name':
'vsc-install', 'license': 'LGPLv2+', 'url':
'https://github.com/hpcugent/vsc-install', 'cmdclass': {'bdist_rpm':
<class __main__.vsc_bdist_rpm at 0x2ab8db002db8>, 'install_scripts':
<class __main__.vsc_install_scripts at 0x2ab8db0022c0>, 'test': <class
__main__.VscTestCommand at 0x2ab8db00d188>, 'vsc_release': <class
__main__.vsc_release at 0x2ab8db00d0b8>, 'egg_info': <class
__main__.vsc_egg_info at 0x2ab8db0020b8>, 'sdist': <class
__main__.vsc_sdist at 0x2ab8db002120>}, 'test_suite': 'test'}
INFO: Adding vsc-install 0.11.3 to easy-install.pth file
INFO: Installing python-stripped-env script to /tmp/tmpgaI94A/eb_stage1/bin
INFO: Installing python-noenv script to /tmp/tmpgaI94A/eb_stage1/bin
INFO:
Installed
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_install-0.11.3-py2.7.egg
INFO: Processing dependencies for vsc-install<0.11.4
INFO: Finished processing dependencies for vsc-install<0.11.4
[[DEBUG]] stderr for 'easy_install --upgrade
--prefix=/tmp/tmpgaI94A/eb_stage1 vsc-install<0.11.4':
warning: easy_install: byte-compiling is disabled, skipping.
WARN: cleanup lib/vsc_install.egg-info
WARN: warning: build_py: byte-compiling is disabled, skipping.
WARN: warning: install_lib: byte-compiling is disabled, skipping.
WARN: zip_safe flag not set; analyzing archive contents...
[[INFO]] running pre-install command 'easy_install --upgrade
--prefix=/tmp/tmpgaI94A/eb_stage1 vsc-base<2.9.0'
[[DEBUG]] Active setuptools installation:
/usr/lib/python2.7/site-packages/setuptools/__init__.pyc
[[DEBUG]] stdout for 'easy_install --upgrade
--prefix=/tmp/tmpgaI94A/eb_stage1 vsc-base<2.9.0':
INFO: Searching for vsc-base<2.9.0
INFO: Reading https://pypi.python.org/simple/vsc-base/
INFO: Best match: vsc-base 2.8.4
INFO: Downloading
https://files.pythonhosted.org/packages/48/aa/f05d350c358338d0e843835660e3993cc5eb28401f32c0c5b8bc9a9458d5/vsc-base-2.8.4.tar.gz#sha256=a6d3ab52c9dec938d98e53860dce4aba79ca8ea4e81f6e07bf2c3787e764bc3e
INFO: Processing vsc-base-2.8.4.tar.gz
INFO: Writing /tmp/easy_install-JUbEwI/vsc-base-2.8.4/setup.cfg
INFO: Running vsc-base-2.8.4/setup.py -q bdist_egg --dist-dir
/tmp/easy_install-JUbEwI/vsc-base-2.8.4/egg-dist-tmp-wtXzHS
INFO: This is (based on) vsc.install.shared_setup 0.11.5
INFO: run_tests from base dir /tmp/easy_install-JUbEwI/vsc-base-2.8.4
(using executable /tmp/easy_install-JUbEwI/vsc-base-2.8.4/setup.py)
INFO: initial packages list: ['vsc', 'vsc.utils']
INFO: generated list: ['vsc', 'vsc.utils']
INFO: generated packages list: ['vsc', 'vsc.utils']
INFO: makesetupcfg set to True, (re)creating setup.cfg
INFO: found license /tmp/easy_install-JUbEwI/vsc-base-2.8.4/LICENSE with
md5sum 5f30f0716dfdd0d91eb439ebec522ec2
INFO: Found license name LGPLv2+ and classifier License :: OSI Approved
:: GNU Lesser General Public License v2 or later (LGPLv2+)
INFO: setting license LGPLv2+
INFO: found match url https://github.com/hpcugent/vsc-base in
/tmp/easy_install-JUbEwI/vsc-base-2.8.4/PKG-INFO
INFO: found match name vsc-base in
/tmp/easy_install-JUbEwI/vsc-base-2.8.4/PKG-INFO
INFO: Removing None download_url
INFO: get_name_url returns {'url':
'https://github.com/hpcugent/vsc-base', 'name': 'vsc-base'}
INFO: using long_description Common tools used within our organization.
Originally created by the HPC team of Ghent University
(http://ugent.be/hpc).
INFO: generated list: ['bin/logdaemon.py', 'bin/startlogdaemon.sh',
'bin/optcomplete.bash']
INFO: generated scripts list: ['bin/logdaemon.py',
'bin/startlogdaemon.sh', 'bin/optcomplete.bash']
INFO: adding prospector to tests_require
{'maintainer': 'Stijn De Weirdt;Jens Timmerman;Andy Georges;Kenneth
Hoste', 'install_requires': ['vsc-install >= 0.10.2'], 'setup_requires':
['vsc-install >= 0.10.2'], 'maintainer_email': '[email protected],
[email protected], [email protected], [email protected]',
'long_description': "# vsc-base\n\n### Build Status\n\n- Python 2.6 :
[](https://jenkins1.ugent.be/job/vsc-base-python26/)\n-
Python 2.7 : [](https://jenkins1.ugent.be/job/vsc-base-python27/)\n\n#
Description\n\nCommon tools used within our organization.\nOriginally
created by the HPC team of Ghent University (http://ugent.be/hpc).\n\n#
Documentation\nhttps://jenkins1.ugent.be/job/vsc-base-python26/Documentation/\n\n#
Namespaces and tools\n\n## lib/utils\npython utilities to be used as
libraries\n\n- __fancylogger__: an extention of the default python
logger designed to be easy to use and have a couple of `fancy`
features.\n\n - custom specifiers for mpi loggin (the mpirank) with
autodetection of mpi\n - custom specifier for always showing the calling
function's name\n - rotating file handler\n - a default formatter.\n -
logging to an UDP server (logdaemon.py f.ex.)\n - easily setting
loglevel\n\n- __daemon.py__ : Daemon class written by Sander Marechal
(http://www.jejik.com) to start a python script as a daemon.\n-
__missing.py__: Small functions and tools that are commonly used but not
available in the Python (2.x) API.\n- ~~__cache.py__ : File cache to
store pickled data identified by a key accompanied by a timestamp.~~
(moved to [vsc-utils](https://github.com/hpcugent/vsc-utils))\n-
__generaloption.py__ : A general option parser for python. It will fetch
options (in this order) from config files, from environment variables
and from the command line and parse them in a way compatible with the
default python optionparser. Thus allowing a very flexible way to
configure your scripts. It also adds a few other useful extras.\n-
__affinity.py__ : Linux cpu affinity.\n\n - Based on `sched.h` and
`bits/sched.h`,\n - see man pages for `sched_getaffinity` and
`sched_setaffinity`\n - also provides a `cpuset` class to convert
between human readable cpusets and the bit version Linux priority\n -
Based on sys/resources.h and bits/resources.h see man pages for
`getpriority` and `setpriority`\n\n- __asyncprocess.py__ : Module to
allow Asynchronous subprocess use on Windows and Posix platforms\n\n -
Based on a [python recipe](http://code.activestate.com/recipes/440554/)
by Josiah Carlson\n - added STDOUT handle and recv_some\n\n-
__daemon.py__ : [A generic daemon class by Sander
Marechal](http://www.jejik.com/articles/2007/02/a_simple_unix_linux_daemon_in_python/)\n-
__dateandtime.py__ : A module with various convenience functions and
classes to deal with date, time and timezone.\n- __nagios.py__ : This
module provides functionality to cache and report results of script
executions that can readily be interpreted by nagios/icinga.\n-
__run.py__ : Python module to execute a command, can make use of
asyncprocess, answer questions based on a dictionary\n\n - supports a
whole lot of ways to input, process and output the command.
(filehandles, PIPE, pty, stdout, logging...)\n\n- __mail.py__ : Wrapper
around the standard Python mail library.\n\n - Send a plain text
message\n - Send an HTML message, with a plain text alternative\n\n##
bin\nA collection of python scripts, these are examples of how you could
use fancylogger to log to a daemon, but should not be used directly.\n-
__logdaemon.py__: A daemon that listens on a port for udp packets and
logs them to file, works toghether with fancylogger.\n-
__startlogdaemon.py__ : Script that will start the logdaemon for you
and set environment variables for fancylogger.\n\n# License\nvsc-base is
made available under the GNU Library General Public License (LGPL)
version 2 or any later version.\n\n# Acknowledgements\nvsc-base was
created with support of [Ghent University](http://www.ugent.be/en),\nthe
[Flemish Supercomputer Centre (VSC)](https://vscentrum.be/nl/en),\nthe
[Flemish Research Foundation (FWO)](http://www.fwo.be/en),\nand [the
Department of Economy, Science and Innovation
(EWI)](http://www.ewi-vlaanderen.be/en).\n\n", 'tests_require':
['prospector', 'coloredlogs<6.0', 'humanfriendly', 'prospector >=
1.1.4'], 'package_dir': {'': 'lib'}, 'extras_require': {'coloredlogs':
['coloredlogs<6.0', 'humanfriendly']}, 'author': 'Stijn De Weirdt;Jens
Timmerman;Andy Georges;Kenneth Hoste', 'cmdclass': {'bdist_rpm': <class
shared_setup_dist_only.vsc_bdist_rpm at 0x2ab8db50a738>,
'install_scripts': <class shared_setup_dist_only.vsc_install_scripts at
0x2ab8db50a530>, 'test': <class shared_setup_dist_only.VscTestCommand at
0x2ab8db50a3f8>, 'vsc_release': <class
shared_setup_dist_only.vsc_release at 0x2ab8db50a328>, 'egg_info':
<class shared_setup_dist_only.vsc_egg_info at 0x2ab8db002188>, 'sdist':
<class shared_setup_dist_only.vsc_sdist at 0x2ab8db00d1f0>},
'download_url': '', 'version': '2.8.4', 'description': 'Common tools
used within our organization. Originally created by the HPC team of
Ghent University (http://ugent.be/hpc).', 'namespace_packages': ['vsc'],
'scripts': ['bin/logdaemon.py', 'bin/startlogdaemon.sh',
'bin/optcomplete.bash'], 'command_packages':
['vsc.install.shared_setup', 'shared_setup_dist_only',
'setuptools.command', 'distutils.command'], 'packages': ['vsc',
'vsc.utils'], 'classifiers': ['License :: OSI Approved :: GNU Lesser
General Public License v2 or later (LGPLv2+)'], 'dependency_links':
['git+https://github.com/hpcugent/vsc-install.git#egg=vsc-install-0.10.2',
'git+https://github.com/hpcugent/vsc-install.git#egg=vsc-install-0.10.2'],
'name': 'vsc-base', 'license': 'LGPLv2+', 'url':
'https://github.com/hpcugent/vsc-base', 'author_email':
'[email protected], [email protected],
[email protected], [email protected]', 'test_suite': 'test'}
INFO: Searching for vsc-install>=0.10.2
INFO: Best match: vsc-install 0.11.3
INFO: Processing vsc_install-0.11.3-py2.7.egg
INFO:
Using
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_install-0.11.3-py2.7.egg
INFO: Adding vsc-base 2.8.4 to easy-install.pth file
INFO: Installing logdaemon script to /tmp/tmpgaI94A/eb_stage1/bin
INFO: Installing startlogdaemon script to /tmp/tmpgaI94A/eb_stage1/bin
INFO: Installing optcomplete.bash script to /tmp/tmpgaI94A/eb_stage1/bin
INFO:
Installed
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_base-2.8.4-py2.7.egg
INFO: Processing dependencies for vsc-base<2.9.0
INFO: Finished processing dependencies for vsc-base<2.9.0
[[DEBUG]] stderr for 'easy_install --upgrade
--prefix=/tmp/tmpgaI94A/eb_stage1 vsc-base<2.9.0':
WARN: cleanup lib/vsc_base.egg-info
WARN: warning: build_py: byte-compiling is disabled, skipping.
WARN: warning: install_lib: byte-compiling is disabled, skipping.
WARN: zip_safe flag not set; analyzing archive contents...
[[INFO]] installing EasyBuild with 'easy_install --upgrade
--prefix=/tmp/tmpgaI94A/eb_stage1 easybuild'
[[INFO]] Note: a 'SyntaxError' may be reported for the
easybuild/tools/py2vs3/py3.py module.
You can safely ignore this message, it will not affect the functionality
of the EasyBuild installation.
[[DEBUG]] Active setuptools installation:
/usr/lib/python2.7/site-packages/setuptools/__init__.pyc
[[DEBUG]] stdout for 'easy_install --upgrade
--prefix=/tmp/tmpgaI94A/eb_stage1 easybuild':
INFO: Searching for easybuild
INFO: Reading https://pypi.python.org/simple/easybuild/
INFO: Best match: easybuild 4.2.0.post0
INFO: Downloading
https://files.pythonhosted.org/packages/94/6c/ced30dc3294882c942eb2e46ca2fa5bcf4f1710166c330849dad184039d3/easybuild-4.2.0.post0.tar.gz#sha256=1ecf70730475b6ee7a6b549b74ef6ff92c17aed061eaf82faa8d83dc43ef0688
INFO: Processing easybuild-4.2.0.post0.tar.gz
INFO: Writing /tmp/easy_install-cT0ASh/easybuild-4.2.0.post0/setup.cfg
INFO: Running easybuild-4.2.0.post0/setup.py -q bdist_egg --dist-dir
/tmp/easy_install-cT0ASh/easybuild-4.2.0.post0/egg-dist-tmp-1cpIV7
INFO: Installing version 4.2.0
INFO: Adding easybuild 4.2.0.post0 to easy-install.pth file
INFO:
Installed
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/easybuild-4.2.0.post0-py2.7.egg
INFO: Processing dependencies for easybuild
INFO: Searching for easybuild-easyconfigs==4.2.0
INFO: Reading https://pypi.python.org/simple/easybuild-easyconfigs/
INFO: Best match: easybuild-easyconfigs 4.2.0
INFO: Downloading
https://files.pythonhosted.org/packages/c3/5e/9e03725be46b8cad207b5ef5f0e80e2eb205f4e6bd80edb731f48cf5d4a5/easybuild-easyconfigs-4.2.0.tar.gz#sha256=81b57120e0e3ba0d97defafa677a7449fa355b34dfa6ecaca190b5bc94fedffd
INFO: Processing easybuild-easyconfigs-4.2.0.tar.gz
INFO: Writing /tmp/easy_install-llk0fv/easybuild-easyconfigs-4.2.0/setup.cfg
INFO: Running easybuild-easyconfigs-4.2.0/setup.py -q bdist_egg
--dist-dir
/tmp/easy_install-llk0fv/easybuild-easyconfigs-4.2.0/egg-dist-tmp-x0KNI5
INFO: Installing version 4.2.0 (required versions: API >= 4, easyblocks
>= 4.2)
INFO: Adding easybuild-easyconfigs 4.2.0 to easy-install.pth file
INFO:
Installed
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/easybuild_easyconfigs-4.2.0-py2.7.egg
INFO: Searching for easybuild-easyblocks==4.2.0
INFO: Reading https://pypi.python.org/simple/easybuild-easyblocks/
INFO: Best match: easybuild-easyblocks 4.2.0
INFO: Downloading
https://files.pythonhosted.org/packages/3a/2c/44bd425b407229f49d2a4b849c57366ccabcfc6a44524772c11954dbc833/easybuild-easyblocks-4.2.0.tar.gz#sha256=3619fcd79b8c4f9ff3c913f8d76586c4388f1ec48c90d99140bd230da5631776
INFO: Processing easybuild-easyblocks-4.2.0.tar.gz
INFO: Writing /tmp/easy_install-I0feXr/easybuild-easyblocks-4.2.0/setup.cfg
INFO: Running easybuild-easyblocks-4.2.0/setup.py -q bdist_egg
--dist-dir
/tmp/easy_install-I0feXr/easybuild-easyblocks-4.2.0/egg-dist-tmp-pr2flL
INFO: Installing version 4.2.0 (required versions: API >= 4)
INFO: Adding easybuild-easyblocks 4.2.0 to easy-install.pth file
INFO:
Installed
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/easybuild_easyblocks-4.2.0-py2.7.egg
INFO: Searching for easybuild-framework==4.2.0
INFO: Reading https://pypi.python.org/simple/easybuild-framework/
INFO: Best match: easybuild-framework 4.2.0
INFO: Downloading
https://files.pythonhosted.org/packages/79/8d/734c9328be100fa088eea370c8a9419fcd00a1d2ffb8e2d8b48e1ea91ccc/easybuild-framework-4.2.0.tar.gz#sha256=e260ad9c921c10873b0e3b6b322a42e5732fbed905cb50f5d189a4f54f4ad327
INFO: Processing easybuild-framework-4.2.0.tar.gz
INFO: Writing /tmp/easy_install-62YvYU/easybuild-framework-4.2.0/setup.cfg
INFO: Running easybuild-framework-4.2.0/setup.py -q bdist_egg --dist-dir
/tmp/easy_install-62YvYU/easybuild-framework-4.2.0/egg-dist-tmp-fDX9pq
INFO: Installing version 4.2.0 (API version 4)
INFO: Adding easybuild-framework 4.2.0 to easy-install.pth file
INFO: Installing bootstrap_eb.py script to /tmp/tmpgaI94A/eb_stage1/bin
INFO: Installing minimal_bash_completion.bash script to
/tmp/tmpgaI94A/eb_stage1/bin
INFO: Installing eb script to /tmp/tmpgaI94A/eb_stage1/bin
INFO: Installing eb_bash_completion.bash script to
/tmp/tmpgaI94A/eb_stage1/bin
INFO: Installing install_eb_dep.sh script to /tmp/tmpgaI94A/eb_stage1/bin
INFO: Installing optcomplete.bash script to /tmp/tmpgaI94A/eb_stage1/bin
INFO:
Installed
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/easybuild_framework-4.2.0-py2.7.egg
INFO: Finished processing dependencies for easybuild
[[DEBUG]] stderr for 'easy_install --upgrade
--prefix=/tmp/tmpgaI94A/eb_stage1 easybuild':
WARN: warning: install_lib: 'build/lib' does not exist -- no Python
modules to install
WARN: zip_safe flag not set; analyzing archive contents...
WARN: warning: install_lib: 'build/lib' does not exist -- no Python
modules to install
WARN: warning: easy_install: byte-compiling is disabled, skipping.
WARN: warning: build_py: byte-compiling is disabled, skipping.
WARN: warning: install_lib: byte-compiling is disabled, skipping.
WARN: zip_safe flag not set; analyzing archive contents...
WARN: warning: build_py: byte-compiling is disabled, skipping.
WARN: warning: install_lib: byte-compiling is disabled, skipping.
WARN: zip_safe flag not set; analyzing archive contents...
[[INFO]] running post install command 'easy_install --upgrade
--prefix=/tmp/tmpgaI94A/eb_stage1 vsc-base<2.9.0'
[[DEBUG]] Active setuptools installation:
/usr/lib/python2.7/site-packages/setuptools/__init__.pyc
[[DEBUG]] stdout for 'easy_install --upgrade
--prefix=/tmp/tmpgaI94A/eb_stage1 vsc-base<2.9.0':
INFO: Searching for vsc-base<2.9.0
INFO: Reading https://pypi.python.org/simple/vsc-base/
INFO: Best match: vsc-base 2.8.4
INFO: Processing vsc_base-2.8.4-py2.7.egg
INFO: vsc-base 2.8.4 is already the active version in easy-install.pth
INFO: Installing logdaemon script to /tmp/tmpgaI94A/eb_stage1/bin
INFO: Installing startlogdaemon script to /tmp/tmpgaI94A/eb_stage1/bin
INFO: Installing optcomplete.bash script to /tmp/tmpgaI94A/eb_stage1/bin
INFO:
Using
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_base-2.8.4-py2.7.egg
INFO: Processing dependencies for vsc-base<2.9.0
INFO: Finished processing dependencies for vsc-base<2.9.0
[[DEBUG]] stderr for 'easy_install --upgrade
--prefix=/tmp/tmpgaI94A/eb_stage1 vsc-base<2.9.0':
[[DEBUG]] Found egg dir for vsc-base at
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_base-2.8.4-py2.7.egg
[[DEBUG]] Found egg dir for vsc-install at
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_install-0.11.3-py2.7.egg
[[DEBUG]] $PYTHONPATH:
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_install-0.11.3-py2.7.egg
[[DEBUG]] Found version for easybuild-vsc-install: 0.11.3
[[DEBUG]] Found egg dir for vsc-base at
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_base-2.8.4-py2.7.egg
[[DEBUG]] $PYTHONPATH:
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_base-2.8.4-py2.7.egg:/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_install-0.11.3-py2.7.egg
[[DEBUG]] Found version for easybuild-vsc-base: 2.8.4
[[DEBUG]] Found egg dir for easybuild-framework at
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/easybuild_framework-4.2.0-py2.7.egg
[[DEBUG]] $PYTHONPATH:
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/easybuild_framework-4.2.0-py2.7.egg:/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_base-2.8.4-py2.7.egg:/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_install-0.11.3-py2.7.egg
[[DEBUG]] Found version for easybuild-easybuild-framework: 4.2.0
[[DEBUG]] Found egg dir for easybuild-easyblocks at
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/easybuild_easyblocks-4.2.0-py2.7.egg
[[DEBUG]] $PYTHONPATH:
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/easybuild_easyblocks-4.2.0-py2.7.egg:/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/easybuild_framework-4.2.0-py2.7.egg:/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_base-2.8.4-py2.7.egg:/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_install-0.11.3-py2.7.egg
[[DEBUG]] Found version for easybuild-easybuild-easyblocks: 4.2.0
[[DEBUG]] Found egg dir for easybuild-easyconfigs at
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/easybuild_easyconfigs-4.2.0-py2.7.egg
[[DEBUG]] $PYTHONPATH:
/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/easybuild_easyconfigs-4.2.0-py2.7.egg:/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/easybuild_easyblocks-4.2.0-py2.7.egg:/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/easybuild_framework-4.2.0-py2.7.egg:/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_base-2.8.4-py2.7.egg:/tmp/tmpgaI94A/eb_stage1/lib/python2.7/site-packages/vsc_install-0.11.3-py2.7.egg
[[DEBUG]] Found version for easybuild-easybuild-easyconfigs: 4.2.0
[[DEBUG]] Determining EasyBuild version using command '/bin/python -c
'from easybuild.tools.version import this_is_easybuild;
print(this_is_easybuild())' > /tmp/tmpgaI94A/eb_version.out 2>&1'
[[ERROR]] Stage 1 failed, could not determine EasyBuild version (txt:
Traceback (most recent call last):
File "<string>", line 1, in <module>
ImportError: No module named tools.version
).