Re: [easybuild] EasyBuild 2.8.1 fails 2 tests from test.framework.suite

[Kenneth Hoste]

Hi Pieter,

On 07/06/16 10:02, Pieter Neerincx wrote:
Hi Kenneth,
On 06 Jun 2016, at 18:17, Kenneth Hoste <kenneth.ho...@ugent.be> wrote:

Hi Pieter,

This sounds very much like the problem being reported in 
https://github.com/hpcugent/easybuild-framework/issues/1685 .

Can you take a look at that, especially my last comment which pinpoints the 
problem in Joachim's setup?
Check, that explains it; we also have EasyBuild in a hierarchical module naming 
scheme with Lmod as a modules tool.

If I understand correctly it is only an issue with the these two tests, which I 
can safely ignore for now...
I do understand that you want to have a "clean" environment for the tests, but 
why does the test not simply use something like

        module purge
        module load EasyBuild
        eb ....

Well, not everyone install EasyBuild via a module, that's one reason.

The reason this problem pops up is because EasyBuild fiddles with 
$MODULEPATH to ensure that only the test modules included are available, 
and nothing else, to avoid that other modules that are installed 'leak' 
into the tests and result in test failures (false positives).

Clearly, this doesn't work out well if EasyBuild itself is provided via 
a module, but only if it's installed in a hierarchy.

I'm thinking about a safe way around this issue, I hope to fix it by the 
next release.

But indeed, nothing to worry about, it's purely an issue with the tests 
themselves, not with your EasyBuild installation or setup.


regards,

Kenneth

Cheers,

Pi

regards,

Kenneth

On 06/06/16 18:07, Pieter Neerincx wrote:
Hi all,

When I run

        python -m test.framework.suite

it reproducibly fails on these two tests:

        --include-toolchains.
        --include-module-naming-schemes.

in what appears to be a silly way: it cannot find the eb command. Apart from 
this test anomaly EasyBuild 2.8.1 seems to work fine though; I've used it to 
deploy a couple of tools on multiple sites: so far so good. See below for the 
summary. The complete log is too large to attach... Is there something obvious 
going wrong or does this warrant creating a bug report @ GitHub?

Cheers,

Pi

-------------------------------------------------------------
phone: +31 6 143 66 783
e-mail: pieter.neeri...@gmail.com
skype:  pieter.online
-------------------------------------------------------------

$> module load EasyBuild
$> module list

Currently Loaded Modules:
   1) EasyBuild/2.8.1

$> eb --version
This is EasyBuild 2.8.1 (framework: 2.8.1, easyblocks: 2.8.1) on host 
leucine-zipper.gcc.rug.nl.
[umcg-pneerincx@leucine-zipper ~]$ python -m test.framework.suite
INFO: This is (based on) vsc.install.shared_setup 0.10.6
WARNING: xmlrunner module not available, falling back to using unittest...

........................Skipping test_from_pr, no GitHub token available?
.Skipping test_from_pr, no GitHub token available?
.........EE......Skipping test_new_pr, no GitHub token available?
.......Skipping test_review_pr, no GitHub token available?
................(skipping GitRepository test)
.(skipping HgRepository test)
..(skipping SvnRepository test)
..............................Skipping test_dep_graph, since pygraph is not 
available
....Skipping test_dump_autopep8, since autopep8 is not available
.........................................................................................................................Skipping
 test_from_pr, no GitHub token available?
.............................Skipping test_download_repo, no GitHub token 
available?
.Skipping test_fetch_easyconfigs_from_pr, no GitHub token available?
.Skipping test_fetch_latest_commit_sha, no GitHub token available?
.Skipping test_install_github_token, no GitHub token available?
.Skipping test_read, no GitHub token available?
.Skipping test_read_api, no GitHub token available?
.Skipping test_validate_github_token, no GitHub token available?
.Skipping test_walk, no GitHub token available?
............................................................/apps/software/EasyBuild/2.8.1/lib/python2.6/site-packages/vsc_install-0.10.6-py2.6.egg/vsc/install/testing.py:90:
 DeprecationWarning: BaseException.message has been deprecated as of Python 2.6
   elif hasattr(err, 'message'):
/apps/software/EasyBuild/2.8.1/lib/python2.6/site-packages/vsc_install-0.10.6-py2.6.egg/vsc/install/testing.py:91:
 DeprecationWarning: BaseException.message has been deprecated as of Python 2.6
   msg = err.message
............................................................GC3Pie not 
available, skipping test
.............................
======================================================================
ERROR: Test --include-module-naming-schemes.
----------------------------------------------------------------------
Traceback (most recent call last):
   File 
"/apps/software/EasyBuild/2.8.1/lib/python2.6/site-packages/easybuild_framework-2.8.1-py2.6.egg/test/framework/options.py",
 line 1914, in test_include_module_naming_schemes
     logtxt, _= run_cmd("cd %s; eb %s" % (self.test_prefix, ' '.join(args)), 
simple=False)
   File 
"/apps/software/EasyBuild/2.8.1/lib/python2.6/site-packages/easybuild_framework-2.8.1-py2.6.egg/easybuild/tools/run.py",
 line 149, in run_cmd
     return parse_cmd_output(cmd, stdouterr, ec, simple, log_all, log_ok, 
regexp)
   File 
"/apps/software/EasyBuild/2.8.1/lib/python2.6/site-packages/easybuild_framework-2.8.1-py2.6.egg/easybuild/tools/run.py",
 line 397, in parse_cmd_output
     raise EasyBuildError('cmd "%s" exited with exitcode %s and output:\n%s', 
cmd, ec, stdouterr)
EasyBuildError: 'cmd "cd /tmp/eb-RGZgpK/eb-jPpZRj/eb-CpYX0l; eb 
--avail-module-naming-schemes" exited with exitcode 127 and output:\n/bin/bash: eb: 
command not found\n'

======================================================================
ERROR: Test --include-toolchains.
----------------------------------------------------------------------
Traceback (most recent call last):
   File 
"/apps/software/EasyBuild/2.8.1/lib/python2.6/site-packages/easybuild_framework-2.8.1-py2.6.egg/test/framework/options.py",
 line 1988, in test_include_toolchains
     logtxt, _= run_cmd("cd %s; eb %s" % (self.test_prefix, ' '.join(args)), 
simple=False)
   File 
"/apps/software/EasyBuild/2.8.1/lib/python2.6/site-packages/easybuild_framework-2.8.1-py2.6.egg/easybuild/tools/run.py",
 line 149, in run_cmd
     return parse_cmd_output(cmd, stdouterr, ec, simple, log_all, log_ok, 
regexp)
   File 
"/apps/software/EasyBuild/2.8.1/lib/python2.6/site-packages/easybuild_framework-2.8.1-py2.6.egg/easybuild/tools/run.py",
 line 397, in parse_cmd_output
     raise EasyBuildError('cmd "%s" exited with exitcode %s and output:\n%s', 
cmd, ec, stdouterr)
EasyBuildError: 'cmd "cd /tmp/eb-RGZgpK/eb-jPpZRj/eb-Z0chZg; eb 
--list-toolchains" exited with exitcode 127 and output:\n/bin/bash: eb: command not 
found\n'

----------------------------------------------------------------------
Ran 408 tests in 14397.898s

FAILED (errors=2)
ERROR: Not all tests were successful.



-------------------------------------------------------------
phone: +31 6 143 66 783
e-mail: pieter.neeri...@gmail.com
skype:  pieter.online
-------------------------------------------------------------