Re: [oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 183 - Failure!

2018-02-06 Thread Simone Tiraboschi 
On Tue, Feb 6, 2018 at 9:41 AM, Eyal Edri  wrote:

>
>
> On Feb 6, 2018 10:37, "Simone Tiraboschi"  wrote:
>
>
>
> On Tue, Feb 6, 2018 at 9:15 AM, Sandro Bonazzola 
> wrote:
>
>> I see:
>>
>> *04:29:42* Error: Ansible(>= 2.2) is not installed.*04:29:42* Some of the 
>> features might not work if not installed.
>>
>>
>> Followed by:
>>
>> *04:29:53* Running test scenario 002_bootstrap.py*04:29:53* + env_run_test 
>> /home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py*04:29:53*
>>  + local res=0*04:29:53* + cd 
>> /home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/deployment-hc-basic-suite-master*04:29:53*
>>  + lago ovirt runtest 
>> /home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py*04:29:53*
>>  @ Run test: 002_bootstrap.py: *04:29:53* nose.config: INFO: Ignoring files 
>> matching ['^\\.', '^_', '^setup\\.py$']*04:29:53*   # wait_engine: 
>> *04:42:13* * Collect artifacts: *04:42:30*   - [Thread-4] 
>> lago-hc-basic-suite-master-engine: ERROR (in 0:00:16)*04:42:30* Error while 
>> running thread*04:42:30* Traceback (most recent call last):*04:42:30*   File 
>> "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in 
>> _ret_via_queue*04:42:30* queue.put({'return': func()})*04:42:30*   File 
>> "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1504, in 
>> _collect_artifacts*04:42:30* vm.collect_artifacts(path, 
>> ignore_nopath)*04:42:30*   File 
>> "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 635, in 
>> collect_artifacts*04:42:30* ignore_nopath=ignore_nopath*04:42:30*   File 
>> "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 381, in 
>> extract_paths*04:42:30* return self.provider.extract_paths(paths, *args, 
>> **kwargs)*04:42:30*   File 
>> "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 251, in 
>> extract_paths*04:42:30* format(self.vm.name())*04:42:30* 
>> ExtractPathError: Unable to extract paths from 
>> lago-hc-basic-suite-master-engine: unreachable with SSH
>>
>>
>> lago is not able to extract logs from the engine because the engine vm is 
>> down.
>>
>> The deploy failed with:
>>
>>
>> 2018-02-05 22:29:38,221-0500 DEBUG 
>> otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:190 
>> ansible-playbook stderr:
>> 2018-02-05 22:29:38,222-0500 DEBUG otopi.context context._executeMethod:143 
>> method exception
>> Traceback (most recent call last):
>>   File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in 
>> _executeMethod
>> method['method']()
>>   File 
>> "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-ansiblesetup/core/target_vm.py",
>>  line 193, in _closeup
>> r = ah.run()
>>   File 
>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/ansible_utils.py",
>>  line 194, in run
>> raise RuntimeError(_('Failed executing ansible-playbook'))
>> RuntimeError: Failed executing ansible-playbook
>>
>> Didi, Simone, can you please have a look?
>>
>> The issue is here:
>
> Feb  5 22:21:39 lago-hc-basic-suite-master-host0 libvirtd: 2018-02-06
> 03:21:39.367+: 16907: error : x86ModelFromCPU:1061 : internal error:
> Unknown CPU model Haswell-noTSXIBRS
>
> We are incorrectly handling the CPU model name for AMD and IBRS enabled
> families.
> We have an open bug here:
> https://bugzilla.redhat.com/show_bug.cgi?id=1541328
>
>
> We fixed a similar issue for basic suite, it might fail on slave with
> outdated lago-ost-plugin.
>
> Gal, can you please have a look to see if it's the same issue we fixed
> already?
>

For sure we have also a bug on hosted-engine-setup code properly detecting
the CPU model name if IBRS is enabled.
Running on not IBRS enabled hosts should work.



>
>
>
>
>> Ansible logs are at:
>>
>> http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/183/artifact/exported-artifacts/test_logs/hc-basic-suite-master/post-002_bootstrap.py/lago-hc-basic-suite-master-host0/_var_log/ovirt-hosted-engine-setup/
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> 2018-02-06 4:43 GMT+01:00 :
>>
>>> Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-sui
>>> te-master/
>>> Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-sui
>>> te-master/183/
>>> Build Number: 183
>>> Build Status:  Failure
>>> Triggered By: Started by timer
>>>
>>> -
>>> Changes Since Last Success:
>>> -
>>> Changes for Build #183
>>> [Sandro Bonazzola] hc-basic-suite-4.1: add centos-qemu-ev-release-el7
>>>
>>> [Sandro Bonazzola] ovirt-engine: dropped fcraw on master
>>>
>>> [Barak Korren] Add a timeout to pipline STDCI jobs
>>>
>>> [Sandro Bonazzola] ovirt-guest-agent: drop el6 on >= 4.2
>>>
>>>
>>>

Re: [oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 183 - Failure!

2018-02-06 Thread Eyal Edri 
On Feb 6, 2018 10:37, "Simone Tiraboschi"  wrote:



On Tue, Feb 6, 2018 at 9:15 AM, Sandro Bonazzola 
wrote:

> I see:
>
> *04:29:42* Error: Ansible(>= 2.2) is not installed.*04:29:42* Some of the 
> features might not work if not installed.
>
>
> Followed by:
>
> *04:29:53* Running test scenario 002_bootstrap.py*04:29:53* + env_run_test 
> /home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py*04:29:53*
>  + local res=0*04:29:53* + cd 
> /home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/deployment-hc-basic-suite-master*04:29:53*
>  + lago ovirt runtest 
> /home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py*04:29:53*
>  @ Run test: 002_bootstrap.py: *04:29:53* nose.config: INFO: Ignoring files 
> matching ['^\\.', '^_', '^setup\\.py$']*04:29:53*   # wait_engine: *04:42:13* 
> * Collect artifacts: *04:42:30*   - [Thread-4] 
> lago-hc-basic-suite-master-engine: ERROR (in 0:00:16)*04:42:30* Error while 
> running thread*04:42:30* Traceback (most recent call last):*04:42:30*   File 
> "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in 
> _ret_via_queue*04:42:30* queue.put({'return': func()})*04:42:30*   File 
> "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1504, in 
> _collect_artifacts*04:42:30* vm.collect_artifacts(path, 
> ignore_nopath)*04:42:30*   File 
> "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 635, in 
> collect_artifacts*04:42:30* ignore_nopath=ignore_nopath*04:42:30*   File 
> "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 381, in 
> extract_paths*04:42:30* return self.provider.extract_paths(paths, *args, 
> **kwargs)*04:42:30*   File 
> "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 251, in 
> extract_paths*04:42:30* format(self.vm.name())*04:42:30* 
> ExtractPathError: Unable to extract paths from 
> lago-hc-basic-suite-master-engine: unreachable with SSH
>
>
> lago is not able to extract logs from the engine because the engine vm is 
> down.
>
> The deploy failed with:
>
>
> 2018-02-05 22:29:38,221-0500 DEBUG 
> otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:190 
> ansible-playbook stderr:
> 2018-02-05 22:29:38,222-0500 DEBUG otopi.context context._executeMethod:143 
> method exception
> Traceback (most recent call last):
>   File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in 
> _executeMethod
> method['method']()
>   File 
> "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-ansiblesetup/core/target_vm.py",
>  line 193, in _closeup
> r = ah.run()
>   File 
> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/ansible_utils.py",
>  line 194, in run
> raise RuntimeError(_('Failed executing ansible-playbook'))
> RuntimeError: Failed executing ansible-playbook
>
> Didi, Simone, can you please have a look?
>
> The issue is here:

Feb  5 22:21:39 lago-hc-basic-suite-master-host0 libvirtd: 2018-02-06
03:21:39.367+: 16907: error : x86ModelFromCPU:1061 : internal error:
Unknown CPU model Haswell-noTSXIBRS

We are incorrectly handling the CPU model name for AMD and IBRS enabled
families.
We have an open bug here:
https://bugzilla.redhat.com/show_bug.cgi?id=1541328


We fixed a similar issue for basic suite, it might fail on slave with
outdated lago-ost-plugin.

Gal, can you please have a look to see if it's the same issue we fixed
already?




> Ansible logs are at:
>
> http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/183/artifact/exported-artifacts/test_logs/hc-basic-suite-master/post-002_bootstrap.py/lago-hc-basic-suite-master-host0/_var_log/ovirt-hosted-engine-setup/
>
>
>
>
>
>
>
>
>
>
>
> 2018-02-06 4:43 GMT+01:00 :
>
>> Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-sui
>> te-master/
>> Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-sui
>> te-master/183/
>> Build Number: 183
>> Build Status:  Failure
>> Triggered By: Started by timer
>>
>> -
>> Changes Since Last Success:
>> -
>> Changes for Build #183
>> [Sandro Bonazzola] hc-basic-suite-4.1: add centos-qemu-ev-release-el7
>>
>> [Sandro Bonazzola] ovirt-engine: dropped fcraw on master
>>
>> [Barak Korren] Add a timeout to pipline STDCI jobs
>>
>> [Sandro Bonazzola] ovirt-guest-agent: drop el6 on >= 4.2
>>
>>
>>
>>
>> -
>> Failed Tests:
>> -
>> No tests ran.
>> ___
>> Infra mailing list
>> Infra@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/infra
>>
>>
>
>
> --
>
> SANDRO BONAZZOLA
>
> ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R
>
> Red Hat EMEA 
>

Re: [oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 183 - Failure!

2018-02-06 Thread Simone Tiraboschi 
On Tue, Feb 6, 2018 at 9:15 AM, Sandro Bonazzola 
wrote:

> I see:
>
> *04:29:42* Error: Ansible(>= 2.2) is not installed.*04:29:42* Some of the 
> features might not work if not installed.
>
>
> Followed by:
>
> *04:29:53* Running test scenario 002_bootstrap.py*04:29:53* + env_run_test 
> /home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py*04:29:53*
>  + local res=0*04:29:53* + cd 
> /home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/deployment-hc-basic-suite-master*04:29:53*
>  + lago ovirt runtest 
> /home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py*04:29:53*
>  @ Run test: 002_bootstrap.py: *04:29:53* nose.config: INFO: Ignoring files 
> matching ['^\\.', '^_', '^setup\\.py$']*04:29:53*   # wait_engine: *04:42:13* 
> * Collect artifacts: *04:42:30*   - [Thread-4] 
> lago-hc-basic-suite-master-engine: ERROR (in 0:00:16)*04:42:30* Error while 
> running thread*04:42:30* Traceback (most recent call last):*04:42:30*   File 
> "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in 
> _ret_via_queue*04:42:30* queue.put({'return': func()})*04:42:30*   File 
> "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1504, in 
> _collect_artifacts*04:42:30* vm.collect_artifacts(path, 
> ignore_nopath)*04:42:30*   File 
> "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 635, in 
> collect_artifacts*04:42:30* ignore_nopath=ignore_nopath*04:42:30*   File 
> "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 381, in 
> extract_paths*04:42:30* return self.provider.extract_paths(paths, *args, 
> **kwargs)*04:42:30*   File 
> "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 251, in 
> extract_paths*04:42:30* format(self.vm.name())*04:42:30* 
> ExtractPathError: Unable to extract paths from 
> lago-hc-basic-suite-master-engine: unreachable with SSH
>
>
> lago is not able to extract logs from the engine because the engine vm is 
> down.
>
> The deploy failed with:
>
>
> 2018-02-05 22:29:38,221-0500 DEBUG 
> otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:190 
> ansible-playbook stderr:
> 2018-02-05 22:29:38,222-0500 DEBUG otopi.context context._executeMethod:143 
> method exception
> Traceback (most recent call last):
>   File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in 
> _executeMethod
> method['method']()
>   File 
> "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-ansiblesetup/core/target_vm.py",
>  line 193, in _closeup
> r = ah.run()
>   File 
> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/ansible_utils.py",
>  line 194, in run
> raise RuntimeError(_('Failed executing ansible-playbook'))
> RuntimeError: Failed executing ansible-playbook
>
> Didi, Simone, can you please have a look?
>
> The issue is here:

Feb  5 22:21:39 lago-hc-basic-suite-master-host0 libvirtd: 2018-02-06
03:21:39.367+: 16907: error : x86ModelFromCPU:1061 : internal error:
Unknown CPU model Haswell-noTSXIBRS

We are incorrectly handling the CPU model name for AMD and IBRS enabled
families.
We have an open bug here:
https://bugzilla.redhat.com/show_bug.cgi?id=1541328



> Ansible logs are at:
>
> http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/183/artifact/exported-artifacts/test_logs/hc-basic-suite-master/post-002_bootstrap.py/lago-hc-basic-suite-master-host0/_var_log/ovirt-hosted-engine-setup/
>
>
>
>
>
>
>
>
>
>
>
> 2018-02-06 4:43 GMT+01:00 :
>
>> Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-sui
>> te-master/
>> Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-sui
>> te-master/183/
>> Build Number: 183
>> Build Status:  Failure
>> Triggered By: Started by timer
>>
>> -
>> Changes Since Last Success:
>> -
>> Changes for Build #183
>> [Sandro Bonazzola] hc-basic-suite-4.1: add centos-qemu-ev-release-el7
>>
>> [Sandro Bonazzola] ovirt-engine: dropped fcraw on master
>>
>> [Barak Korren] Add a timeout to pipline STDCI jobs
>>
>> [Sandro Bonazzola] ovirt-guest-agent: drop el6 on >= 4.2
>>
>>
>>
>>
>> -
>> Failed Tests:
>> -
>> No tests ran.
>> ___
>> Infra mailing list
>> Infra@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/infra
>>
>>
>
>
> --
>
> SANDRO BONAZZOLA
>
> ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R
>
> Red Hat EMEA 
> 
> TRIED. TESTED. TRUSTED. 
>
>
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

Re: [oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 183 - Failure!

2018-02-06 Thread Sandro Bonazzola 
I see:

*04:29:42* Error: Ansible(>= 2.2) is not installed.*04:29:42* Some of
the features might not work if not installed.


Followed by:

*04:29:53* Running test scenario 002_bootstrap.py*04:29:53* +
env_run_test 
/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py*04:29:53*
+ local res=0*04:29:53* + cd
/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/deployment-hc-basic-suite-master*04:29:53*
+ lago ovirt runtest
/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py*04:29:53*
@ Run test: 002_bootstrap.py: *04:29:53* nose.config: INFO: Ignoring
files matching ['^\\.', '^_', '^setup\\.py$']*04:29:53*   #
wait_engine: *04:42:13* * Collect artifacts: *04:42:30*   -
[Thread-4] lago-hc-basic-suite-master-engine: ERROR (in
0:00:16)*04:42:30* Error while running thread*04:42:30* Traceback
(most recent call last):*04:42:30*   File
"/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in
_ret_via_queue*04:42:30* queue.put({'return': func()})*04:42:30*
File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1504, in
_collect_artifacts*04:42:30* vm.collect_artifacts(path,
ignore_nopath)*04:42:30*   File
"/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 635, in
collect_artifacts*04:42:30* ignore_nopath=ignore_nopath*04:42:30*
 File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 381,
in extract_paths*04:42:30* return
self.provider.extract_paths(paths, *args, **kwargs)*04:42:30*   File
"/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 251, in
extract_paths*04:42:30* format(self.vm.name())*04:42:30*
ExtractPathError: Unable to extract paths from
lago-hc-basic-suite-master-engine: unreachable with SSH


lago is not able to extract logs from the engine because the engine vm is down.

The deploy failed with:


2018-02-05 22:29:38,221-0500 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:190
ansible-playbook stderr:
2018-02-05 22:29:38,222-0500 DEBUG otopi.context
context._executeMethod:143 method exception
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133,
in _executeMethod
method['method']()
  File 
"/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-ansiblesetup/core/target_vm.py",
line 193, in _closeup
r = ah.run()
  File 
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/ansible_utils.py",
line 194, in run
raise RuntimeError(_('Failed executing ansible-playbook'))
RuntimeError: Failed executing ansible-playbook

Didi, Simone, can you please have a look?

Ansible logs are at:

http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/183/artifact/exported-artifacts/test_logs/hc-basic-suite-master/post-002_bootstrap.py/lago-hc-basic-suite-master-host0/_var_log/ovirt-hosted-engine-setup/











2018-02-06 4:43 GMT+01:00 :

> Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-
> suite-master/
> Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-
> suite-master/183/
> Build Number: 183
> Build Status:  Failure
> Triggered By: Started by timer
>
> -
> Changes Since Last Success:
> -
> Changes for Build #183
> [Sandro Bonazzola] hc-basic-suite-4.1: add centos-qemu-ev-release-el7
>
> [Sandro Bonazzola] ovirt-engine: dropped fcraw on master
>
> [Barak Korren] Add a timeout to pipline STDCI jobs
>
> [Sandro Bonazzola] ovirt-guest-agent: drop el6 on >= 4.2
>
>
>
>
> -
> Failed Tests:
> -
> No tests ran.
> ___
> Infra mailing list
> Infra@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>
>


-- 

SANDRO BONAZZOLA

ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R

Red Hat EMEA 

TRIED. TESTED. TRUSTED. 
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 183 - Failure!

2018-02-05 Thread jenkins 
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/ 
Build: 
http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/183/
Build Number: 183
Build Status:  Failure
Triggered By: Started by timer

-
Changes Since Last Success:
-
Changes for Build #183
[Sandro Bonazzola] hc-basic-suite-4.1: add centos-qemu-ev-release-el7

[Sandro Bonazzola] ovirt-engine: dropped fcraw on master

[Barak Korren] Add a timeout to pipline STDCI jobs

[Sandro Bonazzola] ovirt-guest-agent: drop el6 on >= 4.2




-
Failed Tests:
-
No tests ran.___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra