Re: [ovirt-devel] [ OST Failure Report ] [ oVirt Hosted-Engine ] [ 17-12-2017 ] [ post-002_bootstrap.py ]

[Yaniv Kaul]

On Sun, Dec 17, 2017 at 3:36 PM, Yaniv Kaul  wrote:

>
>
> On Sun, Dec 17, 2017 at 3:12 PM, Eyal Edri  wrote:
>
>> I believe it correlates with the known bug(s)s we already know about
>> hosted-engine, I think Simone already opened a bug on it, but not sure.
>> Also, all the HE blocker bugs seem to be already on MODIFIED or ON_QA
>> [1], so not sure if its the same issue or not.
>>
>>
>> [1]
>> https://bugzilla.redhat.com/show_bug.cgi?id=1522641
>> https://bugzilla.redhat.com/show_bug.cgi?id=1512534
>>
>
> I thought it is actually https://bugzilla.redh
> at.com/show_bug.cgi?id=1502768
>

But now that I look at the logs, it is the issue with sanlock - reported in
https://bugzilla.redhat.com/show_bug.cgi?id=1525955
Y.


>
> Anyway, I'm more concerned that:
> 1. It is still failing (and this is the old method of provisioning Hosted
> Engine, which is supposed to be our fallback plan!)
> 2. We are not testing the new Ansible based flows in CI.
> Y.
>
>
>>
>>
>>
>>
>> On Sun, Dec 17, 2017 at 2:02 PM, Dafna Ron  wrote:
>>
>>> Hi,
>>>
>>> We are failing OST for HE deployment.
>>>
>>> The failures started on 12/12 and latest failure is today, 17/12.
>>>
>>> *Link and headline of suspected patches: *
>>>
>>>
>>> * OST: avoid excluding ovirt-engine-appliance from base repo-
>>> https://gerrit.ovirt.org/#/c/85439/ 
>>> Link to Job:
>>> http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/139/
>>> *
>>>
>>>
>>> *Link to all logs:*
>>> *
>>> http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/139/artifact/
>>> *
>>>
>>>
>>> *(Relevant) error snippet from the log: *
>>>
>>>
>>> *  *
>>>
>>> 2017-12-16 22:29:49,179-0500 INFO otopi.plugins.gr_he_setup.vm.runvm 
>>> mixins._create_vm:151 Creating VM
>>> 2017-12-16 22:29:49,460-0500 DEBUG otopi.context context._executeMethod:143 
>>> method exception
>>> Traceback (most recent call last):
>>>   File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in 
>>> _executeMethod
>>> method['method']()
>>>   File 
>>> "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-setup/vm/runvm.py",
>>>  line 174, in _boot_from_hd
>>> self._create_vm()
>>>   File 
>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/mixins.py", 
>>> line 303, in _create_vm
>>> raise RuntimeError(str(e))
>>> RuntimeError: Command VM.getStats with args {'vmID': 
>>> '9b8a91ea-d5aa-44e6-8890-684173be7ef5'} failed:
>>> (code=100, message=General Exception: ("VM 
>>> '9b8a91ea-d5aa-44e6-8890-684173be7ef5' was not defined yet or was 
>>> undefined",))
>>> 2017-12-16 22:29:49,512-0500 ERROR otopi.context context._executeMethod:152 
>>> Failed to execute stage 'Closing up': Command VM.getStats with args 
>>> {'vmID': '9b8a91ea-d5aa-44e6-8890-684173be7ef5'} failed:
>>> (code=100, message=General Exception: ("VM 
>>> '9b8a91ea-d5aa-44e6-8890-684173be7ef5' was not defined yet or was 
>>> undefined",))
>>> 2017-12-16 22:29:49,513-0500 DEBUG otopi.plugins.otopi.dialog.human 
>>> human.format:69 newline sent to logger
>>> 2017-12-16 22:29:49,514-0500 DEBUG otopi.context 
>>> context.dumpEnvironment:821 ENVIRONMENT DUMP - BEGIN
>>> 2017-12-16 22:29:49,514-0500 DEBUG otopi.context 
>>> context.dumpEnvironment:831 ENV BASE/error=bool:'True'
>>> 2017-12-16 22:29:49,514-0500 DEBUG otopi.context 
>>> context.dumpEnvironment:831 ENV BASE/exceptionInfo=list:'[(>> 'exceptions.RuntimeError'>, RuntimeError('Command VM.getStats with args 
>>> {\'vmID\': \'9b8a91ea-d5aa-44e6-8890-684173be7ef5\'} failed:\n(code=100, 
>>> message=General Exception: ("VM \'9b8a91ea-d5aa-44e6-8890-684173be7ef5\' 
>>> was not defined yet or was undefined",))',), >> 0x40ba5a8>)]'
>>> 2017-12-16 22:29:49,515-0500 DEBUG otopi.context 
>>> context.dumpEnvironment:831 ENV OVEHOSTED_VM/subst=dict:'{'@VIDEO_DEVICE@': 
>>> 'vga', '@SD_UUID@': 'c3c3e51a-b086-4bc1-97af-89109971b819', 
>>> '@CONSOLE_UUID@': 'b11ce8af-9633-4680-beba-9f2d4e48102f', '@NAME@': 
>>> 'HostedEngine', '@BRIDGE@': 'ovirtmgmt', '@CDROM_UUID@': 
>>> '856afaa0-dc01-403b-9b92-457b6cec081f', '@MEM_SIZE@': 3171, '@NIC_UUID@': 
>>> '8a6fa9b0-4f60-42e2-8cc8-bb45bd124ffd', '@VCPUS@': '2', '@CPU_TYPE@': 
>>> 'SandyBridge', '@VM_UUID@': '9b8a91ea-d5aa-44e6-8890-684173be7ef5', 
>>> '@CDROM@': '/tmp/tmpwDR4Ng/seed.iso', '@EMULATED_MACHINE@': 'pc', 
>>> '@GRAPHICS_DEVICE@': 'vnc', '@MAXVCPUS@': u'2', '@IMG_UUID@': 
>>> '9bae6dab-8697-4bf0-a6da-c4c07d66c57d', '@CONSOLE_TYPE@': 'vnc', 
>>> '@MAC_ADDR@': '54:52:c0:a8:c8:63', '@SP_UUID@': 
>>> '----', '@VOL_UUID@': 
>>> '8a639d80-96eb-47d2-a922-f0ae847137cc'}'
>>> 2017-12-16 22:29:49,517-0500 DEBUG otopi.context 
>>> context.dumpEnvironment:835 ENVIRONMENT DUMP - END
>>> 2017-12-16 22:29:49,518-0500 

Re: [ovirt-devel] [ OST Failure Report ] [ oVirt Hosted-Engine ] [ 17-12-2017 ] [ post-002_bootstrap.py ]

[Yaniv Kaul]

On Sun, Dec 17, 2017 at 3:12 PM, Eyal Edri  wrote:

> I believe it correlates with the known bug(s)s we already know about
> hosted-engine, I think Simone already opened a bug on it, but not sure.
> Also, all the HE blocker bugs seem to be already on MODIFIED or ON_QA [1],
> so not sure if its the same issue or not.
>
>
> [1]
> https://bugzilla.redhat.com/show_bug.cgi?id=1522641
> https://bugzilla.redhat.com/show_bug.cgi?id=1512534
>

I thought it is actually https://bugzilla.redhat.com/show_bug.cgi?id=1502768

Anyway, I'm more concerned that:
1. It is still failing (and this is the old method of provisioning Hosted
Engine, which is supposed to be our fallback plan!)
2. We are not testing the new Ansible based flows in CI.
Y.


>
>
>
>
> On Sun, Dec 17, 2017 at 2:02 PM, Dafna Ron  wrote:
>
>> Hi,
>>
>> We are failing OST for HE deployment.
>>
>> The failures started on 12/12 and latest failure is today, 17/12.
>>
>> *Link and headline of suspected patches: *
>>
>>
>> * OST: avoid excluding ovirt-engine-appliance from base repo-
>> https://gerrit.ovirt.org/#/c/85439/ 
>> Link to Job:
>> http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/139/
>> *
>>
>>
>> *Link to all logs:*
>> *
>> http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/139/artifact/
>> *
>>
>>
>> *(Relevant) error snippet from the log: *
>>
>>
>> *  *
>>
>> 2017-12-16 22:29:49,179-0500 INFO otopi.plugins.gr_he_setup.vm.runvm 
>> mixins._create_vm:151 Creating VM
>> 2017-12-16 22:29:49,460-0500 DEBUG otopi.context context._executeMethod:143 
>> method exception
>> Traceback (most recent call last):
>>   File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in 
>> _executeMethod
>> method['method']()
>>   File 
>> "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-setup/vm/runvm.py",
>>  line 174, in _boot_from_hd
>> self._create_vm()
>>   File 
>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/mixins.py", line 
>> 303, in _create_vm
>> raise RuntimeError(str(e))
>> RuntimeError: Command VM.getStats with args {'vmID': 
>> '9b8a91ea-d5aa-44e6-8890-684173be7ef5'} failed:
>> (code=100, message=General Exception: ("VM 
>> '9b8a91ea-d5aa-44e6-8890-684173be7ef5' was not defined yet or was 
>> undefined",))
>> 2017-12-16 22:29:49,512-0500 ERROR otopi.context context._executeMethod:152 
>> Failed to execute stage 'Closing up': Command VM.getStats with args {'vmID': 
>> '9b8a91ea-d5aa-44e6-8890-684173be7ef5'} failed:
>> (code=100, message=General Exception: ("VM 
>> '9b8a91ea-d5aa-44e6-8890-684173be7ef5' was not defined yet or was 
>> undefined",))
>> 2017-12-16 22:29:49,513-0500 DEBUG otopi.plugins.otopi.dialog.human 
>> human.format:69 newline sent to logger
>> 2017-12-16 22:29:49,514-0500 DEBUG otopi.context context.dumpEnvironment:821 
>> ENVIRONMENT DUMP - BEGIN
>> 2017-12-16 22:29:49,514-0500 DEBUG otopi.context context.dumpEnvironment:831 
>> ENV BASE/error=bool:'True'
>> 2017-12-16 22:29:49,514-0500 DEBUG otopi.context context.dumpEnvironment:831 
>> ENV BASE/exceptionInfo=list:'[(, 
>> RuntimeError('Command VM.getStats with args {\'vmID\': 
>> \'9b8a91ea-d5aa-44e6-8890-684173be7ef5\'} failed:\n(code=100, 
>> message=General Exception: ("VM \'9b8a91ea-d5aa-44e6-8890-684173be7ef5\' was 
>> not defined yet or was undefined",))',), )]'
>> 2017-12-16 22:29:49,515-0500 DEBUG otopi.context context.dumpEnvironment:831 
>> ENV OVEHOSTED_VM/subst=dict:'{'@VIDEO_DEVICE@': 'vga', '@SD_UUID@': 
>> 'c3c3e51a-b086-4bc1-97af-89109971b819', '@CONSOLE_UUID@': 
>> 'b11ce8af-9633-4680-beba-9f2d4e48102f', '@NAME@': 'HostedEngine', 
>> '@BRIDGE@': 'ovirtmgmt', '@CDROM_UUID@': 
>> '856afaa0-dc01-403b-9b92-457b6cec081f', '@MEM_SIZE@': 3171, '@NIC_UUID@': 
>> '8a6fa9b0-4f60-42e2-8cc8-bb45bd124ffd', '@VCPUS@': '2', '@CPU_TYPE@': 
>> 'SandyBridge', '@VM_UUID@': '9b8a91ea-d5aa-44e6-8890-684173be7ef5', 
>> '@CDROM@': '/tmp/tmpwDR4Ng/seed.iso', '@EMULATED_MACHINE@': 'pc', 
>> '@GRAPHICS_DEVICE@': 'vnc', '@MAXVCPUS@': u'2', '@IMG_UUID@': 
>> '9bae6dab-8697-4bf0-a6da-c4c07d66c57d', '@CONSOLE_TYPE@': 'vnc', 
>> '@MAC_ADDR@': '54:52:c0:a8:c8:63', '@SP_UUID@': 
>> '----', '@VOL_UUID@': 
>> '8a639d80-96eb-47d2-a922-f0ae847137cc'}'
>> 2017-12-16 22:29:49,517-0500 DEBUG otopi.context context.dumpEnvironment:835 
>> ENVIRONMENT DUMP - END
>> 2017-12-16 22:29:49,518-0500 INFO otopi.context context.runSequence:735 
>> Stage: Clean up
>>
>> **
>>
>>
>> ___
>> Infra mailing list
>> in...@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/infra
>>
>>
>
>
> --
>
> Eyal edri
>
>
> MANAGER
>
> RHV DevOps
>
> EMEA VIRTUALIZATION R
>
>
> Red Hat EMEA 
>  

Re: [ovirt-devel] [ OST Failure Report ] [ oVirt Hosted-Engine ] [ 17-12-2017 ] [ post-002_bootstrap.py ]

[Eyal Edri]

I believe it correlates with the known bug(s)s we already know about
hosted-engine, I think Simone already opened a bug on it, but not sure.
Also, all the HE blocker bugs seem to be already on MODIFIED or ON_QA [1],
so not sure if its the same issue or not.


[1]
https://bugzilla.redhat.com/show_bug.cgi?id=1522641
https://bugzilla.redhat.com/show_bug.cgi?id=1512534



On Sun, Dec 17, 2017 at 2:02 PM, Dafna Ron  wrote:

> Hi,
>
> We are failing OST for HE deployment.
>
> The failures started on 12/12 and latest failure is today, 17/12.
>
> *Link and headline of suspected patches: *
>
>
> * OST: avoid excluding ovirt-engine-appliance from base repo-
> https://gerrit.ovirt.org/#/c/85439/ 
> Link to Job:
> http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/139/
> *
>
>
> *Link to all logs:*
> *
> http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/139/artifact/
> *
>
>
> *(Relevant) error snippet from the log: *
>
>
> *  *
>
> 2017-12-16 22:29:49,179-0500 INFO otopi.plugins.gr_he_setup.vm.runvm 
> mixins._create_vm:151 Creating VM
> 2017-12-16 22:29:49,460-0500 DEBUG otopi.context context._executeMethod:143 
> method exception
> Traceback (most recent call last):
>   File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in 
> _executeMethod
> method['method']()
>   File 
> "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-setup/vm/runvm.py",
>  line 174, in _boot_from_hd
> self._create_vm()
>   File 
> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/mixins.py", line 
> 303, in _create_vm
> raise RuntimeError(str(e))
> RuntimeError: Command VM.getStats with args {'vmID': 
> '9b8a91ea-d5aa-44e6-8890-684173be7ef5'} failed:
> (code=100, message=General Exception: ("VM 
> '9b8a91ea-d5aa-44e6-8890-684173be7ef5' was not defined yet or was 
> undefined",))
> 2017-12-16 22:29:49,512-0500 ERROR otopi.context context._executeMethod:152 
> Failed to execute stage 'Closing up': Command VM.getStats with args {'vmID': 
> '9b8a91ea-d5aa-44e6-8890-684173be7ef5'} failed:
> (code=100, message=General Exception: ("VM 
> '9b8a91ea-d5aa-44e6-8890-684173be7ef5' was not defined yet or was 
> undefined",))
> 2017-12-16 22:29:49,513-0500 DEBUG otopi.plugins.otopi.dialog.human 
> human.format:69 newline sent to logger
> 2017-12-16 22:29:49,514-0500 DEBUG otopi.context context.dumpEnvironment:821 
> ENVIRONMENT DUMP - BEGIN
> 2017-12-16 22:29:49,514-0500 DEBUG otopi.context context.dumpEnvironment:831 
> ENV BASE/error=bool:'True'
> 2017-12-16 22:29:49,514-0500 DEBUG otopi.context context.dumpEnvironment:831 
> ENV BASE/exceptionInfo=list:'[(, 
> RuntimeError('Command VM.getStats with args {\'vmID\': 
> \'9b8a91ea-d5aa-44e6-8890-684173be7ef5\'} failed:\n(code=100, message=General 
> Exception: ("VM \'9b8a91ea-d5aa-44e6-8890-684173be7ef5\' was not defined yet 
> or was undefined",))',), )]'
> 2017-12-16 22:29:49,515-0500 DEBUG otopi.context context.dumpEnvironment:831 
> ENV OVEHOSTED_VM/subst=dict:'{'@VIDEO_DEVICE@': 'vga', '@SD_UUID@': 
> 'c3c3e51a-b086-4bc1-97af-89109971b819', '@CONSOLE_UUID@': 
> 'b11ce8af-9633-4680-beba-9f2d4e48102f', '@NAME@': 'HostedEngine', '@BRIDGE@': 
> 'ovirtmgmt', '@CDROM_UUID@': '856afaa0-dc01-403b-9b92-457b6cec081f', 
> '@MEM_SIZE@': 3171, '@NIC_UUID@': '8a6fa9b0-4f60-42e2-8cc8-bb45bd124ffd', 
> '@VCPUS@': '2', '@CPU_TYPE@': 'SandyBridge', '@VM_UUID@': 
> '9b8a91ea-d5aa-44e6-8890-684173be7ef5', '@CDROM@': '/tmp/tmpwDR4Ng/seed.iso', 
> '@EMULATED_MACHINE@': 'pc', '@GRAPHICS_DEVICE@': 'vnc', '@MAXVCPUS@': u'2', 
> '@IMG_UUID@': '9bae6dab-8697-4bf0-a6da-c4c07d66c57d', '@CONSOLE_TYPE@': 
> 'vnc', '@MAC_ADDR@': '54:52:c0:a8:c8:63', '@SP_UUID@': 
> '----', '@VOL_UUID@': 
> '8a639d80-96eb-47d2-a922-f0ae847137cc'}'
> 2017-12-16 22:29:49,517-0500 DEBUG otopi.context context.dumpEnvironment:835 
> ENVIRONMENT DUMP - END
> 2017-12-16 22:29:49,518-0500 INFO otopi.context context.runSequence:735 
> Stage: Clean up
>
> **
>
>
> ___
> Infra mailing list
> in...@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>
>


-- 

Eyal edri


MANAGER

RHV DevOps

EMEA VIRTUALIZATION R


Red Hat EMEA 
 TRIED. TESTED. TRUSTED. 
phone: +972-9-7692018
irc: eedri (on #tlv #rhev-dev #rhev-integ)
___
Devel mailing list
Devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/devel

[ovirt-devel] [ OST Failure Report ] [ oVirt Hosted-Engine ] [ 17-12-2017 ] [ post-002_bootstrap.py ]

[Dafna Ron]

Hi,

We are failing OST for HE deployment.

The failures started on 12/12 and latest failure is today, 17/12. 

**

*Link and headline of suspected patches: *

***

OST: avoid excluding ovirt-engine-appliance from base repo-
https://gerrit.ovirt.org/#/c/85439/


Link to Job:

http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/139/*

*
*

*Link to all logs:*

*http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/139/artifact/*

*
*

*(Relevant) error snippet from the log: *

*




*

2017-12-16 22:29:49,179-0500 INFO otopi.plugins.gr_he_setup.vm.runvm 
mixins._create_vm:151 Creating VM
2017-12-16 22:29:49,460-0500 DEBUG otopi.context context._executeMethod:143 
method exception
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in 
_executeMethod
method['method']()
  File 
"/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-setup/vm/runvm.py",
 line 174, in _boot_from_hd
self._create_vm()
  File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/mixins.py", 
line 303, in _create_vm
raise RuntimeError(str(e))
RuntimeError: Command VM.getStats with args {'vmID': 
'9b8a91ea-d5aa-44e6-8890-684173be7ef5'} failed:
(code=100, message=General Exception: ("VM 
'9b8a91ea-d5aa-44e6-8890-684173be7ef5' was not defined yet or was undefined",))
2017-12-16 22:29:49,512-0500 ERROR otopi.context context._executeMethod:152 
Failed to execute stage 'Closing up': Command VM.getStats with args {'vmID': 
'9b8a91ea-d5aa-44e6-8890-684173be7ef5'} failed:
(code=100, message=General Exception: ("VM 
'9b8a91ea-d5aa-44e6-8890-684173be7ef5' was not defined yet or was undefined",))
2017-12-16 22:29:49,513-0500 DEBUG otopi.plugins.otopi.dialog.human 
human.format:69 newline sent to logger
2017-12-16 22:29:49,514-0500 DEBUG otopi.context context.dumpEnvironment:821 
ENVIRONMENT DUMP - BEGIN
2017-12-16 22:29:49,514-0500 DEBUG otopi.context context.dumpEnvironment:831 
ENV BASE/error=bool:'True'
2017-12-16 22:29:49,514-0500 DEBUG otopi.context context.dumpEnvironment:831 
ENV BASE/exceptionInfo=list:'[(, 
RuntimeError('Command VM.getStats with args {\'vmID\': 
\'9b8a91ea-d5aa-44e6-8890-684173be7ef5\'} failed:\n(code=100, message=General 
Exception: ("VM \'9b8a91ea-d5aa-44e6-8890-684173be7ef5\' was not defined yet or 
was undefined",))',), )]'
2017-12-16 22:29:49,515-0500 DEBUG otopi.context context.dumpEnvironment:831 
ENV OVEHOSTED_VM/subst=dict:'{'@VIDEO_DEVICE@': 'vga', '@SD_UUID@': 
'c3c3e51a-b086-4bc1-97af-89109971b819', '@CONSOLE_UUID@': 
'b11ce8af-9633-4680-beba-9f2d4e48102f', '@NAME@': 'HostedEngine', '@BRIDGE@': 
'ovirtmgmt', '@CDROM_UUID@': '856afaa0-dc01-403b-9b92-457b6cec081f', 
'@MEM_SIZE@': 3171, '@NIC_UUID@': '8a6fa9b0-4f60-42e2-8cc8-bb45bd124ffd', 
'@VCPUS@': '2', '@CPU_TYPE@': 'SandyBridge', '@VM_UUID@': 
'9b8a91ea-d5aa-44e6-8890-684173be7ef5', '@CDROM@': '/tmp/tmpwDR4Ng/seed.iso', 
'@EMULATED_MACHINE@': 'pc', '@GRAPHICS_DEVICE@': 'vnc', '@MAXVCPUS@': u'2', 
'@IMG_UUID@': '9bae6dab-8697-4bf0-a6da-c4c07d66c57d', '@CONSOLE_TYPE@': 'vnc', 
'@MAC_ADDR@': '54:52:c0:a8:c8:63', '@SP_UUID@': 
'----', '@VOL_UUID@': 
'8a639d80-96eb-47d2-a922-f0ae847137cc'}'
2017-12-16 22:29:49,517-0500 DEBUG otopi.context context.dumpEnvironment:835 
ENVIRONMENT DUMP - END
2017-12-16 22:29:49,518-0500 INFO otopi.context context.runSequence:735 Stage: 
Clean up

**

**

*
*

___
Devel mailing list
Devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/devel