Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/
Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/396/
Build Number: 396
Build Status: Still Failing
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #366
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #367
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #368
[Gal Ben Haim] Remove stale url to the internal repo
[Greg Sheremeta] add ovirt-web-ui to stdci v2
Changes for Build #369
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #370
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #371
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #372
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #373
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #374
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #375
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #376
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #377
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #378
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #379
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #380
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #381
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #382
[Eitan Raviv] networking: retrieve ipv6 of lago engine VM
Changes for Build #383
[Eitan Raviv] networking: retrieve ipv6 of lago engine VM
Changes for Build #384
[Eitan Raviv] networking: retrieve ipv6 of lago engine VM
Changes for Build #385
[Eitan Raviv] networking: retrieve ipv6 of lago engine VM
Changes for Build #386
[Eitan Raviv] networking: connect NFS to engine over IPv6
[Daniel Belenky] standard-pipelines: add kubevirt/common-templates
Changes for Build #387
[Eitan Raviv] networking: connect NFS to engine over IPv6
Changes for Build #388
[Eitan Raviv] networking: connect NFS to engine over IPv6
Changes for Build #389
[Eitan Raviv] networking: connect NFS to engine over IPv6
Changes for Build #390
[Eitan Raviv] networking: connect NFS to engine over IPv6
Changes for Build #391
[Eitan Raviv] networking: connect NFS to engine over IPv6
Changes for Build #392
[Eitan Raviv] networking: connect NFS to engine over IPv6
Changes for Build #393
[Eitan Raviv] networking: connect NFS to engine over IPv6
Changes for Build #394
[Eitan Raviv] networking: connect NFS to engine over IPv6
Changes for Build #395
[Eitan Raviv] networking: connect NFS to engine over IPv6
Changes for Build #396
[Eitan Raviv] networking: connect NFS to engine over IPv6
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 010_local_maintenance_cli.local_maintenance
Error Message:
143
-------------------- >> begin captured logging << --------------------
root: INFO: * Waiting For System Stability...
lago.ssh: DEBUG: start task:92984b83-8ac4-4390-b8db-fab332efd303:Get ssh client
for lago-he-node-ng-suite-4-2-host-1:
lago.ssh: DEBUG: end task:92984b83-8ac4-4390-b8db-fab332efd303:Get ssh client
for lago-he-node-ng-suite-4-2-host-1:
lago.ssh: DEBUG: Running 3c6eb576 on lago-he-node-ng-suite-4-2-host-1:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 3c6eb576 on lago-he-node-ng-suite-4-2-host-1 returned
with 0
lago.ssh: DEBUG: Command 3c6eb576 on lago-he-node-ng-suite-4-2-host-1 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4167 (Sat Oct
13 01:42:14 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=4167 (Sat Oct 13
01:42:14
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "3bf41c38", "local_conf_timestamp": 4167,
"host-ts": 4167}, "2": {"conf_on_shared_storage": true, "live-data": true,
"extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4172
(Sat Oct 13 01:42:19 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4172
(Sat Oct 13 01:42:19
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "f37ee498", "local_conf_timestamp": 4172, "host-ts": 4172},
"global_maintenance": false}
lago.ssh: DEBUG: start task:0425e165-cbe8-4092-9f52-e47497928de6:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:0425e165-cbe8-4092-9f52-e47497928de6:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 3d74e864 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --set-maintenance --mode=local
lago.ssh: DEBUG: Command 3d74e864 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
root: INFO: * Waiting for engine to migrate...
lago.ssh: DEBUG: start task:e496d289-deb2-4736-b4bb-9204269f9978:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:e496d289-deb2-4736-b4bb-9204269f9978:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 3e82f44e on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 3e82f44e on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 3e82f44e on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4177 (Sat Oct
13 01:42:24 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=4177 (Sat Oct 13
01:42:24
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "e7935c07", "local_conf_timestamp": 4177,
"host-ts": 4177}, "2": {"conf_on_shared_storage": true, "live-data": true,
"extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4172
(Sat Oct 13 01:42:19 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4172
(Sat Oct 13 01:42:19
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "f37ee498", "local_conf_timestamp": 4172, "host-ts": 4172},
"global_maintenance": false}
lago.ssh: DEBUG: start task:955a1007-9cd8-433a-b93c-0c86ecca896e:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:955a1007-9cd8-433a-b93c-0c86ecca896e:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 45dbce82 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 45dbce82 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 45dbce82 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4187 (Sat Oct
13 01:42:34 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4187 (Sat Oct 13
01:42:34
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped":
false, "maintenance": false, "crc32": "e9d4dfe8", "local_conf_timestamp": 4187,
"host-ts": 4187}, "2": {"conf_on_shared_storage": true, "live-data": true,
"extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4182
(Sat Oct 13 01:42:29 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4182
(Sat Oct 13 01:42:29
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "cc99e1ab", "local_conf_timestamp": 4182, "host-ts": 4182},
"global_maintenance": false}
lago.ssh: DEBUG: start task:81f09ed3-396c-4de9-a6d7-35e3cf71267e:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:81f09ed3-396c-4de9-a6d7-35e3cf71267e:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 49a10fdc on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 49a10fdc on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 49a10fdc on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4197 (Sat Oct
13 01:42:44 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4197 (Sat Oct 13
01:42:44
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Migration Source"}, "score": 3000, "stopped": false, "maintenance": false,
"crc32": "7f019970", "local_conf_timestamp": 4197, "host-ts": 4197}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4192 (Sat Oct
13 01:42:39 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4193 (Sat Oct 13
01:42:39
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"c8e51ba0", "local_conf_timestamp": 4193, "host-ts": 4192},
"global_maintenance": false}
lago.ssh: DEBUG: start task:37a1a751-8932-41c2-af76-479733384384:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:37a1a751-8932-41c2-af76-479733384384:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 4ad632f6 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 4ad632f6 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 4ad632f6 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4197 (Sat Oct
13 01:42:44 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4197 (Sat Oct 13
01:42:44
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Migration Source"}, "score": 3000, "stopped": false, "maintenance": false,
"crc32": "7f019970", "local_conf_timestamp": 4197, "host-ts": 4197}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4192 (Sat Oct
13 01:42:39 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4193 (Sat Oct 13
01:42:39
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"c8e51ba0", "local_conf_timestamp": 4193, "host-ts": 4192},
"global_maintenance": false}
lago.ssh: DEBUG: start task:7a793ff4-f806-4a5b-8587-e728e5ba7e0e:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:7a793ff4-f806-4a5b-8587-e728e5ba7e0e:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 522d71a4 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 522d71a4 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 522d71a4 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4207 (Sat Oct
13 01:42:54 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4207 (Sat Oct 13
01:42:54
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "2253735e",
"local_conf_timestamp": 4207, "host-ts": 4207}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4202 (Sat Oct
13 01:42:48 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4202 (Sat Oct 13
01:42:49
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"0920fa8b", "local_conf_timestamp": 4202, "host-ts": 4202},
"global_maintenance": false}
lago.ssh: DEBUG: start task:4bba4ad3-25e2-43c0-9e65-efe37c75b0f5:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:4bba4ad3-25e2-43c0-9e65-efe37c75b0f5:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 5568556e on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 5568556e on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 5568556e on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4217 (Sat Oct
13 01:43:04 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4217 (Sat Oct 13
01:43:04
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "8c604d9c",
"local_conf_timestamp": 4217, "host-ts": 4217}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4212 (Sat Oct
13 01:42:59 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4212 (Sat Oct 13
01:42:59
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"0d66058e", "local_conf_timestamp": 4212, "host-ts": 4212},
"global_maintenance": false}
lago.ssh: DEBUG: start task:dbcc3120-2610-49b0-b97e-71c0bf4072af:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:dbcc3120-2610-49b0-b97e-71c0bf4072af:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 585f9e80 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 585f9e80 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 585f9e80 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4217 (Sat Oct
13 01:43:04 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4217 (Sat Oct 13
01:43:04
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "8c604d9c",
"local_conf_timestamp": 4217, "host-ts": 4217}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4212 (Sat Oct
13 01:42:59 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4212 (Sat Oct 13
01:42:59
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"0d66058e", "local_conf_timestamp": 4212, "host-ts": 4212},
"global_maintenance": false}
lago.ssh: DEBUG: start task:8d00eb73-8cdf-4ba1-92e0-b82f4efd3ba7:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:8d00eb73-8cdf-4ba1-92e0-b82f4efd3ba7:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 5ba10c5a on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 5ba10c5a on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 5ba10c5a on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4227 (Sat Oct
13 01:43:14 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4227 (Sat Oct 13
01:43:14
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "a544089b",
"local_conf_timestamp": 4227, "host-ts": 4227}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4222 (Sat Oct
13 01:43:09 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4222 (Sat Oct 13
01:43:09
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"01ad0481", "local_conf_timestamp": 4222, "host-ts": 4222},
"global_maintenance": false}
lago.ssh: DEBUG: start task:6433cd3c-c9bf-461b-a49a-8f042f373d06:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:6433cd3c-c9bf-461b-a49a-8f042f373d06:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 5ec9914a on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 5ec9914a on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 5ec9914a on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4227 (Sat Oct
13 01:43:14 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4227 (Sat Oct 13
01:43:14
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "a544089b",
"local_conf_timestamp": 4227, "host-ts": 4227}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4232 (Sat Oct
13 01:43:19 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4233 (Sat Oct 13
01:43:19
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"c1c8139c", "local_conf_timestamp": 4233, "host-ts": 4232},
"global_maintenance": false}
lago.ssh: DEBUG: start task:f80027ff-b30a-4635-84fc-70f911f385c1:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:f80027ff-b30a-4635-84fc-70f911f385c1:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 61ec5b32 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 61ec5b32 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 61ec5b32 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4237 (Sat Oct
13 01:43:24 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4237 (Sat Oct 13
01:43:24
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "0b773659",
"local_conf_timestamp": 4237, "host-ts": 4237}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4232 (Sat Oct
13 01:43:19 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4233 (Sat Oct 13
01:43:19
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"c1c8139c", "local_conf_timestamp": 4233, "host-ts": 4232},
"global_maintenance": false}
lago.ssh: DEBUG: start task:4daa5725-25ce-4ed2-9d87-f827fc71cc22:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:4daa5725-25ce-4ed2-9d87-f827fc71cc22:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 6539ab32 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 6539ab32 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 6539ab32 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4247 (Sat Oct
13 01:43:34 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4247 (Sat Oct 13
01:43:34
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "f70c8295",
"local_conf_timestamp": 4247, "host-ts": 4247}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4242 (Sat Oct
13 01:43:28 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4242 (Sat Oct 13
01:43:29
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"ab1fde11", "local_conf_timestamp": 4242, "host-ts": 4242},
"global_maintenance": false}
lago.ssh: DEBUG: start task:ee21f1f9-90a2-4de6-bea2-07ba6fac7aa3:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:ee21f1f9-90a2-4de6-bea2-07ba6fac7aa3:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 684e7316 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 684e7316 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 684e7316 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4247 (Sat Oct
13 01:43:34 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4247 (Sat Oct 13
01:43:34
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "f70c8295",
"local_conf_timestamp": 4247, "host-ts": 4247}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4242 (Sat Oct
13 01:43:28 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4242 (Sat Oct 13
01:43:29
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"ab1fde11", "local_conf_timestamp": 4242, "host-ts": 4242},
"global_maintenance": false}
lago.ssh: DEBUG: start task:18e6eec4-1c48-4760-a29d-5ac44874f243:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:18e6eec4-1c48-4760-a29d-5ac44874f243:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 6b27c9c0 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 6b27c9c0 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 6b27c9c0 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4257 (Sat Oct
13 01:43:44 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=4257 (Sat Oct 13
01:43:44
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "6ddeffd1", "local_conf_timestamp": 4257, "host-ts": 4257}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4252 (Sat Oct
13 01:43:39 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4252 (Sat Oct 13
01:43:39
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "937c7fc4", "local_conf_timestamp": 4252,
"host-ts": 4252}, "global_maintenance": false}
root: INFO: * Engine has migrated.
root: INFO: * Waiting For System Stability...
cli: DEBUG: signal 15 was caught
--------------------- >> end captured logging << ---------------------
Stack Trace:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in
wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in
wrapper
return func(get_test_prefix(), *args, **kwargs)
File
"/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/010_local_maintenance_cli.py",
line 125, in local_maintenance
_wait_for_engine_migration(host, he_index, "bad", "Migration Destination")
File
"/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/010_local_maintenance_cli.py",
line 45, in _wait_for_engine_migration
time.sleep(wait_value)
File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in exit_handler
sys.exit(128 + signum)
'143\n-------------------- >> begin captured logging <<
--------------------\nroot: INFO: * Waiting For System
Stability...\nlago.ssh: DEBUG: start
task:92984b83-8ac4-4390-b8db-fab332efd303:Get ssh client for
lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: end
task:92984b83-8ac4-4390-b8db-fab332efd303:Get ssh client for
lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 3c6eb576 on
lago-he-node-ng-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 3c6eb576 on lago-he-node-ng-suite-4-2-host-1 returned with
0\nlago.ssh: DEBUG: Command 3c6eb576 on lago-he-node-ng-suite-4-2-host-1
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4167 (Sat
Oct 13 01:42:14 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=4167 (Sat
Oct 13 01:42:14
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "3bf41c38", "local_conf_timestamp": 4167,
"host-ts": 4167}, "2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4172 (Sat
Oct 13 01:42:19 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4172 (Sat
Oct 13 01:42:19
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "f37ee498", "local_conf_timestamp": 4172, "host-ts": 4172},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:0425e165-cbe8-4092-9f52-e47497928de6:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:0425e165-cbe8-4092-9f52-e47497928de6:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 3d74e864 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --set-maintenance
--mode=local\nlago.ssh: DEBUG: Command 3d74e864 on
lago-he-node-ng-suite-4-2-host-0 returned with 0\nroot: INFO: * Waiting for
engine to migrate...\nlago.ssh: DEBUG: start
task:e496d289-deb2-4736-b4bb-9204269f9978:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:e496d289-deb2-4736-b4bb-9204269f9978:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 3e82f44e on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 3e82f44e on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 3e82f44e on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4177 (Sat
Oct 13 01:42:24 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=4177 (Sat
Oct 13 01:42:24
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "e7935c07", "local_conf_timestamp": 4177,
"host-ts": 4177}, "2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4172 (Sat
Oct 13 01:42:19 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4172 (Sat
Oct 13 01:42:19
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "f37ee498", "local_conf_timestamp": 4172, "host-ts": 4172},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:955a1007-9cd8-433a-b93c-0c86ecca896e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:955a1007-9cd8-433a-b93c-0c86ecca896e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 45dbce82 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 45dbce82 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 45dbce82 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4187 (Sat
Oct 13 01:42:34 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4187 (Sat
Oct 13 01:42:34
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped":
false, "maintenance": false, "crc32": "e9d4dfe8", "local_conf_timestamp": 4187,
"host-ts": 4187}, "2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4182 (Sat
Oct 13 01:42:29 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4182 (Sat
Oct 13 01:42:29
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "cc99e1ab", "local_conf_timestamp": 4182, "host-ts": 4182},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:81f09ed3-396c-4de9-a6d7-35e3cf71267e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:81f09ed3-396c-4de9-a6d7-35e3cf71267e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 49a10fdc on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 49a10fdc on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 49a10fdc on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4197 (Sat
Oct 13 01:42:44 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4197 (Sat
Oct 13 01:42:44
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Migration Source"}, "score": 3000, "stopped": false, "maintenance": false,
"crc32": "7f019970", "local_conf_timestamp": 4197, "host-ts": 4197}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4192 (Sat
Oct 13 01:42:39 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4193 (Sat
Oct 13 01:42:39
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"c8e51ba0", "local_conf_timestamp": 4193, "host-ts": 4192},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:37a1a751-8932-41c2-af76-479733384384:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:37a1a751-8932-41c2-af76-479733384384:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 4ad632f6 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 4ad632f6 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 4ad632f6 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4197 (Sat
Oct 13 01:42:44 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4197 (Sat
Oct 13 01:42:44
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Migration Source"}, "score": 3000, "stopped": false, "maintenance": false,
"crc32": "7f019970", "local_conf_timestamp": 4197, "host-ts": 4197}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4192 (Sat
Oct 13 01:42:39 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4193 (Sat
Oct 13 01:42:39
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"c8e51ba0", "local_conf_timestamp": 4193, "host-ts": 4192},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:7a793ff4-f806-4a5b-8587-e728e5ba7e0e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:7a793ff4-f806-4a5b-8587-e728e5ba7e0e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 522d71a4 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 522d71a4 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 522d71a4 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4207 (Sat
Oct 13 01:42:54 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4207 (Sat
Oct 13 01:42:54
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "2253735e",
"local_conf_timestamp": 4207, "host-ts": 4207}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4202 (Sat
Oct 13 01:42:48 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4202 (Sat
Oct 13 01:42:49
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"0920fa8b", "local_conf_timestamp": 4202, "host-ts": 4202},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:4bba4ad3-25e2-43c0-9e65-efe37c75b0f5:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:4bba4ad3-25e2-43c0-9e65-efe37c75b0f5:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 5568556e on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 5568556e on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 5568556e on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4217 (Sat
Oct 13 01:43:04 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4217 (Sat
Oct 13 01:43:04
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "8c604d9c",
"local_conf_timestamp": 4217, "host-ts": 4217}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4212 (Sat
Oct 13 01:42:59 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4212 (Sat
Oct 13 01:42:59
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"0d66058e", "local_conf_timestamp": 4212, "host-ts": 4212},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:dbcc3120-2610-49b0-b97e-71c0bf4072af:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:dbcc3120-2610-49b0-b97e-71c0bf4072af:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 585f9e80 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 585f9e80 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 585f9e80 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4217 (Sat
Oct 13 01:43:04 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4217 (Sat
Oct 13 01:43:04
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "8c604d9c",
"local_conf_timestamp": 4217, "host-ts": 4217}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4212 (Sat
Oct 13 01:42:59 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4212 (Sat
Oct 13 01:42:59
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"0d66058e", "local_conf_timestamp": 4212, "host-ts": 4212},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:8d00eb73-8cdf-4ba1-92e0-b82f4efd3ba7:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:8d00eb73-8cdf-4ba1-92e0-b82f4efd3ba7:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 5ba10c5a on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 5ba10c5a on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 5ba10c5a on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4227 (Sat
Oct 13 01:43:14 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4227 (Sat
Oct 13 01:43:14
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "a544089b",
"local_conf_timestamp": 4227, "host-ts": 4227}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4222 (Sat
Oct 13 01:43:09 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4222 (Sat
Oct 13 01:43:09
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"01ad0481", "local_conf_timestamp": 4222, "host-ts": 4222},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:6433cd3c-c9bf-461b-a49a-8f042f373d06:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:6433cd3c-c9bf-461b-a49a-8f042f373d06:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 5ec9914a on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 5ec9914a on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 5ec9914a on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4227 (Sat
Oct 13 01:43:14 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4227 (Sat
Oct 13 01:43:14
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "a544089b",
"local_conf_timestamp": 4227, "host-ts": 4227}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4232 (Sat
Oct 13 01:43:19 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4233 (Sat
Oct 13 01:43:19
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"c1c8139c", "local_conf_timestamp": 4233, "host-ts": 4232},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:f80027ff-b30a-4635-84fc-70f911f385c1:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:f80027ff-b30a-4635-84fc-70f911f385c1:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 61ec5b32 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 61ec5b32 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 61ec5b32 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4237 (Sat
Oct 13 01:43:24 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4237 (Sat
Oct 13 01:43:24
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "0b773659",
"local_conf_timestamp": 4237, "host-ts": 4237}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4232 (Sat
Oct 13 01:43:19 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4233 (Sat
Oct 13 01:43:19
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"c1c8139c", "local_conf_timestamp": 4233, "host-ts": 4232},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:4daa5725-25ce-4ed2-9d87-f827fc71cc22:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:4daa5725-25ce-4ed2-9d87-f827fc71cc22:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 6539ab32 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 6539ab32 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 6539ab32 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4247 (Sat
Oct 13 01:43:34 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4247 (Sat
Oct 13 01:43:34
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "f70c8295",
"local_conf_timestamp": 4247, "host-ts": 4247}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4242 (Sat
Oct 13 01:43:28 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4242 (Sat
Oct 13 01:43:29
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"ab1fde11", "local_conf_timestamp": 4242, "host-ts": 4242},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:ee21f1f9-90a2-4de6-bea2-07ba6fac7aa3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:ee21f1f9-90a2-4de6-bea2-07ba6fac7aa3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 684e7316 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 684e7316 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 684e7316 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4247 (Sat
Oct 13 01:43:34 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4247 (Sat
Oct 13 01:43:34
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32": "f70c8295",
"local_conf_timestamp": 4247, "host-ts": 4247}, "2": {"conf_on_shared_storage":
true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4242 (Sat
Oct 13 01:43:28 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4242 (Sat
Oct 13 01:43:29
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration
Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"ab1fde11", "local_conf_timestamp": 4242, "host-ts": 4242},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:18e6eec4-1c48-4760-a29d-5ac44874f243:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:18e6eec4-1c48-4760-a29d-5ac44874f243:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 6b27c9c0 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 6b27c9c0 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 6b27c9c0 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4257 (Sat
Oct 13 01:43:44 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=4257 (Sat
Oct 13 01:43:44
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "6ddeffd1", "local_conf_timestamp": 4257, "host-ts": 4257}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4252 (Sat
Oct 13 01:43:39 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4252 (Sat
Oct 13 01:43:39
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "937c7fc4", "local_conf_timestamp": 4252,
"host-ts": 4252}, "global_maintenance": false}\n\nroot: INFO: * Engine has
migrated.\nroot: INFO: * Waiting For System Stability...\ncli: DEBUG:
signal 15 was caught\n--------------------- >> end captured logging <<
---------------------'_______________________________________________
Infra mailing list -- [email protected]
To unsubscribe send an email to [email protected]
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/[email protected]/message/7ZD3O2NPMA75UWNM7ZMWQ56OGYNKD3IL/
