Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/
Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/370/
Build Number: 370
Build Status: Still Failing
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #347
[Dafna Ron] ovirt-4.2: block external links from running in ost
Changes for Build #348
[Dafna Ron] ovirt-4.2: block external links from running in ost
Changes for Build #349
[Dafna Ron] ovirt-4.2: block external links from running in ost
Changes for Build #350
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #351
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #352
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #353
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #354
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #355
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #356
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #357
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #358
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #359
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #360
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #361
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #362
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
[Sandro Bonazzola] ovirt-setup-lib: drop 3.6
[Sandro Bonazzola] ovirt-host: drop 3.6 and 4.1
Changes for Build #363
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #364
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #365
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
[Sandro Bonazzola] ovirt-reports: drop 3.6 jobs
[Sandro Bonazzola] ovirt-host-deploy: drop 3.6 jobs
Changes for Build #366
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #367
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #368
[Gal Ben Haim] Remove stale url to the internal repo
[Greg Sheremeta] add ovirt-web-ui to stdci v2
Changes for Build #369
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #370
[Gal Ben Haim] Remove stale url to the internal repo
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 008_restart_he_vm.restart_he_vm
Error Message:
143
-------------------- >> begin captured logging << --------------------
lago.ssh: DEBUG: start task:f00620a7-648c-4102-80bc-305dfc8df78e:Get ssh client
for lago-he-node-ng-suite-4-2-host-1:
lago.ssh: DEBUG: end task:f00620a7-648c-4102-80bc-305dfc8df78e:Get ssh client
for lago-he-node-ng-suite-4-2-host-1:
lago.ssh: DEBUG: Running aa8cf260 on lago-he-node-ng-suite-4-2-host-1:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command aa8cf260 on lago-he-node-ng-suite-4-2-host-1 returned
with 0
lago.ssh: DEBUG: Command aa8cf260 on lago-he-node-ng-suite-4-2-host-1 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3242 (Thu Oct
4 09:41:15 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3242 (Thu Oct 4
09:41:15
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "8b107fe5", "local_conf_timestamp": 3242,
"host-ts": 3242}, "2": {"conf_on_shared_storage": true, "live-data": true,
"extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3246
(Thu Oct 4 09:41:18 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3246
(Thu Oct 4 09:41:18
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "1fcb2337", "local_conf_timestamp": 3246, "host-ts": 3246},
"global_maintenance": true}
root: INFO: * Shutting down HE VM on host: lago-he-node-ng-suite-4-2-host-0
lago.ssh: DEBUG: start task:ec93ce68-9d74-4565-953a-955d1eb0e8d1:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:ec93ce68-9d74-4565-953a-955d1eb0e8d1:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running abab09a2 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-shutdown
lago.ssh: DEBUG: Command abab09a2 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
root: INFO: * Command succeeded
root: INFO: * Waiting for VM to be down...
lago.ssh: DEBUG: start task:637d3a75-934a-403b-915a-ac54ccf78e16:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:637d3a75-934a-403b-915a-ac54ccf78e16:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running ae5d3166 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command ae5d3166 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command ae5d3166 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3262 (Thu Oct
4 09:41:34 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3262 (Thu Oct 4
09:41:35
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Powering down"}, "score": 3000, "stopped": false, "maintenance": false,
"crc32": "23914a5d", "local_conf_timestamp": 3262, "host-ts": 3262}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3256 (Thu Oct
4 09:41:28 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3256 (Thu Oct 4
09:41:29
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "1b8ddc32", "local_conf_timestamp": 3256, "host-ts": 3256},
"global_maintenance": true}
lago.ssh: DEBUG: start task:f3cc7ee7-b43b-46f1-b562-71fd5f30b603:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:f3cc7ee7-b43b-46f1-b562-71fd5f30b603:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running b614c996 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command b614c996 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command b614c996 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3272 (Thu Oct
4 09:41:45 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3272 (Thu Oct 4
09:41:45
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down_unexpected", "detail":
"Down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"b515bfa9", "local_conf_timestamp": 3272, "host-ts": 3272}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3266 (Thu Oct
4 09:41:39 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3266 (Thu Oct 4
09:41:39
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "1746dd3d", "local_conf_timestamp": 3266, "host-ts": 3266},
"global_maintenance": true}
root: INFO: * VM is down.
root: INFO: * Stopping services...
lago.ssh: DEBUG: start task:e3ace6d9-9908-46d5-99cc-941775ff753d:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:e3ace6d9-9908-46d5-99cc-941775ff753d:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running b71f7034 on lago-he-node-ng-suite-4-2-host-0:
systemctl stop vdsmd ovirt-ha-broker ovirt-ha-agent
lago.ssh: DEBUG: Command b71f7034 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
root: INFO: * Starting services...
lago.ssh: DEBUG: start task:06f7c3be-084f-41e8-9b7e-7fd8fd888104:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:06f7c3be-084f-41e8-9b7e-7fd8fd888104:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running c0e5d356 on lago-he-node-ng-suite-4-2-host-0:
systemctl start vdsmd ovirt-ha-broker ovirt-ha-agent
lago.ssh: DEBUG: Command c0e5d356 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
root: INFO: * Waiting for agent to be ready...
lago.ssh: DEBUG: start task:1be0a2bc-9f9b-41bc-a071-bfd9fdba671b:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:1be0a2bc-9f9b-41bc-a071-bfd9fdba671b:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running c44de510 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status
lago.ssh: DEBUG: Command c44de510 on lago-he-node-ng-suite-4-2-host-0 returned
with 1
lago.ssh: DEBUG: Command c44de510 on lago-he-node-ng-suite-4-2-host-0 output:
The hosted engine configuration has not been retrieved from shared storage.
Please ensure that ovirt-ha-agent is running and the storage server is
reachable.
lago.ssh: DEBUG: start task:373c4570-500d-4ce6-927b-bb6123864318:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:373c4570-500d-4ce6-927b-bb6123864318:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running cb39b75a on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status
lago.ssh: DEBUG: Command cb39b75a on lago-he-node-ng-suite-4-2-host-0 returned
with 1
lago.ssh: DEBUG: Command cb39b75a on lago-he-node-ng-suite-4-2-host-0 output:
The hosted engine configuration has not been retrieved from shared storage.
Please ensure that ovirt-ha-agent is running and the storage server is
reachable.
lago.ssh: DEBUG: start task:37a4e08d-5b8c-483b-933c-dce619e1dedc:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:37a4e08d-5b8c-483b-933c-dce619e1dedc:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running cdf4d326 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status
lago.ssh: DEBUG: Command cdf4d326 on lago-he-node-ng-suite-4-2-host-0 returned
with 1
lago.ssh: DEBUG: Command cdf4d326 on lago-he-node-ng-suite-4-2-host-0 output:
The hosted engine configuration has not been retrieved from shared storage.
Please ensure that ovirt-ha-agent is running and the storage server is
reachable.
lago.ssh: DEBUG: start task:d521aeb6-5fcf-47c2-9a71-9a780446b6f8:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:d521aeb6-5fcf-47c2-9a71-9a780446b6f8:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running d09c5e6e on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status
lago.ssh: DEBUG: Command d09c5e6e on lago-he-node-ng-suite-4-2-host-0 returned
with 1
lago.ssh: DEBUG: Command d09c5e6e on lago-he-node-ng-suite-4-2-host-0 output:
The hosted engine configuration has not been retrieved from shared storage.
Please ensure that ovirt-ha-agent is running and the storage server is
reachable.
lago.ssh: DEBUG: start task:b6cf3caa-8870-4f9c-b7aa-0efc0d342232:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:b6cf3caa-8870-4f9c-b7aa-0efc0d342232:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running d347692e on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status
lago.ssh: DEBUG: Command d347692e on lago-he-node-ng-suite-4-2-host-0 returned
with 1
lago.ssh: DEBUG: Command d347692e on lago-he-node-ng-suite-4-2-host-0 output:
The hosted engine configuration has not been retrieved from shared storage.
Please ensure that ovirt-ha-agent is running and the storage server is
reachable.
lago.ssh: DEBUG: start task:418cf9ef-1ff0-4e84-907a-d8413925b236:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:418cf9ef-1ff0-4e84-907a-d8413925b236:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running d5fb6a58 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status
lago.ssh: DEBUG: Command d5fb6a58 on lago-he-node-ng-suite-4-2-host-0 returned
with 1
lago.ssh: DEBUG: Command d5fb6a58 on lago-he-node-ng-suite-4-2-host-0 output:
The hosted engine configuration has not been retrieved from shared storage.
Please ensure that ovirt-ha-agent is running and the storage server is
reachable.
lago.ssh: DEBUG: start task:dbd2db9e-0adf-4215-bfaf-f2d71b8673dd:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:dbd2db9e-0adf-4215-bfaf-f2d71b8673dd:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running d8b69a56 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status
lago.ssh: DEBUG: Command d8b69a56 on lago-he-node-ng-suite-4-2-host-0 returned
with 1
lago.ssh: DEBUG: Command d8b69a56 on lago-he-node-ng-suite-4-2-host-0 output:
The hosted engine configuration has not been retrieved from shared storage.
Please ensure that ovirt-ha-agent is running and the storage server is
reachable.
lago.ssh: DEBUG: start task:9ca1ee48-a3eb-4211-8687-82c96b23ffc4:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:9ca1ee48-a3eb-4211-8687-82c96b23ffc4:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running db62bfdc on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status
lago.ssh: DEBUG: Command db62bfdc on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command db62bfdc on lago-he-node-ng-suite-4-2-host-0 output:
!! Cluster is in GLOBAL MAINTENANCE mode !!
--== Host 1 status ==--
conf_on_shared_storage : True
Status up-to-date : True
Hostname : lago-he-node-ng-suite-4-2-host-0
Host ID : 1
Engine status : {"reason": "bad vm status", "health":
"bad", "vm": "down", "detail": "Down"}
Score : 0
stopped : False
Local maintenance : False
crc32 : 5317f638
local_conf_timestamp : 3338
Host timestamp : 3337
Extra metadata (valid at timestamp):
metadata_parse_version=1
metadata_feature_version=1
timestamp=3337 (Thu Oct 4 09:42:50 2018)
host-id=1
score=0
vm_conf_refresh_time=3338 (Thu Oct 4 09:42:50 2018)
conf_on_shared_storage=True
maintenance=False
state=ReinitializeFSM
stopped=False
--== Host 2 status ==--
conf_on_shared_storage : True
Status up-to-date : False
Hostname : lago-he-node-ng-suite-4-2-host-1
Host ID : 2
Engine status : unknown stale-data
Score : 3400
stopped : False
Local maintenance : False
crc32 : 72756c5c
local_conf_timestamp : 3336
Host timestamp : 3336
Extra metadata (valid at timestamp):
metadata_parse_version=1
metadata_feature_version=1
timestamp=3336 (Thu Oct 4 09:42:48 2018)
host-id=2
score=3400
vm_conf_refresh_time=3336 (Thu Oct 4 09:42:48 2018)
conf_on_shared_storage=True
maintenance=False
state=GlobalMaintenance
stopped=False
!! Cluster is in GLOBAL MAINTENANCE mode !!
root: INFO: * Agent is ready.
root: INFO: * Starting VM...
lago.ssh: DEBUG: start task:256bf5d7-8dab-43b3-8663-aad3142b3931:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:256bf5d7-8dab-43b3-8663-aad3142b3931:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running dc6fdb58 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-start
lago.ssh: DEBUG: Command dc6fdb58 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command dc6fdb58 on lago-he-node-ng-suite-4-2-host-0 output:
VM exists and is down, cleaning up and restarting
root: INFO: * Command succeeded
root: INFO: * Waiting for VM to be UP...
lago.ssh: DEBUG: start task:81f8d6ed-81db-4fe1-bddd-4d14ae2fa5f2:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:81f8d6ed-81db-4fe1-bddd-4d14ae2fa5f2:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running ded02ba0 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command ded02ba0 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command ded02ba0 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3337 (Thu Oct
4 09:42:50 2018)\nhost-id=1\nscore=0\nvm_conf_refresh_time=3338 (Thu Oct 4
09:42:50
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=ReinitializeFSM\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Down"},
"score": 0, "stopped": false, "maintenance": false, "crc32": "5317f638",
"local_conf_timestamp": 3338, "host-ts": 3337}, "2": {"conf_on_shared_storage":
true, "live-data": false, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3336 (Thu Oct
4 09:42:48 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3336 (Thu Oct 4
09:42:48
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "72756c5c", "local_conf_timestamp": 3336, "host-ts": 3336},
"global_maintenance": true}
lago.ssh: DEBUG: start task:59bc4945-9a1c-4406-b554-c17f80313d43:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:59bc4945-9a1c-4406-b554-c17f80313d43:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running e5fe607c on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command e5fe607c on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command e5fe607c on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3348 (Thu Oct
4 09:43:00 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3348 (Thu Oct 4
09:43:01
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering
up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"560c0311", "local_conf_timestamp": 3348, "host-ts": 3348}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3346 (Thu Oct
4 09:42:58 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3346 (Thu Oct 4
09:42:59
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "6fa59147", "local_conf_timestamp": 3346, "host-ts": 3346},
"global_maintenance": true}
root: INFO: * VM is UP.
root: INFO: * Waiting for engine to start...
lago.ssh: DEBUG: start task:42395fbb-6d4f-4700-9c2d-29b8f3c271b1:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:42395fbb-6d4f-4700-9c2d-29b8f3c271b1:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running e719f840 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command e719f840 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command e719f840 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3348 (Thu Oct
4 09:43:00 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3348 (Thu Oct 4
09:43:01
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering
up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"560c0311", "local_conf_timestamp": 3348, "host-ts": 3348}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3346 (Thu Oct
4 09:42:58 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3346 (Thu Oct 4
09:42:59
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "6fa59147", "local_conf_timestamp": 3346, "host-ts": 3346},
"global_maintenance": true}
lago.ssh: DEBUG: start task:a894e3bb-c156-448c-95e9-6a2401b193a5:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:a894e3bb-c156-448c-95e9-6a2401b193a5:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running ee354454 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command ee354454 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command ee354454 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3368 (Thu Oct
4 09:43:21 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3369 (Thu Oct 4
09:43:21
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering
up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"5e53497f", "local_conf_timestamp": 3369, "host-ts": 3368}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3366 (Thu Oct
4 09:43:18 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3366 (Thu Oct 4
09:43:18
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "67286f4d", "local_conf_timestamp": 3366, "host-ts": 3366},
"global_maintenance": true}
lago.ssh: DEBUG: start task:2335e608-378b-412d-8e55-fc56f15b0046:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:2335e608-378b-412d-8e55-fc56f15b0046:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running f1b67954 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command f1b67954 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command f1b67954 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3368 (Thu Oct
4 09:43:21 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3369 (Thu Oct 4
09:43:21
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering
up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"5e53497f", "local_conf_timestamp": 3369, "host-ts": 3368}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3366 (Thu Oct
4 09:43:18 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3366 (Thu Oct 4
09:43:18
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "67286f4d", "local_conf_timestamp": 3366, "host-ts": 3366},
"global_maintenance": true}
lago.ssh: DEBUG: start task:815ddfdf-c730-40b4-be0e-c849bacfc3b3:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:815ddfdf-c730-40b4-be0e-c849bacfc3b3:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running f4cf656a on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command f4cf656a on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command f4cf656a on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3378 (Thu Oct
4 09:43:30 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3378 (Thu Oct 4
09:43:31
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering
up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"16f84495", "local_conf_timestamp": 3378, "host-ts": 3378}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3376 (Thu Oct
4 09:43:28 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3376 (Thu Oct 4
09:43:28
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "636e9048", "local_conf_timestamp": 3376, "host-ts": 3376},
"global_maintenance": true}
lago.ssh: DEBUG: start task:ea2f18ce-d614-466c-81f5-b758f3605b54:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:ea2f18ce-d614-466c-81f5-b758f3605b54:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running f828d642 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command f828d642 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command f828d642 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3378 (Thu Oct
4 09:43:30 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3378 (Thu Oct 4
09:43:31
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering
up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"16f84495", "local_conf_timestamp": 3378, "host-ts": 3378}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3376 (Thu Oct
4 09:43:28 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3376 (Thu Oct 4
09:43:28
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "636e9048", "local_conf_timestamp": 3376, "host-ts": 3376},
"global_maintenance": true}
lago.ssh: DEBUG: start task:b6afb67b-a051-42dd-8b75-44020ce3ff10:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:b6afb67b-a051-42dd-8b75-44020ce3ff10:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running fb396cac on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command fb396cac on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command fb396cac on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3388 (Thu Oct
4 09:43:41 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3388 (Thu Oct 4
09:43:41
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"4fc508ca", "local_conf_timestamp": 3388, "host-ts": 3388}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3386 (Thu Oct
4 09:43:38 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3386 (Thu Oct 4
09:43:39
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "5c89957b", "local_conf_timestamp": 3386, "host-ts": 3386},
"global_maintenance": true}
lago.ssh: DEBUG: start task:20f3c2d4-19a5-40e0-8c97-7b3edb28aec3:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:20f3c2d4-19a5-40e0-8c97-7b3edb28aec3:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running fe524544 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command fe524544 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command fe524544 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3398 (Thu Oct
4 09:43:50 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3398 (Thu Oct 4
09:43:51
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"0e90c296", "local_conf_timestamp": 3398, "host-ts": 3398}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3396 (Thu Oct
4 09:43:49 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3396 (Thu Oct 4
09:43:49
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "58cf6a7e", "local_conf_timestamp": 3396, "host-ts": 3396},
"global_maintenance": true}
lago.ssh: DEBUG: start task:9f48c0ef-ebcc-4a54-80d4-4d3e243de50e:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:9f48c0ef-ebcc-4a54-80d4-4d3e243de50e:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 040a95b8 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 040a95b8 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 040a95b8 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3398 (Thu Oct
4 09:43:50 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3398 (Thu Oct 4
09:43:51
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"0e90c296", "local_conf_timestamp": 3398, "host-ts": 3398}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3396 (Thu Oct
4 09:43:49 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3396 (Thu Oct 4
09:43:49
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "58cf6a7e", "local_conf_timestamp": 3396, "host-ts": 3396},
"global_maintenance": true}
lago.ssh: DEBUG: start task:429cd235-4fe5-4c16-b3b0-11f9e55560ca:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:429cd235-4fe5-4c16-b3b0-11f9e55560ca:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 076c265e on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 076c265e on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 076c265e on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3408 (Thu Oct
4 09:44:01 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3409 (Thu Oct 4
09:44:01
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"a95b9e55", "local_conf_timestamp": 3409, "host-ts": 3408}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3406 (Thu Oct
4 09:43:58 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3406 (Thu Oct 4
09:43:58
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "f4c67442", "local_conf_timestamp": 3406, "host-ts": 3406},
"global_maintenance": true}
lago.ssh: DEBUG: start task:2a141c53-21e1-4165-b46e-1cf570715f1e:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:2a141c53-21e1-4165-b46e-1cf570715f1e:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 0b16e942 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 0b16e942 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 0b16e942 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3408 (Thu Oct
4 09:44:01 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3409 (Thu Oct 4
09:44:01
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"a95b9e55", "local_conf_timestamp": 3409, "host-ts": 3408}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3406 (Thu Oct
4 09:43:58 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3406 (Thu Oct 4
09:43:58
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "f4c67442", "local_conf_timestamp": 3406, "host-ts": 3406},
"global_maintenance": true}
lago.ssh: DEBUG: start task:e486af2a-d1e1-4b09-ae1b-4c295bac8e90:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:e486af2a-d1e1-4b09-ae1b-4c295bac8e90:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 0ec55f06 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 0ec55f06 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 0ec55f06 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3418 (Thu Oct
4 09:44:10 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3418 (Thu Oct 4
09:44:11
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"9f09649f", "local_conf_timestamp": 3418, "host-ts": 3418}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3416 (Thu Oct
4 09:44:08 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3416 (Thu Oct 4
09:44:08
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "f0808b47", "local_conf_timestamp": 3416, "host-ts": 3416},
"global_maintenance": true}
lago.ssh: DEBUG: start task:f3668d90-a0c3-4f38-b486-1f5efa7f7c88:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:f3668d90-a0c3-4f38-b486-1f5efa7f7c88:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 1261b772 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 1261b772 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 1261b772 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3428 (Thu Oct
4 09:44:21 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3429 (Thu Oct 4
09:44:21
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"2bf00aed", "local_conf_timestamp": 3429, "host-ts": 3428}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3426 (Thu Oct
4 09:44:18 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3426 (Thu Oct 4
09:44:18
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "fc4b8a48", "local_conf_timestamp": 3426, "host-ts": 3426},
"global_maintenance": true}
lago.ssh: DEBUG: start task:79c50e1a-ea5f-44e3-a92c-dbdad9dd29e2:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:79c50e1a-ea5f-44e3-a92c-dbdad9dd29e2:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 15ac24d0 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 15ac24d0 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 15ac24d0 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3428 (Thu Oct
4 09:44:21 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3429 (Thu Oct 4
09:44:21
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"2bf00aed", "local_conf_timestamp": 3429, "host-ts": 3428}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3426 (Thu Oct
4 09:44:18 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3426 (Thu Oct 4
09:44:18
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "fc4b8a48", "local_conf_timestamp": 3426, "host-ts": 3426},
"global_maintenance": true}
lago.ssh: DEBUG: start task:8ea9732b-ebbf-479e-a5f8-c33e269564f3:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:8ea9732b-ebbf-479e-a5f8-c33e269564f3:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 18eb5c92 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 18eb5c92 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 18eb5c92 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3438 (Thu Oct
4 09:44:31 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3438 (Thu Oct 4
09:44:31
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"1da2f027", "local_conf_timestamp": 3438, "host-ts": 3438}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3436 (Thu Oct
4 09:44:29 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3436 (Thu Oct 4
09:44:29
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "f80d754d", "local_conf_timestamp": 3436, "host-ts": 3436},
"global_maintenance": true}
lago.ssh: DEBUG: start task:f95ac86b-781d-4bc6-8a9a-a1a6224f395d:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:f95ac86b-781d-4bc6-8a9a-a1a6224f395d:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 1d18356a on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 1d18356a on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 1d18356a on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3448 (Thu Oct
4 09:44:41 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3448 (Thu Oct 4
09:44:41
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"007a81f2", "local_conf_timestamp": 3448, "host-ts": 3448}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3446 (Thu Oct
4 09:44:39 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3447 (Thu Oct 4
09:44:39
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "92dab8c0", "local_conf_timestamp": 3447, "host-ts": 3446},
"global_maintenance": true}
lago.ssh: DEBUG: start task:b0263ebe-2821-49e8-b0a7-2bfbb224a43b:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:b0263ebe-2821-49e8-b0a7-2bfbb224a43b:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 2179aae4 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 2179aae4 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 2179aae4 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3448 (Thu Oct
4 09:44:41 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3448 (Thu Oct 4
09:44:41
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"007a81f2", "local_conf_timestamp": 3448, "host-ts": 3448}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3446 (Thu Oct
4 09:44:39 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3447 (Thu Oct 4
09:44:39
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "92dab8c0", "local_conf_timestamp": 3447, "host-ts": 3446},
"global_maintenance": true}
lago.ssh: DEBUG: start task:456b4cca-60ce-4282-a4ea-a675560048e9:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:456b4cca-60ce-4282-a4ea-a675560048e9:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 253bc464 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 253bc464 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 253bc464 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3458 (Thu Oct
4 09:44:50 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3458 (Thu Oct 4
09:44:51
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"56af83fa", "local_conf_timestamp": 3458, "host-ts": 3458}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3456 (Thu Oct
4 09:44:48 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3456 (Thu Oct 4
09:44:48
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "e19b7753", "local_conf_timestamp": 3456, "host-ts": 3456},
"global_maintenance": true}
lago.ssh: DEBUG: start task:c63e8892-0155-4afc-a41d-f35f4eb94cd2:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:c63e8892-0155-4afc-a41d-f35f4eb94cd2:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 28fdd538 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 28fdd538 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 28fdd538 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3468 (Thu Oct
4 09:45:01 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3468 (Thu Oct 4
09:45:01
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"9551dd1e", "local_conf_timestamp": 3468, "host-ts": 3468}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3466 (Thu Oct
4 09:44:58 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3466 (Thu Oct 4
09:44:58
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "ed50765c", "local_conf_timestamp": 3466, "host-ts": 3466},
"global_maintenance": true}
lago.ssh: DEBUG: start task:7297b9f6-3b34-4367-a8f8-f6fdd2e32ded:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:7297b9f6-3b34-4367-a8f8-f6fdd2e32ded:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 2d8da9ca on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 2d8da9ca on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 2d8da9ca on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3468 (Thu Oct
4 09:45:01 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3468 (Thu Oct 4
09:45:01
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"9551dd1e", "local_conf_timestamp": 3468, "host-ts": 3468}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3466 (Thu Oct
4 09:44:58 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3466 (Thu Oct 4
09:44:58
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "ed50765c", "local_conf_timestamp": 3466, "host-ts": 3466},
"global_maintenance": true}
lago.ssh: DEBUG: start task:d56805c8-ada4-4e0d-b735-22b02bcd3e91:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:d56805c8-ada4-4e0d-b735-22b02bcd3e91:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 32f8f45a on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 32f8f45a on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 32f8f45a on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3478 (Thu Oct
4 09:45:10 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3478 (Thu Oct 4
09:45:11
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"d4041742", "local_conf_timestamp": 3478, "host-ts": 3478}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3476 (Thu Oct
4 09:45:08 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3476 (Thu Oct 4
09:45:09
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "e9168959", "local_conf_timestamp": 3476, "host-ts": 3476},
"global_maintenance": true}
lago.ssh: DEBUG: start task:f339adce-4d16-4509-a178-0f0c89fb9acc:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:f339adce-4d16-4509-a178-0f0c89fb9acc:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 36c35c4c on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 36c35c4c on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 36c35c4c on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3488 (Thu Oct
4 09:45:21 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3489 (Thu Oct 4
09:45:21
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"d9e60e22", "local_conf_timestamp": 3489, "host-ts": 3488}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3486 (Thu Oct
4 09:45:19 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3486 (Thu Oct 4
09:45:19
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "d6f18c6a", "local_conf_timestamp": 3486, "host-ts": 3486},
"global_maintenance": true}
lago.ssh: DEBUG: start task:108b90d6-a84d-4089-8f0f-c5f017828dea:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:108b90d6-a84d-4089-8f0f-c5f017828dea:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 3b44df52 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 3b44df52 on lago-he-node-ng-suite-4-2-host-0 returned
with 0
lago.ssh: DEBUG: Command 3b44df52 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3498 (Thu Oct
4 09:45:31 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3498 (Thu Oct 4
09:45:31
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"efb4f4e8", "local_conf_timestamp": 3498, "host-ts": 3498}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3496 (Thu Oct
4 09:45:28 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3496 (Thu Oct 4
09:45:28
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "d2b7736f", "local_conf_timestamp": 3496, "host-ts": 3496},
"global_maintenance": true}
lago.ssh: DEBUG: start task:705dfd9b-7751-4274-a837-69b6bc0c3228:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:705dfd9b-7751-4274-a837-69b6bc0c3228:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 3f92ff80 on lago-he-node-ng-suite-4-2-host-0:
hosted-engine --vm-status --json
cli: DEBUG: signal 15 was caught
--------------------- >> end captured logging << ---------------------
Stack Trace:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in
wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in
wrapper
return func(get_test_prefix(), *args, **kwargs)
File
"/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py",
line 53, in restart_he_vm
_wait_for_engine_health(host)
File
"/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py",
line 185, in _wait_for_engine_health
testlib.assert_true_within_long(lambda: any(
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in
assert_true_within_long
assert_equals_within_long(func, True, allowed_exceptions)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in
assert_equals_within_long
func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in
assert_equals_within
res = func()
File
"/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py",
line 187, in <lambda>
for k, v in _get_he_status(host).items()
File
"/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py",
line 122, in _get_he_status
ret = host.ssh(["hosted-engine", "--vm-status", "--json"])
File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 529, in ssh
password=self._spec.get('ssh-password'),
File "/usr/lib/python2.7/site-packages/lago/ssh.py", line 69, in ssh
'stderr': None
File "/usr/lib/python2.7/site-packages/lago/ssh.py", line 247, in
drain_ssh_channel
0.1,
File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in exit_handler
sys.exit(128 + signum)
'143\n-------------------- >> begin captured logging <<
--------------------\nlago.ssh: DEBUG: start
task:f00620a7-648c-4102-80bc-305dfc8df78e:Get ssh client for
lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: end
task:f00620a7-648c-4102-80bc-305dfc8df78e:Get ssh client for
lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: Running aa8cf260 on
lago-he-node-ng-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command aa8cf260 on lago-he-node-ng-suite-4-2-host-1 returned with
0\nlago.ssh: DEBUG: Command aa8cf260 on lago-he-node-ng-suite-4-2-host-1
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3242 (Thu
Oct 4 09:41:15 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3242 (Thu
Oct 4 09:41:15
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "8b107fe5", "local_conf_timestamp": 3242,
"host-ts": 3242}, "2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3246 (Thu
Oct 4 09:41:18 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3246 (Thu
Oct 4 09:41:18
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "1fcb2337", "local_conf_timestamp": 3246, "host-ts": 3246},
"global_maintenance": true}\n\nroot: INFO: * Shutting down HE VM on host:
lago-he-node-ng-suite-4-2-host-0\nlago.ssh: DEBUG: start
task:ec93ce68-9d74-4565-953a-955d1eb0e8d1:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:ec93ce68-9d74-4565-953a-955d1eb0e8d1:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running abab09a2 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-shutdown\nlago.ssh: DEBUG:
Command abab09a2 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nroot:
INFO: * Command succeeded\nroot: INFO: * Waiting for VM to be
down...\nlago.ssh: DEBUG: start task:637d3a75-934a-403b-915a-ac54ccf78e16:Get
ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:637d3a75-934a-403b-915a-ac54ccf78e16:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ae5d3166 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command ae5d3166 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command ae5d3166 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3262 (Thu
Oct 4 09:41:34 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3262 (Thu
Oct 4 09:41:35
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Powering down"}, "score": 3000, "stopped": false, "maintenance": false,
"crc32": "23914a5d", "local_conf_timestamp": 3262, "host-ts": 3262}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3256 (Thu
Oct 4 09:41:28 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3256 (Thu
Oct 4 09:41:29
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "1b8ddc32", "local_conf_timestamp": 3256, "host-ts": 3256},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:f3cc7ee7-b43b-46f1-b562-71fd5f30b603:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:f3cc7ee7-b43b-46f1-b562-71fd5f30b603:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running b614c996 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command b614c996 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command b614c996 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3272 (Thu
Oct 4 09:41:45 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3272 (Thu
Oct 4 09:41:45
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down_unexpected", "detail":
"Down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"b515bfa9", "local_conf_timestamp": 3272, "host-ts": 3272}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3266 (Thu
Oct 4 09:41:39 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3266 (Thu
Oct 4 09:41:39
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "1746dd3d", "local_conf_timestamp": 3266, "host-ts": 3266},
"global_maintenance": true}\n\nroot: INFO: * VM is down.\nroot: INFO: *
Stopping services...\nlago.ssh: DEBUG: start
task:e3ace6d9-9908-46d5-99cc-941775ff753d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:e3ace6d9-9908-46d5-99cc-941775ff753d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running b71f7034 on
lago-he-node-ng-suite-4-2-host-0: systemctl stop vdsmd ovirt-ha-broker
ovirt-ha-agent\nlago.ssh: DEBUG: Command b71f7034 on
lago-he-node-ng-suite-4-2-host-0 returned with 0\nroot: INFO: * Starting
services...\nlago.ssh: DEBUG: start
task:06f7c3be-084f-41e8-9b7e-7fd8fd888104:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:06f7c3be-084f-41e8-9b7e-7fd8fd888104:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running c0e5d356 on
lago-he-node-ng-suite-4-2-host-0: systemctl start vdsmd ovirt-ha-broker
ovirt-ha-agent\nlago.ssh: DEBUG: Command c0e5d356 on
lago-he-node-ng-suite-4-2-host-0 returned with 0\nroot: INFO: * Waiting for
agent to be ready...\nlago.ssh: DEBUG: start
task:1be0a2bc-9f9b-41bc-a071-bfd9fdba671b:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:1be0a2bc-9f9b-41bc-a071-bfd9fdba671b:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running c44de510 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG:
Command c44de510 on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh:
DEBUG: Command c44de510 on lago-he-node-ng-suite-4-2-host-0 output:\n The
hosted engine configuration has not been retrieved from shared storage. Please
ensure that ovirt-ha-agent is running and the storage server is
reachable.\n\nlago.ssh: DEBUG: start
task:373c4570-500d-4ce6-927b-bb6123864318:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:373c4570-500d-4ce6-927b-bb6123864318:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running cb39b75a on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG:
Command cb39b75a on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh:
DEBUG: Command cb39b75a on lago-he-node-ng-suite-4-2-host-0 output:\n The
hosted engine configuration has not been retrieved from shared storage. Please
ensure that ovirt-ha-agent is running and the storage server is
reachable.\n\nlago.ssh: DEBUG: start
task:37a4e08d-5b8c-483b-933c-dce619e1dedc:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:37a4e08d-5b8c-483b-933c-dce619e1dedc:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running cdf4d326 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG:
Command cdf4d326 on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh:
DEBUG: Command cdf4d326 on lago-he-node-ng-suite-4-2-host-0 output:\n The
hosted engine configuration has not been retrieved from shared storage. Please
ensure that ovirt-ha-agent is running and the storage server is
reachable.\n\nlago.ssh: DEBUG: start
task:d521aeb6-5fcf-47c2-9a71-9a780446b6f8:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:d521aeb6-5fcf-47c2-9a71-9a780446b6f8:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running d09c5e6e on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG:
Command d09c5e6e on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh:
DEBUG: Command d09c5e6e on lago-he-node-ng-suite-4-2-host-0 output:\n The
hosted engine configuration has not been retrieved from shared storage. Please
ensure that ovirt-ha-agent is running and the storage server is
reachable.\n\nlago.ssh: DEBUG: start
task:b6cf3caa-8870-4f9c-b7aa-0efc0d342232:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:b6cf3caa-8870-4f9c-b7aa-0efc0d342232:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running d347692e on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG:
Command d347692e on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh:
DEBUG: Command d347692e on lago-he-node-ng-suite-4-2-host-0 output:\n The
hosted engine configuration has not been retrieved from shared storage. Please
ensure that ovirt-ha-agent is running and the storage server is
reachable.\n\nlago.ssh: DEBUG: start
task:418cf9ef-1ff0-4e84-907a-d8413925b236:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:418cf9ef-1ff0-4e84-907a-d8413925b236:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running d5fb6a58 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG:
Command d5fb6a58 on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh:
DEBUG: Command d5fb6a58 on lago-he-node-ng-suite-4-2-host-0 output:\n The
hosted engine configuration has not been retrieved from shared storage. Please
ensure that ovirt-ha-agent is running and the storage server is
reachable.\n\nlago.ssh: DEBUG: start
task:dbd2db9e-0adf-4215-bfaf-f2d71b8673dd:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:dbd2db9e-0adf-4215-bfaf-f2d71b8673dd:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running d8b69a56 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG:
Command d8b69a56 on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh:
DEBUG: Command d8b69a56 on lago-he-node-ng-suite-4-2-host-0 output:\n The
hosted engine configuration has not been retrieved from shared storage. Please
ensure that ovirt-ha-agent is running and the storage server is
reachable.\n\nlago.ssh: DEBUG: start
task:9ca1ee48-a3eb-4211-8687-82c96b23ffc4:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:9ca1ee48-a3eb-4211-8687-82c96b23ffc4:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running db62bfdc on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG:
Command db62bfdc on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh:
DEBUG: Command db62bfdc on lago-he-node-ng-suite-4-2-host-0 output:\n \n\n!!
Cluster is in GLOBAL MAINTENANCE mode !!\n\n\n\n--== Host 1 status
==--\n\nconf_on_shared_storage : True\nStatus up-to-date
: True\nHostname :
lago-he-node-ng-suite-4-2-host-0\nHost ID :
1\nEngine status : {"reason": "bad vm status", "health":
"bad", "vm": "down", "detail": "Down"}\nScore :
0\nstopped : False\nLocal maintenance
: False\ncrc32 : 5317f638\nlocal_conf_timestamp
: 3338\nHost timestamp : 3337\nExtra metadata
(valid at
timestamp):\n\tmetadata_parse_version=1\n\tmetadata_feature_version=1\n\ttimestamp=3337
(Thu Oct 4 09:42:50
2018)\n\thost-id=1\n\tscore=0\n\tvm_conf_refresh_time=3338 (Thu Oct 4 09:42:50
2018)\n\tconf_on_shared_storage=True\n\tmaintenance=False\n\tstate=ReinitializeFSM\n\tstopped=False\n\n\n--==
Host 2 status ==--\n\nconf_on_shared_storage : True\nStatus
up-to-date : False\nHostname :
lago-he-node-ng-suite-4-2-host-1\nHost ID :
2\nEngine status : unknown stale-data\nScore
: 3400\nstopped : False\nLocal
maintenance : False\ncrc32 :
72756c5c\nlocal_conf_timestamp : 3336\nHost timestamp
: 3336\nExtra metadata (valid at
timestamp):\n\tmetadata_parse_version=1\n\tmetadata_feature_version=1\n\ttimestamp=3336
(Thu Oct 4 09:42:48
2018)\n\thost-id=2\n\tscore=3400\n\tvm_conf_refresh_time=3336 (Thu Oct 4
09:42:48
2018)\n\tconf_on_shared_storage=True\n\tmaintenance=False\n\tstate=GlobalMaintenance\n\tstopped=False\n\n\n!!
Cluster is in GLOBAL MAINTENANCE mode !!\n\n\nroot: INFO: * Agent is
ready.\nroot: INFO: * Starting VM...\nlago.ssh: DEBUG: start
task:256bf5d7-8dab-43b3-8663-aad3142b3931:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:256bf5d7-8dab-43b3-8663-aad3142b3931:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running dc6fdb58 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-start\nlago.ssh: DEBUG:
Command dc6fdb58 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh:
DEBUG: Command dc6fdb58 on lago-he-node-ng-suite-4-2-host-0 output:\n VM exists
and is down, cleaning up and restarting\n\nroot: INFO: * Command
succeeded\nroot: INFO: * Waiting for VM to be UP...\nlago.ssh: DEBUG: start
task:81f8d6ed-81db-4fe1-bddd-4d14ae2fa5f2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:81f8d6ed-81db-4fe1-bddd-4d14ae2fa5f2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ded02ba0 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command ded02ba0 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command ded02ba0 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3337 (Thu
Oct 4 09:42:50 2018)\\nhost-id=1\\nscore=0\\nvm_conf_refresh_time=3338 (Thu
Oct 4 09:42:50
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=ReinitializeFSM\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Down"},
"score": 0, "stopped": false, "maintenance": false, "crc32": "5317f638",
"local_conf_timestamp": 3338, "host-ts": 3337}, "2": {"conf_on_shared_storage":
true, "live-data": false, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3336 (Thu
Oct 4 09:42:48 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3336 (Thu
Oct 4 09:42:48
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "72756c5c", "local_conf_timestamp": 3336, "host-ts": 3336},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:59bc4945-9a1c-4406-b554-c17f80313d43:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:59bc4945-9a1c-4406-b554-c17f80313d43:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running e5fe607c on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command e5fe607c on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command e5fe607c on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3348 (Thu
Oct 4 09:43:00 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3348 (Thu
Oct 4 09:43:01
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering
up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"560c0311", "local_conf_timestamp": 3348, "host-ts": 3348}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3346 (Thu
Oct 4 09:42:58 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3346 (Thu
Oct 4 09:42:59
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "6fa59147", "local_conf_timestamp": 3346, "host-ts": 3346},
"global_maintenance": true}\n\nroot: INFO: * VM is UP.\nroot: INFO: *
Waiting for engine to start...\nlago.ssh: DEBUG: start
task:42395fbb-6d4f-4700-9c2d-29b8f3c271b1:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:42395fbb-6d4f-4700-9c2d-29b8f3c271b1:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running e719f840 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command e719f840 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command e719f840 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3348 (Thu
Oct 4 09:43:00 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3348 (Thu
Oct 4 09:43:01
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering
up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"560c0311", "local_conf_timestamp": 3348, "host-ts": 3348}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3346 (Thu
Oct 4 09:42:58 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3346 (Thu
Oct 4 09:42:59
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "6fa59147", "local_conf_timestamp": 3346, "host-ts": 3346},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:a894e3bb-c156-448c-95e9-6a2401b193a5:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:a894e3bb-c156-448c-95e9-6a2401b193a5:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ee354454 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command ee354454 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command ee354454 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3368 (Thu
Oct 4 09:43:21 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3369 (Thu
Oct 4 09:43:21
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering
up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"5e53497f", "local_conf_timestamp": 3369, "host-ts": 3368}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3366 (Thu
Oct 4 09:43:18 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3366 (Thu
Oct 4 09:43:18
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "67286f4d", "local_conf_timestamp": 3366, "host-ts": 3366},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:2335e608-378b-412d-8e55-fc56f15b0046:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:2335e608-378b-412d-8e55-fc56f15b0046:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running f1b67954 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command f1b67954 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command f1b67954 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3368 (Thu
Oct 4 09:43:21 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3369 (Thu
Oct 4 09:43:21
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering
up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"5e53497f", "local_conf_timestamp": 3369, "host-ts": 3368}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3366 (Thu
Oct 4 09:43:18 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3366 (Thu
Oct 4 09:43:18
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "67286f4d", "local_conf_timestamp": 3366, "host-ts": 3366},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:815ddfdf-c730-40b4-be0e-c849bacfc3b3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:815ddfdf-c730-40b4-be0e-c849bacfc3b3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running f4cf656a on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command f4cf656a on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command f4cf656a on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3378 (Thu
Oct 4 09:43:30 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3378 (Thu
Oct 4 09:43:31
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering
up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"16f84495", "local_conf_timestamp": 3378, "host-ts": 3378}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3376 (Thu
Oct 4 09:43:28 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3376 (Thu
Oct 4 09:43:28
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "636e9048", "local_conf_timestamp": 3376, "host-ts": 3376},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:ea2f18ce-d614-466c-81f5-b758f3605b54:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:ea2f18ce-d614-466c-81f5-b758f3605b54:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running f828d642 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command f828d642 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command f828d642 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3378 (Thu
Oct 4 09:43:30 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3378 (Thu
Oct 4 09:43:31
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering
up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"16f84495", "local_conf_timestamp": 3378, "host-ts": 3378}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3376 (Thu
Oct 4 09:43:28 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3376 (Thu
Oct 4 09:43:28
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "636e9048", "local_conf_timestamp": 3376, "host-ts": 3376},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:b6afb67b-a051-42dd-8b75-44020ce3ff10:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:b6afb67b-a051-42dd-8b75-44020ce3ff10:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running fb396cac on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command fb396cac on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command fb396cac on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3388 (Thu
Oct 4 09:43:41 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3388 (Thu
Oct 4 09:43:41
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"4fc508ca", "local_conf_timestamp": 3388, "host-ts": 3388}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3386 (Thu
Oct 4 09:43:38 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3386 (Thu
Oct 4 09:43:39
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "5c89957b", "local_conf_timestamp": 3386, "host-ts": 3386},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:20f3c2d4-19a5-40e0-8c97-7b3edb28aec3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:20f3c2d4-19a5-40e0-8c97-7b3edb28aec3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running fe524544 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command fe524544 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command fe524544 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3398 (Thu
Oct 4 09:43:50 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3398 (Thu
Oct 4 09:43:51
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"0e90c296", "local_conf_timestamp": 3398, "host-ts": 3398}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3396 (Thu
Oct 4 09:43:49 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3396 (Thu
Oct 4 09:43:49
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "58cf6a7e", "local_conf_timestamp": 3396, "host-ts": 3396},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:9f48c0ef-ebcc-4a54-80d4-4d3e243de50e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:9f48c0ef-ebcc-4a54-80d4-4d3e243de50e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 040a95b8 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 040a95b8 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 040a95b8 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3398 (Thu
Oct 4 09:43:50 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3398 (Thu
Oct 4 09:43:51
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"0e90c296", "local_conf_timestamp": 3398, "host-ts": 3398}, "2":
{"conf_on_shared_storage": true, "live-data": false, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3396 (Thu
Oct 4 09:43:49 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3396 (Thu
Oct 4 09:43:49
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "58cf6a7e", "local_conf_timestamp": 3396, "host-ts": 3396},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:429cd235-4fe5-4c16-b3b0-11f9e55560ca:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:429cd235-4fe5-4c16-b3b0-11f9e55560ca:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 076c265e on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 076c265e on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 076c265e on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3408 (Thu
Oct 4 09:44:01 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3409 (Thu
Oct 4 09:44:01
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"a95b9e55", "local_conf_timestamp": 3409, "host-ts": 3408}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3406 (Thu
Oct 4 09:43:58 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3406 (Thu
Oct 4 09:43:58
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "f4c67442", "local_conf_timestamp": 3406, "host-ts": 3406},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:2a141c53-21e1-4165-b46e-1cf570715f1e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:2a141c53-21e1-4165-b46e-1cf570715f1e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 0b16e942 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 0b16e942 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 0b16e942 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3408 (Thu
Oct 4 09:44:01 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3409 (Thu
Oct 4 09:44:01
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"a95b9e55", "local_conf_timestamp": 3409, "host-ts": 3408}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3406 (Thu
Oct 4 09:43:58 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3406 (Thu
Oct 4 09:43:58
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "f4c67442", "local_conf_timestamp": 3406, "host-ts": 3406},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:e486af2a-d1e1-4b09-ae1b-4c295bac8e90:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:e486af2a-d1e1-4b09-ae1b-4c295bac8e90:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 0ec55f06 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 0ec55f06 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 0ec55f06 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3418 (Thu
Oct 4 09:44:10 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3418 (Thu
Oct 4 09:44:11
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"9f09649f", "local_conf_timestamp": 3418, "host-ts": 3418}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3416 (Thu
Oct 4 09:44:08 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3416 (Thu
Oct 4 09:44:08
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "f0808b47", "local_conf_timestamp": 3416, "host-ts": 3416},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:f3668d90-a0c3-4f38-b486-1f5efa7f7c88:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:f3668d90-a0c3-4f38-b486-1f5efa7f7c88:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 1261b772 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 1261b772 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 1261b772 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3428 (Thu
Oct 4 09:44:21 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3429 (Thu
Oct 4 09:44:21
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"2bf00aed", "local_conf_timestamp": 3429, "host-ts": 3428}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3426 (Thu
Oct 4 09:44:18 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3426 (Thu
Oct 4 09:44:18
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "fc4b8a48", "local_conf_timestamp": 3426, "host-ts": 3426},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:79c50e1a-ea5f-44e3-a92c-dbdad9dd29e2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:79c50e1a-ea5f-44e3-a92c-dbdad9dd29e2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 15ac24d0 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 15ac24d0 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 15ac24d0 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3428 (Thu
Oct 4 09:44:21 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3429 (Thu
Oct 4 09:44:21
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"2bf00aed", "local_conf_timestamp": 3429, "host-ts": 3428}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3426 (Thu
Oct 4 09:44:18 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3426 (Thu
Oct 4 09:44:18
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "fc4b8a48", "local_conf_timestamp": 3426, "host-ts": 3426},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:8ea9732b-ebbf-479e-a5f8-c33e269564f3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:8ea9732b-ebbf-479e-a5f8-c33e269564f3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 18eb5c92 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 18eb5c92 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 18eb5c92 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3438 (Thu
Oct 4 09:44:31 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3438 (Thu
Oct 4 09:44:31
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"1da2f027", "local_conf_timestamp": 3438, "host-ts": 3438}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3436 (Thu
Oct 4 09:44:29 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3436 (Thu
Oct 4 09:44:29
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "f80d754d", "local_conf_timestamp": 3436, "host-ts": 3436},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:f95ac86b-781d-4bc6-8a9a-a1a6224f395d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:f95ac86b-781d-4bc6-8a9a-a1a6224f395d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 1d18356a on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 1d18356a on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 1d18356a on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3448 (Thu
Oct 4 09:44:41 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3448 (Thu
Oct 4 09:44:41
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"007a81f2", "local_conf_timestamp": 3448, "host-ts": 3448}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3446 (Thu
Oct 4 09:44:39 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3447 (Thu
Oct 4 09:44:39
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "92dab8c0", "local_conf_timestamp": 3447, "host-ts": 3446},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:b0263ebe-2821-49e8-b0a7-2bfbb224a43b:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:b0263ebe-2821-49e8-b0a7-2bfbb224a43b:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 2179aae4 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 2179aae4 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 2179aae4 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3448 (Thu
Oct 4 09:44:41 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3448 (Thu
Oct 4 09:44:41
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32":
"007a81f2", "local_conf_timestamp": 3448, "host-ts": 3448}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3446 (Thu
Oct 4 09:44:39 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3447 (Thu
Oct 4 09:44:39
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "92dab8c0", "local_conf_timestamp": 3447, "host-ts": 3446},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:456b4cca-60ce-4282-a4ea-a675560048e9:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:456b4cca-60ce-4282-a4ea-a675560048e9:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 253bc464 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 253bc464 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 253bc464 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3458 (Thu
Oct 4 09:44:50 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3458 (Thu
Oct 4 09:44:51
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"56af83fa", "local_conf_timestamp": 3458, "host-ts": 3458}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3456 (Thu
Oct 4 09:44:48 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3456 (Thu
Oct 4 09:44:48
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "e19b7753", "local_conf_timestamp": 3456, "host-ts": 3456},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:c63e8892-0155-4afc-a41d-f35f4eb94cd2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:c63e8892-0155-4afc-a41d-f35f4eb94cd2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 28fdd538 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 28fdd538 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 28fdd538 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3468 (Thu
Oct 4 09:45:01 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3468 (Thu
Oct 4 09:45:01
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"9551dd1e", "local_conf_timestamp": 3468, "host-ts": 3468}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3466 (Thu
Oct 4 09:44:58 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3466 (Thu
Oct 4 09:44:58
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "ed50765c", "local_conf_timestamp": 3466, "host-ts": 3466},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:7297b9f6-3b34-4367-a8f8-f6fdd2e32ded:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:7297b9f6-3b34-4367-a8f8-f6fdd2e32ded:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 2d8da9ca on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 2d8da9ca on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 2d8da9ca on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3468 (Thu
Oct 4 09:45:01 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3468 (Thu
Oct 4 09:45:01
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"9551dd1e", "local_conf_timestamp": 3468, "host-ts": 3468}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3466 (Thu
Oct 4 09:44:58 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3466 (Thu
Oct 4 09:44:58
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "ed50765c", "local_conf_timestamp": 3466, "host-ts": 3466},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:d56805c8-ada4-4e0d-b735-22b02bcd3e91:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:d56805c8-ada4-4e0d-b735-22b02bcd3e91:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 32f8f45a on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 32f8f45a on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 32f8f45a on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3478 (Thu
Oct 4 09:45:10 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3478 (Thu
Oct 4 09:45:11
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"d4041742", "local_conf_timestamp": 3478, "host-ts": 3478}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3476 (Thu
Oct 4 09:45:08 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3476 (Thu
Oct 4 09:45:09
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "e9168959", "local_conf_timestamp": 3476, "host-ts": 3476},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:f339adce-4d16-4509-a178-0f0c89fb9acc:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:f339adce-4d16-4509-a178-0f0c89fb9acc:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 36c35c4c on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 36c35c4c on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 36c35c4c on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3488 (Thu
Oct 4 09:45:21 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3489 (Thu
Oct 4 09:45:21
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"d9e60e22", "local_conf_timestamp": 3489, "host-ts": 3488}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3486 (Thu
Oct 4 09:45:19 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3486 (Thu
Oct 4 09:45:19
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "d6f18c6a", "local_conf_timestamp": 3486, "host-ts": 3486},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:108b90d6-a84d-4089-8f0f-c5f017828dea:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:108b90d6-a84d-4089-8f0f-c5f017828dea:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 3b44df52 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh:
DEBUG: Command 3b44df52 on lago-he-node-ng-suite-4-2-host-0 returned with
0\nlago.ssh: DEBUG: Command 3b44df52 on lago-he-node-ng-suite-4-2-host-0
output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3498 (Thu
Oct 4 09:45:31 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3498 (Thu
Oct 4 09:45:31
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status":
{"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32":
"efb4f4e8", "local_conf_timestamp": 3498, "host-ts": 3498}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3496 (Thu
Oct 4 09:45:28 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3496 (Thu
Oct 4 09:45:28
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status":
{"reason": "vm not running on this host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false,
"crc32": "d2b7736f", "local_conf_timestamp": 3496, "host-ts": 3496},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:705dfd9b-7751-4274-a837-69b6bc0c3228:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:705dfd9b-7751-4274-a837-69b6bc0c3228:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 3f92ff80 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\ncli: DEBUG:
signal 15 was caught\n--------------------- >> end captured logging <<
---------------------'_______________________________________________
Infra mailing list -- [email protected]
To unsubscribe send an email to [email protected]
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/[email protected]/message/TQSN6T2XGMIZYECSAP7XPF4MG6BO2MQF/
