Dear oVirt,
I have problem migrating HostedEngine, only HA VM server, to other HA nodes.
Bit of background story:
* We have oVirt SHE 4.3.5
* Three Nodes act as HA pool for SHE
* Node 3 is currently Hosting SHE
* Actions:
* Put Node1 in Maintenance mode, all VMs were successfully migrated,
than Upgrade packages, Activate Host – all looks good
* Put Node2 in Maintenance mode, all VMs were successfully migrated,
than Upgrade packages, Activate Host – all looks good
Not the problem:
Try to set Node3 in Maintenance mode, all VMs were successfully migrated,
except HostedEngine.
When attempting Migration of the VM HostedEngine, it fails with following error
message:
2020-02-14 12:33:49,960Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand]
(default task-265) [16f4559e-e262-4c9d-80b4-ec81c2cbf950] Lock Acquired to
object 'EngineLock:{exclusiveLocks='[66b6d489-ceb8-486a-951a-355e21f13627=VM]',
sharedLocks=''}'
2020-02-14 12:33:49,984Z INFO
[org.ovirt.engine.core.bll.scheduling.SchedulingManager] (default task-265)
[16f4559e-e262-4c9d-80b4-ec81c2cbf950] Candidate host 'ovirt-sj-04.ictv.com'
('d98843da-bd81-46c9-9425-065b196ac59d') was filtered out by
'VAR__FILTERTYPE__INTERNAL' filter 'HA' (correlation id: null)
2020-02-14 12:33:49,984Z INFO
[org.ovirt.engine.core.bll.scheduling.SchedulingManager] (default task-265)
[16f4559e-e262-4c9d-80b4-ec81c2cbf950] Candidate host 'ovirt-sj-05.ictv.com'
('e3176705-9fb0-41d6-8721-367dfa2e62bd') was filtered out by
'VAR__FILTERTYPE__INTERNAL' filter 'HA' (correlation id: null)
2020-02-14 12:33:49,997Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand]
(default task-265) [16f4559e-e262-4c9d-80b4-ec81c2cbf950] Running command:
MigrateVmCommand internal: false. Entities affected : ID:
66b6d489-ceb8-486a-951a-355e21f13627 Type: VMAction group MIGRATE_VM with role
type USER
2020-02-14 12:33:50,008Z INFO
[org.ovirt.engine.core.bll.scheduling.SchedulingManager] (default task-265)
[16f4559e-e262-4c9d-80b4-ec81c2cbf950] Candidate host 'ovirt-sj-04.ictv.com'
('d98843da-bd81-46c9-9425-065b196ac59d') was filtered out by
'VAR__FILTERTYPE__INTERNAL' filter 'HA' (correlation id:
16f4559e-e262-4c9d-80b4-ec81c2cbf950)
2020-02-14 12:33:50,008Z INFO
[org.ovirt.engine.core.bll.scheduling.SchedulingManager] (default task-265)
[16f4559e-e262-4c9d-80b4-ec81c2cbf950] Candidate host 'ovirt-sj-05.ictv.com'
('e3176705-9fb0-41d6-8721-367dfa2e62bd') was filtered out by
'VAR__FILTERTYPE__INTERNAL' filter 'HA' (correlation id:
16f4559e-e262-4c9d-80b4-ec81c2cbf950)
2020-02-14 12:33:50,033Z INFO
[org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-265)
[16f4559e-e262-4c9d-80b4-ec81c2cbf950] START, MigrateVDSCommand(
MigrateVDSCommandParameters:{hostId='f8d27efb-1527-45f0-97d6-d34a86abaaa2',
vmId='66b6d489-ceb8-486a-951a-355e21f13627', srcHost='ovirt-sj-03.ictv.com',
dstVdsId='9808f434-5cd4-48b5-8bbc-e639e391c6a5',
dstHost='ovirt-sj-01.ictv.com:54321', migrationMethod='ONLINE',
tunnelMigration='false', migrationDowntime='0', autoConverge='true',
migrateCompressed='false', consoleAddress='null', maxBandwidth='40',
enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2',
convergenceSchedule='[init=[{name=setDowntime, params=[100]}],
stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2,
action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime,
params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6,
action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort,
params=[]}}]]', dstQemu='10.210.13.11'}), log id: 5c126a47
2020-02-14 12:33:50,036Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default
task-265) [16f4559e-e262-4c9d-80b4-ec81c2cbf950] START,
MigrateBrokerVDSCommand(HostName = ovirt-sj-03.ictv.com,
MigrateVDSCommandParameters:{hostId='f8d27efb-1527-45f0-97d6-d34a86abaaa2',
vmId='66b6d489-ceb8-486a-951a-355e21f13627', srcHost='ovirt-sj-03.ictv.com',
dstVdsId='9808f434-5cd4-48b5-8bbc-e639e391c6a5',
dstHost='ovirt-sj-01.ictv.com:54321', migrationMethod='ONLINE',
tunnelMigration='false', migrationDowntime='0', autoConverge='true',
migrateCompressed='false', consoleAddress='null', maxBandwidth='40',
enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2',
convergenceSchedule='[init=[{name=setDowntime, params=[100]}],
stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2,
action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime,
params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6,
action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort,
params=[]}}]]', dstQemu='10.210.13.11'}), log id: a0f776d
2020-02-14 12:33:50,043Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default
task-265) [16f4559e-e262-4c9d-80b4-ec81c2cbf950] FINISH,
MigrateBrokerVDSCommand, return: , log id: a0f776d
2020-02-14 12:33:50,046Z INFO
[org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-265)
[16f4559e-e262-4c9d-80b4-ec81c2cbf950] FINISH, MigrateVDSCommand, return:
MigratingFrom, log id: 5c126a47
2020-02-14 12:33:50,052Z INFO
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default
task-265) [16f4559e-e262-4c9d-80b4-ec81c2cbf950] EVENT_ID:
VM_MIGRATION_START(62), Migration started (VM: HostedEngine, Source:
ovirt-sj-03.ictv.com, Destination: ovirt-sj-01.ictv.com, User:
mvrgo...@ictv.com@ictv.com-authz).
2020-02-14 12:33:52,893Z INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer]
(ForkJoinPool-1-worker-8) [] VM '66b6d489-ceb8-486a-951a-355e21f13627' was
reported as Down on VDS
'9808f434-5cd4-48b5-8bbc-e639e391c6a5'(ovirt-sj-01.ictv.com)
2020-02-14 12:33:52,893Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand]
(ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName =
ovirt-sj-01.ictv.com,
DestroyVmVDSCommandParameters:{hostId='9808f434-5cd4-48b5-8bbc-e639e391c6a5',
vmId='66b6d489-ceb8-486a-951a-355e21f13627', secondsToWait='0',
gracefully='false', reason='', ignoreNoVm='true'}), log id: 7532a8c0
2020-02-14 12:33:53,217Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand]
(ForkJoinPool-1-worker-8) [] Failed to destroy VM
'66b6d489-ceb8-486a-951a-355e21f13627' because VM does not exist, ignoring
2020-02-14 12:33:53,217Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand]
(ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, return: , log id:
7532a8c0
2020-02-14 12:33:53,217Z INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer]
(ForkJoinPool-1-worker-8) [] VM
'66b6d489-ceb8-486a-951a-355e21f13627'(HostedEngine) was unexpectedly detected
as 'Down' on VDS '9808f434-5cd4-48b5-8bbc-e639e391c6a5'(ovirt-sj-01.ictv.com)
(expected on 'f8d27efb-1527-45f0-97d6-d34a86abaaa2')
2020-02-14 12:33:53,217Z ERROR
[org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer]
(ForkJoinPool-1-worker-8) [] Migration of VM 'HostedEngine' to host
'ovirt-sj-01.ictv.com' failed: VM destroyed during the startup.
2020-02-14 12:33:53,219Z INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer]
(ForkJoinPool-1-worker-15) [] VM
'66b6d489-ceb8-486a-951a-355e21f13627'(HostedEngine) moved from 'MigratingFrom'
--> 'Up'
2020-02-14 12:33:53,219Z INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer]
(ForkJoinPool-1-worker-15) [] Adding VM
'66b6d489-ceb8-486a-951a-355e21f13627'(HostedEngine) to re-run list
2020-02-14 12:33:53,221Z ERROR
[org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring]
(ForkJoinPool-1-worker-15) [] Rerun VM '66b6d489-ceb8-486a-951a-355e21f13627'.
Called from VDS 'ovirt-sj-03.ictv.com'
2020-02-14 12:33:53,259Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-377323) [] START,
MigrateStatusVDSCommand(HostName = ovirt-sj-03.ictv.com,
MigrateStatusVDSCommandParameters:{hostId='f8d27efb-1527-45f0-97d6-d34a86abaaa2',
vmId='66b6d489-ceb8-486a-951a-355e21f13627'}), log id: 62bac076
2020-02-14 12:33:53,265Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-377323) [] FINISH,
MigrateStatusVDSCommand, return: , log id: 62bac076
2020-02-14 12:33:53,277Z WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engine-Thread-377323) [] EVENT_ID:
VM_MIGRATION_TRYING_RERUN(128), Failed to migrate VM HostedEngine to Host
ovirt-sj-01.ictv.com . Trying to migrate to another Host.
2020-02-14 12:33:53,330Z INFO
[org.ovirt.engine.core.bll.scheduling.SchedulingManager]
(EE-ManagedThreadFactory-engine-Thread-377323) [] Candidate host
'ovirt-sj-04.ictv.com' ('d98843da-bd81-46c9-9425-065b196ac59d') was filtered
out by 'VAR__FILTERTYPE__INTERNAL' filter 'HA' (correlation id: null)
2020-02-14 12:33:53,330Z INFO
[org.ovirt.engine.core.bll.scheduling.SchedulingManager]
(EE-ManagedThreadFactory-engine-Thread-377323) [] Candidate host
'ovirt-sj-05.ictv.com' ('e3176705-9fb0-41d6-8721-367dfa2e62bd') was filtered
out by 'VAR__FILTERTYPE__INTERNAL' filter 'HA' (correlation id: null)
2020-02-14 12:33:53,345Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand]
(EE-ManagedThreadFactory-engine-Thread-377323) [] Running command:
MigrateVmCommand internal: false. Entities affected : ID:
66b6d489-ceb8-486a-951a-355e21f13627 Type: VMAction group MIGRATE_VM with role
type USER
2020-02-14 12:33:53,356Z INFO
[org.ovirt.engine.core.bll.scheduling.SchedulingManager]
(EE-ManagedThreadFactory-engine-Thread-377323) [] Candidate host
'ovirt-sj-04.ictv.com' ('d98843da-bd81-46c9-9425-065b196ac59d') was filtered
out by 'VAR__FILTERTYPE__INTERNAL' filter 'HA' (correlation id:
16f4559e-e262-4c9d-80b4-ec81c2cbf950)
2020-02-14 12:33:53,356Z INFO
[org.ovirt.engine.core.bll.scheduling.SchedulingManager]
(EE-ManagedThreadFactory-engine-Thread-377323) [] Candidate host
'ovirt-sj-05.ictv.com' ('e3176705-9fb0-41d6-8721-367dfa2e62bd') was filtered
out by 'VAR__FILTERTYPE__INTERNAL' filter 'HA' (correlation id:
16f4559e-e262-4c9d-80b4-ec81c2cbf950)
2020-02-14 12:33:53,380Z INFO
[org.ovirt.engine.core.vdsbroker.MigrateVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-377323) [] START, MigrateVDSCommand(
MigrateVDSCommandParameters:{hostId='f8d27efb-1527-45f0-97d6-d34a86abaaa2',
vmId='66b6d489-ceb8-486a-951a-355e21f13627', srcHost='ovirt-sj-03.ictv.com',
dstVdsId='33e8ff78-e396-4f40-b43c-685bfaaee9af',
dstHost='ovirt-sj-02.ictv.com:54321', migrationMethod='ONLINE',
tunnelMigration='false', migrationDowntime='0', autoConverge='true',
migrateCompressed='false', consoleAddress='null', maxBandwidth='40',
enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2',
convergenceSchedule='[init=[{name=setDowntime, params=[100]}],
stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2,
action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime,
params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6,
action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort,
params=[]}}]]', dstQemu='10.210.13.12'}), log id: d99059f
2020-02-14 12:33:53,380Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-377323) [] START,
MigrateBrokerVDSCommand(HostName = ovirt-sj-03.ictv.com,
MigrateVDSCommandParameters:{hostId='f8d27efb-1527-45f0-97d6-d34a86abaaa2',
vmId='66b6d489-ceb8-486a-951a-355e21f13627', srcHost='ovirt-sj-03.ictv.com',
dstVdsId='33e8ff78-e396-4f40-b43c-685bfaaee9af',
dstHost='ovirt-sj-02.ictv.com:54321', migrationMethod='ONLINE',
tunnelMigration='false', migrationDowntime='0', autoConverge='true',
migrateCompressed='false', consoleAddress='null', maxBandwidth='40',
enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2',
convergenceSchedule='[init=[{name=setDowntime, params=[100]}],
stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2,
action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime,
params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6,
action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort,
params=[]}}]]', dstQemu='10.210.13.12'}), log id: 6f0483ac
2020-02-14 12:33:53,386Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-377323) [] FINISH,
MigrateBrokerVDSCommand, return: , log id: 6f0483ac
2020-02-14 12:33:53,388Z INFO
[org.ovirt.engine.core.vdsbroker.MigrateVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-377323) [] FINISH, MigrateVDSCommand,
return: MigratingFrom, log id: d99059f
2020-02-14 12:33:53,391Z INFO
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engine-Thread-377323) [] EVENT_ID:
VM_MIGRATION_START(62), Migration started (VM: HostedEngine, Source:
ovirt-sj-03.ictv.com, Destination: ovirt-sj-02.ictv.com, User:
mvrgo...@ictv.com@ictv.com-authz).
2020-02-14 12:33:55,108Z INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher]
(EE-ManagedThreadFactory-engineScheduled-Thread-96) [] Fetched 10 VMs from VDS
'33e8ff78-e396-4f40-b43c-685bfaaee9af'
2020-02-14 12:33:55,110Z INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer]
(EE-ManagedThreadFactory-engineScheduled-Thread-96) [] VM
'66b6d489-ceb8-486a-951a-355e21f13627' is migrating to VDS
'33e8ff78-e396-4f40-b43c-685bfaaee9af'(ovirt-sj-02.ictv.com) ignoring it in the
refresh until migration is done
2020-02-14 12:33:57,224Z INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer]
(ForkJoinPool-1-worker-15) [] VM '66b6d489-ceb8-486a-951a-355e21f13627' was
reported as Down on VDS
'33e8ff78-e396-4f40-b43c-685bfaaee9af'(ovirt-sj-02.ictv.com)
2020-02-14 12:33:57,225Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand]
(ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName =
ovirt-sj-02.ictv.com,
DestroyVmVDSCommandParameters:{hostId='33e8ff78-e396-4f40-b43c-685bfaaee9af',
vmId='66b6d489-ceb8-486a-951a-355e21f13627', secondsToWait='0',
gracefully='false', reason='', ignoreNoVm='true'}), log id: 1dec553e
2020-02-14 12:33:57,672Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand]
(ForkJoinPool-1-worker-15) [] Failed to destroy VM
'66b6d489-ceb8-486a-951a-355e21f13627' because VM does not exist, ignoring
2020-02-14 12:33:57,672Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand]
(ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, return: , log id:
1dec553e
2020-02-14 12:33:57,672Z INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer]
(ForkJoinPool-1-worker-15) [] VM
'66b6d489-ceb8-486a-951a-355e21f13627'(HostedEngine) was unexpectedly detected
as 'Down' on VDS '33e8ff78-e396-4f40-b43c-685bfaaee9af'(ovirt-sj-02.ictv.com)
(expected on 'f8d27efb-1527-45f0-97d6-d34a86abaaa2')
2020-02-14 12:33:57,672Z ERROR
[org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer]
(ForkJoinPool-1-worker-15) [] Migration of VM 'HostedEngine' to host
'ovirt-sj-02.ictv.com' failed: VM destroyed during the startup.
2020-02-14 12:33:57,674Z INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer]
(ForkJoinPool-1-worker-8) [] VM
'66b6d489-ceb8-486a-951a-355e21f13627'(HostedEngine) moved from 'MigratingFrom'
--> 'Up'
2020-02-14 12:33:57,674Z INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer]
(ForkJoinPool-1-worker-8) [] Adding VM
'66b6d489-ceb8-486a-951a-355e21f13627'(HostedEngine) to re-run list
2020-02-14 12:33:57,676Z ERROR
[org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring]
(ForkJoinPool-1-worker-8) [] Rerun VM '66b6d489-ceb8-486a-951a-355e21f13627'.
Called from VDS 'ovirt-sj-03.ictv.com'
2020-02-14 12:33:57,678Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-377324) [] START,
MigrateStatusVDSCommand(HostName = ovirt-sj-03.ictv.com,
MigrateStatusVDSCommandParameters:{hostId='f8d27efb-1527-45f0-97d6-d34a86abaaa2',
vmId='66b6d489-ceb8-486a-951a-355e21f13627'}), log id: 2228bcc
2020-02-14 12:33:57,682Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-377324) [] FINISH,
MigrateStatusVDSCommand, return: , log id: 2228bcc
2020-02-14 12:33:57,691Z WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engine-Thread-377324) [] EVENT_ID:
VM_MIGRATION_TRYING_RERUN(128), Failed to migrate VM HostedEngine to Host
ovirt-sj-02.ictv.com . Trying to migrate to another Host.
2020-02-14 12:33:57,713Z INFO
[org.ovirt.engine.core.bll.scheduling.SchedulingManager]
(EE-ManagedThreadFactory-engine-Thread-377324) [] Candidate host
'ovirt-sj-04.ictv.com' ('d98843da-bd81-46c9-9425-065b196ac59d') was filtered
out by 'VAR__FILTERTYPE__INTERNAL' filter 'HA' (correlation id: null)
2020-02-14 12:33:57,713Z INFO
[org.ovirt.engine.core.bll.scheduling.SchedulingManager]
(EE-ManagedThreadFactory-engine-Thread-377324) [] Candidate host
'ovirt-sj-05.ictv.com' ('e3176705-9fb0-41d6-8721-367dfa2e62bd') was filtered
out by 'VAR__FILTERTYPE__INTERNAL' filter 'HA' (correlation id: null)
2020-02-14 12:33:57,713Z WARN [org.ovirt.engine.core.bll.MigrateVmCommand]
(EE-ManagedThreadFactory-engine-Thread-377324) [] Validation of action
'MigrateVm' failed for user mvrgo...@ictv.com@ictv.com-authz. Reasons:
VAR__ACTION__MIGRATE,VAR__TYPE__VM,VAR__ACTION__MIGRATE,VAR__TYPE__VM,VAR__ACTION__MIGRATE,VAR__TYPE__VM,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName
ovirt-sj-04.ictv.com,$filterName
HA,VAR__DETAIL__NOT_HE_HOST,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL,VAR__FILTERTYPE__INTERNAL,$hostName
ovirt-sj-05.ictv.com,$filterName
HA,VAR__DETAIL__NOT_HE_HOST,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL
2020-02-14 12:33:57,715Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand]
(EE-ManagedThreadFactory-engine-Thread-377324) [] Lock freed to object
'EngineLock:{exclusiveLocks='[66b6d489-ceb8-486a-951a-355e21f13627=VM]',
sharedLocks=''}'
2020-02-14 12:33:57,725Z WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engine-Thread-377324) [] EVENT_ID:
VM_MIGRATION_NO_VDS_TO_MIGRATE_TO(166), No available host was found to migrate
VM HostedEngine to.
2020-02-14 12:33:57,752Z ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engine-Thread-377324) [] EVENT_ID:
VM_MIGRATION_FAILED(65), Migration failed (VM: HostedEngine, Source:
ovirt-sj-03.ictv.com).
2020-02-14 12:33:58,220Z INFO
[org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService]
(EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool
'commandCoordinator' is using 0 threads out of 10, 6 threads waiting for tasks.
2020-02-14 12:33:58,220Z INFO
[org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService]
(EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool
'default' is using 0 threads out of 1, 5 threads waiting for tasks.
2020-02-14 12:33:58,220Z INFO
[org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService]
(EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool
'engine' is using 0 threads out of 500, 42 threads waiting for tasks and 0
tasks in queue.
2020-02-14 12:33:58,220Z INFO
[org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService]
(EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool
'engineScheduled' is using 0 threads out of 100, 100 threads waiting for tasks.
2020-02-14 12:33:58,220Z INFO
[org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService]
(EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool
'engineThreadMonitoring' is using 1 threads out of 1, 0 threads waiting for
tasks.
2020-02-14 12:33:58,220Z INFO
[org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService]
(EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool
'hostUpdatesChecker' is using 0 threads out of 5, 5 threads waiting for tasks.
2020-02-14 12:34:05,643Z INFO
[org.ovirt.engine.core.bll.EngineBackupAwarenessManager]
(EE-ManagedThreadFactory-engineScheduled-Thread-94) [] Backup check started.
2020-02-14 12:34:05,649Z WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engineScheduled-Thread-94) [] EVENT_ID:
ENGINE_NO_WARM_BACKUP(9,023), Full backup was created on Mon Feb 03 17:48:23
UTC 2020 and it's too old. Please run engine-backup to prevent data loss in
case of corruption.
2020-02-14 12:34:05,649Z INFO
[org.ovirt.engine.core.bll.EngineBackupAwarenessManager]
(EE-ManagedThreadFactory-engineScheduled-Thread-94) [] Backup check completed.
2020-02-14 12:34:10,145Z INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher]
(EE-ManagedThreadFactory-engineScheduled-Thread-92) [] Fetched 9 VMs from VDS
'33e8ff78-e396-4f40-b43c-685bfaaee9af'
I have tried to fix the issue:
* by reinstall of the Node1
* by Undeploy HostedEngine from Node1 – than remove the Node1 from oVIrt –
add as NewHost with HostedEngine deploy
* by Undeploy HostedEngine from Node1 – than remove the Node1 from oVIrt –
add as NewHost with HostedEngine deploy – set to Maintenance Mode and reboot –
just for sake of starting services in correct order
In all cases, error message remains the same and HostedEngine remains on Node3.
Kindly awaiting your reply.
-----
kind regards/met vriendelijke groeten
Marko Vrgotic
Sr. System Engineer @ System Administration
ActiveVideo
o: +31 (35) 6774131
e: m.vrgo...@activevideo.com<mailto:m.vrgo...@activevideo.com>
w: www.activevideo.com<http://www.activevideo.com>
ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ
Hilversum, The Netherlands. The information contained in this message may be
legally privileged and confidential. It is intended to be read only by the
individual or entity to whom it is addressed or by their designee. If the
reader of this message is not the intended recipient, you are on notice that
any distribution of this message, in any form, is strictly prohibited. If you
have received this message in error, please immediately notify the sender
and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or
destroy any copy of this message.
_______________________________________________
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/MBHAW4TEDZTAILENO3SW35V2JVWBCWHL/
