EduFrazao commented on issue #13376:
URL: https://github.com/apache/cloudstack/issues/13376#issuecomment-5191931308

   > [@EduFrazao](https://github.com/EduFrazao) Please test with the following 
global setting
   > 
   > ```
   > "commands.timeout" = "CheckHealthCommand=5,CheckOnHostCommand=5
   > 
   > "kvm.ha.activity.check.failure.ratio"= "0.6"
   > 
   > "kvm.ha.activity.check.interval" = "8"
   > 
   > "kvm.ha.activity.check.max.attempts" =  "5"
   > 
   > "kvm.ha.activity.check.timeout" = "30"
   > 
   > "kvm.ha.degraded.max.period" = "30"
   > 
   > "kvm.ha.fence.timeout" = "30"
   > 
   > "kvm.ha.health.check.timeout" = "30"
   > 
   > "kvm.ha.recover.failure.threshold" = "2"
   > 
   > "kvm.ha.recover.timeout" = "30"
   > 
   > "kvm.ha.recover.wait.period" = "30"
   > ```
   
   Tested. Same behavior: Host transits from degraded to suspect, VMs on it 
never gets started on another host (shows as running).
   
   ```
   2026-08-05 09:43:02,969 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-9:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:43:10,951 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-6:[ctx-0bca60b7]) (logid:356cd5c5) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:43:11,018 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-11:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:43:19,003 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-4:[ctx-b9f34119]) (logid:b0269d8e) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:43:19,074 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-13:[]) 
(logid:) HA state post-transition:: new state=[Degraded], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Degraded].
   2026-08-05 09:43:51,159 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-1:[ctx-66099631]) (logid:58756953) HA state 
post-transition:: new state=[Suspect], old state=[Degraded], for resource 
id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:43:55,191 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-4:[ctx-aa6ba133]) (logid:10b2cbfb) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:43:55,262 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-15:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:44:03,241 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-1:[ctx-0149983e]) (logid:6ea189de) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:44:03,307 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-17:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:44:11,294 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-6:[ctx-03239e43]) (logid:2efea5dd) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:44:11,360 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-19:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:44:19,349 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-4:[ctx-06275c87]) (logid:5b6e6999) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:44:19,415 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-21:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:44:27,395 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-1:[ctx-57d7aae0]) (logid:f6b2aad4) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:44:27,463 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-23:[]) 
(logid:) HA state post-transition:: new state=[Degraded], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Degraded].
   2026-08-05 09:44:59,542 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-6:[ctx-6245caf2]) (logid:a99dabb3) HA state 
post-transition:: new state=[Ineligible], old state=[Available], for resource 
id=[1], status=[true], ha config state=[Ineligible].
   2026-08-05 09:44:59,563 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-6:[ctx-6245caf2]) (logid:a99dabb3) HA state 
post-transition:: new state=[Suspect], old state=[Degraded], for resource 
id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:45:03,596 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-1:[ctx-5bf998c6]) (logid:ae1cf98a) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:45:03,624 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-25:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:45:11,640 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-5:[ctx-2560ddd4]) (logid:fc2a9de9) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:45:11,662 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-1:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:45:19,681 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-4:[ctx-48587166]) (logid:5e52ba69) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:45:19,703 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-3:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:45:27,726 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-3:[ctx-ebcf71fe]) (logid:894f0560) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:45:27,753 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-5:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:45:35,767 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-5:[ctx-3b36f1aa]) (logid:8bdde64e) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:45:35,794 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-7:[]) 
(logid:) HA state post-transition:: new state=[Degraded], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Degraded].
   2026-08-05 09:46:07,902 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-4:[ctx-d8c7a401]) (logid:c2eb4e05) HA state 
post-transition:: new state=[Suspect], old state=[Degraded], for resource 
id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:46:11,929 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-5:[ctx-2a831644]) (logid:f651b8f0) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:46:11,958 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-9:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:46:19,975 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-4:[ctx-37ff6819]) (logid:e301711d) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:46:20,001 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-11:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:46:28,017 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-3:[ctx-da736655]) (logid:19a55180) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:46:28,038 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-13:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:46:36,058 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-5:[ctx-fcd86cf6]) (logid:d95f40d1) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:46:36,081 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-15:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:46:44,103 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-4:[ctx-4b97d5d3]) (logid:1515b9e4) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:46:44,127 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-17:[]) 
(logid:) HA state post-transition:: new state=[Degraded], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Degraded].
   2026-08-05 09:47:16,242 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-3:[ctx-4bd2b165]) (logid:f1848cd0) HA state 
post-transition:: new state=[Suspect], old state=[Degraded], for resource 
id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:47:20,266 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-4:[ctx-d087b4db]) (logid:bbf34e62) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:47:20,291 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-19:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:47:28,312 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-3:[ctx-15de9fb2]) (logid:f5fb894f) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:47:28,418 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-21:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:47:36,356 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-5:[ctx-2bf564ee]) (logid:7bd90672) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:47:36,380 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-23:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:47:44,397 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-4:[ctx-6d079343]) (logid:cd751ab6) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:47:44,419 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-25:[]) 
(logid:) HA state post-transition:: new state=[Suspect], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Suspect].
   2026-08-05 09:47:52,439 DEBUG [o.a.c.h.HAManagerImpl] 
(BackgroundTaskPollManager-3:[ctx-0676188b]) (logid:32396f39) HA state 
post-transition:: new state=[Checking], old state=[Suspect], for resource 
id=[6], status=[true], ha config state=[Checking].
   2026-08-05 09:47:52,465 DEBUG [o.a.c.h.HAManagerImpl] (pool-3-thread-1:[]) 
(logid:) HA state post-transition:: new state=[Degraded], old state=[Checking], 
for resource id=[6], status=[true], ha config state=[Degraded].
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to