GitHub user muthukrishnang1100 created a discussion: System VM Issue
My both system vms are running and active state, But i cant able to open the console, When i open console it comes those error i shared below and also the public traffic Gateway is not reachable inside the system VMs, But it reachable on both compute and management nodes. Can you check me what is this issue? <img width="1619" height="384" alt="image" src="https://github.com/user-attachments/assets/7ba8b5ba-e118-475c-a00b-d7a869871669" /> 1-bdef-6a26868cc9b3"}]' is allowed to perform API calls: 0.0.0.0/0,::/0 2026-05-25 14:50:20,394 INFO [o.a.c.a.DynamicRoleBasedAPIAccessChecker] (qtp1404565079-23811:[ctx-cb4544e8, ctx-75d5e2f5]) (logid:bda946a5) Account for user id e6574eea-4e04-11f1-bdef-6a26868cc9b3 is Root Admin or Domain Admin, all APIs are allowed. 2026-05-25 14:50:20,394 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker] (qtp1404565079-23811:[ctx-cb4544e8, ctx-75d5e2f5]) (logid:bda946a5) RoleService is enabled. We will use it instead of StaticRoleBasedAPIAccessChecker. 2026-05-25 14:50:20,394 DEBUG [o.a.c.r.ApiRateLimitServiceImpl] (qtp1404565079-23811:[ctx-cb4544e8, ctx-75d5e2f5]) (logid:bda946a5) API rate limiting is disabled. We will not use ApiRateLimitService. 2026-05-25 14:50:20,396 DEBUG [c.c.a.ApiServlet] (qtp1404565079-23811:[ctx-cb4544e8, ctx-75d5e2f5]) (logid:bda946a5) ===END=== 172.16.155.2 -- GET command=readyForShutdown&response=json&sessionkey=RySxR0x1KhAOxaqRrEPeCA7_Duw 2026-05-25 14:50:20,722 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-2d0054a9]) (logid:057b8417) No inactive management server node found 2026-05-25 14:50:20,722 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-2d0054a9]) (logid:057b8417) Peer scan is finished. profiler: Done. Duration: 0ms , profilerQueryActiveList: Done. Duration: 0ms, , profilerSyncClusterInfo: Done. Duration: 0ms, profilerInvalidatedNodeList: Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms,, profilerNewList: Done. Duration: 0ms, profilerInactiveList: Done. Duration: 0ms 2026-05-25 14:50:21,102 DEBUG [c.c.a.ApiServlet] (qtp1404565079-23812:[ctx-04809e5f]) (logid:69f700c1) ===START=== 172.16.155.2 -- GET virtualmachineid=35ab68a3-7042-4bc0-82b4-319f78aa2c39&command=createConsoleEndpoint&response=json&sessionkey=RySxR0x1KhAOxaqRrEPeCA7_Duw 2026-05-25 14:50:21,102 DEBUG [c.c.a.ApiServlet] (qtp1404565079-23812:[ctx-04809e5f]) (logid:69f700c1) Two factor authentication is already verified for the user 2, so skipping 2026-05-25 14:50:21,105 DEBUG [c.c.a.ApiServer] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) CIDRs from which account 'Account [{"accountName":"admin","id":2,"uuid":"e6570663-4e04-11f1-bdef-6a26868cc9b3"}]' is allowed to perform API calls: 0.0.0.0/0,::/0 2026-05-25 14:50:21,105 INFO [o.a.c.a.DynamicRoleBasedAPIAccessChecker] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Account for user id e6574eea-4e04-11f1-bdef-6a26868cc9b3 is Root Admin or Domain Admin, all APIs are allowed. 2026-05-25 14:50:21,105 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) RoleService is enabled. We will use it instead of StaticRoleBasedAPIAccessChecker. 2026-05-25 14:50:21,105 DEBUG [o.a.c.r.ApiRateLimitServiceImpl] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) API rate limiting is disabled. We will not use ApiRateLimitService. 2026-05-25 14:50:21,107 WARN [c.c.a.d.ParamGenericValidationWorker] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Received unknown parameters for command createConsoleEndpoint. Unknown parameters : client-inet-address 2026-05-25 14:50:21,110 DEBUG [c.c.c.ConsoleProxyManagerImpl] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Assign previous allocated console proxy for user vm: VM instance {"id":4,"instanceName":"s-4-VM","state":"Running","type":"SecondaryStorageVm","uuid":"35ab68a3-7042-4bc0-82b4-319f78aa2c39"} 2026-05-25 14:50:21,111 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Wait time setting on com.cloud.agent.api.GetVncPortCommand is 1800 seconds 2026-05-25 14:50:21,112 DEBUG [c.c.a.m.ClusteredAgentAttache] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Seq 30-3656359947471432472: Routed from 222786140395859 2026-05-25 14:50:21,112 DEBUG [c.c.a.t.Request] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Seq 6-3656359947471432472: Sending { Cmd , MgmtId: 222786140395859, via: 6(ltchl1pacscom01), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.GetVncPortCommand":{"id":"4","name":"s-4-VM","wait":"0","bypassHostMaintenance":"false"}}] } 2026-05-25 14:50:21,158 DEBUG [c.c.a.t.Request] (AgentManager-Handler-9:[]) (logid:) Seq 6-3656359947471432472: Processing: { Ans: , MgmtId: 222786140395859, via: 6, Ver: v1, Flags: 10, [{"com.cloud.agent.api.GetVncPortAnswer":{"address":"10.29.30.4","port":"5901","result":"true","wait":"0","bypassHostMaintenance":"false"}}] } 2026-05-25 14:50:21,158 DEBUG [c.c.a.t.Request] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Seq 6-3656359947471432472: Received: { Ans: , MgmtId: 222786140395859, via: 6(ltchl1pacscom01), Ver: v1, Flags: 10, { GetVncPortAnswer } } 2026-05-25 14:50:21,158 DEBUG [o.a.c.c.ConsoleAccessManagerImpl] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Port info 10.29.30.4 2026-05-25 14:50:21,158 INFO [o.a.c.c.ConsoleAccessManagerImpl] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Parse host info returned from executing GetVNCPortCommand. host info: 10.29.30.4 2026-05-25 14:50:21,160 DEBUG [o.a.c.c.ConsoleAccessManagerImpl] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Compose console url: //10.31.0.2/resource/noVNC/vnc.html?autoconnect=true&port=8080&token=CqjCK3/Q7bbeecdgUxZR4z1/fRAgTtNcij8hlikeagoiGdFj92yL+sSXuy0w3TofcyBxColxyHihwSaBeMlSDolF2uQA1RLtUGuuaf18NK53XYCWYM6AmTaP+dgU9X5HT6qKFRrpUVDbhj444g61PWSMBA5WghtQ62zjhYMi5AU1Qnx25c/fjlgxNZSECNRJEDh6S5I4mwgH5kv+inXqziBHNkhgl11SBA6ebFit78kbXVjnvoQ2Hoqv0y4rQv00HkoCYF7uts1A/J/dHmz4xDClkjCZ1XK9s6An0A9QBuZIxB+IOFYAierFWWsI2jzZMyn2l5UgBKa8HnWGcWgV+rhZ+8sEfWNUcCsQGhRHzF15IOyzOMTWyDATOXfXIpnhAmj7WBLMYnONZTyhN8cgFqgI220i9Lo3V/zE3DFIAqz5dlHmRbELpKrNNzi0Sj3oQhMOfno3+Fr4PPVOHuXe8Aey+cGlSBIWos2V+Lghdx3pw0hfO8SlL0PB+/MHnV3cuPBg/2AwMBhhxyRCzqBC 2026-05-25 14:50:21,160 DEBUG [o.a.c.c.ConsoleAccessManagerImpl] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Adding allowed session: 87e7eea3-f112-4534-95df-2529640885cd 2026-05-25 14:50:21,162 DEBUG [c.c.c.ConsoleProxyManagerImpl] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Assign previous allocated console proxy for user vm: VM instance {"id":4,"instanceName":"s-4-VM","state":"Running","type":"SecondaryStorageVm","uuid":"35ab68a3-7042-4bc0-82b4-319f78aa2c39"} 2026-05-25 14:50:21,163 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Wait time setting on com.cloud.agent.api.proxy.AllowConsoleAccessCommand is 1800 seconds 2026-05-25 14:50:21,164 DEBUG [c.c.a.m.ClusteredAgentAttache] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Seq 30-51791395714760759: Routed from 222786140395859 2026-05-25 14:50:21,164 DEBUG [c.c.a.t.Request] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Seq 8-51791395714760759: Sending { Cmd , MgmtId: 222786140395859, via: 8(v-3-VM), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.proxy.AllowConsoleAccessCommand":{"sessionUuid":"87e7eea3-f112-4534-95df-2529640885cd","wait":"0","bypassHostMaintenance":"false"}}] } 2026-05-25 14:50:21,206 DEBUG [c.c.a.t.Request] (AgentManager-Handler-7:[]) (logid:) Seq 8-51791395714760759: Processing: { Ans: , MgmtId: 222786140395859, via: 8, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":"true","wait":"0","bypassHostMaintenance":"false"}}] } 2026-05-25 14:50:21,206 DEBUG [c.c.a.t.Request] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Seq 8-51791395714760759: Received: { Ans: , MgmtId: 222786140395859, via: 8(v-3-VM), Ver: v1, Flags: 10, { Answer } } 2026-05-25 14:50:21,207 DEBUG [c.c.c.ConsoleProxyManagerImpl] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) Assign previous allocated console proxy for user vm: VM instance {"id":4,"instanceName":"s-4-VM","state":"Running","type":"SecondaryStorageVm","uuid":"35ab68a3-7042-4bc0-82b4-319f78aa2c39"} 2026-05-25 14:50:21,208 DEBUG [o.a.c.c.ConsoleAccessManagerImpl] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) The console URL is: http://10.31.0.2/resource/noVNC/vnc.html?autoconnect=true&port=8080&token=CqjCK3/Q7bbeecdgUxZR4z1/fRAgTtNcij8hlikeagoiGdFj92yL+sSXuy0w3TofcyBxColxyHihwSaBeMlSDolF2uQA1RLtUGuuaf18NK53XYCWYM6AmTaP+dgU9X5HT6qKFRrpUVDbhj444g61PWSMBA5WghtQ62zjhYMi5AU1Qnx25c/fjlgxNZSECNRJEDh6S5I4mwgH5kv+inXqziBHNkhgl11SBA6ebFit78kbXVjnvoQ2Hoqv0y4rQv00HkoCYF7uts1A/J/dHmz4xDClkjCZ1XK9s6An0A9QBuZIxB+IOFYAierFWWsI2jzZMyn2l5UgBKa8HnWGcWgV+rhZ+8sEfWNUcCsQGhRHzF15IOyzOMTWyDATOXfXIpnhAmj7WBLMYnONZTyhN8cgFqgI220i9Lo3V/zE3DFIAqz5dlHmRbELpKrNNzi0Sj3oQhMOfno3+Fr4PPVOHuXe8Aey+cGlSBIWos2V+Lghdx3pw0hfO8SlL0PB+/MHnV3cuPBg/2AwMBhhxyRCzqBC 2026-05-25 14:50:21,208 DEBUG [c.c.a.ApiServlet] (qtp1404565079-23812:[ctx-04809e5f, ctx-7bce3a93]) (logid:69f700c1) ===END=== 172.16.155.2 -- GET virtualmachineid=35ab68a3-7042-4bc0-82b4-319f78aa2c39&command=createConsoleEndpoint&response=json&sessionkey=RySxR0x1KhAOxaqRrEPeCA7_Duw 2026-05-25 14:50:22,222 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f3b9d871]) (logid:f4567bdc) No inactive management server node found 2026-05-25 14:50:22,222 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f3b9d871]) (logid:f4567bdc) Peer scan is finished. profiler: Done. Duration: 0ms , profilerQueryActiveList: Done. Duration: 0ms, , profilerSyncClusterInfo: Done. Duration: 0ms, profilerInvalidatedNodeList: Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms,, profilerNewList: Done. Duration: 0ms, profilerInactiveList: Done. Duration: 0ms 2026-05-25 14:50:23,416 DEBUG [o.a.c.h.H.HAManagerBgPollTask] (BackgroundTaskPollManager-3:[ctx-2df2479a]) (logid:4e44576d) HA health check task is running... 2026-05-25 14:50:23,722 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-456486f2]) (logid:a6937104) No inactive management server node found 2026-05-25 14:50:23,722 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-456486f2]) (logid:a6937104) Peer scan is finished. profiler: Done. Duration: 0ms , profilerQueryActiveList: Done. Duration: 0ms, , profilerSyncClusterInfo: Done. Duration: 0ms, profilerInvalidatedNodeList: Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms,, profilerNewList: Done. Duration: 0ms, profilerInactiveList: Done. Duration: 0ms 2026-05-25 14:50:25,222 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-7ce62413]) (logid:0b34f97d) No inactive management server node found 2026-05-25 14:50:25,222 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-7ce62413]) (logid:0b34f97d) Peer scan is finished. profiler: Done. Duration: 0ms , profilerQueryActiveList: Done. Duration: 0ms, , profilerSyncClusterInfo: Done. Duration: 0ms, profilerInvalidatedNodeList: Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms,, profilerNewList: Done. Duration: 0ms, profilerInactiveList: Done. Duration: 0ms 2026-05-25 14:50:26,009 DEBUG [c.c.a.ApiServlet] (qtp1404565079-23811:[ctx-b3ad78f9]) (logid:9a47fa72) ===START=== 172.16.155.2 -- GET command=readyForShutdown&response=json&sessionkey=RySxR0x1KhAOxaqRrEPeCA7_Duw 2026-05-25 14:50:26,009 DEBUG [c.c.a.ApiServlet] (qtp1404565079-23811:[ctx-b3ad78f9]) (logid:9a47fa72) Two factor authentication is already verified for the user 2, so skipping 2026-05-25 14:50:26,012 DEBUG [c.c.a.ApiServer] (qtp1404565079-23811:[ctx-b3ad78f9, ctx-cdaeb3e8]) (logid:9a47fa72) CIDRs from which account 'Account [{"accountName":"admin","id":2,"uuid":"e6570663-4e04-11f1-bdef-6a26868cc9b3"}]' is allowed to perform API calls: 0.0.0.0/0,::/0 2026-05-25 14:50:26,013 INFO [o.a.c.a.DynamicRoleBasedAPIAccessChecker] (qtp1404565079-23811:[ctx-b3ad78f9, ctx-cdaeb3e8]) (logid:9a47fa72) Account for user id e6574eea-4e04-11f1-bdef-6a26868cc9b3 is Root Admin or Domain Admin, all APIs are allowed. 2026-05-25 14:50:26,013 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker] (qtp1404565079-23811:[ctx-b3ad78f9, ctx-cdaeb3e8]) (logid:9a47fa72) RoleService is enabled. We will use it instead of StaticRoleBasedAPIAccessChecker. 2026-05-25 14:50:26,013 DEBUG [o.a.c.r.ApiRateLimitServiceImpl] (qtp1404565079-23811:[ctx-b3ad78f9, ctx-cdaeb3e8]) (logid:9a47fa72) API rate limiting is disabled. We will not use ApiRateLimitService. 2026-05-25 14:50:26,014 DEBUG [c.c.a.ApiServlet] (qtp1404565079-23811:[ctx-b3ad78f9, ctx-cdaeb3e8]) (logid:9a47fa72) ===END=== 172.16.155.2 -- GET command=readyForShutdown&response=json&sessionkey=RySxR0x1KhAOxaqRrEPeCA7_Duw GitHub link: https://github.com/apache/cloudstack/discussions/13230 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
