GitHub user akrasnov-drv added a comment to the discussion: CloudStack fails to
start more VMs
One more peace of info
I see CloudStack agent stuck in 1 of my hosts. The last message in its log is
`2025-01-15 09:21:59,544 WARN [kvm.resource.LibvirtComputingResource]
(Script-10:[]) (logid:) Interrupting script.`
Then CloudStack stops processing expunge, for all hosts.
After restarting libvirtd, I've got this addition to agent log (so agent was
not really stuck, but rather waiting)
```
2025-01-15 11:03:07,848 WARN [kvm.resource.LibvirtComputingResource]
(agentRequest-Handler-1:[]) (logid:bba1b4b7) Process [168078] for command
[/usr/share/cloudstack-common/scripts/network/domr/router_proxy.sh
update_config.py 169.254.130.62
vm_metadata.json.4846fe83-e605-4882-a203-45ef732d05aa ] timed out. Output is
[java.io.IOException: Stream closed
at java.base/java.io.BufferedReader.ensureOpen(BufferedReader.java:123)
at java.base/java.io.BufferedReader.ready(BufferedReader.java:444)
at
com.cloud.utils.script.OutputInterpreter$TimedOutLogger.interpret(OutputInterpreter.java:72)
at com.cloud.utils.script.Script$Task.run(Script.java:490)
at com.cloud.utils.script.Script.execute(Script.java:298)
at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeInVR(LibvirtComputingResource.java:553)
at
com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.applyConfigToVR(VirtualRoutingResource.java:303)
at
com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.applyConfig(VirtualRoutingResource.java:318)
at
com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.executeRequest(VirtualRoutingResource.java:165)
at
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtNetworkElementCommandWrapper.execute(LibvirtNetworkElementCommandWrapper.java:35)
at
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtNetworkElementCommandWrapper.execute(LibvirtNetworkElementCommandWrapper.java:29)
at
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78)
at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1945)
at com.cloud.agent.Agent.processRequest(Agent.java:686)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1109)
at com.cloud.utils.nio.Task.call(Task.java:83)
at com.cloud.utils.nio.Task.call(Task.java:29)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:840)
].
2025-01-15 11:03:07,849 INFO [cloud.agent.Agent] (AgentShutdownThread:[])
(logid:) Stopping the agent: Reason = sig.kill : Detail =
2025-01-15 11:03:10,743 INFO [cloud.agent.AgentShell] (main:[]) (logid:) Agent
started
```
Then most of VMs were expunged.
GitHub link:
https://github.com/apache/cloudstack/discussions/10184#discussioncomment-11841960
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscr...@cloudstack.apache.org
