phsm commented on issue #8055:
URL: https://github.com/apache/cloudstack/issues/8055#issuecomment-1752828968
@weizhouapache
Thanks for prompt reply.
Yes, both management server and hypervisors are updated to 4.18.1.0.
However, it doesn't seem this is the bug you mentioned.
As per Cloudstack management server, the job for creating a new virtual
router is created, but the hypervisor never receives the command to start the
new routerVM.
Here are the last messages from the management server regarding starting new
VM:
```
2023-10-09 10:49:49,488 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4140
2023-10-09 10:49:49,510 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4141
2023-10-09 10:49:49,531 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4142
2023-10-09 10:49:49,552 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4143
2023-10-09 10:49:49,574 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4144
2023-10-09 10:49:49,596 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4145
2023-10-09 10:49:49,616 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4146
2023-10-09 10:49:49,637 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4147
2023-10-09 10:49:49,678 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4148
2023-10-09 10:49:49,699 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4149
2023-10-09 10:49:49,721 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4150
2023-10-09 10:49:50,028 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4140
2023-10-09 10:49:50,060 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4140
2023-10-09 10:49:50,087 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4140
2023-10-09 10:49:50,140 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4141
2023-10-09 10:49:50,172 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4141
2023-10-09 10:49:50,200 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4141
2023-10-09 10:49:50,253 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4142
2023-10-09 10:49:50,285 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4142
2023-10-09 10:49:50,313 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4142
2023-10-09 10:49:50,363 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4143
2023-10-09 10:49:50,394 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4143
2023-10-09 10:49:50,421 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4143
2023-10-09 10:49:50,472 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4144
2023-10-09 10:49:50,503 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4144
2023-10-09 10:49:50,533 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4144
2023-10-09 10:49:50,581 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4145
2023-10-09 10:49:50,612 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4145
2023-10-09 10:49:50,641 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4145
2023-10-09 10:49:50,692 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4146
2023-10-09 10:49:50,721 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4146
2023-10-09 10:49:50,750 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4146
2023-10-09 10:49:50,808 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4147
2023-10-09 10:49:50,842 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4147
2023-10-09 10:49:50,874 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4147
2023-10-09 10:49:50,929 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4148
2023-10-09 10:49:50,960 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4148
2023-10-09 10:49:50,989 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4148
2023-10-09 10:49:51,041 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4149
2023-10-09 10:49:51,075 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4149
2023-10-09 10:49:51,102 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4149
2023-10-09 10:49:51,151 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4150
2023-10-09 10:49:51,182 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4150
2023-10-09 10:49:51,211 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4150
2023-10-09 10:49:51,242 DEBUG
[c.c.n.r.VpcVirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Found 0 static routes to apply as a part of vpc route VM
instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start
2023-10-09 10:49:51,250 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Creating monitoring services on VM instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start...
2023-10-09 10:57:21,381 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Resending ipAssoc, port forwarding, load balancing rules as a
part of Virtual router start
2023-10-09 10:57:21,389 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Found 0 firewall Egress rule(s) to apply as a part of domR VM
instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start.
2023-10-09 10:57:21,389 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Found 0 Ipv6 firewall rule(s) to apply as a part of domR VM
instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start.
2023-10-09 10:57:21,397 DEBUG
[c.c.n.r.VpcVirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Found 3 network ACLs to apply as a part of VPC VR VM instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start for guest network id=4140
2023-10-09 10:57:21,415 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4140
2023-10-09 10:57:21,441 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Creating monitoring services on VM instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start...
2023-10-09 11:04:49,515 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Reapplying dhcp entries as a part of domR VM instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start...
2023-10-09 11:04:49,525 DEBUG [c.c.n.r.CommandSetupHelper]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Creating dhcp entry for vm VM instance
{"id":27189,"instanceName":"i-877-27189-VM","type":"User","uuid":"f34641cc-1885-430e-9eef-0f2560527f69"}
on domR VM instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}.
2023-10-09 11:04:49,539 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Reapplying vm data (userData and metaData) entries as a part
of domR VM instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start...
2023-10-09 11:04:49,546 DEBUG [c.c.n.r.CommandSetupHelper]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Creating user data entry for vm VM instance
{"id":27189,"instanceName":"i-877-27189-VM","type":"User","uuid":"f34641cc-1885-430e-9eef-0f2560527f69"}
on domR VM instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
2023-10-09 11:04:49,581 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Resending ipAssoc, port forwarding, load balancing rules as a
part of Virtual router start
2023-10-09 11:04:49,590 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Found 0 firewall Egress rule(s) to apply as a part of domR VM
instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start.
2023-10-09 11:04:49,590 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Found 0 Ipv6 firewall rule(s) to apply as a part of domR VM
instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start.
2023-10-09 11:04:49,600 DEBUG
[c.c.n.r.VpcVirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Found 3 network ACLs to apply as a part of VPC VR VM instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start for guest network id=4141
2023-10-09 11:04:49,625 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4141
2023-10-09 11:04:49,654 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Creating monitoring services on VM instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start...
2023-10-09 11:12:18,234 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Reapplying dhcp entries as a part of domR VM instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start...
2023-10-09 11:12:18,245 DEBUG [c.c.n.r.CommandSetupHelper]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Creating dhcp entry for vm VM instance
{"id":27190,"instanceName":"i-877-27190-VM","type":"User","uuid":"4aa04dae-091d-4f78-bc32-af5da5a1ca2d"}
on domR VM instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}.
2023-10-09 11:12:18,262 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Reapplying vm data (userData and metaData) entries as a part
of domR VM instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start...
2023-10-09 11:12:18,270 DEBUG [c.c.n.r.CommandSetupHelper]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Creating user data entry for vm VM instance
{"id":27190,"instanceName":"i-877-27190-VM","type":"User","uuid":"4aa04dae-091d-4f78-bc32-af5da5a1ca2d"}
on domR VM instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
2023-10-09 11:12:18,307 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Resending ipAssoc, port forwarding, load balancing rules as a
part of Virtual router start
2023-10-09 11:12:18,315 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Found 0 firewall Egress rule(s) to apply as a part of domR VM
instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start.
2023-10-09 11:12:18,315 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Found 0 Ipv6 firewall rule(s) to apply as a part of domR VM
instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start.
2023-10-09 11:12:18,325 DEBUG
[c.c.n.r.VpcVirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Found 3 network ACLs to apply as a part of VPC VR VM instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start for guest network id=4142
2023-10-09 11:12:18,345 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Service SecurityGroup is not supported in the network id=4142
2023-10-09 11:12:18,372 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-29:ctx-50e781f7 job-2775939/job-2775942 ctx-4b8d8442)
(logid:32899a45) Creating monitoring services on VM instance
{"id":27201,"instanceName":"r-27201-VM","type":"DomainRouter","uuid":"40d534e2-c6cd-43a6-8d1c-4c2f5bb6e377"}
start...
```
After this line, no activity on this job anymore (the new routerVM appears
as "Starting").
The hypervisor that is chosen for the routerVM doesn't have any mentions of
its name in the agent.log:
```
# grep r-27201-VM /var/log/cloudstack/agent/agent.log
#
```
It looks like the management server doesn't even send VM creation command to
the hypervisor.
The running routerVM (the one in Running state while Cloudstack is trying to
create the second routerVM) indeed shows the lines from the bug you've
mentioned:
```
root@r-27188-VM:~# cat /var/log/cloud.log | grep md5
Mon 09 Oct 2023 08:39:31 AM UTC Scripts checksum detected:
oldmd5=da16d6a2533fd19960304152dd78e02c newmd5=da16d6a2533fd19960304152dd78e02c
Mon 09 Oct 2023 08:39:39 AM UTC Scripts checksum detected:
oldmd5=da16d6a2533fd19960304152dd78e02c newmd5=28d602db87f545cced0664df0ed9d437
```
However the timestamps in the log correspond to the VPC creation time (I
created this test VPC at 09 Oct 2023 08:39:10).
I'm still attempting to figure out the cause of the bug by removing VPC
elements and trying to restart it. So far I have a suspicion that large amount
of tiers (the VPC has 11 tiers) is the cause but it is yet to be confirmed.
I will post an update here with the reproduce scenario once I have it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
