Rayees Namathponnan created CLOUDSTACK-4543:
-----------------------------------------------
Summary: [Automation] Failed to configure VPC router then reported
as deployment failure
Key: CLOUDSTACK-4543
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4543
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Automation
Affects Versions: 4.2.0
Environment: KVM
4.2.1-stable branch
Reporter: Rayees Namathponnan
Priority: Critical
Fix For: 4.2.1
This issue observed during automation run, VPC router deployment failed during
network configuration the failed with error
[{"com.cloud.agent.api.SetupGuestNetworkAnswer":{"result":false,"details":"Creating
guest network failed due to ","wait":0}}] }
Here the log from Management server
2013-08-28 05:09:27,760 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-8:job-2160 = [ 58de3203-44b2-4384-aff3-b66a617425d3 ]) Network
id=473 is shutdown successfully, cleaning up corresponding resources now.
2013-08-28 05:09:27,762 DEBUG [network.guru.GuestNetworkGuru]
(Job-Executor-8:job-2160 = [ 58de3203-44b2-4384-aff3-b66a617425d3 ]) Releasing
vnet for the network id=473
2013-08-28 05:09:27,773 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-8:job-2160 = [ 58de3203-44b2-4384-aff3-b66a617425d3 ]) Lock is
released for network Ntwk[473|Guest|125] as a part of network shutdown
2013-08-28 05:09:27,774 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-8:job-2160 = [ 58de3203-44b2-4384-aff3-b66a617425d3 ]) Lock is
released for network id 473 as a part of network implement
2013-08-28 05:09:27,774 ERROR [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-8:job-2160 = [ 58de3203-44b2-4384-aff3-b66a617425d3 ]) Failed to
start instance VM[User|267a2467-9d94-4667-9624-60e139fd2d1d]
com.cloud.utils.exception.CloudRuntimeException: Failed to add VPC router
VM[DomainRouter|r-507-QA] to guest network Ntwk[473|Guest|125]
at
com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtualRouterElement.java:178)
at
com.cloud.network.NetworkManagerImpl.implementNetworkElementsAndResources(NetworkManagerImpl.java:2034)
at
com.cloud.network.NetworkManagerImpl.implementNetwork(NetworkManagerImpl.java:1939)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
com.cloud.network.NetworkManagerImpl.prepare(NetworkManagerImpl.java:2120)
at
com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:886)
at
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:578)
at
org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:227)
at
org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:209)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3406)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2966)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2952)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:420)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
at
com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2013-08-28 05:09:27,782 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-8:job-2160 = [ 58de3203-44b2-4384-aff3-b66a617425d3 ]) Cleaning
up resources for the vm VM[User|267a2467-9d94-4667-9624-60e139fd2d1d] in
Starting state
Log from Agent
2013-08-28 05:06:48,127 DEBUG [cloud.agent.Agent] (agentRequest-Handler-3:null)
Request:Seq 1-1854544170: { Cmd , MgmtId: 29066118877352, via: 1, Ver: v1,
Flags: 100111, [{"com.cloud.agent.api.SetupGuestN
etworkCommand":{"dhcpRange":"10.1.2.1","networkDomain":"test.domain.org","defaultDns1":"8.8.8.8","isRedundant":false,"add":true,"nic":{"deviceId":3,"networkRateMbps":200,"defaultNic":false,"uuid":"7b212956
-2acf-448d-95f4-7b8bb95c4127","ip":"10.1.2.1","netmask":"255.255.255.0","gateway":"10.1.2.1","mac":"02:00:33:f3:00:02","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://2316","isolationUri":"vla
n://2316","isSecurityGroupEnabled":false},"accessDetails":{"router.guest.ip":"10.1.2.1","guest.vlan.tag":"2316","guest.network.gateway":"10.1.2.1","guest.bridge":"10.1.2.255","router.ip":"169.254.0.91","ro
uter.name":"r-507-QA"},"wait":0}}] }
2013-08-28 05:06:48,127 DEBUG [cloud.agent.Agent] (agentRequest-Handler-3:null)
Processing command: com.cloud.agent.api.SetupGuestNetworkCommand
2013-08-28 05:06:48,206 DEBUG [resource.virtualnetwork.VirtualRoutingResource]
(agentRequest-Handler-3:null) Executing:
/usr/share/cloudstack-common/scripts/network/domr/router_proxy.sh
vpc_guestnw.sh 169.
254.0.91 -C -d eth3 -i 10.1.2.1 -g 10.1.2.1 -m 24 -n 10.1.2.0 -s 8.8.8.8 -e
test.domain.org
2013-08-28 05:07:04,749 DEBUG [cloud.agent.Agent] (agentRequest-Handler-4:null)
Processing command: com.cloud.agent.api.GetVmStatsCommand
2013-08-28 05:07:07,005 DEBUG [cloud.agent.Agent] (agentRequest-Handler-5:null)
Processing command: com.cloud.agent.api.GetHostStatsCommand
2013-08-28 05:07:07,005 DEBUG [kvm.resource.LibvirtComputingResource]
(agentRequest-Handler-5:null) Executing: /bin/bash -c idle=$(top -b -n 1|grep
Cpu\(s\):|cut -d% -f4|cut -d, -f2);echo $idle
2013-08-28 05:07:07,592 DEBUG [kvm.resource.LibvirtComputingResource]
(agentRequest-Handler-5:null) Execution is successful.
2013-08-28 05:07:07,593 DEBUG [kvm.resource.LibvirtComputingResource]
(agentRequest-Handler-5:null) Executing: /bin/bash -c freeMem=$(free|grep
cache:|awk '{print $4}');echo $freeMem
2013-08-28 05:07:07,606 DEBUG [kvm.resource.LibvirtComputingResource]
(agentRequest-Handler-5:null) Execution is successful.
2013-08-28 05:07:07,607 DEBUG [kvm.resource.LibvirtComputingResource]
(agentRequest-Handler-5:null) Executing: /bin/bash -c free|grep Mem:|awk
'{print $2}'
2013-08-28 05:07:07,619 DEBUG [kvm.resource.LibvirtComputingResource]
(agentRequest-Handler-5:null) Execution is successful.
2013-08-28 05:07:09,242 DEBUG [resource.virtualnetwork.VirtualRoutingResource]
(agentRequest-Handler-3:null) Exit value is 1
2013-08-28 05:07:09,242 DEBUG [resource.virtualnetwork.VirtualRoutingResource]
(agentRequest-Handler-3:null)
2013-08-28 05:07:09,242 DEBUG [cloud.agent.Agent] (agentRequest-Handler-3:null)
Seq 1-1854544170: { Ans: , MgmtId: 29066118877352, via: 1, Ver: v1, Flags:
110,
[{"com.cloud.agent.api.SetupGuestNetworkAnswer":{"result":false,"details":"Creating
guest network failed due to ","wait":0}}] }
2013-08-28 05:07:09,245 DEBUG [cloud.agent.Agent] (agentRequest-Handler-2:null)
Request:Seq 1-1854544171: { Cmd , MgmtId: 29066118877352, via: 1, Ver: v1,
Flags: 100111,
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":true,"vmName":"i-372-508-QA","wait":0}}]
}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
