Chandan Purushothama created CLOUDSTACK-5774:
------------------------------------------------
Summary: [Automation] VPCChecker failed to delete the VPC VR's
Volume due to NPE
Key: CLOUDSTACK-5774
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5774
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Management Server
Affects Versions: 4.3.0
Environment: ==================
NullPointer Exception:
==================
2014-01-04 00:47:14,661 INFO [c.c.n.v.VpcManagerImpl]
(VpcChecker-1:ctx-4daa3c04) Found 1 removed VPCs to cleanup
2014-01-04 00:47:14,662 DEBUG [c.c.n.v.VpcManagerImpl]
(VpcChecker-1:ctx-4daa3c04) Cleaning up [VPC [5-TestVPC-G9J5FX]
2014-01-04 00:47:14,665 DEBUG [c.c.n.v.VpcManagerImpl]
(VpcChecker-1:ctx-4daa3c04) Destroying vpc [VPC [5-TestVPC-G9J5FX]
2014-01-04 00:47:14,668 DEBUG [c.c.n.v.VpcManagerImpl]
(VpcChecker-1:ctx-4daa3c04) Shutting down vpc [VPC [5-TestVPC-G9J5FX]
2014-01-04 00:47:14,677 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(VpcChecker-1:ctx-4daa3c04) Attempting to destroy router 77
2014-01-04 00:47:14,682 DEBUG [c.c.v.VirtualMachineManagerImpl]
(VpcChecker-1:ctx-4daa3c04) Stopped called on VM[DomainRouter|r-77-QA] but the
state is Expunging
2014-01-04 00:47:14,684 DEBUG [c.c.c.CapacityManagerImpl]
(VpcChecker-1:ctx-4daa3c04) VM state transitted from :Expunging to Expunging
with event: ExpungeOperationvm's original host id: 1 new host id: 2 host id
before state transition: 2
2014-01-04 00:47:14,684 DEBUG [c.c.v.VirtualMachineManagerImpl]
(VpcChecker-1:ctx-4daa3c04) Destroying vm VM[DomainRouter|r-77-QA]
2014-01-04 00:47:14,685 DEBUG [c.c.v.VirtualMachineManagerImpl]
(VpcChecker-1:ctx-4daa3c04) Cleaning up NICS
2014-01-04 00:47:14,685 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(VpcChecker-1:ctx-4daa3c04) Cleaning network for vm: 77
2014-01-04 00:47:14,686 DEBUG [c.c.v.VirtualMachineManagerImpl]
(VpcChecker-1:ctx-4daa3c04) Cleaning up hypervisor data structures (ex. SRs in
XenServer) for managed storage
2014-01-04 00:47:14,688 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-250:ctx-1c5db065) Seq 2-1933902599: Response Received:
2014-01-04 00:47:14,689 DEBUG [c.c.a.t.Request] (DirectAgent-250:ctx-1c5db065)
Seq 2-1933902599: Processing: { Ans: , MgmtId: 6631563722783, via: 2, Ver: v1,
Flags: 10,
[{"com.cloud.agent.api.NetworkUsageAnswer":{"routerName":"r-13-QA","bytesSent":1440,"bytesReceived":0,"result":true,"details":"","wait":0}}]
}
2014-01-04 00:47:14,689 DEBUG [c.c.a.t.Request] (RouterMonitor-1:ctx-83046987)
Seq 2-1933902599: Received: { Ans: , MgmtId: 6631563722783, via: 2, Ver: v1,
Flags: 10, { NetworkUsageAnswer } }
2014-01-04 00:47:14,689 DEBUG [c.c.a.m.AgentManagerImpl]
(RouterMonitor-1:ctx-83046987) Details from executing class
com.cloud.agent.api.NetworkUsageCommand:
2014-01-04 00:47:14,708 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-146:ctx-4ab2a172) Seq 2-1933902600: Response Received:
2014-01-04 00:47:14,709 DEBUG [c.c.a.t.Request] (DirectAgent-146:ctx-4ab2a172)
Seq 2-1933902600: Processing: { Ans: , MgmtId: 6631563722783, via: 2, Ver: v1,
Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
2014-01-04 00:47:14,709 DEBUG [c.c.a.t.Request] (AccountChecker-1:ctx-3dd8fde4)
Seq 2-1933902600: Received: { Ans: , MgmtId: 6631563722783, via: 2, Ver: v1,
Flags: 10, { Answer } }
2014-01-04 00:47:14,719 DEBUG [o.a.c.e.o.VolumeOrchestrator]
(VpcChecker-1:ctx-4daa3c04) Cleaning storage for vm: 77
2014-01-04 00:47:14,724 DEBUG [o.a.c.e.o.VolumeOrchestrator]
(VpcChecker-1:ctx-4daa3c04) Skipping destroy for the volume Vol[83|vm=77|ROOT]
as its in state Expunged
2014-01-04 00:47:14,730 INFO [o.a.c.s.v.VolumeServiceImpl]
(AccountChecker-1:ctx-3dd8fde4) Volume 83 is not referred anywhere, remove it
from volumes table
2014-01-04 00:47:14,751 DEBUG [c.c.v.VirtualMachineManagerImpl]
(AccountChecker-1:ctx-3dd8fde4) Expunged VM[DomainRouter|r-77-QA]
2014-01-04 00:47:14,753 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-154:ctx-9dc1ad33) Seq 2-1933902601: Executing request
2014-01-04 00:47:14,779 DEBUG [c.c.n.v.VpcManagerImpl]
(AccountChecker-1:ctx-3dd8fde4) Vpc [VPC [5-TestVPC-G9J5FX] has been shutdown
succesfully
2014-01-04 00:47:14,779 DEBUG [c.c.n.v.VpcManagerImpl]
(AccountChecker-1:ctx-3dd8fde4) Cleaning up resources for vpc id=5
2014-01-04 00:47:14,779 DEBUG [c.c.n.v.VpcManagerImpl]
(AccountChecker-1:ctx-3dd8fde4) Cleaning up existed site to site VPN connections
2014-01-04 00:47:14,786 DEBUG [c.c.n.v.VpcManagerImpl]
(AccountChecker-1:ctx-3dd8fde4) Cleaning up existed site to site VPN gateways
2014-01-04 00:47:14,793 DEBUG [c.c.n.v.VpcManagerImpl]
(AccountChecker-1:ctx-3dd8fde4) Releasing ips for vpc id=5 as a part of vpc
cleanup
2014-01-04 00:47:14,797 DEBUG [c.c.n.IpAddressManagerImpl]
(AccountChecker-1:ctx-3dd8fde4) Revoking all Firewallrules as a part of public
IP id=29 release...
2014-01-04 00:47:14,817 DEBUG [c.c.n.f.FirewallManagerImpl]
(AccountChecker-1:ctx-3dd8fde4) Releasing 0 firewall rules for ip id=29
2014-01-04 00:47:14,821 DEBUG [c.c.n.f.FirewallManagerImpl]
(AccountChecker-1:ctx-3dd8fde4) There are no firewall rules to apply
2014-01-04 00:47:14,827 DEBUG [c.c.s.s.SnapshotSchedulerImpl]
(SnapshotPollTask:ctx-aa249df6) Snapshot scheduler.poll is being called at
2014-01-03 19:17:14 GMT
2014-01-04 00:47:14,830 DEBUG [c.c.n.f.FirewallManagerImpl]
(AccountChecker-1:ctx-3dd8fde4) Successfully released firewall rules for ip
id=29 and # of rules now = 0
2014-01-04 00:47:14,831 DEBUG [c.c.u.d.T.Transaction]
(VpcChecker-1:ctx-4daa3c04) Rolling back the transaction: Time = 166 Name =
VpcChecker-1; called by
-TransactionLegacy.rollback:896-TransactionLegacy.removeUpTo:839-TransactionLegacy.close:663-Transaction.execute:41-VpcManagerImpl$VpcCleanupTask.runInContext:1991-ManagedContextRunnable$1.run:49-DefaultManagedContext$1.call:56-DefaultManagedContext.callWithContext:103-DefaultManagedContext.runWithContext:53-ManagedContextRunnable.run:46-Executors$RunnableAdapter.call:471-FutureTask$Sync.innerRunAndReset:351
2014-01-04 00:47:14,834 DEBUG [c.c.s.s.SnapshotSchedulerImpl]
(SnapshotPollTask:ctx-aa249df6) Got 0 snapshots to be executed at 2014-01-03
19:17:14 GMT
2014-01-04 00:47:14,834 DEBUG [c.c.s.s.SnapshotSchedulerImpl]
(SnapshotPollTask:ctx-aa249df6) Got 0 snapshots to be executed at 2014-01-03
19:17:14 GMT
2014-01-04 00:47:14,840 ERROR [c.c.n.v.VpcManagerImpl]
(VpcChecker-1:ctx-4daa3c04) Exception
java.lang.NullPointerException
at
org.apache.cloudstack.storage.volume.VolumeObject.getUuid(VolumeObject.java:113)
at
org.apache.cloudstack.storage.to.VolumeObjectTO.<init>(VolumeObjectTO.java:54)
at
org.apache.cloudstack.storage.volume.VolumeObject.getTO(VolumeObject.java:483)
at
org.apache.cloudstack.storage.datastore.driver.CloudStackPrimaryDataStoreDriverImpl.deleteAsync(CloudStackPrimaryDataStoreDriverImpl.java:179)
at
org.apache.cloudstack.storage.volume.VolumeServiceImpl.expungeVolumeAsync(VolumeServiceImpl.java:317)
at
org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.cleanupVolumes(VolumeOrchestrator.java:835)
at
com.cloud.vm.VirtualMachineManagerImpl.advanceExpunge(VirtualMachineManagerImpl.java:515)
at
com.cloud.vm.VirtualMachineManagerImpl.advanceExpunge(VirtualMachineManagerImpl.java:448)
at
com.cloud.vm.VirtualMachineManagerImpl.expunge(VirtualMachineManagerImpl.java:437)
at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl.destroyRouter(VirtualNetworkApplianceManagerImpl.java:311)
at sun.reflect.GeneratedMethodAccessor566.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy240.destroyRouter(Unknown Source)
at
com.cloud.network.element.VpcVirtualRouterElement.shutdownVpc(VpcVirtualRouterElement.java:150)
at
com.cloud.network.vpc.VpcManagerImpl.shutdownVpc(VpcManagerImpl.java:1055)
at
com.cloud.network.vpc.VpcManagerImpl.destroyVpc(VpcManagerImpl.java:769)
at
com.cloud.network.vpc.VpcManagerImpl$VpcCleanupTask$1.doInTransactionWithoutResult(VpcManagerImpl.java:1999)
at
com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTransaction(TransactionCallbackWithExceptionNoReturn.java:25)
at
com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTransaction(TransactionCallbackWithExceptionNoReturn.java:21)
at com.cloud.utils.db.Transaction.execute(Transaction.java:37)
at
com.cloud.network.vpc.VpcManagerImpl$VpcCleanupTask.runInContext(VpcManagerImpl.java:1991)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at
java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2014-01-04 00:47:14,847 DEBUG [c.c.n.IpAddressManagerImpl]
(AccountChecker-1:ctx-3dd8fde4) Revoking all PortForwarding/StaticNat rules as
a part of public IP id=29 release...
Reporter: Chandan Purushothama
Priority: Critical
Fix For: 4.3.0
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
