[
https://issues.apache.org/jira/browse/CLOUDSTACK-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harikrishna Patnala resolved CLOUDSTACK-5015.
---------------------------------------------
Resolution: Not A Problem
During account cleanup we first delete the entire directory of snapshots
corresponding to a volume in that account. After this we retry deleting the
snapshots one by one and mark them as destroyed. During this second try we are
logging the exception("snapshot directory 'X' doesn't exist") in DEBUG mode.
> snapshot deletion fails as part of account cleanup on upgraded setup
> --------------------------------------------------------------------
>
> Key: CLOUDSTACK-5015
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5015
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the
> default.)
> Components: Snapshot, Upgrade
> Affects Versions: 4.2.1
> Environment: 3.0.7 patch E to 4.2.1 upgrade with xen6.0.2 advance zone
> Reporter: shweta agarwal
> Assignee: Harikrishna Patnala
> Priority: Critical
> Fix For: 4.2.1
>
> Attachments: cloud.dmp, cloud_after.dmp, management-server.log.tar.gz
>
>
> Repro steps:
> Create a 3.0.7 setup
> create an account
> create some manual and recurring snapshots in this account .
> Upgrade to 4.2.1
> Delete the account
> MS log shows
> 2013-10-31 03:36:13,151 INFO [cloud.user.AccountManagerImpl]
> (Job-Executor-116:job-214 = [ fbae6bed-a270-4fd2-af84-db70c23966ef ])
> deleteAccount: Released 0 dedicated guest vlan ranges from account 5
> 2013-10-31 03:36:13,159 DEBUG [agent.transport.Request]
> (Job-Executor-114:job-212 = [ 4f683d9e-112a-4197-967f-532264c18dd7 ]) Seq
> 3-495256722: Sending { Cmd , MgmtId: 6826313646254, via: 3, Ver: v1, Flags:
> 100011,
> [{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/3/24/94f36b90-c52a-45a2-a0b7-0d53a444d9cc","volume":{"uuid":"dc4b65b3-630e-4504-98b2-28aa091d61cf","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"338e8952-c068-3fb4-90bd-bdf995d55d32","id":200,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/shweta/307.xen.primary1","port":2049}},"name":"DATA-12","size":5368709120,"path":"ce0d9b0c-bdc2-49e5-9e68-82c705a28114","volumeId":24,"accountId":3,"format":"VHD","id":24,"hypervisorType":"XenServer"},"dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.147.28.7/export/home/shweta/307.xen.secondary1","_role":"Image"}},"name":"fe357200-3975-482e-a594-797e5c8f972a_DATA-12_20131031050911","hypervisorType":"XenServer","id":50}},"wait":0}}]
> }
> 2013-10-31 03:36:13,213 DEBUG [agent.transport.Request]
> (AgentManager-Handler-14:null) Seq 3-495256722: Processing: { Ans: , MgmtId:
> 6826313646254, via: 3, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.Answer":{"result":false,"details":"snapshot directory
> 24 doesn't exist","wait":0}}] }
> 2013-10-31 03:36:13,213 DEBUG [agent.transport.Request]
> (Job-Executor-114:job-212 = [ 4f683d9e-112a-4197-967f-532264c18dd7 ]) Seq
> 3-495256722: Received: { Ans: , MgmtId: 6826313646254, via: 3, Ver: v1,
> Flags: 10, { Answer } }
> 2013-10-31 03:36:13,214 DEBUG [storage.snapshot.SnapshotServiceImpl]
> (Job-Executor-114:job-212 = [ 4f683d9e-112a-4197-967f-532264c18dd7 ]) delete
> snapshot failedsnapshot directory 24 doesn't exist
> 2013-10-31 03:36:13,241 DEBUG [storage.snapshot.XenserverSnapshotStrategy]
> (Job-Executor-114:job-212 = [ 4f683d9e-112a-4197-967f-532264c18dd7 ]) delete
> snapshot failed:
> com.cloud.utils.exception.CloudRuntimeException: snapshot directory 24
> doesn't exist
> at
> org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.deleteSnapshot(SnapshotServiceImpl.java:369)
> at
> org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.deleteSnapshotChain(XenserverSnapshotStrategy.java:173)
> at
> org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.deleteSnapshot(XenserverSnapshotStrategy.java:225)
> at
> com.cloud.storage.snapshot.SnapshotManagerImpl.deleteSnapshotDirsForAccount(SnapshotManagerImpl.java:684)
> at
> com.cloud.user.AccountManagerImpl.cleanupAccount(AccountManagerImpl.java:584)
> at
> com.cloud.user.AccountManagerImpl.deleteAccount(AccountManagerImpl.java:547)
> at
> com.cloud.user.AccountManagerImpl.deleteUserAccount(AccountManagerImpl.java:1276)
> at
> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
> at
> org.apache.cloudstack.region.RegionManagerImpl.deleteUserAccount(RegionManagerImpl.java:206)
> at
> org.apache.cloudstack.region.RegionServiceImpl.deleteUserAccount(RegionServiceImpl.java:118)
> at
> org.apache.cloudstack.api.command.admin.account.DeleteAccountCmd.execute(DeleteAccountCmd.java:100)
> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
> at
> com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> 2013-10-31 03:36:13,278 DEBUG [cloud.user.AccountManagerImpl]
> (Job-Executor-114:job-212 = [ 4f683d9e-112a-4197-967f-532264c18dd7 ])
> Successfully deleted snapshots directories for all volumes under account 3
> across all zones
> 2013-10-31 03:36:13,296 DEBUG [cloud.user.AccountManagerImpl]
> (Job-Executor-114:job-212 = [ 4f683d9e-112a-4197-967f-532264c18dd7 ])
> Expunging # of vms (accountId=3): 3
>
> Attaching Ms logs and cloud dump before and after upgrade
--
This message was sent by Atlassian JIRA
(v6.1#6144)
