[
https://issues.apache.org/jira/browse/CLOUDSTACK-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13760672#comment-13760672
]
Min Chen commented on CLOUDSTACK-4190:
--------------------------------------
For Vmware, volumes created on staging has an extra directory due to vmware
export utility, the new commit handles this different structure from xen and
kvm. Mark this defect as resolved. For the issue of not deleting storage
artifacts on staging storage for createTemplateFromSnapshot, I have created
another defect CLOUDSTACK-4625 to track that issue.
> [Object_store_refactor] volume should be deleted from staging storage after
> successfule volume migration
> --------------------------------------------------------------------------------------------------------
>
> Key: CLOUDSTACK-4190
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4190
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the
> default.)
> Components: Storage Controller, Volumes
> Affects Versions: 4.2.0
> Environment: Latest build from ACS 4.2 branch
> Storage: S3 for image store, NFS for secondary staging and primary storage
> Reporter: Sanjeev N
> Assignee: Min Chen
> Priority: Critical
> Fix For: 4.2.1
>
> Attachments: cloud.dmp, cloud.dmp, cloud.rar, management-server.rar,
> management-server.rar
>
>
> volume copied to secondary staging storage during volume migration should be
> deleted after migration.
> Steps to Reproduce:
> =================
> 1.Bring up CS with xen cluster using S3 from image store, NFS for secondary
> staging and primary storage
> 2.Deploy guest vm using default cent os template with both Root and Data
> disks.
> 3.Add another NFS based primary storage to the cluster
> 4.Detach data disk from the vm
> 5.Migrate the data disk to the primary storage created at step3
> Result:
> ======
> Volume migration was successful. But the volume copied to secondary staging
> storage during migration process did not get deleted.
> Only volume from source primary storage got deleted.
> Observations:
> ============
> Following is the log snippet during volume migration:
> 2013-08-08 08:34:49,766 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null)
> ===START=== 10.146.0.20 -- GET
> command=migrateVolume&storageid=29a0c990-7100-3a8d-b570-ba9f84ca78bc&volumeid=e1eb0b93-3fba-4437-ad50-b12bf1d6f1ef&response=json&sessionkey=qXfe5TLEOA5koD0qobFirCKKbOY%3D&_=1375965252817
> 2013-08-08 08:34:49,954 DEBUG [cloud.async.AsyncJobManagerImpl]
> (catalina-exec-13:null) submit async job-44 = [
> 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ], details: AsyncJobVO {id:44, userId:
> 2, accountId: 2, sessionKey: null, instanceType: None, instanceId: null, cmd:
> org.apache.cloudstack.api.command.user.volume.MigrateVolumeCmd,
> cmdOriginator: null, cmdInfo:
> {"response":"json","sessionkey":"qXfe5TLEOA5koD0qobFirCKKbOY\u003d","cmdEventType":"VOLUME.MIGRATE","ctxUserId":"2","storageid":"29a0c990-7100-3a8d-b570-ba9f84ca78bc","httpmethod":"GET","volumeid":"e1eb0b93-3fba-4437-ad50-b12bf1d6f1ef","_":"1375965252817","ctxAccountId":"2","ctxStartEventId":"194"},
> cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0,
> processStatus: 0, resultCode: 0, result: null, initMsid: 6615759585382,
> completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
> 2013-08-08 08:34:49,957 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null)
> ===END=== 10.146.0.20 -- GET
> command=migrateVolume&storageid=29a0c990-7100-3a8d-b570-ba9f84ca78bc&volumeid=e1eb0b93-3fba-4437-ad50-b12bf1d6f1ef&response=json&sessionkey=qXfe5TLEOA5koD0qobFirCKKbOY%3D&_=1375965252817
> 2013-08-08 08:34:49,961 DEBUG [cloud.async.AsyncJobManagerImpl]
> (Job-Executor-45:job-44 = [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Executing
> org.apache.cloudstack.api.command.user.volume.MigrateVolumeCmd for job-44 = [
> 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]
> 2013-08-08 08:34:50,032 DEBUG [storage.motion.AncientDataMotionStrategy]
> (Job-Executor-45:job-44 = [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) copyAsync
> inspecting src type VOLUME copyAsync inspecting dest type VOLUME
> 2013-08-08 08:34:50,061 DEBUG [storage.motion.AncientDataMotionStrategy]
> (Job-Executor-45:job-44 = [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) copyAsync
> inspecting src type VOLUME copyAsync inspecting dest type VOLUME
> 2013-08-08 08:34:50,083 DEBUG [agent.transport.Request]
> (Job-Executor-45:job-44 = [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Seq
> 2-1303576995: Sending { Cmd , MgmtId: 6615759585382, via: 2, Ver: v1, Flags:
> 100011,
> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"e1eb0b93-3fba-4437-ad50-b12bf1d6f1ef","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":3,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/sanjeev/pri_xen_os","port":2049}},"name":"cs-3416","size":5368709120,"path":"5a436a4d-5758-4699-b4d1-7276e1ceb4e5","volumeId":14,"accountId":2,"format":"VHD","id":14,"hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"e1eb0b93-3fba-4437-ad50-b12bf1d6f1ef","volumeType":"DATADISK","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.147.28.7/export/home/sanjeev/sec_xen_os","_role":"ImageCache"}},"name":"cs-3416","size":5368709120,"path":"volumes/2/14","volumeId":14,"accountId":2,"format":"VHD","id":14,"hypervisorType":"XenServer"}},"executeInSequence":false,"wait":10800}}]
> }
> 2013-08-08 08:34:50,085 DEBUG [agent.transport.Request]
> (Job-Executor-45:job-44 = [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Seq
> 2-1303576995: Executing: { Cmd , MgmtId: 6615759585382, via: 2, Ver: v1,
> Flags: 100011,
> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"e1eb0b93-3fba-4437-ad50-b12bf1d6f1ef","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":3,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/sanjeev/pri_xen_os","port":2049}},"name":"cs-3416","size":5368709120,"path":"5a436a4d-5758-4699-b4d1-7276e1ceb4e5","volumeId":14,"accountId":2,"format":"VHD","id":14,"hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"e1eb0b93-3fba-4437-ad50-b12bf1d6f1ef","volumeType":"DATADISK","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.147.28.7/export/home/sanjeev/sec_xen_os","_role":"ImageCache"}},"name":"cs-3416","size":5368709120,"path":"volumes/2/14","volumeId":14,"accountId":2,"format":"VHD","id":14,"hypervisorType":"XenServer"}},"executeInSequence":false,"wait":10800}}]
> }
> 2013-08-08 08:35:20,118 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null)
> ===START=== 10.146.0.20 -- GET
> command=queryAsyncJobResult&jobId=3c1fd226-af63-47fe-9a5c-fc4770f1a6f5&response=json&sessionkey=qXfe5TLEOA5koD0qobFirCKKbOY%3D&_=1375965283221
> 2013-08-08 08:35:20,246 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null)
> ===END=== 10.146.0.20 -- GET
> command=queryAsyncJobResult&jobId=3c1fd226-af63-47fe-9a5c-fc4770f1a6f5&response=json&sessionkey=qXfe5TLEOA5koD0qobFirCKKbOY%3D&_=1375965283221
> 2013-08-08 08:35:20,676 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-79:null) Seq 2-1303576999: Response Received:
> 2013-08-08 08:35:20,676 DEBUG [agent.transport.Request] (DirectAgent-79:null)
> Seq 2-1303576999: Processing: { Ans: , MgmtId: 6615759585382, via: 2, Ver:
> v1, Flags: 10,
> [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"newData":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"size":5368709120,"path":"5a6f328e-cb37-447d-90e9-eb3efaa4e0db","accountId":0,"id":0}},"result":true,"wait":0}}]
> }
> 2013-08-08 08:35:20,677 DEBUG [agent.transport.Request]
> (Job-Executor-45:job-44 = [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Seq
> 2-1303576999: Received: { Ans: , MgmtId: 6615759585382, via: 2, Ver: v1,
> Flags: 10, { CopyCmdAnswer } }
> 2013-08-08 08:35:20,778 DEBUG [agent.transport.Request]
> (Job-Executor-45:job-44 = [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Seq
> 2-1303577000: Sending { Cmd , MgmtId: 6615759585382, via: 2, Ver: v1, Flags:
> 100011,
> [{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"e1eb0b93-3fba-4437-ad50-b12bf1d6f1ef","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":3,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/sanjeev/pri_xen_os","port":2049}},"name":"cs-3416","size":5368709120,"path":"5a436a4d-5758-4699-b4d1-7276e1ceb4e5","volumeId":14,"accountId":2,"format":"VHD","id":14,"hypervisorType":"XenServer"}},"wait":0}}]
> }
> 2013-08-08 08:35:20,779 DEBUG [agent.transport.Request]
> (Job-Executor-45:job-44 = [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Seq
> 2-1303577000: Executing: { Cmd , MgmtId: 6615759585382, via: 2, Ver: v1,
> Flags: 100011,
> [{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"e1eb0b93-3fba-4437-ad50-b12bf1d6f1ef","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":3,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/sanjeev/pri_xen_os","port":2049}},"name":"cs-3416","size":5368709120,"path":"5a436a4d-5758-4699-b4d1-7276e1ceb4e5","volumeId":14,"accountId":2,"format":"VHD","id":14,"hypervisorType":"XenServer"}},"wait":0}}]
> }
> 2013-08-08 08:35:20,780 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-90:null) Seq 2-1303577000: Executing request
> 2013-08-08 08:35:21,440 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-90:null) Seq 2-1303577000: Response Received:
> 2013-08-08 08:35:21,441 DEBUG [agent.transport.Request] (DirectAgent-90:null)
> Seq 2-1303577000: Processing: { Ans: , MgmtId: 6615759585382, via: 2, Ver:
> v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
> 2013-08-08 08:35:21,441 DEBUG [agent.transport.Request]
> (Job-Executor-45:job-44 = [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Seq
> 2-1303577000: Received: { Ans: , MgmtId: 6615759585382, via: 2, Ver: v1,
> Flags: 10, { Answer } }
> 2013-08-08 08:35:21,562 DEBUG [cloud.async.AsyncJobManagerImpl]
> (Job-Executor-45:job-44 = [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Complete
> async job-44 = [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ], jobStatus: 1,
> resultCode: 0, result:
> org.apache.cloudstack.api.response.VolumeResponse@388699b5
> 2013-08-08 08:35:21,578 DEBUG [cloud.async.AsyncJobManagerImpl]
> (Job-Executor-45:job-44 = [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]) Done
> executing org.apache.cloudstack.api.command.user.volume.MigrateVolumeCmd for
> job-44 = [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5 ]
> 2013-08-08 08:35:23,171 DEBUG [cloud.api.ApiServlet] (catalina-exec-14:null)
> ===START=== 10.146.0.20 -- GET
> command=queryAsyncJobResult&jobId=3c1fd226-af63-47fe-9a5c-fc4770f1a6f5&response=json&sessionkey=qXfe5TLEOA5koD0qobFirCKKbOY%3D&_=1375965286243
> 2013-08-08 08:35:23,199 DEBUG [cloud.async.AsyncJobManagerImpl]
> (catalina-exec-14:null) Async job-44 = [ 3c1fd226-af63-47fe-9a5c-fc4770f1a6f5
> ] completed
> During volume migration process, an entry will be made in volume_store_ref
> table with install_path points to the volume location in the secondary
> staging storage.
> Attaching management server log file and cloud DB.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
