[
https://issues.apache.org/jira/browse/CLOUDSTACK-3737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nitin Mehta resolved CLOUDSTACK-3737.
-------------------------------------
Resolution: Fixed
> Uploaded volume is not getting deleted from secondary storage after attaching
> it to guest vm
> --------------------------------------------------------------------------------------------
>
> Key: CLOUDSTACK-3737
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-3737
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the
> default.)
> Components: Storage Controller, Volumes
> Affects Versions: 4.2.0
> Environment: Latest build from ACS 4.2 branch
> Storage: NFS for both primary and secondary
> Reporter: Sanjeev N
> Assignee: Nitin Mehta
> Priority: Critical
> Fix For: 4.2.1
>
> Attachments: management-server.rar
>
>
> Uploaded volume is not getting deleted from secondary storage after attaching
> it to guest vm
> Steps to Reproduce:
> ================
> 1.Bring up CS with xen hypervisor and use NFS as the storage for both primary
> and secondary storage
> 2.Deploy guest vm using default cent of template just with root disk
> 3.Upload volume to CS using following API:
> http://10.147.59.126:8096/client/api?command=uploadVolume&format=VHD&name=cent62&url=http://10.147.28.7/templates/CentOS62-64bit/280c2a70-e37f-4863-bff8-d318122fd61b.vhd&zoneid=5c5c0b8a-9d5a-4b95-8f13-b31058ffdb37&account=admin&domainid=1
> 4.After the volume download is complete to secondary storage , attache it to
> vm using API:
> http://10.147.59.126:8096/client/api?command=attachVolume&id=0d627eec-3824-4d35-8997-853472502454&virtualmachineid=6ef83f81-2577-4be2-9720-5fdcf3912e5f
> Observations:
> ===========
> After step4 volume should be moved from secondary to primary. But the
> observation is it is just getting copied to primary and still present in the
> secondary. It should be deleted from secondary storage after successful
> copying to primary storage.
> Volume state in DB after attaching to VM:
> mysql> select * from volumes where
> uuid='0d627eec-3824-4d35-8997-853472502454'\G;
> *************************** 1. row ***************************
> id: 10
> account_id: 2
> domain_id: 1
> pool_id: 1
> last_pool_id: NULL
> instance_id: 3
> device_id: 1
> name: cent62
> uuid: 0d627eec-3824-4d35-8997-853472502454
> size: 10737418240
> folder: NULL
> path: b2b96197-665a-40cd-a52b-de0506c45a8e
> pod_id: NULL
> data_center_id: 1
> iscsi_name: NULL
> host_ip: NULL
> volume_type: DATADISK
> pool_type: NULL
> disk_offering_id: 6
> template_id: NULL
> first_snapshot_backup_uuid: NULL
> recreatable: 0
> created: 2013-07-23 12:36:22
> attached: 2013-07-23 12:52:40
> updated: 2013-07-23 13:09:08
> removed: NULL
> state: Ready
> chain_info: NULL
> update_count: 6
> disk_type: NULL
> display_volume: 0
> format: VHD
> min_iops: NULL
> max_iops: NULL
> 1 row in set (0.00 sec)
> ERROR:
> No query specified
> In volume_store_ref the volume state is remained in "Creating" state. Still
> attaching volume was succeeded.
> Here is the volume state in volume_store_ref from cloud db:
> mysql> select * from volume_store_ref where id=4\G;
> *************************** 1. row ***************************
> id: 4
> store_id: 1
> volume_id: 10
> zone_id: 0
> created: 2013-07-23 13:09:07
> last_updated: NULL
> job_id: NULL
> download_pct: 0
> size: 0
> physical_size: 0
> download_state: NULL
> checksum: NULL
> error_str: NULL
> local_path: NULL
> install_path: volumes/2/10
> url: NULL
> download_url: NULL
> state: Creating
> destroyed: 0
> update_count: 1
> ref_cnt: 0
> updated: 2013-07-23 13:09:07
> 1 row in set (0.00 sec)
> ERROR:
> No query specified
> Log snippet for upload volume:
> 2013-07-23 08:36:22,827 DEBUG [cloud.async.AsyncJobManagerImpl]
> (ApiServer-1:null) submit async job-22 = [
> 63bf80a6-5142-489e-ab5d-7a5ef061140d ], details: AsyncJobVO {id:22, userId:
> 1, accountId: 1, sessionKey: null, instanceType: None, instanceId: null, cmd:
> org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd, cmdOriginator:
> null, cmdInfo:
> {"cmdEventType":"VOLUME.UPLOAD","ctxUserId":"1","zoneid":"5c5c0b8a-9d5a-4b95-8f13-b31058ffdb37","name":"cent62","account":"admin","httpmethod":"GET","domainid":"1","ctxAccountId":"1","format":"VHD","ctxStartEventId":"91","url":"http://10.147.28.7/templates/CentOS62-64bit/280c2a70-e37f-4863-bff8-d318122fd61b.vhd"},
> cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0,
> processStatus: 0, resultCode: 0, result: null, initMsid: 6615759585382,
> completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
> 2013-07-23 08:36:22,837 DEBUG [cloud.async.AsyncJobManagerImpl]
> (Job-Executor-22:job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ]) Executing
> org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd for job-22 = [
> 63bf80a6-5142-489e-ab5d-7a5ef061140d ]
> 2013-07-23 08:36:23,066 DEBUG [storage.image.BaseImageStoreDriverImpl]
> (Job-Executor-22:job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ])
> Downloading volume to data store 1
> 2013-07-23 08:36:23,121 DEBUG [cloudstack.storage.RemoteHostEndPoint]
> (Job-Executor-22:job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ]) Sending
> command org.apache.cloudstack.storage.command.DownloadCommand to host: 3
> 2013-07-23 08:36:23,125 DEBUG [agent.transport.Request]
> (Job-Executor-22:job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ]) Seq
> 3-1340014758: Sending { Cmd , MgmtId: 6615759585382, via: 3, Ver: v1, Flags:
> 100011,
> [{"org.apache.cloudstack.storage.command.DownloadCommand":{"hvm":false,"maxDownloadSizeInBytes":536870912000,"id":10,"resourceType":"VOLUME","installPath":"volumes/2/10","_store":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.147.28.7/export/home/sanjeev/sec_xen_os","_role":"Image"}},"url":"http://10.147.28.7/templates/CentOS62-64bit/280c2a70-e37f-4863-bff8-d318122fd61b.vhd","format":"VHD","accountId":2,"name":"cent62","wait":0}}]
> }
> 2013-07-23 08:36:23,149 DEBUG [cloud.async.AsyncJobManagerImpl]
> (Job-Executor-22:job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ]) Complete
> async job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ], jobStatus: 1,
> resultCode: 0, result:
> org.apache.cloudstack.api.response.VolumeResponse@2a5b5372
> 2013-07-23 08:36:23,163 DEBUG [cloud.async.AsyncJobManagerImpl]
> (Job-Executor-22:job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ]) Done
> executing org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd for
> job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ]
> 2013-07-23 08:36:26,660 DEBUG [agent.transport.Request]
> (AgentManager-Handler-14:null) Seq 3-1340014758: Processing: { Ans: ,
> MgmtId: 6615759585382, via: 3, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.storage.DownloadAnswer":{"jobId":"9d1225f8-4dd3-44fb-b39d-391583e95281","downloadPct":1,"errorString":"
>
> ","downloadStatus":"DOWNLOAD_IN_PROGRESS","downloadPath":"/mnt/SecStorage/1f24310b-8f0b-3563-aecc-779179564245/volumes/2/10/dnld6777686660366560545tmp_","installPath":"volumes/2/10","templateSize":0,"templatePhySicalSize":0,"result":true,"details":"
> ","wait":0}}] }
> After some time volume was successfully downloaded to secondary storage:
> 2013-07-23 08:45:31,785 DEBUG [agent.transport.Request]
> (AgentManager-Handler-4:null) Seq 3-1340014793: Processing: { Ans: , MgmtId:
> 6615759585382, via: 3, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.storage.DownloadAnswer":{"jobId":"9d1225f8-4dd3-44fb-b39d-391583e95281","downloadPct":100,"errorString":"Install
> completed successfully at 7/23/13 12:45
> PM","downloadStatus":"DOWNLOADED","downloadPath":"/mnt/SecStorage/1f24310b-8f0b-3563-aecc-779179564245/volumes/2/10/dnld6777686660366560545tmp_","installPath":"volumes/2/10/a58b5e0e-8548-34e3-a22f-8a4b52701ac4.vhd","templateSize":10737418240,"templatePhySicalSize":2132787712,"checkSum":"bebf14997dd834de2053ce2dd6a903b6","result":true,"details":"Install
> completed successfully at 7/23/13 12:45 PM","wait":0}}] }
> Executed Attachevolume cmd to attach it to guest vm:
> 2013-07-23 08:50:36,484 DEBUG [cloud.async.AsyncJobManagerImpl]
> (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Executing
> org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd for job-23 = [
> 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]
> 2013-07-23 08:50:36,549 DEBUG [storage.allocator.LocalStoragePoolAllocator]
> (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ])
> LocalStoragePoolAllocator trying to find storage pool to fit the vm
> 2013-07-23 08:50:36,551 DEBUG
> [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-23:job-23
> = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) ClusterScopeStoragePoolAllocator
> looking for storage pool
> 2013-07-23 08:50:36,551 DEBUG
> [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-23:job-23
> = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Looking for pools in dc: 1 pod:1
> cluster:1
> 2013-07-23 08:50:36,559 DEBUG
> [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-23:job-23 = [
> 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Checking if storage pool is suitable,
> name: null ,poolId: 1
> 2013-07-23 08:50:36,567 DEBUG [cloud.storage.StorageManagerImpl]
> (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Checking
> pool 1 for storage, totalSize: 5902284816384, usedBytes: 3927302963200,
> usedPct: 0.6653868942919022, disable threshold: 0.85
> 2013-07-23 08:50:36,598 DEBUG [cloud.storage.StorageManagerImpl]
> (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Checking
> pool: 1 for volume allocation [Vol[10|vm=null|DATADISK]], maxSize :
> 11804569632768, totalAllocatedSize : 54609838080, askingSize : 10737418240,
> allocated disable threshold: 0.85
> 2013-07-23 08:50:36,598 DEBUG
> [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-23:job-23
> = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) FirstFitStoragePoolAllocator
> returning 1 suitable storage pools
> 2013-07-23 08:50:36,638 DEBUG [storage.motion.AncientDataMotionStrategy]
> (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) copyAsync
> inspecting src type VOLUME copyAsync inspecting dest type VOLUME
> 2013-07-23 08:50:36,653 DEBUG [agent.transport.Request]
> (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Seq
> 1-1929052680: Sending { Cmd , MgmtId: 6615759585382, via: 1, Ver: v1, Flags:
> 100011,
> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"0d627eec-3824-4d35-8997-853472502454","volumeType":"DATADISK","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.147.28.7/export/home/sanjeev/sec_xen_os","_role":"Image"}},"name":"cent62","size":10737418240,"path":"volumes/2/10/a58b5e0e-8548-34e3-a22f-8a4b52701ac4.vhd","volumeId":10,"accountId":2,"format":"VHD","id":10}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"0d627eec-3824-4d35-8997-853472502454","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":1,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/sanjeev/pri_xen_os","port":2049}},"name":"cent62","size":10737418240,"volumeId":10,"accountId":2,"format":"VHD","id":10}},"executeInSequence":false,"wait":10800}}]
> }
> 2013-07-23 08:50:36,654 DEBUG [agent.transport.Request]
> (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Seq
> 1-1929052680: Executing: { Cmd , MgmtId: 6615759585382, via: 1, Ver: v1,
> Flags: 100011,
> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"0d627eec-3824-4d35-8997-853472502454","volumeType":"DATADISK","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.147.28.7/export/home/sanjeev/sec_xen_os","_role":"Image"}},"name":"cent62","size":10737418240,"path":"volumes/2/10/a58b5e0e-8548-34e3-a22f-8a4b52701ac4.vhd","volumeId":10,"accountId":2,"format":"VHD","id":10}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"0d627eec-3824-4d35-8997-853472502454","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":1,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/sanjeev/pri_xen_os","port":2049}},"name":"cent62","size":10737418240,"volumeId":10,"accountId":2,"format":"VHD","id":10}},"executeInSequence":false,"wait":10800}}]
> }
> 2013-07-23 08:50:36,655 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-17:null) Seq 1-1929052680: Executing request
> 2013-07-23 08:52:39,712 DEBUG [agent.transport.Request]
> (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Seq
> 1-1929052687: Sending { Cmd , MgmtId: 6615759585382, via: 1, Ver: v1, Flags:
> 100011,
> [{"org.apache.cloudstack.storage.command.AttachCommand":{"disk":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"0d627eec-3824-4d35-8997-853472502454","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":1,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/sanjeev/pri_xen_os","port":2049}},"name":"cent62","size":10737418240,"path":"b2b96197-665a-40cd-a52b-de0506c45a8e","volumeId":10,"accountId":2,"format":"VHD","id":10}},"diskSeq":1,"type":"DATADISK"},"vmName":"i-2-3-VM","_storageHost":"10.147.28.7","_storagePort":2049,"_managed":false,"wait":0}}]
> }
> 2013-07-23 08:52:39,713 DEBUG [agent.transport.Request]
> (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Seq
> 1-1929052687: Executing: { Cmd , MgmtId: 6615759585382, via: 1, Ver: v1,
> Flags: 100011,
> [{"org.apache.cloudstack.storage.command.AttachCommand":{"disk":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"0d627eec-3824-4d35-8997-853472502454","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":1,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/sanjeev/pri_xen_os","port":2049}},"name":"cent62","size":10737418240,"path":"b2b96197-665a-40cd-a52b-de0506c45a8e","volumeId":10,"accountId":2,"format":"VHD","id":10}},"diskSeq":1,"type":"DATADISK"},"vmName":"i-2-3-VM","_storageHost":"10.147.28.7","_storagePort":2049,"_managed":false,"wait":0}}]
> }
> 2013-07-23 08:52:39,714 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-399:null) Seq 1-1929052687: Executing request
> 2013-07-23 08:52:40,868 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-399:null) Seq 1-1929052687: Response Received:
> 2013-07-23 08:52:40,870 DEBUG [agent.transport.Request]
> (DirectAgent-399:null) Seq 1-1929052687: Processing: { Ans: , MgmtId:
> 6615759585382, via: 1, Ver: v1, Flags: 10,
> [{"org.apache.cloudstack.storage.command.AttachAnswer":{"disk":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"0d627eec-3824-4d35-8997-853472502454","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":1,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/sanjeev/pri_xen_os","port":2049}},"name":"cent62","size":10737418240,"path":"b2b96197-665a-40cd-a52b-de0506c45a8e","volumeId":10,"accountId":2,"format":"VHD","id":10}},"diskSeq":1,"vdiUuid":"b2b96197-665a-40cd-a52b-de0506c45a8e","type":"DATADISK"},"result":true,"wait":0}}]
> }
> 2013-07-23 08:52:40,870 DEBUG [agent.transport.Request]
> (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Seq
> 1-1929052687: Received: { Ans: , MgmtId: 6615759585382, via: 1, Ver: v1,
> Flags: 10, { AttachAnswer } }
> 2013-07-23 08:52:40,915 DEBUG [cloud.async.AsyncJobManagerImpl]
> (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Complete
> async job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ], jobStatus: 1,
> resultCode: 0, result:
> org.apache.cloudstack.api.response.VolumeResponse@50be7f47
> 2013-07-23 08:52:40,922 DEBUG [cloud.async.AsyncJobManagerImpl]
> (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Done
> executing org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd for
> job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]
--
This message was sent by Atlassian JIRA
(v6.1#6144)
