sadhu suresh created CLOUDSTACK-4424:
----------------------------------------
Summary: ceph:kvm:download volume created from snapshot failed
with runtime exception
Key: CLOUDSTACK-4424
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4424
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Reporter: sadhu suresh
steps:
1.deploy a vm on ceph enabled cluster
2.perform snapshot on root volume
3.create a volume from snapshot
4.once its successful,try to download the volume
Actual results:
download volume fails with "Failed to copy the volume from the source primary
storage pool to secondary storage"
content of management log:
**************************
2013-08-21 21:16:13,563 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-3:job-31 = [ a5680044-b669-4c7e-9ee7-961b5f855dd3 ]) Executing
org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd for job-31 = [
a5680044-b669-4c7e-9ee7-961b5f855dd3 ]
2013-08-21 21:16:14,130 DEBUG [storage.motion.AncientDataMotionStrategy]
(Job-Executor-3:job-31 = [ a5680044-b669-4c7e-9ee7-961b5f855dd3 ]) copyAsync
inspecting src type VOLUME copyAsync inspecting dest type VOLUME
2013-08-21 21:16:14,307 DEBUG [agent.transport.Request] (Job-Executor-3:job-31
= [ a5680044-b669-4c7e-9ee7-961b5f855dd3 ]) Seq 4-462553323: Sending { Cmd ,
MgmtId: 7175246184473, via: 4, Ver: v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"06445577-d626-4e49-9601-08005519ce8f","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"08d53ff3-8884-30a4-a1d1-ac621abcc688","id":3,"poolType":"RBD","host":"10.147.41.3","path":"cloudkvm","port":6789}},"name":"volfromsnapshot1","size":8598335488,"path":"47a4c967-25d0-4d4b-8c75-686caa54e5d3","volumeId":11,"accountId":2,"format":"RAW","id":11,"hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"06445577-d626-4e49-9601-08005519ce8f","volumeType":"DATADISK","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.147.28.7/export/home/sadhu/asf/kvmsec","_role":"Image"}},"name":"volfromsnapshot1","size":8598335488,"path":"volumes/2/11","volumeId":11,"accountId":2,"format":"RAW","id":11,"hypervisorType":"KVM"}},"executeInSequence":false,"wait":10800}}]
}
2013-08-21 21:16:14,841 DEBUG [agent.transport.Request]
(AgentManager-Handler-11:null) Seq 4-462553323: Processing: { Ans: , MgmtId:
7175246184473, via: 4, Ver: v1, Flags: 10,
[{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"com.cloud.utils.exception.CloudRuntimeException:
Failed to copy cloudkvm/47a4c967-25d0-4d4b-8c75-686caa54e5d3 to
8c9eaf72-20f1-486a-8cd2-da1b18fecabd.qcow2","wait":0}}] }
2013-08-21 21:16:14,841 DEBUG [agent.transport.Request] (Job-Executor-3:job-31
= [ a5680044-b669-4c7e-9ee7-961b5f855dd3 ]) Seq 4-462553323: Received: { Ans: ,
MgmtId: 7175246184473, via: 4, Ver: v1, Flags: 10, { CopyCmdAnswer } }
2013-08-21 21:16:14,851 WARN [storage.datastore.ObjectInDataStoreManagerImpl]
(Job-Executor-3:job-31 = [ a5680044-b669-4c7e-9ee7-961b5f855dd3 ]) Unsupported
data object (VOLUME,
org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@71fc8be7), no need
to delete from object in store ref table
2013-08-21 21:16:14,950 ERROR [cloud.async.AsyncJobManagerImpl]
(Job-Executor-3:job-31 = [ a5680044-b669-4c7e-9ee7-961b5f855dd3 ]) Unexpected
exception while executing
org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd
com.cloud.utils.exception.CloudRuntimeException: Failed to copy the volume
from the source primary storage pool to secondary storage.
at
com.cloud.storage.VolumeManagerImpl.extractVolume(VolumeManagerImpl.java:2832)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd.execute(ExtractVolumeCmd.java:130)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
at
com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
2013-08-21 21:16:14,990 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-3:job-31 = [ a5680044-b669-4c7e-9ee7-961b5f855dd3 ]) Complete
async job-31 = [ a5680044-b669-4c7e-9ee7-961b5f855dd3 ], jobStatus: 2,
resultCode: 530, result: Error Code: 530 Error text: Failed to copy the volume
from the source primary storage pool to secondary storage.
2013-08-21 21:16:17,240 DEBUG [agent.manager.AgentManagerImpl]
(AgentManager-Handler-10:null) SeqA 2-11291: Processing Seq 2-11291: { Cmd ,
MgmtId: -1, via: 2, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
2013-08-21 21:16:17,247 DEBUG [agent.manager.AgentManagerImpl]
(AgentManager-Handler-10:null) SeqA 2-11291: Sending Seq 2-11291: { Ans: ,
MgmtId: 7175246184473, via: 2, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2013-08-21 21:16:18,470 DEBUG [cloud.api.ApiServlet] (catalina-exec-3:null)
===START=== 10.252.192.16 -- GET
command=queryAsyncJobResult&jobId=a5680044-b669-4c7e-9ee7-961b5f855dd3&response=json&sessionkey=QXvx6d1Pphs1M1Lf0SmxJkM9OdQ%3D&_=1377080515260
id: 29
user_id: 2
account_id: 2
session_key: NULL
instance_type: NULL
instance_id: NULL
job_cmd:
org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd
job_cmd_originator: NULL
job_cmd_info:
{"id":"3","response":"json","sessionkey":"f3aprigxbh/mEtMHCesr43UPUnM\u003d","cmdEventType":"SNAPSHOT.CREATE","ctxUserId":"2","httpmethod":"GET","_":"1377076933345","volumeid":"306b108d-0fef-4b9e-85ff-f212d9acb22a","ctxAccountId":"2","ctxStartEventId":"114"}
job_cmd_ver: 0
callback_type: 0
callback_address: NULL
job_status: 1
job_process_status: 0
job_result_code: 0
job_result:
org.apache.cloudstack.api.response.SnapshotResponse/snapshot/{"id":"b1354580-10b0-40df-bb1e-9063d6550e17","account":"admin","domainid":"1eaf273a-098d-11e3-9f8b-06869e000019","domain":"ROOT","snapshottype":"MANUAL","volumeid":"306b108d-0fef-4b9e-85ff-f212d9acb22a","volumename":"ROOT-4","volumetype":"ROOT","created":"2013-08-21T20:16:35+0530","name":"vm1_ROOT-4_20130821144635","intervaltype":"MANUAL","state":"BackedUp","tags":[]}
job_init_msid: 7175246184473
job_complete_msid: 7175246184473
created: 2013-08-21 14:46:35
last_updated: 2013-08-21 14:50:09
last_polled: 2013-08-21 14:50:08
removed: NULL
uuid: 360e6efe-0eaa-4360-88c2-79535d5270d8
*************************** 18. row ***************************
id: 30
user_id: 2
account_id: 2
session_key: NULL
instance_type: NULL
instance_id: NULL
job_cmd:
org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd
job_cmd_originator: NULL
job_cmd_info:
{"id":"11","response":"json","sessionkey":"QXvx6d1Pphs1M1Lf0SmxJkM9OdQ\u003d","cmdEventType":"VOLUME.CREATE","ctxUserId":"2","snapshotid":"b1354580-10b0-40df-bb1e-9063d6550e17","name":"volfromsnapshot1","httpmethod":"GET","_":"1377079957328","ctxAccountId":"2","ctxStartEventId":"116"}
job_cmd_ver: 0
callback_type: 0
callback_address: NULL
job_status: 1
job_process_status: 0
job_result_code: 0
job_result:
org.apache.cloudstack.api.response.VolumeResponse/volume/{"id":"06445577-d626-4e49-9601-08005519ce8f","name":"volfromsnapshot1","zoneid":"d54091a5-0e54-4198-89ca-b6e9e21b3b4f","zonename":"zone1","type":"DATADISK","size":8598335488,"created":"2013-08-21T21:07:00+0530","state":"Ready","account":"admin","domainid":"1eaf273a-098d-11e3-9f8b-06869e000019","domain":"ROOT","storagetype":"shared","hypervisor":"KVM","diskofferingid":"b2a86bc1-f20a-4933-b312-860a0c570aed","diskofferingname":"testrbd","diskofferingdisplaytext":"testrbd","storage":"KVMRBD","snapshotid":"b1354580-10b0-40df-bb1e-9063d6550e17","destroyed":false,"isextractable":true,"tags":[],"displayvolume":true,"jobid":"54094850-dd4b-4aa8-8e1a-fa0065566922","jobstatus":0}
job_init_msid: 7175246184473
job_complete_msid: 7175246184473
created: 2013-08-21 15:37:00
last_updated: 2013-08-21 15:43:12
last_polled: 2013-08-21 15:43:11
removed: NULL
uuid: 54094850-dd4b-4aa8-8e1a-fa0065566922
id: 31
user_id: 2
account_id: 2
session_key: NULL
instance_type: NULL
instance_id: NULL
job_cmd:
org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd
job_cmd_originator: NULL
job_cmd_info:
{"id":"06445577-d626-4e49-9601-08005519ce8f","response":"json","sessionkey":"QXvx6d1Pphs1M1Lf0SmxJkM9OdQ\u003d","cmdEventType":"VOLUME.EXTRACT","ctxUserId":"2","zoneid":"d54091a5-0e54-4198-89ca-b6e9e21b3b4f","httpmethod":"GET","_":"1377080510839","ctxAccountId":"2","ctxStartEventId":"120","mode":"HTTP_DOWNLOAD"}
job_cmd_ver: 0
callback_type: 0
callback_address: NULL
job_status: 2
job_process_status: 0
job_result_code: 530
job_result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Failed
to copy the volume from the source primary storage pool to secondary storage."}
job_init_msid: 7175246184473
job_complete_msid: 7175246184473
created: 2013-08-21 15:46:13
last_updated: 2013-08-21 15:46:15
last_polled: NULL
removed: NULL
uuid: a5680044-b669-4c7e-9ee7-961b5f855dd3
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
