Sangeetha Hariharan created CLOUDSTACK-2520:
-----------------------------------------------
Summary: Object_Store_Refactor - Not able to attach volumes to VMs.
Key: CLOUDSTACK-2520
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-2520
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Management Server
Affects Versions: 4.2.0
Environment: Build from object_store
Reporter: Sangeetha Hariharan
Priority: Critical
Fix For: 4.2.0
Steps to reproduce the problem:
1.Deploy a VM using the Default CentOS Template.
2.Create a Volume.
3.Attach the Volume to the VM deployed in Step 1.
Not able to attach volumes to VMs.
Fails with following message:
"Failed to attach volume: test-vol to VM: sangee-1"
Mangement server logs:
2013-05-15 12:13:41,910 DEBUG [cloud.api.ApiServlet] (catalina-exec-7:null)
===START=== 10.217.252.128 -- GET command=attachVolume&id=6a82db7e-56d4-
4f22-ae40-813af8e3a836&virtualMachineId=fbb063aa-1801-4c9d-9d7a-9b4663c16885&response=json&sessionkey=71qVeiluDEOL7wvsmcgtqt8I1NM%3D&_=1368648642146
2013-05-15 12:13:41,995 DEBUG [cloud.async.AsyncJobManagerImpl]
(catalina-exec-7:null) submit async job-15, details: AsyncJobVO {id:15, userId:
3, acc ountId: 3, sessionKey: null, instanceType: Volume, instanceId:
5, cmd: org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd,
cmdOriginator: n ull, cmdInfo:
{"response":"json","id":"6a82db7e-56d4-4f22-ae40-813af8e3a836","sessionkey":"71qVeiluDEOL7wvsmcgtqt8I1NM\u003d","ctxUserId":"3","virtual
MachineId":"fbb063aa-1801-4c9d-9d7a-9b4663c16885","httpmethod":"GET","_":"1368648642146","ctxAccountId":"3","ctxStartEventId":"58"},
cmdVersion: 0, ca llbackType: 0, callbackAddress: null, status: 0,
processStatus: 0, resultCode: 0, result: null, initMsid: 206915885079359,
completeMsid: null, lastUpd ated: null, lastPolled: null, created: null}
2013-05-15 12:13:41,996 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-15:job-15) Executing
org.apache.cloudstack.api.command.user.volume.Attac hVolumeCmd for
job-15
2013-05-15 12:13:41,998 DEBUG [cloud.api.ApiServlet] (catalina-exec-7:null)
===END=== 10.217.252.128 -- GET command=attachVolume&id=6a82db7e-56d4-4f
22-ae40-813af8e3a836&virtualMachineId=fbb063aa-1801-4c9d-9d7a-9b4663c16885&response=json&sessionkey=71qVeiluDEOL7wvsmcgtqt8I1NM%3D&_=1368648642146
2013-05-15 12:13:42,073 DEBUG [cloud.user.AccountManagerImpl]
(Job-Executor-15:job-15) Access to
org.apache.cloudstack.storage.volume.VolumeObject@5c1 b5149 granted to
Acct[3-sangee] by DomainChecker_EnhancerByCloudStack_9de4226a
2013-05-15 12:13:42,074 DEBUG [cloud.user.AccountManagerImpl]
(Job-Executor-15:job-15) Access to VM[User|sangee-1] granted to Acct[3-sangee]
by Domain Checker_EnhancerByCloudStack_9de4226a
2013-05-15 12:13:42,087 DEBUG [cloud.storage.StorageManagerImpl]
(Job-Executor-15:job-15) Checking pool 1 for storage, totalSize:
11810778316800, used Bytes: 8712135213056, usedPct: 0.7376427682724009,
disable threshold: 0.85
2013-05-15 12:13:42,100 DEBUG [cloud.storage.StorageManagerImpl]
(Job-Executor-15:job-15) Checking pool: 1 for volume allocation
[Vol[5|vm=null|DATADI SK]], maxSize : 23621556633600,
totalAllocatedSize : 27766292480, askingSize : 5368709120, allocated disable
threshold: 0.85
2013-05-15 12:13:42,101 DEBUG [cloud.storage.VolumeManagerImpl]
(Job-Executor-15:job-15) Trying to create
org.apache.cloudstack.storage.volume.VolumeO bject@5c1b5149 on
org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@296da993
2013-05-15 12:13:42,133 DEBUG [agent.transport.Request]
(Job-Executor-15:job-15) Seq 1-772931717: Sending { Cmd , MgmtId:
206915885079359, via: 1, Ve r: v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid"
:"6a82db7e-56d4-4f22-ae40-813af8e3a836","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"e97b5727-d
157-3dc1-b32c-065b99806623","id":1,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/campo-systemp-1/primary","por
t":2049}},"name":"test-vol","size":5368709120,"volumeId":5,"accountId":3,"id":5}},"wait":0}}]
}
2013-05-15 12:13:42,133 DEBUG [agent.transport.Request]
(Job-Executor-15:job-15) Seq 1-772931717: Executing: { Cmd , MgmtId:
206915885079359, via: 1, Ver: v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uu
id":"6a82db7e-56d4-4f22-ae40-813af8e3a836","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"e97b572
7-d157-3dc1-b32c-065b99806623","id":1,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/campo-systemp-1/primary","
port":2049}},"name":"test-vol","size":5368709120,"volumeId":5,"accountId":3,"id":5}},"wait":0}}]
}
2013-05-15 12:13:42,134 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-41:null) Seq 1-772931717: Executing request
2013-05-15 12:13:42,222 DEBUG [xen.resource.CitrixResourceBase]
(DirectAgent-41:null) SR retrieved for e97b5727-d157-3dc1-b32c-065b99806623
2013-05-15 12:13:42,233 DEBUG [xen.resource.CitrixResourceBase]
(DirectAgent-41:null) Checking e97b5727-d157-3dc1-b32c-065b99806623 or SR
73739a32-2b4 0-de8b-32d0-55685eb9f3ab on
XS[de441988-b533-4974-be18-632a8d30a408-10.223.56.194]
2013-05-15 12:13:42,482 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-41:null) Seq 1-772931717: Response Received:
2013-05-15 12:13:42,483 DEBUG [agent.transport.Request] (DirectAgent-41:null)
Seq 1-772931717: Processing: { Ans: , MgmtId: 206915885079359, via: 1,
Ver: v1, Flags: 10,
[{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"name":"t
est-vol","size":5368709120,"path":"3d62aaa7-297f-4784-9c8f-95eb5f431a7b","accountId":0,"id":0}},"result":false,"wait":0}}]
}
2013-05-15 12:13:42,483 DEBUG [agent.transport.Request]
(Job-Executor-15:job-15) Seq 1-772931717: Received: { Ans: , MgmtId:
206915885079359, via: 1, Ver: v1, Flags: 10, { CreateObjectAnswer } }
2013-05-15 12:13:42,525 DEBUG [agent.transport.Request]
(Job-Executor-15:job-15) Seq 1-772931718: Sending { Cmd , MgmtId:
206915885079359, via: 1, Ve r: v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.AttachCommand":{"disk":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uui
d":"6a82db7e-56d4-4f22-ae40-813af8e3a836","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"e97b5727
-d157-3dc1-b32c-065b99806623","id":1,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/campo-systemp-1/primary","p
ort":2049}},"name":"test-vol","size":5368709120,"path":"3d62aaa7-297f-4784-9c8f-95eb5f431a7b","volumeId":5,"accountId":3,"id":5}},"diskSeq":1,"type":"
DATADISK"},"vmName":"i-3-3-VM","wait":0}}] }
2013-05-15 12:13:42,526 DEBUG [agent.transport.Request]
(Job-Executor-15:job-15) Seq 1-772931718: Executing: { Cmd , MgmtId:
206915885079359, via: 1, Ver: v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.AttachCommand":{"disk":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"
uuid":"6a82db7e-56d4-4f22-ae40-813af8e3a836","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"e97b5
727-d157-3dc1-b32c-065b99806623","id":1,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/campo-systemp-1/primary"
,"port":2049}},"name":"test-vol","size":5368709120,"path":"3d62aaa7-297f-4784-9c8f-95eb5f431a7b","volumeId":5,"accountId":3,"id":5}},"diskSeq":1,"type
":"DATADISK"},"vmName":"i-3-3-VM","wait":0}}] }
2013-05-15 12:13:42,526 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-206:null) Seq 1-772931718: Executing request
2013-05-15 12:13:43,628 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-206:null) Seq 1-772931718: Response Received:
2013-05-15 12:13:43,629 DEBUG [agent.transport.Request] (DirectAgent-206:null)
Seq 1-772931718: Processing: { Ans: , MgmtId: 206915885079359, via: 1,
Ver: v1, Flags: 10,
[{"org.apache.cloudstack.storage.command.AttachAnswer":{"disk":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid"
:"6a82db7e-56d4-4f22-ae40-813af8e3a836","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"e97b5727-d
157-3dc1-b32c-065b99806623","id":1,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/campo-systemp-1/primary","por
t":2049}},"name":"test-vol","size":5368709120,"path":"3d62aaa7-297f-4784-9c8f-95eb5f431a7b","volumeId":5,"accountId":3,"id":5}},"diskSeq":1,"type":"DA
TADISK"},"result":false,"wait":0}}] }
2013-05-15 12:13:43,629 DEBUG [agent.transport.Request]
(Job-Executor-15:job-15) Seq 1-772931718: Received: { Ans: , MgmtId:
206915885079359, via: 1, Ver: v1, Flags: 10, { AttachAnswer } }
2013-05-15 12:13:43,666 ERROR [cloud.async.AsyncJobManagerImpl]
(Job-Executor-15:job-15) Unexpected exception while executing
org.apache.cloudstack.ap i.command.user.volume.AttachVolumeCmd
com.cloud.utils.exception.CloudRuntimeException: Failed to attach volume:
test-vol to VM: sangee-1
at
com.cloud.storage.VolumeManagerImpl.sendAttachVolumeCommand(VolumeManagerImpl.java:1577)
at
com.cloud.storage.VolumeManagerImpl.attachVolumeToVM(VolumeManagerImpl.java:1782)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd.execute(AttachVolumeCmd.java:122)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:155)
at
com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2013-05-15 12:13:43,667 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-15:job-15) Complete async job-15, jobStatus: 2, resultCode: 530,
result: Error Code: 530 Error text: Failed to attach volume: test-vol
to VM: sangee-1
2013-05-15 12:13:45,017 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null)
===START=== 10.217.252.128 -- GET command=queryAsyncJobResult&jobId=27ed
8c9d-7251-4da6-8dc9-a98884ebe0a8&response=json&sessionkey=71qVeiluDEOL7wvsmcgtqt8I1NM%3D&_=1368648645296
2013-05-15 12:13:45,029 DEBUG [cloud.async.AsyncJobManagerImpl]
(catalina-exec-8:null) Async job-15 completed
2013-05-15 12:13:45,034 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null)
===END=== 10.217.252.128 -- GET command=queryAsyncJobResult&jobId=27ed8c
9d-7251-4da6-8dc9-a98884ebe0a8&response=json&sessionkey=71qVeiluDEOL7wvsmcgtqt8I1NM%3D&_=1368648645296
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira