Venkata Siva Vijayendra Bhamidipati created CLOUDSTACK-3430:
---------------------------------------------------------------
Summary: volume migration on zone wide primary storage pool failing
Key: CLOUDSTACK-3430
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-3430
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Management Server
Affects Versions: 4.2.0
Environment: vmware on cloudstack master
Reporter: Venkata Siva Vijayendra Bhamidipati
Create a zone with zone wide primary storage.
Bring up system VMs, create a guest VM.
Add another zone wide primary storage to the zone.
Attempt to migrate the root volume of the guest VM from its current zone wide
primary storage to the new zone wide primary storage. The operation fails, and
the logs show the following trace:
2013-07-09 08:36:29,943 DEBUG [cloud.api.ApiServlet]
(1754543106@qtp-481326697-2:null) ===START=== 10.217.252.54 -- GET
command=findStoragePoolsForMigration&id=d0cd5d41-f395-48d9-8bd6-3886f4f76c3e&response=json&sessionkey=PWQxaW5CBGIDG7HYLOQBdAk3RJg%3D&_=1373407310956
2013-07-09 08:36:30,492 DEBUG [storage.allocator.LocalStoragePoolAllocator]
(1754543106@qtp-481326697-2:null) LocalStoragePoolAllocator trying to find
storage pool to fit the vm
2013-07-09 08:36:30,496 DEBUG
[storage.allocator.ClusterScopeStoragePoolAllocator]
(1754543106@qtp-481326697-2:null) ClusterScopeStoragePoolAllocator looking for
storage pool
2013-07-09 08:36:30,497 DEBUG [storage.allocator.ZoneWideStoragePoolAllocator]
(1754543106@qtp-481326697-2:null) ZoneWideStoragePoolAllocator to find storage
pool
2013-07-09 08:36:30,660 DEBUG [cloud.storage.StorageManagerImpl]
(1754543106@qtp-481326697-2:null) Checking pool 1 for storage, totalSize:
11810778316800, usedBytes: 8451350200320, usedPct: 0.7155625119386544, disable
threshold: 0.85
2013-07-09 08:36:30,791 DEBUG [cloud.storage.StorageManagerImpl]
(1754543106@qtp-481326697-2:null) Checking pool: 1 for volume allocation
[Vol[10|vm=5|ROOT]], maxSize : 23621556633600, totalAllocatedSize : 0,
askingSize : 0, allocated disable threshold: 0.85
2013-07-09 08:36:30,842 DEBUG [cloud.storage.StorageManagerImpl]
(1754543106@qtp-481326697-2:null) Checking pool 2 for storage, totalSize:
11810778316800, usedBytes: 8451350200320, usedPct: 0.7155625119386544, disable
threshold: 0.85
2013-07-09 08:36:30,878 DEBUG [cloud.storage.StorageManagerImpl]
(1754543106@qtp-481326697-2:null) Checking pool: 2 for volume allocation
[Vol[10|vm=5|ROOT]], maxSize : 23621556633600, totalAllocatedSize : 0,
askingSize : 0, allocated disable threshold: 0.85
2013-07-09 08:36:31,204 DEBUG [cloud.api.ApiServlet]
(1754543106@qtp-481326697-2:null) ===END=== 10.217.252.54 -- GET
command=findStoragePoolsForMigration&id=d0cd5d41-f395-48d9-8bd6-3886f4f76c3e&response=json&sessionkey=PWQxaW5CBGIDG7HYLOQBdAk3RJg%3D&_=1373407310956
2013-07-09 08:36:33,437 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-29:null) Ping from 1
2013-07-09 08:36:33,671 DEBUG [cloud.api.ApiServlet]
(1754543106@qtp-481326697-2:null) ===START=== 10.217.252.54 -- GET
command=migrateVolume&livemigrate=true&storageid=d867446f-73d6-365c-bf50-27fdde7e2a6b&volumeid=d0cd5d41-f395-48d9-8bd6-3886f4f76c3e&response=json&sessionkey=PWQxaW5CBGIDG7HYLOQBdAk3RJg%3D&_=1373407314785
2013-07-09 08:36:33,906 DEBUG [cloud.async.AsyncJobManagerImpl]
(1754543106@qtp-481326697-2:null) submit async job-24, details: AsyncJobVO
{id:24, userId: 2, accountId: 2, sessionKey: null, instanceType: None,
instanceId: null, cmd:
org.apache.cloudstack.api.command.user.volume.MigrateVolumeCmd, cmdOriginator:
null, cmdInfo:
{"response":"json","sessionkey":"PWQxaW5CBGIDG7HYLOQBdAk3RJg\u003d","cmdEventType":"VOLUME.MIGRATE","ctxUserId":"2","storageid":"d867446f-73d6-365c-bf50-27fdde7e2a6b","livemigrate":"true","httpmethod":"GET","volumeid":"d0cd5d41-f395-48d9-8bd6-3886f4f76c3e","_":"1373407314785","ctxAccountId":"2","ctxStartEventId":"92"},
cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0,
processStatus: 0, resultCode: 0, result: null, initMsid: 52241838869,
completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
2013-07-09 08:36:33,937 DEBUG [cloud.api.ApiServlet]
(1754543106@qtp-481326697-2:null) ===END=== 10.217.252.54 -- GET
command=migrateVolume&livemigrate=true&storageid=d867446f-73d6-365c-bf50-27fdde7e2a6b&volumeid=d0cd5d41-f395-48d9-8bd6-3886f4f76c3e&response=json&sessionkey=PWQxaW5CBGIDG7HYLOQBdAk3RJg%3D&_=1373407314785
2013-07-09 08:36:34,045 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-4:job-24) Executing
org.apache.cloudstack.api.command.user.volume.MigrateVolumeCmd for job-24
2013-07-09 08:36:34,681 DEBUG [storage.motion.AncientDataMotionStrategy]
(Job-Executor-4:job-24) copyAsync inspecting src type VOLUME copyAsync
inspecting dest type VOLUME
2013-07-09 08:36:34,692 DEBUG [cache.allocator.StorageCacheRandomAllocator]
(Job-Executor-4:job-24) Can't find cache storage in zone: 1
2013-07-09 08:36:34,885 DEBUG [agent.transport.Request] (Job-Executor-4:job-24)
Seq 3-1074790423: Sending { Cmd , MgmtId: 52241838869, via: 3, Ver: v1, Flags:
100111,
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"d0cd5d41-f395-48d9-8bd6-3886f4f76c3e","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"12062dc7-8666-3961-a146-07db07c3af21","id":1,"poolType":"NetworkFilesystem","host":"10.223.110.231","path":"/export/home/vijay/vmware/primary1","port":2049}},"name":"ROOT-5","size":0,"path":"ROOT-5-10","volumeId":10,"vmName":"i-2-5-VM","accountId":2,"format":"OVA","id":10}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"d0cd5d41-f395-48d9-8bd6-3886f4f76c3e","volumeType":"ROOT","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.223.110.232/export/home/vijay/vmware/secondary2/","_role":"Image"}},"name":"ROOT-5","size":0,"path":"volumes/2/10","volumeId":10,"vmName":"i-2-5-VM","accountId":2,"format":"OVA","id":10}},"wait":10800}}]
}
2013-07-09 08:36:34,933 DEBUG [agent.transport.Request]
(AgentManager-Handler-6:null) Seq 3-1074790423: Processing: { Ans: , MgmtId:
52241838869, via: 3, Ver: v1, Flags: 110,
[{"com.cloud.agent.api.Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat
com.cloud.storage.resource.VmwareSecondaryStorageResourceHandler.executeRequest(VmwareSecondaryStorageResourceHandler.java:103)\n\tat
com.cloud.storage.resource.PremiumSecondaryStorageResource.executeRequest(PremiumSecondaryStorageResource.java:56)\n\tat
com.cloud.agent.Agent.processRequest(Agent.java:525)\n\tat
com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)\n\tat
com.cloud.utils.nio.Task.run(Task.java:83)\n\tat
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)\n\tat
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)\n\tat
java.lang.Thread.run(Thread.java:662)\n","wait":0}}] }
2013-07-09 08:36:34,933 DEBUG [agent.manager.AgentAttache]
(AgentManager-Handler-6:null) Seq 3-1074790423: No more commands found
2013-07-09 08:36:34,933 DEBUG [agent.transport.Request] (Job-Executor-4:job-24)
Seq 3-1074790423: Received: { Ans: , MgmtId: 52241838869, via: 3, Ver: v1,
Flags: 110, { Answer } }
2013-07-09 08:36:34,934 DEBUG [storage.motion.AncientDataMotionStrategy]
(Job-Executor-4:job-24) copy to image store failed:
java.lang.NullPointerException
at
com.cloud.storage.resource.VmwareSecondaryStorageResourceHandler.executeRequest(VmwareSecondaryStorageResourceHandler.java:103)
at
com.cloud.storage.resource.PremiumSecondaryStorageResource.executeRequest(PremiumSecondaryStorageResource.java:56)
at com.cloud.agent.Agent.processRequest(Agent.java:525)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)
at com.cloud.utils.nio.Task.run(Task.java:83)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
