[
https://issues.apache.org/jira/browse/CLOUDSTACK-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644753#comment-15644753
]
ASF GitHub Bot commented on CLOUDSTACK-9538:
--------------------------------------------
Github user ozhanrk commented on the issue:
https://github.com/apache/cloudstack/pull/1710
Hi @jburwell , i am so sorry but i do not understand, what you mean by
combining fixes under a single pr because this is a only single fix with a 4
lines of code change which only effects rbd storage users for primary storage.
The previous tickets which mentioned above was both fixed and currently in
4.9.0.0 code. So this is the only remaining part of that fixes for rbd users.
@ustcweizhou i am not a developer, if i am wrong could you explain our
current status in more technical way, i am very new to ACS community, so maybe
i could not express pr's current status :)
> Deleting Snapshot From Primary Storage Fails on RBD Storage if you already
> delete vm's itself
> ---------------------------------------------------------------------------------------------
>
> Key: CLOUDSTACK-9538
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-9538
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the
> default.)
> Components: KVM, Snapshot, Storage Controller
> Affects Versions: 4.9.0
> Environment: Ubuntu 14.04 Management Server + Ubuntu 14.04 KVM
> Reporter: Özhan Rüzgar Karaman
>
> Hi;
> We plan to store vm snapshots as vm backups on secondary storage while we
> still destroyed/expunged related vm. The idea is good there was a bug which
> blocks this idea to work and it was fixed with CLOUDSTACK-9297 bug.
> Normally with 4.9 release we expected this idea to work on our on our 4.9 ACS
> environment but we noticed that because we are using rbd as primary storage
> we need to fix one minor bug for this idea to work.
> The problem occurs because CLOUDSTACK-8302 bug fixed on 4.9 release and it
> block our idea to work. If you destroy a vm which is on RBD Storage as
> primary storage it also deletes any related snapshots of that vm on Primary
> RBD Storage. So after vm destroy no disk file or snapshot file over RBD
> Storage. This is good for cleanup purposes on primary storage but
> XenserverSnapshotStrategy.deleteSnapshot class method did not expect this to
> happen.
> org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.deleteSnapshot
> method receives exception. The code tries 10 times on KVM node to remove RBD
> snapshot but because there is no snapshot on RBD side it get exception after
> 10 retries, it also spends nearly 5 minutes to delete snapshots and after
> that it ends with an error like "Failed to delete snapshot" error.
> I think we need to disable snapshot cleanup on primary storage only for RBD
> type Primary Storage if its related vm was already been destroyed. (Because
> vm destroy stage removed all snapshots related to vm on primary storage so
> there is no need to take any action on primary storage.)
> We make some tests below to make this issue clear for bug.
> 1) We create a vm with 3 snapshots on ACS.
> mysql> select * from snapshot_store_ref where snapshot_id in (93,94,95);
> +-----+----------+-------------+---------------------+--------------+--------+------------+-------------+---------------+--------------------+--------------------------------------------------------------------------------+-------+--------------+---------+---------------------+-----------+
> | id | store_id | snapshot_id | created | last_updated | job_id
> | store_role | size | physical_size | parent_snapshot_id |
> install_path
> | state | update_count | ref_cnt | updated | volume_id |
> +-----+----------+-------------+---------------------+--------------+--------+------------+-------------+---------------+--------------------+--------------------------------------------------------------------------------+-------+--------------+---------+---------------------+-----------+
> | 185 | 1 | 93 | 2016-10-12 10:13:44 | NULL | NULL
> | Primary | 28991029248 | 28991029248 | 0 |
> cst4/bb9ca3c7-96d6-4465-85b5-cd01f4d635f2/54008bf3-43dd-469d-91a7-4acd146d7b84
> | Ready | 2 | 0 | 2016-10-12 10:13:45 | 4774 |
> | 186 | 1 | 93 | 2016-10-12 10:13:45 | NULL | NULL
> | Image | 28991029248 | 28991029248 | 0 |
> snapshots/2/4774/54008bf3-43dd-469d-91a7-4acd146d7b84
> | Ready | 2 | 0 | 2016-10-12 10:15:04 | 4774 |
> | 187 | 1 | 94 | 2016-10-12 10:15:38 | NULL | NULL
> | Primary | 28991029248 | 28991029248 | 0 |
> cst4/bb9ca3c7-96d6-4465-85b5-cd01f4d635f2/45fc4f44-b377-49c0-9264-5d813fefe93f
> | Ready | 2 | 0 | 2016-10-12 10:15:39 | 4774 |
> | 188 | 1 | 94 | 2016-10-12 10:15:39 | NULL | NULL
> | Image | 28991029248 | 28991029248 | 0 |
> snapshots/2/4774/45fc4f44-b377-49c0-9264-5d813fefe93f
> | Ready | 2 | 0 | 2016-10-12 10:16:52 | 4774 |
> | 189 | 1 | 95 | 2016-10-12 10:17:08 | NULL | NULL
> | Primary | 28991029248 | 28991029248 | 0 |
> cst4/bb9ca3c7-96d6-4465-85b5-cd01f4d635f2/1c1890bf-5a55-4060-bf3f-cf064629dcdf
> | Ready | 2 | 0 | 2016-10-12 10:17:09 | 4774 |
> | 190 | 1 | 95 | 2016-10-12 10:17:09 | NULL | NULL
> | Image | 28991029248 | 28991029248 | 0 |
> snapshots/2/4774/1c1890bf-5a55-4060-bf3f-cf064629dcdf
> | Ready | 2 | 0 | 2016-10-12 10:18:23 | 4774 |
> +-----+----------+-------------+---------------------+--------------+--------+------------+-------------+---------------+--------------------+--------------------------------------------------------------------------------+-------+--------------+---------+---------------------+-----------+
> 6 rows in set (0.00 sec)
> mysql> select * from snapshots where name like '%TolgaC72%';
> +----+----------------+------------+-----------+-----------+------------------+----------+------+------------------+--------------------------------------+---------------+------------------+-------------+---------------------+---------+----------------+----------+------------+--------------+-----------------+---------+-------+----------+----------+
> | id | data_center_id | account_id | domain_id | volume_id | disk_offering_id
> | status | path | name | uuid |
> snapshot_type | type_description | size | created |
> removed | backup_snap_id | swift_id | sechost_id | prev_snap_id |
> hypervisor_type | version | s3_id | min_iops | max_iops |
> +----+----------------+------------+-----------+-----------+------------------+----------+------+------------------+--------------------------------------+---------------+------------------+-------------+---------------------+---------+----------------+----------+------------+--------------+-----------------+---------+-------+----------+----------+
> | 93 | 1 | 2 | 1 | 4774 | 19
> | BackedUp | NULL | S1TolgaC72Test41 | 0f84acd8-9a5c-4de5-a58a-b528b4e72839 |
> 0 | MANUAL | 28991029248 | 2016-10-12 10:13:42 | NULL
> | NULL | NULL | NULL | NULL | KVM |
> 2.2 | NULL | NULL | NULL |
> | 94 | 1 | 2 | 1 | 4774 | 19
> | BackedUp | NULL | S2TolgaC72Test41 | 51ef5246-27ae-435e-92ac-7428bab64cb8 |
> 0 | MANUAL | 28991029248 | 2016-10-12 10:15:36 | NULL
> | NULL | NULL | NULL | NULL | KVM |
> 2.2 | NULL | NULL | NULL |
> | 95 | 1 | 2 | 1 | 4774 | 19
> | BackedUp | NULL | S3TolgaC72Test41 | e5550dd6-9a43-4dd7-959a-7aabf26f0593 |
> 0 | MANUAL | 28991029248 | 2016-10-12 10:17:06 | NULL
> | NULL | NULL | NULL | NULL | KVM |
> 2.2 | NULL | NULL | NULL |
> +----+----------------+------------+-----------+-----------+------------------+----------+------+------------------+--------------------------------------+---------------+------------------+-------------+---------------------+---------+----------------+----------+------------+--------------+-----------------+---------+-------+----------+----------+
> 3 rows in set (0.00 sec)
> mysql> select uuid, name from volumes where name='ROOT-4795';
> +--------------------------------------+-----------+
> | uuid | name |
> +--------------------------------------+-----------+
> | bb9ca3c7-96d6-4465-85b5-cd01f4d635f2 | ROOT-4795 |
> +--------------------------------------+-----------+
> 1 row in set (0.00 sec)
> mysql>
>
> #VM + 3 Snapshots
> #Ceph / Primary Storage
> root@mont1:/var/log/ceph# rbd ls -l -p cst4|grep
> bb9ca3c7-96d6-4465-85b5-cd01f4d635f2
> bb9ca3c7-96d6-4465-85b5-cd01f4d635f2
> 27648M cst4/fb80c005-51d2-4fc4-8a98-39073866e826@cloudstack-base-snap 2
> bb9ca3c7-96d6-4465-85b5-cd01f4d635f2@54008bf3-43dd-469d-91a7-4acd146d7b84
> 27648M cst4/fb80c005-51d2-4fc4-8a98-39073866e826@cloudstack-base-snap 2
> bb9ca3c7-96d6-4465-85b5-cd01f4d635f2@45fc4f44-b377-49c0-9264-5d813fefe93f
> 27648M cst4/fb80c005-51d2-4fc4-8a98-39073866e826@cloudstack-base-snap 2
> bb9ca3c7-96d6-4465-85b5-cd01f4d635f2@1c1890bf-5a55-4060-bf3f-cf064629dcdf
> 27648M cst4/fb80c005-51d2-4fc4-8a98-39073866e826@cloudstack-base-snap 2
> root@mont1:/var/log/ceph#
> #NFS / Secondary Side
> root@cloudstackt4:/CST/S# ls -l
> snapshots/2/4774/54008bf3-43dd-469d-91a7-4acd146d7b84
> snapshots/2/4774/45fc4f44-b377-49c0-9264-5d813fefe93f
> snapshots/2/4774/1c1890bf-5a55-4060-bf3f-cf064629dcdf
> -rw-r--r-- 1 root root 28991029248 Oct 12 13:18
> snapshots/2/4774/1c1890bf-5a55-4060-bf3f-cf064629dcdf
> -rw-r--r-- 1 root root 28991029248 Oct 12 13:16
> snapshots/2/4774/45fc4f44-b377-49c0-9264-5d813fefe93f
> -rw-r--r-- 1 root root 28991029248 Oct 12 13:15
> snapshots/2/4774/54008bf3-43dd-469d-91a7-4acd146d7b84
> root@cloudstackt4:/CST/S#
> 2) We destroy only vm not snapshots so 3 snapshots are active with BackedUp
> Status. On vm destroy stage vm destroy method removes all vm's files and its
> related snapshots on primary storage.
> #VM Destroyed we have 3 Snapshots on BackedUp state
> #Ceph Side / Primary Storage
> root@mont1:/var/log/ceph# rbd ls -l -p cst4|grep
> bb9ca3c7-96d6-4465-85b5-cd01f4d635f2
> root@mont1:/var/log/ceph#
> #NFS / Secondary Side
> root@cloudstackt4:/CST/S# ls -l
> snapshots/2/4774/54008bf3-43dd-469d-91a7-4acd146d7b84
> snapshots/2/4774/45fc4f44-b377-49c0-9264-5d813fefe93f
> snapshots/2/4774/1c1890bf-5a55-4060-bf3f-cf064629dcdf
> -rw-r--r-- 1 root root 28991029248 Oct 12 13:18
> snapshots/2/4774/1c1890bf-5a55-4060-bf3f-cf064629dcdf
> -rw-r--r-- 1 root root 28991029248 Oct 12 13:16
> snapshots/2/4774/45fc4f44-b377-49c0-9264-5d813fefe93f
> -rw-r--r-- 1 root root 28991029248 Oct 12 13:15
> snapshots/2/4774/54008bf3-43dd-469d-91a7-4acd146d7b84
> root@cloudstackt4:/CST/S#
> 3) We destroy 1 Snapshot named S3TolgaC72Test41
> #Ceph Side / Primary Storage
> root@mont1:/var/log/ceph# rbd ls -l -p cst4|grep
> bb9ca3c7-96d6-4465-85b5-cd01f4d635f2
> root@mont1:/var/log/ceph#
> #NFS / Secondary Side
> root@cloudstackt4:/CST/S# ls -l
> snapshots/2/4774/54008bf3-43dd-469d-91a7-4acd146d7b84
> snapshots/2/4774/45fc4f44-b377-49c0-9264-5d813fefe93f
> snapshots/2/4774/1c1890bf-5a55-4060-bf3f-cf064629dcdf
> ls: cannot access snapshots/2/4774/1c1890bf-5a55-4060-bf3f-cf064629dcdf: No
> such file or directory
> -rw-r--r-- 1 root root 28991029248 Oct 12 13:16
> snapshots/2/4774/45fc4f44-b377-49c0-9264-5d813fefe93f
> -rw-r--r-- 1 root root 28991029248 Oct 12 13:15
> snapshots/2/4774/54008bf3-43dd-469d-91a7-4acd146d7b84
> #SQL Side
> mysql> select * from snapshots where name like '%TolgaC72%' and name !=
> 'StolgaC72Revert';
> +----+----------------+------------+-----------+-----------+------------------+-----------+------+------------------+--------------------------------------+---------------+------------------+-------------+---------------------+---------+----------------+----------+------------+--------------+-----------------+---------+-------+----------+----------+
> | id | data_center_id | account_id | domain_id | volume_id | disk_offering_id
> | status | path | name | uuid
> | snapshot_type | type_description | size | created |
> removed | backup_snap_id | swift_id | sechost_id | prev_snap_id |
> hypervisor_type | version | s3_id | min_iops | max_iops |
> +----+----------------+------------+-----------+-----------+------------------+-----------+------+------------------+--------------------------------------+---------------+------------------+-------------+---------------------+---------+----------------+----------+------------+--------------+-----------------+---------+-------+----------+----------+
> | 93 | 1 | 2 | 1 | 4774 | 19
> | BackedUp | NULL | S1TolgaC72Test41 | 0f84acd8-9a5c-4de5-a58a-b528b4e72839
> | 0 | MANUAL | 28991029248 | 2016-10-12 10:13:42 | NULL
> | NULL | NULL | NULL | NULL | KVM
> | 2.2 | NULL | NULL | NULL |
> | 94 | 1 | 2 | 1 | 4774 | 19
> | BackedUp | NULL | S2TolgaC72Test41 | 51ef5246-27ae-435e-92ac-7428bab64cb8
> | 0 | MANUAL | 28991029248 | 2016-10-12 10:15:36 | NULL
> | NULL | NULL | NULL | NULL | KVM
> | 2.2 | NULL | NULL | NULL |
> | 95 | 1 | 2 | 1 | 4774 | 19
> | Destroyed | NULL | S3TolgaC72Test41 | e5550dd6-9a43-4dd7-959a-7aabf26f0593
> | 0 | MANUAL | 28991029248 | 2016-10-12 10:17:06 | NULL
> | NULL | NULL | NULL | NULL | KVM
> | 2.2 | NULL | NULL | NULL |
> +----+----------------+------------+-----------+-----------+------------------+-----------+------+------------------+--------------------------------------+---------------+------------------+-------------+---------------------+---------+----------------+----------+------------+--------------+-----------------+---------+-------+----------+----------+
> 3 rows in set (0.00 sec)
> mysql> select * from snapshot_store_ref where snapshot_id in (93,94,95);
> +-----+----------+-------------+---------------------+--------------+--------+------------+-------------+---------------+--------------------+--------------------------------------------------------------------------------+-----------+--------------+---------+---------------------+-----------+
> | id | store_id | snapshot_id | created | last_updated | job_id
> | store_role | size | physical_size | parent_snapshot_id |
> install_path
> | state | update_count | ref_cnt | updated | volume_id |
> +-----+----------+-------------+---------------------+--------------+--------+------------+-------------+---------------+--------------------+--------------------------------------------------------------------------------+-----------+--------------+---------+---------------------+-----------+
> | 185 | 1 | 93 | 2016-10-12 10:13:44 | NULL | NULL
> | Primary | 28991029248 | 28991029248 | 0 |
> cst4/bb9ca3c7-96d6-4465-85b5-cd01f4d635f2/54008bf3-43dd-469d-91a7-4acd146d7b84
> | Ready | 2 | 0 | 2016-10-12 10:13:45 | 4774 |
> | 186 | 1 | 93 | 2016-10-12 10:13:45 | NULL | NULL
> | Image | 28991029248 | 28991029248 | 0 |
> snapshots/2/4774/54008bf3-43dd-469d-91a7-4acd146d7b84
> | Ready | 2 | 0 | 2016-10-12 10:15:04 | 4774 |
> | 187 | 1 | 94 | 2016-10-12 10:15:38 | NULL | NULL
> | Primary | 28991029248 | 28991029248 | 0 |
> cst4/bb9ca3c7-96d6-4465-85b5-cd01f4d635f2/45fc4f44-b377-49c0-9264-5d813fefe93f
> | Ready | 2 | 0 | 2016-10-12 10:15:39 | 4774 |
> | 188 | 1 | 94 | 2016-10-12 10:15:39 | NULL | NULL
> | Image | 28991029248 | 28991029248 | 0 |
> snapshots/2/4774/45fc4f44-b377-49c0-9264-5d813fefe93f
> | Ready | 2 | 0 | 2016-10-12 10:16:52 | 4774 |
> | 190 | 1 | 95 | 2016-10-12 10:17:09 | NULL | NULL
> | Image | 28991029248 | 28991029248 | 0 |
> snapshots/2/4774/1c1890bf-5a55-4060-bf3f-cf064629dcdf
> | Destroyed | 4 | 0 | 2016-10-12 10:48:31 | 4774 |
> +-----+----------+-------------+---------------------+--------------+--------+------------+-------------+---------------+--------------------+--------------------------------------------------------------------------------+-----------+--------------+---------+---------------------+-----------+
> 5 rows in set (0.00 sec)
> mysql>
> ERROR on Cloudstack Management Server: Failed to delete snapshot
> 2016-10-12 13:54:02,911 DEBUG [o.a.c.s.s.XenserverSnapshotStrategy]
> (API-Job-Executor-70:ctx-06858bab job-34505 ctx-a6bc52fb) (logid:a2b92099)
> Failed to delete snapshot:
> com.cloud.utils.exception.CloudRuntimeException: Failed to remove snapshot
> at
> org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.deleteSnapshot(SnapshotServiceImpl.java:396)
> at
> org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.deleteSnapshot(XenserverSnapshotStrategy.java:272)
> at
> com.cloud.storage.snapshot.SnapshotManagerImpl.deleteSnapshot(SnapshotManagerImpl.java:454)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> at
> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> at
> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> at
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> at
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
> at com.sun.proxy.$Proxy192.deleteSnapshot(Unknown Source)
> at
> org.apache.cloudstack.api.command.user.snapshot.DeleteSnapshotCmd.execute(DeleteSnapshotCmd.java:103)
> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
> at
> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
> at
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> at
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 2016-10-12 13:54:02,918 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-70:ctx-06858bab job-34505) (logid:a2b92099) Complete async
> job-34505, jobStatus: FAILED, resultCode: 530,
> result:
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Failed
> to delete snapshot"}
> ERROR on KVM Agent
> 2016-10-12 13:49:38,227 DEBUG [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-3:null) Could not find volume
> bb9ca3c7-96d6-4465-85b5-cd01f4d635f2: Storage volume not found: no storage
> vol with matching name 'bb9ca3c7-96d6-4465-85b5-cd01f4d635f2'
> 2016-10-12 13:49:38,227 DEBUG [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-3:null) Refreshing storage pool
> 01b375db-d3f5-33c1-9389-8bf226c887e8
> 2016-10-12 13:49:41,253 DEBUG [kvm.storage.KVMStoragePoolManager]
> (agentRequest-Handler-3:null) Failed to find
> volume:bb9ca3c7-96d6-4465-85b5-cd01f4d635f2 due
> tocom.cloud.utils.exception.CloudRuntimeException: Could not find volume
> bb9ca3c7-96d6-4465-85b5-cd01f4d635f2: Storage volume not found: no storage
> vol with matching name 'bb9ca3c7-96d6-4465-85b5-cd01f4d635f2', retry:2
> 2016-10-12 13:51:53,819 DEBUG [kvm.storage.KVMStoragePoolManager]
> (agentRequest-Handler-3:null) Failed to find
> volume:bb9ca3c7-96d6-4465-85b5-cd01f4d635f2 due
> tocom.cloud.utils.exception.CloudRuntimeException: Could not find volume
> bb9ca3c7-96d6-4465-85b5-cd01f4d635f2: Storage volume not found: no storage
> vol with matching name 'bb9ca3c7-96d6-4465-85b5-cd01f4d635f2', retry:6
> 2016-10-12 13:52:26,858 DEBUG [kvm.storage.KVMStoragePoolManager]
> (agentRequest-Handler-3:null) Failed to find
> volume:bb9ca3c7-96d6-4465-85b5-cd01f4d635f2 due
> tocom.cloud.utils.exception.CloudRuntimeException: Could not find volume
> bb9ca3c7-96d6-4465-85b5-cd01f4d635f2: Storage volume not found: no storage
> vol with matching name 'bb9ca3c7-96d6-4465-85b5-cd01f4d635f2', retry:7
> 2016-10-12 13:53:33,390 DEBUG [kvm.storage.KVMStoragePoolManager]
> (agentRequest-Handler-3:null) Failed to find
> volume:bb9ca3c7-96d6-4465-85b5-cd01f4d635f2 due
> tocom.cloud.utils.exception.CloudRuntimeException: Could not find volume
> bb9ca3c7-96d6-4465-85b5-cd01f4d635f2: Storage volume not found: no storage
> vol with matching name 'bb9ca3c7-96d6-4465-85b5-cd01f4d635f2', retry:9
> 2016-10-12 13:54:03,390 ERROR [kvm.storage.KVMStorageProcessor]
> (agentRequest-Handler-3:null) Failed to remove snapshot , with exception:
> com.cloud.utils.exception.CloudRuntimeException:
> com.cloud.utils.exception.CloudRuntimeException: Could not find volume
> bb9ca3c7-96d6-4465-85b5-cd01f4d635f2: Storage volume not found: no storage
> vol with matching name 'bb9ca3c7-96d6-4465-85b5-cd01f4d635f2'
> Thanks
> Özhan
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
