[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865419#comment-15865419 ] ASF subversion and git services commented on CLOUDSTACK-8896: - Commit abd7860e68f3465f4c79fed657f27ef1737b92f1 in cloudstack's branch refs/heads/master from [~rajanik] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=abd7860 ] Merge pull request #873 from karuturi/CLOUDSTACK-8896 CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100%This issue occurs when a volume in Ready state is moved across storage pools. While finding if the storage pool has enough space, it has a check to consider the size of non Ready volumes only. This is true if the volume to be attached to a vm is in the same storage pool. But, if the volume is in another storage pool and has to be moved to a vm's storage pool, the size of the volume should be considered in doing the space check. computing the asking size when volume is not in ready state or when the volume is on a different storage pool. Testing: I couldnt write unittests for it. This class is not in a unittestable state. manually tested in the below environment 1. xenserver 6.5 setup with 2 clusters and a host each in each of them. 2. added storage tags for the primary storage. 3. created two service offerings with the storage tags. 4. deployed two vms using newly created offerings in step 3. 5. at this stage, there are two vms one on each host with root disks on the corresponding primary. 6. create a data disk and attach it to vm1 7. detach the data disk. now the data disk is in the primary storage of the cluster of vm1 (let us say primary1) 8. attach this data disk to vm2(running on a host in different cluster) 9. the volume should be moved to the primary storage of another cluster and op_host_capacity should be accordingly updated. * pr/873: CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100% Signed-off-by: Rajani Karuturi> Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865418#comment-15865418 ] ASF subversion and git services commented on CLOUDSTACK-8896: - Commit bec9115a617ecac27e5b5785c8e838a535764f7d in cloudstack's branch refs/heads/master from [~rajanik] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=bec9115 ] CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100% This issue occurs when a volume in Ready state is moved across storage pools. While finding if the storage pool has enough space, it has a check to consider the size of non Ready volumes only. This is true if the volume to be attached to a vm is in the same storage pool. But, if the volume is in another storage pool and has to be moved to a vm's storage pool, the size of the volume should be considered in doing the space check. computing the asking size when volume is not in ready state or when the volume is on a different storage pool. > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865423#comment-15865423 ] ASF subversion and git services commented on CLOUDSTACK-8896: - Commit bec9115a617ecac27e5b5785c8e838a535764f7d in cloudstack's branch refs/heads/4.9 from [~rajanik] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=bec9115 ] CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100% This issue occurs when a volume in Ready state is moved across storage pools. While finding if the storage pool has enough space, it has a check to consider the size of non Ready volumes only. This is true if the volume to be attached to a vm is in the same storage pool. But, if the volume is in another storage pool and has to be moved to a vm's storage pool, the size of the volume should be considered in doing the space check. computing the asking size when volume is not in ready state or when the volume is on a different storage pool. > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865422#comment-15865422 ] ASF subversion and git services commented on CLOUDSTACK-8896: - Commit 2aeca0d34fc1e7352a9a287b965202cdd1a7f6a5 in cloudstack's branch refs/heads/master from [~rajanik] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=2aeca0d ] Merge release branch 4.9 to master * 4.9: CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100% > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865420#comment-15865420 ] ASF subversion and git services commented on CLOUDSTACK-8896: - Commit abd7860e68f3465f4c79fed657f27ef1737b92f1 in cloudstack's branch refs/heads/master from [~rajanik] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=abd7860 ] Merge pull request #873 from karuturi/CLOUDSTACK-8896 CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100%This issue occurs when a volume in Ready state is moved across storage pools. While finding if the storage pool has enough space, it has a check to consider the size of non Ready volumes only. This is true if the volume to be attached to a vm is in the same storage pool. But, if the volume is in another storage pool and has to be moved to a vm's storage pool, the size of the volume should be considered in doing the space check. computing the asking size when volume is not in ready state or when the volume is on a different storage pool. Testing: I couldnt write unittests for it. This class is not in a unittestable state. manually tested in the below environment 1. xenserver 6.5 setup with 2 clusters and a host each in each of them. 2. added storage tags for the primary storage. 3. created two service offerings with the storage tags. 4. deployed two vms using newly created offerings in step 3. 5. at this stage, there are two vms one on each host with root disks on the corresponding primary. 6. create a data disk and attach it to vm1 7. detach the data disk. now the data disk is in the primary storage of the cluster of vm1 (let us say primary1) 8. attach this data disk to vm2(running on a host in different cluster) 9. the volume should be moved to the primary storage of another cluster and op_host_capacity should be accordingly updated. * pr/873: CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100% Signed-off-by: Rajani Karuturi> Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865426#comment-15865426 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user asfgit closed the pull request at: https://github.com/apache/cloudstack/pull/873 > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865425#comment-15865425 ] ASF subversion and git services commented on CLOUDSTACK-8896: - Commit abd7860e68f3465f4c79fed657f27ef1737b92f1 in cloudstack's branch refs/heads/4.9 from [~rajanik] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=abd7860 ] Merge pull request #873 from karuturi/CLOUDSTACK-8896 CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100%This issue occurs when a volume in Ready state is moved across storage pools. While finding if the storage pool has enough space, it has a check to consider the size of non Ready volumes only. This is true if the volume to be attached to a vm is in the same storage pool. But, if the volume is in another storage pool and has to be moved to a vm's storage pool, the size of the volume should be considered in doing the space check. computing the asking size when volume is not in ready state or when the volume is on a different storage pool. Testing: I couldnt write unittests for it. This class is not in a unittestable state. manually tested in the below environment 1. xenserver 6.5 setup with 2 clusters and a host each in each of them. 2. added storage tags for the primary storage. 3. created two service offerings with the storage tags. 4. deployed two vms using newly created offerings in step 3. 5. at this stage, there are two vms one on each host with root disks on the corresponding primary. 6. create a data disk and attach it to vm1 7. detach the data disk. now the data disk is in the primary storage of the cluster of vm1 (let us say primary1) 8. attach this data disk to vm2(running on a host in different cluster) 9. the volume should be moved to the primary storage of another cluster and op_host_capacity should be accordingly updated. * pr/873: CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100% Signed-off-by: Rajani Karuturi> Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865427#comment-15865427 ] ASF subversion and git services commented on CLOUDSTACK-8896: - Commit abd7860e68f3465f4c79fed657f27ef1737b92f1 in cloudstack's branch refs/heads/4.9 from [~rajanik] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=abd7860 ] Merge pull request #873 from karuturi/CLOUDSTACK-8896 CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100%This issue occurs when a volume in Ready state is moved across storage pools. While finding if the storage pool has enough space, it has a check to consider the size of non Ready volumes only. This is true if the volume to be attached to a vm is in the same storage pool. But, if the volume is in another storage pool and has to be moved to a vm's storage pool, the size of the volume should be considered in doing the space check. computing the asking size when volume is not in ready state or when the volume is on a different storage pool. Testing: I couldnt write unittests for it. This class is not in a unittestable state. manually tested in the below environment 1. xenserver 6.5 setup with 2 clusters and a host each in each of them. 2. added storage tags for the primary storage. 3. created two service offerings with the storage tags. 4. deployed two vms using newly created offerings in step 3. 5. at this stage, there are two vms one on each host with root disks on the corresponding primary. 6. create a data disk and attach it to vm1 7. detach the data disk. now the data disk is in the primary storage of the cluster of vm1 (let us say primary1) 8. attach this data disk to vm2(running on a host in different cluster) 9. the volume should be moved to the primary storage of another cluster and op_host_capacity should be accordingly updated. * pr/873: CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100% Signed-off-by: Rajani Karuturi> Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865421#comment-15865421 ] ASF subversion and git services commented on CLOUDSTACK-8896: - Commit abd7860e68f3465f4c79fed657f27ef1737b92f1 in cloudstack's branch refs/heads/master from [~rajanik] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=abd7860 ] Merge pull request #873 from karuturi/CLOUDSTACK-8896 CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100%This issue occurs when a volume in Ready state is moved across storage pools. While finding if the storage pool has enough space, it has a check to consider the size of non Ready volumes only. This is true if the volume to be attached to a vm is in the same storage pool. But, if the volume is in another storage pool and has to be moved to a vm's storage pool, the size of the volume should be considered in doing the space check. computing the asking size when volume is not in ready state or when the volume is on a different storage pool. Testing: I couldnt write unittests for it. This class is not in a unittestable state. manually tested in the below environment 1. xenserver 6.5 setup with 2 clusters and a host each in each of them. 2. added storage tags for the primary storage. 3. created two service offerings with the storage tags. 4. deployed two vms using newly created offerings in step 3. 5. at this stage, there are two vms one on each host with root disks on the corresponding primary. 6. create a data disk and attach it to vm1 7. detach the data disk. now the data disk is in the primary storage of the cluster of vm1 (let us say primary1) 8. attach this data disk to vm2(running on a host in different cluster) 9. the volume should be moved to the primary storage of another cluster and op_host_capacity should be accordingly updated. * pr/873: CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100% Signed-off-by: Rajani Karuturi> Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865424#comment-15865424 ] ASF subversion and git services commented on CLOUDSTACK-8896: - Commit abd7860e68f3465f4c79fed657f27ef1737b92f1 in cloudstack's branch refs/heads/4.9 from [~rajanik] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=abd7860 ] Merge pull request #873 from karuturi/CLOUDSTACK-8896 CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100%This issue occurs when a volume in Ready state is moved across storage pools. While finding if the storage pool has enough space, it has a check to consider the size of non Ready volumes only. This is true if the volume to be attached to a vm is in the same storage pool. But, if the volume is in another storage pool and has to be moved to a vm's storage pool, the size of the volume should be considered in doing the space check. computing the asking size when volume is not in ready state or when the volume is on a different storage pool. Testing: I couldnt write unittests for it. This class is not in a unittestable state. manually tested in the below environment 1. xenserver 6.5 setup with 2 clusters and a host each in each of them. 2. added storage tags for the primary storage. 3. created two service offerings with the storage tags. 4. deployed two vms using newly created offerings in step 3. 5. at this stage, there are two vms one on each host with root disks on the corresponding primary. 6. create a data disk and attach it to vm1 7. detach the data disk. now the data disk is in the primary storage of the cluster of vm1 (let us say primary1) 8. attach this data disk to vm2(running on a host in different cluster) 9. the volume should be moved to the primary storage of another cluster and op_host_capacity should be accordingly updated. * pr/873: CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100% Signed-off-by: Rajani Karuturi> Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863410#comment-15863410 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user karuturi commented on the issue: https://github.com/apache/cloudstack/pull/873 added ifdebugenabled() checks > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15751205#comment-15751205 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user karuturi commented on the issue: https://github.com/apache/cloudstack/pull/873 @rhtyd will do in coming days (though I dont see a reason for the stress on log message leaving aside logic) > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750593#comment-15750593 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/873 @karuturi can you make suggested changes. > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714133#comment-15714133 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user jburwell commented on a diff in the pull request: https://github.com/apache/cloudstack/pull/873#discussion_r90589240 --- Diff: server/src/com/cloud/storage/StorageManagerImpl.java --- @@ -1746,10 +1747,10 @@ public boolean storagePoolHasEnoughSpace(List volumes, StoragePool pool, allocatedSizeWithTemplate = _capacityMgr.getAllocatedPoolCapacity(poolVO, tmpl); } } - -if (volumeVO.getState() != Volume.State.Ready) { -totalAskingSize += getDataObjectSizeIncludingHypervisorSnapshotReserve(volumeVO, pool); - +// A ready state volume is already allocated in a pool. so the asking size is zero for it. +// In case the volume is moving across pools or is not ready yet, the asking size has to be computed +s_logger.debug("pool id for the volume with id: " + volumeVO.getId() + " is: " + volumeVO.getPoolId()); --- End diff -- Please wrap this `DEBUG` log in an `if (s_logger.isDebugEnabled)` check to prevent unnecessary/expensive string concatenation when `DEBUG` logging is not enabled. Minor nit: grammatically, the `:` character after `is` is unnecessary. > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714134#comment-15714134 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user jburwell commented on a diff in the pull request: https://github.com/apache/cloudstack/pull/873#discussion_r90589284 --- Diff: server/src/com/cloud/storage/StorageManagerImpl.java --- @@ -1719,6 +1719,7 @@ public boolean storagePoolHasEnoughSpace(List volumes, StoragePool pool, } // allocated space includes templates +s_logger.debug("Destination pool id: " + pool.getId()); --- End diff -- Please wrap this `DEBUG` log in an `if (s_logger.isDebugEnabled)` check to prevent unnecessary/expensive string concatenation when `DEBUG` logging is not enabled. Also, please add context to message to explain what operation is being performed for the destination pool. > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714122#comment-15714122 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/873 Test LGTM. > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712797#comment-15712797 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/873 @abhinandanprateek @murali-reddy @jburwell this may be useful for 4.9/lts, would you like to review? > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712793#comment-15712793 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/873 LGTM. Travis failure was due to an intermittent issue with oobm test, which has been fixed now. > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712419#comment-15712419 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/873 Trillian test result (tid-519) Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7 Total time taken: 27196 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr873-t519-kvm-centos7.zip Test completed. 46 look ok, 2 have error(s) Test | Result | Time (s) | Test File --- | --- | --- | --- test_02_redundant_VPC_default_routes | `Failure` | 870.17 | test_vpc_redundant.py test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Failure` | 379.81 | test_vpc_redundant.py test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 245.11 | test_internal_lb.py ContextSuite context=TestVPCRedundancy>:teardown | `Error` | 535.18 | test_vpc_redundant.py test_01_vpc_site2site_vpn | Success | 165.81 | test_vpc_vpn.py test_01_vpc_remote_access_vpn | Success | 81.27 | test_vpc_vpn.py test_01_redundant_vpc_site2site_vpn | Success | 341.36 | test_vpc_vpn.py test_02_VPC_default_routes | Success | 323.55 | test_vpc_router_nics.py test_01_VPC_nics_after_destroy | Success | 608.23 | test_vpc_router_nics.py test_05_rvpc_multi_tiers | Success | 530.07 | test_vpc_redundant.py test_04_rvpc_network_garbage_collector_nics | Success | 1421.98 | test_vpc_redundant.py test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 575.32 | test_vpc_redundant.py test_09_delete_detached_volume | Success | 15.60 | test_volumes.py test_08_resize_volume | Success | 15.36 | test_volumes.py test_07_resize_fail | Success | 20.47 | test_volumes.py test_06_download_detached_volume | Success | 15.37 | test_volumes.py test_05_detach_volume | Success | 100.29 | test_volumes.py test_04_delete_attached_volume | Success | 10.19 | test_volumes.py test_03_download_attached_volume | Success | 15.28 | test_volumes.py test_02_attach_volume | Success | 73.73 | test_volumes.py test_01_create_volume | Success | 712.51 | test_volumes.py test_deploy_vm_multiple | Success | 248.44 | test_vm_life_cycle.py test_deploy_vm | Success | 0.03 | test_vm_life_cycle.py test_advZoneVirtualRouter | Success | 0.02 | test_vm_life_cycle.py test_10_attachAndDetach_iso | Success | 26.80 | test_vm_life_cycle.py test_09_expunge_vm | Success | 125.24 | test_vm_life_cycle.py test_08_migrate_vm | Success | 40.93 | test_vm_life_cycle.py test_07_restore_vm | Success | 0.12 | test_vm_life_cycle.py test_06_destroy_vm | Success | 125.78 | test_vm_life_cycle.py test_03_reboot_vm | Success | 125.81 | test_vm_life_cycle.py test_02_start_vm | Success | 10.17 | test_vm_life_cycle.py test_01_stop_vm | Success | 40.33 | test_vm_life_cycle.py test_CreateTemplateWithDuplicateName | Success | 100.86 | test_templates.py test_08_list_system_templates | Success | 0.03 | test_templates.py test_07_list_public_templates | Success | 0.04 | test_templates.py test_05_template_permissions | Success | 0.07 | test_templates.py test_04_extract_template | Success | 5.17 | test_templates.py test_03_delete_template | Success | 5.11 | test_templates.py test_02_edit_template | Success | 90.18 | test_templates.py test_01_create_template | Success | 40.54 | test_templates.py test_10_destroy_cpvm | Success | 161.54 | test_ssvm.py test_09_destroy_ssvm | Success | 163.64 | test_ssvm.py test_08_reboot_cpvm | Success | 131.60 | test_ssvm.py test_07_reboot_ssvm | Success | 133.63 | test_ssvm.py test_06_stop_cpvm | Success | 161.76 | test_ssvm.py test_05_stop_ssvm | Success | 139.47 | test_ssvm.py test_04_cpvm_internals | Success | 1.17 | test_ssvm.py test_03_ssvm_internals | Success | 3.45 | test_ssvm.py test_02_list_cpvm_vm | Success | 0.14 | test_ssvm.py test_01_list_sec_storage_vm | Success | 0.12 | test_ssvm.py test_01_snapshot_root_disk | Success | 16.35 | test_snapshots.py test_04_change_offering_small | Success | 246.70 | test_service_offerings.py test_03_delete_service_offering | Success | 0.04 | test_service_offerings.py test_02_edit_service_offering | Success | 0.06 | test_service_offerings.py test_01_create_service_offering | Success | 0.10 | test_service_offerings.py test_02_sys_template_ready | Success | 0.13 | test_secondary_storage.py test_01_sys_vm_start | Success | 0.19 | test_secondary_storage.py test_09_reboot_router | Success | 35.30 | test_routers.py test_08_start_router | Success | 35.30 | test_routers.py test_07_stop_router | Success | 10.19 | test_routers.py test_06_router_advanced |
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711394#comment-15711394 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/873 @rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711391#comment-15711391 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/873 @blueorangutan test > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711313#comment-15711313 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/873 Packaging result: ✔centos6 ✔centos7 ✔debian. JID-293 > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711175#comment-15711175 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/873 @rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress. > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711173#comment-15711173 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/873 @blueorangutan package > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15636849#comment-15636849 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/873 Trillian test result (tid-293) Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7 Total time taken: 38539 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr873-t293-vmware-55u3.zip Test completed. 46 look ok, 2 have error(s) Test | Result | Time (s) | Test File --- | --- | --- | --- test_02_vpc_privategw_static_routes | `Failure` | 433.87 | test_privategw_acl.py ContextSuite context=TestVpcSite2SiteVpn>:setup | `Error` | 0.00 | test_vpc_vpn.py ContextSuite context=TestVpcRemoteAccessVpn>:setup | `Error` | 0.00 | test_vpc_vpn.py ContextSuite context=TestRVPCSite2SiteVpn>:setup | `Error` | 0.00 | test_vpc_vpn.py test_02_VPC_default_routes | Success | 424.21 | test_vpc_router_nics.py test_01_VPC_nics_after_destroy | Success | 822.35 | test_vpc_router_nics.py test_05_rvpc_multi_tiers | Success | 725.71 | test_vpc_redundant.py test_04_rvpc_network_garbage_collector_nics | Success | 1557.63 | test_vpc_redundant.py test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Success | 817.94 | test_vpc_redundant.py test_02_redundant_VPC_default_routes | Success | 707.16 | test_vpc_redundant.py test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | Success | 1457.27 | test_vpc_redundant.py test_09_delete_detached_volume | Success | 25.68 | test_volumes.py test_06_download_detached_volume | Success | 60.44 | test_volumes.py test_05_detach_volume | Success | 100.22 | test_volumes.py test_04_delete_attached_volume | Success | 20.18 | test_volumes.py test_03_download_attached_volume | Success | 15.26 | test_volumes.py test_02_attach_volume | Success | 58.71 | test_volumes.py test_01_create_volume | Success | 525.38 | test_volumes.py test_03_delete_vm_snapshots | Success | 285.23 | test_vm_snapshots.py test_02_revert_vm_snapshots | Success | 251.85 | test_vm_snapshots.py test_01_test_vm_volume_snapshot | Success | 251.97 | test_vm_snapshots.py test_01_create_vm_snapshots | Success | 171.69 | test_vm_snapshots.py test_deploy_vm_multiple | Success | 262.48 | test_vm_life_cycle.py test_deploy_vm | Success | 0.02 | test_vm_life_cycle.py test_advZoneVirtualRouter | Success | 0.02 | test_vm_life_cycle.py test_10_attachAndDetach_iso | Success | 26.70 | test_vm_life_cycle.py test_09_expunge_vm | Success | 125.19 | test_vm_life_cycle.py test_08_migrate_vm | Success | 80.77 | test_vm_life_cycle.py test_07_restore_vm | Success | 0.06 | test_vm_life_cycle.py test_06_destroy_vm | Success | 10.10 | test_vm_life_cycle.py test_03_reboot_vm | Success | 5.09 | test_vm_life_cycle.py test_02_start_vm | Success | 20.15 | test_vm_life_cycle.py test_01_stop_vm | Success | 10.09 | test_vm_life_cycle.py test_CreateTemplateWithDuplicateName | Success | 266.47 | test_templates.py test_08_list_system_templates | Success | 0.02 | test_templates.py test_07_list_public_templates | Success | 0.03 | test_templates.py test_05_template_permissions | Success | 0.05 | test_templates.py test_04_extract_template | Success | 20.29 | test_templates.py test_03_delete_template | Success | 5.08 | test_templates.py test_02_edit_template | Success | 90.09 | test_templates.py test_01_create_template | Success | 125.69 | test_templates.py test_10_destroy_cpvm | Success | 236.56 | test_ssvm.py test_09_destroy_ssvm | Success | 268.30 | test_ssvm.py test_08_reboot_cpvm | Success | 156.31 | test_ssvm.py test_07_reboot_ssvm | Success | 158.25 | test_ssvm.py test_06_stop_cpvm | Success | 176.44 | test_ssvm.py test_05_stop_ssvm | Success | 178.32 | test_ssvm.py test_04_cpvm_internals | Success | 1.00 | test_ssvm.py test_03_ssvm_internals | Success | 3.15 | test_ssvm.py test_02_list_cpvm_vm | Success | 0.07 | test_ssvm.py test_01_list_sec_storage_vm | Success | 0.08 | test_ssvm.py test_01_snapshot_root_disk | Success | 25.94 | test_snapshots.py test_04_change_offering_small | Success | 97.61 | test_service_offerings.py test_03_delete_service_offering | Success | 0.02 | test_service_offerings.py test_02_edit_service_offering | Success | 0.05 | test_service_offerings.py test_01_create_service_offering | Success | 0.07 | test_service_offerings.py test_02_sys_template_ready | Success | 0.08 | test_secondary_storage.py test_01_sys_vm_start | Success | 0.11 | test_secondary_storage.py test_09_reboot_router | Success | 176.07 | test_routers.py test_08_start_router | Success |
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631766#comment-15631766 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/873 @rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631765#comment-15631765 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/873 @blueorangutan test > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631659#comment-15631659 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user blueorangutan commented on the issue: https://github.com/apache/cloudstack/pull/873 @rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress. > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631658#comment-15631658 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/873 @blueorangutan package > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631648#comment-15631648 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user karuturi commented on the issue: https://github.com/apache/cloudstack/pull/873 I tried rebasing to 4.8 but there were conflicts. rebased it against 4.9 > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15581666#comment-15581666 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user rhtyd commented on the issue: https://github.com/apache/cloudstack/pull/873 @karuturi can you please rebase this against latest master, let's get this reviewed and merged. > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529739#comment-15529739 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user cloudmonger commented on the issue: https://github.com/apache/cloudstack/pull/873 ### ACS CI BVT Run **Sumarry:** Build Number 105 Hypervisor xenserver NetworkType Advanced Passed=102 Failed=1 Skipped=4 _Link to logs Folder (search by build_no):_ https://www.dropbox.com/sh/yj3wnzbceo9uef2/AAB6u-Iap-xztdm6jHX9SjPja?dl=0 **Failed tests:** * test_nic.py * test_01_nic Failed **Skipped tests:** test_vm_nic_adapter_vmxnet3 test_static_role_account_acls test_3d_gpu_support test_deploy_vgpu_enabled_vm **Passed test suits:** test_deploy_vm_with_userdata.py test_affinity_groups_projects.py test_portable_publicip.py test_over_provisioning.py test_global_settings.py test_scale_vm.py test_service_offerings.py test_routers_iptables_default_policy.py test_loadbalance.py test_routers.py test_reset_vm_on_reboot.py test_snapshots.py test_deploy_vms_with_varied_deploymentplanners.py test_network.py test_router_dns.py test_non_contigiousvlan.py test_login.py test_deploy_vm_iso.py test_list_ids_parameter.py test_public_ip_range.py test_multipleips_per_nic.py test_regions.py test_affinity_groups.py test_network_acl.py test_pvlan.py test_volumes.py test_ssvm.py test_deploy_vm_root_resize.py test_resource_detail.py test_secondary_storage.py test_vm_life_cycle.py test_disk_offerings.py > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15266366#comment-15266366 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user rhtyd commented on the pull request: https://github.com/apache/cloudstack/pull/873#issuecomment-216193641 @karuturi please rebase against latest master and push -f, update on status of your PR LGTM tag:easypr > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952601#comment-14952601 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user karuturi commented on a diff in the pull request: https://github.com/apache/cloudstack/pull/873#discussion_r41721892 --- Diff: server/src/com/cloud/storage/StorageManagerImpl.java --- @@ -1736,7 +1737,10 @@ public boolean storagePoolHasEnoughSpace(List volumes, StoragePool pool) allocatedSizeWithtemplate = _capacityMgr.getAllocatedPoolCapacity(poolVO, tmpl); } } -if (volumeVO.getState() != Volume.State.Ready) { +// A ready state volume is already allocated in a pool. so the asking size is zero for it. +// In case the volume is moving across pools or is not ready yet, the asking size has to be computed +s_logger.debug("pool id for the volume with id: " + volumeVO.getId() + " is: " + volumeVO.getPoolId()); --- End diff -- as i said before, looking at the earlier logs will give you the context. what more are you looking for? please suggest. > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951845#comment-14951845 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user bhaisaab commented on a diff in the pull request: https://github.com/apache/cloudstack/pull/873#discussion_r41697351 --- Diff: server/src/com/cloud/storage/StorageManagerImpl.java --- @@ -1736,7 +1737,10 @@ public boolean storagePoolHasEnoughSpace(List volumes, StoragePool pool) allocatedSizeWithtemplate = _capacityMgr.getAllocatedPoolCapacity(poolVO, tmpl); } } -if (volumeVO.getState() != Volume.State.Ready) { +// A ready state volume is already allocated in a pool. so the asking size is zero for it. +// In case the volume is moving across pools or is not ready yet, the asking size has to be computed +s_logger.debug("pool id for the volume with id: " + volumeVO.getId() + " is: " + volumeVO.getPoolId()); --- End diff -- I guess there is no consensus or guideline around logging ids in debug logs (uuids vs ids) though I've seen most logs messages using IDs instead of UUIDs (perhaps because most code relied on IDs than UUIDs, as UUIDs were introduced only in that last 2 years or so). Though the logged message is not verbose enough wrt what it was doing, may be you can add some context to say what it is doing etc? > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14939364#comment-14939364 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user karuturi commented on a diff in the pull request: https://github.com/apache/cloudstack/pull/873#discussion_r40881830 --- Diff: server/src/com/cloud/storage/StorageManagerImpl.java --- @@ -1736,7 +1737,10 @@ public boolean storagePoolHasEnoughSpace(List volumes, StoragePool pool) allocatedSizeWithtemplate = _capacityMgr.getAllocatedPoolCapacity(poolVO, tmpl); } } -if (volumeVO.getState() != Volume.State.Ready) { +// A ready state volume is already allocated in a pool. so the asking size is zero for it. +// In case the volume is moving across pools or is not ready yet, the asking size has to be computed +s_logger.debug("pool id for the volume with id: " + volumeVO.getId() + " is: " + volumeVO.getPoolId()); --- End diff -- @wido numeric ids in logs are easy to understand/debug than uuids. names might me more readable but ids are unique and hence no ambiguity. The current pool-id is already logged and the pool-id of the the volume would help me see if the volume is moving across pools. That was the information I was looking for while debugging this issue and was hard to find given nothing was logged before. > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936586#comment-14936586 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user runseb commented on a diff in the pull request: https://github.com/apache/cloudstack/pull/873#discussion_r40771703 --- Diff: server/src/com/cloud/storage/StorageManagerImpl.java --- @@ -1736,7 +1737,10 @@ public boolean storagePoolHasEnoughSpace(List volumes, StoragePool pool) allocatedSizeWithtemplate = _capacityMgr.getAllocatedPoolCapacity(poolVO, tmpl); } } -if (volumeVO.getState() != Volume.State.Ready) { +// A ready state volume is already allocated in a pool. so the asking size is zero for it. +// In case the volume is moving across pools or is not ready yet, the asking size has to be computed +s_logger.debug("pool id for the volume with id: " + volumeVO.getId() + " is: " + volumeVO.getPoolId()); --- End diff -- @karuturi waiting for your reply on wido's question :) > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904401#comment-14904401 ] ASF GitHub Bot commented on CLOUDSTACK-8896: Github user wido commented on a diff in the pull request: https://github.com/apache/cloudstack/pull/873#discussion_r40195709 --- Diff: server/src/com/cloud/storage/StorageManagerImpl.java --- @@ -1736,7 +1737,10 @@ public boolean storagePoolHasEnoughSpace(List volumes, StoragePool pool) allocatedSizeWithtemplate = _capacityMgr.getAllocatedPoolCapacity(poolVO, tmpl); } } -if (volumeVO.getState() != Volume.State.Ready) { +// A ready state volume is already allocated in a pool. so the asking size is zero for it. +// In case the volume is moving across pools or is not ready yet, the asking size has to be computed +s_logger.debug("pool id for the volume with id: " + volumeVO.getId() + " is: " + volumeVO.getPoolId()); --- End diff -- Could you make this line a bit more descriptive? To me it doesn't seem like a very useful line when running in debug mode. Also, do we want the numeric IDs here? > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8896) Allocated percentage of storage can go beyond 100%
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902299#comment-14902299 ] ASF GitHub Bot commented on CLOUDSTACK-8896: GitHub user karuturi opened a pull request: https://github.com/apache/cloudstack/pull/873 CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100% This issue occurs when a volume in Ready state is moved across storage pools. While finding if the storage pool has enough space, it has a check to consider the size of non Ready volumes only. This is true if the volume to be attached to a vm is in the same storage pool. But, if the volume is in another storage pool and has to be moved to a vm's storage pool, the size of the volume should be considered in doing the space check. computing the asking size when volume is not in ready state or when the volume is on a different storage pool. Testing: I couldnt write unittests for it. This class is not in a unittestable state. manually tested in the below environment 1. xenserver 6.5 setup with 2 clusters and a host each in each of them. 2. added storage tags for the primary storage. 3. created two service offerings with the storage tags. 4. deployed two vms using newly created offerings in step 3. 5. at this stage, there are two vms one on each host with root disks on the corresponding primary. 6. create a data disk and attach it to vm1 7. detach the data disk. now the data disk is in the primary storage of the cluster of vm1 (let us say primary1) 8. attach this data disk to vm2(running on a host in different cluster) 9. the volume should be moved to the primary storage of another cluster and op_host_capacity should be accordingly updated. You can merge this pull request into a Git repository by running: $ git pull https://github.com/karuturi/cloudstack CLOUDSTACK-8896 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/cloudstack/pull/873.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #873 commit 5d8fd6e9acdc6b28d6a14b092290483614f412b3 Author: Rajani KaruturiDate: 2015-09-22T09:27:38Z CLOUDSTACK-8896: allocated percentage of storage pool going beyond 100% This issue occurs when a volume in Ready state is moved across storage pools. While finding if the storage pool has enough space, it has a check to consider the size of non Ready volumes only. This is true if the volume to be attached to a vm is in the same storage pool. But, if the volume is in another storage pool and has to be moved to a vm's storage pool, the size of the volume should be considered in doing the space check. setting the asking size when volume is not in ready state or when on a different storage pool. > Allocated percentage of storage can go beyond 100% > -- > > Key: CLOUDSTACK-8896 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8896 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) >Affects Versions: 4.5.2, 4.6.0 >Reporter: Rajani Karuturi >Assignee: Rajani Karuturi > > This issue occurs when a volume in Ready state is moved across storage pools. > Let us say there is a data volume, volume0 in Ready state in a cluster scope > primary storage primary0. > Now, when an operation is attempted to attach this volume to a vm in another > cluster, the volume is moved to the new cluster and the asking size is zero > at this time. > you can observe logs like below with asking size 0 in the management server > logs. > 2015-09-22 08:49:02,754 DEBUG [c.c.s.StorageManagerImpl] > (Work-Job-Executor-6:ctx-27e0990a job-37/job-38 ctx-985e5ad0) > (logid:a0a97129) Checking pool: 1 for volume allocation > [Vol[8|vm=null|DATADISK]], maxSize : 3298534883328, totalAllocatedSize : > 24096276480, askingSize : 0, allocated disable threshold: 0.85 -- This message was sent by Atlassian JIRA (v6.3.4#6332)