Re: [ceph-users] Cluster is empty but it still use 1Gb of data

2018-03-02 Thread Max Cuttins
perfect Il 02/03/2018 19:18, Igor Fedotov ha scritto: Yes, by default BlueStore reports 1Gb per OSD as used by BlueFS. On 3/2/2018 8:10 PM, Max Cuttins wrote: Umh Taking a look to your computation I think the ratio OSD/Overhead it's really about 1.1Gb per OSD. Because I have 9 NVMe

Re: [ceph-users] Cluster is empty but it still use 1Gb of data

2018-03-02 Thread Igor Fedotov
Yes, by default BlueStore reports 1Gb per OSD as used by BlueFS. On 3/2/2018 8:10 PM, Max Cuttins wrote: Umh Taking a look to your computation I think the ratio OSD/Overhead it's really about 1.1Gb per OSD. Because I have 9 NVMe OSD alive right now. So about 9.5Gb of overhead. So I

Re: [ceph-users] Cluster is empty but it still use 1Gb of data

2018-03-02 Thread Max Cuttins
Umh Taking a look to your computation I think the ratio OSD/Overhead it's really about 1.1Gb per OSD. Because I have 9 NVMe OSD alive right now. So about 9.5Gb of overhead. So I guess this is just it's right behaviour. Fine! Il 02/03/2018 15:18, David Turner ha scritto: [1] Here is a

Re: [ceph-users] Cluster is empty but it still use 1Gb of data

2018-03-02 Thread David Turner
[1] Here is a ceph starts on a brand new cluster that has never had any pools created or data or into it at all. 323GB used out of 2.3PB. that's 0.01% overhead, but we're using 10TB disks for this cluster, and the overhead is moreso per osd than per TB. It is 1.1GB overhead per osd. 34 of the

Re: [ceph-users] Cluster is empty but it still use 1Gb of data

2018-03-02 Thread Igor Fedotov
Hi Max, how many OSDs do you have? Are they bluestore? what's the "cepf df detail" output? On 3/2/2018 1:21 PM, Max Cuttins wrote: Hi everybody, i deleted everything from the cluster after some test with RBD. Now I see that there something still in use:   data:     pools:   0

Re: [ceph-users] Cluster is empty but it still use 1Gb of data

2018-03-02 Thread Max Cuttins
How can I analyze this? Il 02/03/2018 12:18, Gonzalo Aguilar Delgado ha scritto: Hi Max, No that's not normal. 9GB for an empty cluster. Maybe you reserved some space or you have other service that's taking the space. But It seems way to much for me. El 02/03/18 a las 12:09, Max Cuttins

Re: [ceph-users] Cluster is empty but it still use 1Gb of data

2018-03-02 Thread Gonzalo Aguilar Delgado
Hi Max, No that's not normal. 9GB for an empty cluster. Maybe you reserved some space or you have other service that's taking the space. But It seems way to much for me. El 02/03/18 a las 12:09, Max Cuttins escribió: I don't care of get back those space. I just want to know if it's

Re: [ceph-users] Cluster is empty but it still use 1Gb of data

2018-03-02 Thread Max Cuttins
I don't care of get back those space. I just want to know if it's expected or not. Because I run several rados bench with the flag |--no-cleanup| And maybe I leaved something in the way. Il 02/03/2018 11:35, Janne Johansson ha scritto: 2018-03-02 11:21 GMT+01:00 Max Cuttins

Re: [ceph-users] Cluster is empty but it still use 1Gb of data

2018-03-02 Thread Janne Johansson
2018-03-02 11:21 GMT+01:00 Max Cuttins : > Hi everybody, > > i deleted everything from the cluster after some test with RBD. > Now I see that there something still in use: > > data: > pools: 0 pools, 0 pgs > objects: 0 objects, 0 bytes > usage: *9510 MB