[ceph-users] ceph -w: Understanding MB data versus MB used

2015-03-25 Thread Saverio Proto
Hello there,

I started to push data into my ceph cluster. There is something I
cannot understand in the output of ceph -w.

When I run ceph -w I get this kinkd of output:

2015-03-25 09:11:36.785909 mon.0 [INF] pgmap v278788: 26056 pgs: 26056
active+clean; 2379 MB data, 19788 MB used, 33497 GB / 33516 GB avail


2379MB is actually the data I pushed into the cluster, I can see it
also in the ceph df output, and the numbers are consistent.

What I dont understand is 19788MB used. All my pools have size 3, so I
expected something like 2379 * 3. Instead this number is very big.

I really need to understand how MB used grows because I need to know
how many disks to buy.

Any hints ?

thank you.

Saverio
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] ceph -w: Understanding MB data versus MB used

2015-03-25 Thread Gregory Farnum
On Wed, Mar 25, 2015 at 1:24 AM, Saverio Proto ziopr...@gmail.com wrote:
 Hello there,

 I started to push data into my ceph cluster. There is something I
 cannot understand in the output of ceph -w.

 When I run ceph -w I get this kinkd of output:

 2015-03-25 09:11:36.785909 mon.0 [INF] pgmap v278788: 26056 pgs: 26056
 active+clean; 2379 MB data, 19788 MB used, 33497 GB / 33516 GB avail


 2379MB is actually the data I pushed into the cluster, I can see it
 also in the ceph df output, and the numbers are consistent.

 What I dont understand is 19788MB used. All my pools have size 3, so I
 expected something like 2379 * 3. Instead this number is very big.

 I really need to understand how MB used grows because I need to know
 how many disks to buy.

MB used is the summation of (the programmatic equivalent to) df
across all your nodes, whereas MB data is calculated by the OSDs
based on data they've written down. Depending on your configuration
MB used can include thing like the OSD journals, or even totally
unrelated data if the disks are shared with other applications.

MB used including the space used by the OSD journals is my first
guess about what you're seeing here, in which case you'll notice that
it won't grow any faster than MB data does once the journal is fully
allocated.
-Greg
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com