Ceph newbie question.

I have a disparity between the free space that my cephfs file system is showing 
and what ceph df is showing.
As you can see below my cephfs file system says there is 9.5TB free however 
ceph df says there is 186TB which with replication size 3 should equate to 62TB 
free space.
I guess the basic question is how can I get cephfs to see and use all of the 
available space?
I recently changed my number of pg's on the cephfs_data pool from 2048 to 4096 
and this gave me another 8TB so do I keep increasing the number of pg's or is 
there something else that I am missing? I have only been running ceph for ~6 
months so I'm relatively new to it all and not being able to use all of the 
space is just plain bugging me.

# df -h /ceph
Filesystem                                Size  Used Avail Use% Mounted on
X,y,z:/  107T   97T  9.5T  92% /ceph
# ceph df
GLOBAL:
    SIZE        AVAIL       RAW USED     %RAW USED
    495 TiB     186 TiB      310 TiB         62.51
POOLS:
    NAME                ID     USED        %USED     MAX AVAIL     OBJECTS
    cephfs_data         1       97 TiB     91.06       9.5 TiB     156401395
    cephfs_metadata     2      385 MiB         0       9.5 TiB        530590
# ceph osd pool ls detail
pool 1 'cephfs_data' replicated size 3 min_size 1 crush_rule 0 object_hash 
rjenkins pg_num 4096 pgp_num 4096 last_change 33914 lfor 0/29945 flags 
hashpspool,nearfull,selfmanaged_snaps stripe_width 0 application cephfs
        removed_snaps [2~2]
pool 2 'cephfs_metadata' replicated size 3 min_size 1 crush_rule 0 object_hash 
rjenkins pg_num 256 pgp_num 256 last_change 33914 lfor 0/30369 flags 
hashpspool,nearfull stripe_width 0 application cephfs


Regards
Robert Ruge


Important Notice: The contents of this email are intended solely for the named 
addressee and are confidential; any unauthorised use, reproduction or storage 
of the contents is expressly prohibited. If you have received this email in 
error, please delete it and any attachments immediately and advise the sender 
by return email or telephone.

Deakin University does not warrant that this email and any attachments are 
error or virus free.
_______________________________________________
ceph-users mailing list
[email protected]
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to