Simple issue I cant find with the cache tier. Thanks for taking the time…

Setup a new cluster with ssd cache tier. My cache tier is on 1TB ssd. With 2 
replicas. It just fills up my cache until the ceph filesystem stops allowing 
access.
I even set the target_max_bytes to 1048576 (1GB) and still doesn’t flush.

Here are the settings:

Setup the pools

ceph osd pool create cephfs-cache 512 512 replicated ssd_ruleset
ceph osd pool create cephfs-metadata 512 512 replicated ssd_ruleset
ceph osd pool create cephfs-data 512 512 erasure default spinning_ruleset
ceph osd pool set cephfs-cache min_size 1
ceph osd pool set cephfs-cache size 2
ceph osd pool set cephfs-metadata min_size 1
ceph osd pool set cephfs-metadata size 2



Add tiers

ceph osd tier add cephfs-data cephfs-cache
ceph osd tier cache-mode cephfs-cache writeback
ceph osd tier set-overlay cephfs-data cephfs-cache
ceph osd pool set cephfs-cache hit_set_type bloom
ceph osd pool set cephfs-cache hit_set_count 1
ceph osd pool set cephfs-cache hit_set_period 3600
ceph osd pool set cephfs-cache target_max_bytes 1048576 # 1 TB
ceph osd pool set cephfs-cache cache_target_dirty_ratio 0.4 # percentage of 
target_max_bytes before flushes dirty objects
ceph osd pool set cephfs-cache cache_target_dirty_high_ratio 0.6 # percentage 
of target_max_bytes before flushes dirty objects more aggressively
ceph osd pool set cephfs-cache cache_target_full_ratio 0.80 # percentage of 
cache full before evicts objects


Am I missing something stupid? Must be. I can cause it to flush with
rados -p cephfs-cache cache-try-flush-evict-all

Should my metadata not be on the same pool as the cache pool?

I cant figure out why it doesn’t start flushing when I copy over 2 GB data. It 
just goes to
'cephfs-cache' at/near target max

Regards,
Jim

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10

_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to