[ceph-users] Re: Massive OMAP remediation

2023-04-27 Thread dongdong tao
Luminous 12.2.11 is still default using bluefs_buffered_io = false, which will disable the kernel side cache for rocksdb. It's possible that your NVMe is saturated with the massive rocksdb workload when bluefs_buffered_io is disabled. So one way you could try is to set the bluefs_buffered_io =

[ceph-users] Re: Massive OMAP remediation

2023-04-26 Thread Dan van der Ster
Hi Ben, Are you compacting the relevant osds periodically? ceph tell osd.x compact (for the three osds holding the bilog) would help reshape the rocksdb levels to least perform better for a little while until the next round of bilog trims. Otherwise, I have experience deleting ~50M object