Luminous 12.2.11 is still default using bluefs_buffered_io = false, which will
disable the kernel side cache for rocksdb.
It's possible that your NVMe is saturated with the massive rocksdb workload
when bluefs_buffered_io is disabled.
So one way you could try is to set the bluefs_buffered_io =
Hi Ben,
Are you compacting the relevant osds periodically? ceph tell osd.x
compact (for the three osds holding the bilog) would help reshape the
rocksdb levels to least perform better for a little while until the
next round of bilog trims.
Otherwise, I have experience deleting ~50M object