thanks for this info, but our purge queue is more or less empty
"purge_queue": {
"pq_executing_ops": 2,
"pq_executing_ops_high_water": 13659,
"pq_executing": 1,
"pq_executing_high_water": 500,
"pq_executed_ops": 127095,
"pq_executed": 50471,
"pq_item_in_journal": 2
},
anyway, I raised the parameters to see if it helps.
Best,
Andrej
On 9. 6. 2026 14:57, Loïc Tortay via ceph-users wrote:
On 09/06/2026 14:10, Andrej Filipcic via ceph-users wrote:
Hi,
I have a problem with large amounts of dark data/orphans on cephfs
data pool. Data is stored mostly on a 8+3 EC pool (cephfs_data_echdd).
There is ~5.6PiB stored on /ceph, shown by ceph.dir.rbytes with 132M
files and 139M rentries. The pool shows 7PiB stored and 9.7PiB used
consistent with 8+3 EC.
The layout for most files:
ceph.dir.layout="stripe_unit=16777216 stripe_count=1
object_size=16777216 pool=cephfs_data_echdd"
But there is 1.4PiB discrepancy between the pool and the filesystem
which I cannot explain and I suspect there are a lot of orphan
objects there. I have run mds scrub on / and ~mdsdir as well. There
is some mds damage on some old small files (~400 files), which I do
not think it's relevant here.
Hello,
We had a similar issue last year with a group of users that created
and removed files at a very high rate.
Have you read
https://docs.clyso.com/docs/kb/cephfs/#cephfs-pool-data-usage-growth-without-explanation
?
We increased the purge rate parameters (very) aggressively to get back
to a comfortable situation (i.e. not a pool w/ near full warnings).
Loïc.
--
_____________________________________________________________
prof. dr. Andrej Filipcic, E-mail: [email protected]
Department of Experimental High Energy Physics - F9
Jozef Stefan Institute, Jamova 39, P.o.Box 3000
SI-1001 Ljubljana, Slovenia
Tel.: +386-1-477-3674 Fax: +386-1-477-3166
-------------------------------------------------------------
_______________________________________________
ceph-users mailing list -- [email protected]
To unsubscribe send an email to [email protected]
