[ceph-users] Re: XFS on top of RBD, overhead

2024-02-02 Thread Maged Mokhtar
On 02/02/2024 16:41, Ruben Vestergaard wrote: Hi group, Today I conducted a small experiment to test an assumption of mine, namely that Ceph incurs a substantial network overhead when doing many small files. One RBD was created, and on top of that an XFS containing 1.6 M files, each with

[ceph-users] Re: XFS on top of RBD, overhead

2024-02-02 Thread Ruben Vestergaard
On Fri, Feb 02 2024 at 07:51:36 -0700, Josh Baergen wrote: On Fri, Feb 2, 2024 at 7:44 AM Ruben Vestergaard wrote: Is the RBD client performing partial object reads? Is that even a thing? Yup! The rados API has both length and offset parameters for reads

[ceph-users] Re: XFS on top of RBD, overhead

2024-02-02 Thread Josh Baergen
On Fri, Feb 2, 2024 at 7:44 AM Ruben Vestergaard wrote: > Is the RBD client performing partial object reads? Is that even a thing? Yup! The rados API has both length and offset parameters for reads (https://docs.ceph.com/en/latest/rados/api/librados/#c.rados_aio_read) and writes