Hi, guys. I made a few tests and i see that performance is better if osd_journal_aio=false for LV-journals.
Setup: 2 servers x 4 OSD (SATA HDD + journal on SSD LV) 12.2.5, filestore cluster: id: ce305aae-4c56-41ec-be54-529b05eb45ed health: HEALTH_OK services: mon: 2 daemons, quorum a,b mgr: a(active), standbys: b osd: 8 osds: 8 up, 8 in data: pools: 1 pools, 512 pgs objects: 0 objects, 0 bytes usage: 904 MB used, 11440 GB / 11441 GB avail pgs: 512 active+clean 0 objects before each test. I used rados bench from two servers in parralel: 2x of: rados bench -p test 30 write -b 1M -t 32 I ran each test four times. file-journal on XFS FS, dio=1, aio=0: Average IOPS: 102.5 Average Latency(s): 0.30 LV-journal, dio=1, aio=1: Average IOPS: 96.5 Average Latency(s): 32.5 LV-journal, dio=1, aio=0: Average IOPS: 104 Average Latency(s): 0.30 Is It safe to disable aio on LV journals? Is it make sence?
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com