Re: [lustre-discuss] Read performance bad, telepathy in Lustre

2020-01-23 Thread Andreas Dilger
Thomas, If you are positive that the two sets of clients are not reading files on other on the OSTs, I don't think there is anything at the Lustre level that communicates between OSSes to balance traffic or anything like that. One possibility is congestion control at the network level, possibly

[lustre-discuss] Read performance bad, telepathy in Lustre

2020-01-23 Thread Thomas Roth
Hi all, Lustre 2.10.6, 45 OSS with 7 OSTs each on ZFS 0.7.9, 3 MDTs (ldiskfs), clients 2.10 and 2.12. Infiniband network, Mellanox FDR w half bisectional bandwidth. A sample of ~250.000 files, stripe count 1, average size 100 MB. is read with dd, output > /dev/null. The location of the