>> For context, Lustre is an open-source (GPLv2) out-of-tree Linux filesystem >> commonly used for HPC applications. >> >> Let me know if you need anymore context. Thanks! > >Could you check coreutils built with this patch and see if it fixes the >performance? I can push it to Gnulib afterwards:
Works perfectly: $ echo 3 | sudo tee /proc/sys/vm/drop_caches 3 $ time coreutils-9.9-unpatched/src/du /fsx/test_100K > /dev/null real 1m54.268s user 0m0.229s sys 0m14.136s $ echo 3 | sudo tee /proc/sys/vm/drop_caches 3 $ time coreutils-9.9-patched/src/du /fsx/test_100K > /dev/null real 0m13.150s user 0m0.075s sys 0m1.956s That's around a 9x speedup. I haven't tested any other commands. Lustre statahead (which is giving the performance boost) is designed for "stat everything in a directory" type workloads. The other commands wouldn't do that, I think. Perhaps chown would? Either way, thanks for the help! Tim Day
