Hi all,
I am in the process of replacing a beegfs cluster with a spectrum scale cluster and some of our initial tests have returned poor performance when writing from multiple client nodes to the same file.
If we setup a client to write into a file it takes less than 8 seconds to complete the write on Flash and about the same on NLSAS storage. But if we get 3 more nodes to do the exact same write the cluster seems to slow down and completes all writes in about 1.5 minute.
We are running 5.0.4-0 on 4 Lenovo SR630 servers with a V7000 control enclosure with flash drives and a 92F drawer with NLSAS drives behind the nodes attach through SAN.
Is there something I am missing since the writes are so slow compared to beegfs?
Beegfs completes the write from all clients within 9 second when run from 4 clients doing the same write to the same file
GPFS takes 1.5 min to do the same.
Tests run:
time (for i in `seq 5000`;do echo "This is $(hostname) writing line number" $i >> "/gpfs_T0/test/benchmark1.txt";done) ########## this is run from 4 gpfs client nodes at the same time.
Result for scale:
real 1m43.995s
user 0m0.821s
sys 0m3.545s
Result for beegfs:
real 0m6.507s
user 0m0.651s
sys 0m2.534s
if we run writes from each client node to separate files, performance is way better with GPFS than beegfs but not when the writes are done parallel.
If anyone have an idea I would be glad to hear it 😊
Best Regards
Andi Christiansen
_______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
