When an AFM gateway is flushing data to the target (home) it starts flushing with a few threads (Don't remember the number) and ramps up to afmNumFlushThreads. How quickly this ramp up occurs is controlled by afmFlushThreadDealy. The default is 5 seconds. So flushing only adds threads once every 5 seconds.
This was an experimental parameter so your milage may vary.
Scott Fadden
Spectrum Scale - Technical Marketing
Phone: (503) 880-5833
[email protected]
http://www.ibm.com/systems/storage/spectrum/scale
Spectrum Scale - Technical Marketing
Phone: (503) 880-5833
[email protected]
http://www.ibm.com/systems/storage/spectrum/scale
----- Original message -----
From: "Billich Heinrich Rainer (PSI)" <[email protected]>
Sent by: [email protected]
To: "[email protected]" <[email protected]>
Cc:
Subject: [gpfsug-discuss] AFM: Slow startup of flush from cache to home
Date: Fri, Oct 13, 2017 10:16 AM
Hello,
Running an AFM IW cache we noticed that AFM starts the flushing of data from cache to home rather slow, say at 20MB/s, and only slowly increases to several 100MB/s after a few minutes. As soon as the pending queue gets no longer filled the data rate drops, again.
I assume that this is a good behavior for WAN traffic where you don’t want to use the full bandwidth from the beginning but only if really needed. For our local setup with dedicated links I would prefer a much more aggressive behavior to get data transferred asap to home.
Am I right, does AFM implement such a ‘slow startup’, and is there a way to change this behavior? We did increase afmNumFlushThreads to 128. Currently we measure with many small files (1MB). For large files the behavior is different, we get a stable data rate from the beginning, but I did not yet try with a continuous write on the cache to see whether I see an increase after a while, too.
Thank you,
Heiner Billich
--
Paul Scherrer Institut
Science IT
Heiner Billich
WHGA 106
CH 5232 Villigen PSI
056 310 36 02
https://urldefense.proofpoint.com/v2/url?u=https-3A__www.psi.ch&d=DwIGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=WDtkF9zLTGGYqFnVnJ3rywZM6KHROA4FpMYi6cUkkKY&m=oOrvSj2SQ96R2IlqeBCAr1a4P1iiAoH7ltrylfmBltA&s=M22skyIzFv0EAU9eWqhcbEC0vvlhTAe-dcIDMfnOK9Q&e=
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwIGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=WDtkF9zLTGGYqFnVnJ3rywZM6KHROA4FpMYi6cUkkKY&m=oOrvSj2SQ96R2IlqeBCAr1a4P1iiAoH7ltrylfmBltA&s=25M9gkJOC6oIe9SeyMwKvS-i4UDPKmf7EOX6ngzk5n4&e=
_______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
