Why don’t you look at packaging your small files into larger files which will be handled more effectively.
There is no simple way to replicate / move billions of small files, But surely you can build your work flow to package the files up into a zip or tar format which will simplify not only the number of IO transactions but also make the whole process more palatable to the NFS protocol Sent from my iPhone > On 26 Feb 2020, at 22:58, Andi Christiansen <[email protected]> wrote: > > > Hi all, > > Does anyone know of an alternative to AFM ? > > We have been working on tuning AFM for a few weeks now and see little to no improvement.. And now we are searching for an alternative.. So if anyone knows of a product that can implement with Spectrum Scale i am open to any suggestions :) > > We have a good mix of files but primarily billions of very small files which AFM does not handle well on long distances. > > > Best Regards > A. Christiansen > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=STXkGEO2XATS_s2pRCAAh2wXtuUgwVcx1XjUX7ELNdk&m=BDsYqP0is2zoDGYU5Ej1lSJ4s9DJhMsW40equi5dqCs&s=22KcLJbUqsq3nfr3qWnxDqA3kuHnFxSDeiENVUITmdA&e= >
_______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
