Hi Rob,
Some things to think about from experiences a year or so ago...
If you intend to perform any HPC workload (writing / updating / deleting
files) inside a cache, then appropriately specified gateway nodes will be
your friend:
1. When creating, updating or deleting files in the cache, each
Dean"
To: gpfsug main discussion list
Date: 11/23/2020 11:44 PM
Subject:[EXTERNAL] Re: [gpfsug-discuss] AFM experiences?
Sent by:gpfsug-discuss-boun...@spectrumscale.org
Hello Rob,
We looked at AFM years ago for DR, but after reading the bug reports, we
avoided it
>- Quota management on the home cluster - we need a way of ensuring
>people don't write data to the cache which can't be accomodated on
>home. Probably not insurmountable but needs a bit of thought...
You could set same quotas between cache and home clusters. AFM does not
support replication of
Ours are about 50 and 100 km from the home cluster, but it’s over 100Gb fiber.
> On Nov 23, 2020, at 4:54 PM, Andrew Beattie wrote:
>
> Rob,
>
> Talk to Jake Carroll from the University of Queensland, he has done a number
> of presentations at Scale User Groups of UQ’s MeDiCI data fabric
Rob,
Talk to Jake Carroll from the University of Queensland, he has done a
number of presentations at Scale User Groups of UQ’s MeDiCI data fabric
which is based on Spectrum Scale and does very aggressive use of AFM.
Their use of AFM is not only on campus, but to remote Storage clusters
between
From: gpfsug-discuss-boun...@spectrumscale.org
On Behalf Of Ryan Novosielski
Sent: Monday, November 23, 2020 4:31 PM
To: gpfsug main discussion list
Subject: Re: [gpfsug-discuss] AFM experiences?
We use it similar to how you describe it. We now run 5.0.4.1 on the client side
(I mean actual client
We use it similar to how you describe it. We now run 5.0.4.1 on the client side
(I mean actual client nodes, not the home or cache clusters). Before that, we
had reliability problems (failure to cache libraries of programs that were
executing, etc.). The storage clusters in our case are
