Hi Andrew, Alright, that partly confirms that there is no automatically sweep of data at cache site, right? I mean data will not be deleted automatically after a while in the cache fileset, where it is only metadata that stays? If data is kept until a manual deletion of data is requested on the cache site then this is the way to go for us..!
Also, Site A has no connection to Site C so it needs to be connected as A to B and B to C.. This means: Site A holds live data from Site A, Site B holds live data from Site B and Replicated data from Site A, Site C holds replicated data from A and B. Does that make sense? The connection between A and B is LAN, about 500meters apart.. basically same site but different data centers and strictly separated because of security.. Site C is in another Country. Hence why we cant use GPFS AFM and also why we need to utilize WAN/NFS tunneled for AFM. Best Regards Andi Nør Christiansen B4Restore A/S Phone +45 87 81 37 39 Mobile +45 23 89 59 75 Fra: [email protected] <[email protected]> På vegne af Andrew Beattie Sendt: 18. december 2019 13:04 Til: [email protected] Cc: [email protected] Emne: Re: [gpfsug-discuss] Spectrum Scale mirrored filesets across sites. Andi, This is basic functionality that is part of Spectrum Scale there is no additional licensing or HSM costs required for this. Set Site C as your AFM Home, and have Site A and Site B both as Caches of Site C you can then Write Data in to Site A - have it stream to Site C, and call it on demand or Prefetch from Site C to Site B as required the Same is true of Site B, you can write Data into Site B, have it Stream to Site C, and call it on demand to site A if you want the data to be Multi Writer then you will need to make sure you use Independent writer as the AFM type https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/General%20Parallel%20File%20System%20(GPFS)/page/Active%20File%20Management%20(AFM) Regards, Andrew Beattie File and Object Storage Technical Specialist - A/NZ IBM Systems - Storage Phone: 614-2133-7927 E-mail: [email protected]<mailto:[email protected]> ----- Original message ----- From: "Andi Nør Christiansen" <[email protected]<mailto:[email protected]>> Sent by: [email protected]<mailto:[email protected]> To: gpfsug main discussion list <[email protected]<mailto:[email protected]>> Cc: Subject: [EXTERNAL] [gpfsug-discuss] Spectrum Scale mirrored filesets across sites. Date: Wed, Dec 18, 2019 8:00 PM Hi, We are currently building a 3 site spectrum scale solution where data is going to be generated at two different sites (Site A and Site B, Site C is for archiving/backup) and then archived on site three. I have however not worked with AFM much so I was wondering if there is someone who knows how to configure AFM to have all data generated in a file-set automatically being copied to an offsite. GPFS AFM is not an option because of latency between sites so NFS AFM is going to be tunneled between the site via WAN. As of now we have tried to set up AFM but it only transfers data from home to cache when a prefetch is manually started or a file is being opened, we need all files from home to go to cache as soon as it is generated or at least after a little while. It does not need to be synchronous it just need to be automatic. I’m not sure if attachments will be available in this thread but I have attached the concept of our design. Basically the setup is : Site A: Owns “fileset A1” which needs to be replicated to Site B “fileset A2” the from Site B to Site C “fileset A3”. Site B: Owns “fileset B1” which needs to be replicated to Site C “fileset B2”. Site C: Holds all data from Site A and B “fileset A3 & B2”. We do not need any sites to have failover functionality only a copy of the data from the two first sites. If anyone knows how to accomplish this I would be glad to know how! We have been looking into switching the home and cache site so that data is generated at the cache sites which will trigger GPFS to transfer the files to home as soon as possible but as I have little to no experience with AFM I don’t know what happens to the cache site over time, does the cache site empty itself after a while or does data stay there until manually deleted? Thanks in advance! Best Regards<https://www.linkedin.com/company/b4restore-a-s/> [cid:[email protected]] Andi Nør Christiansen IT Solution Specialist Phone +45 87 81 37 39 Mobile +45 23 89 59 75 E-mail [email protected]<mailto:> Web www.b4restore.com<http://www.b4restore.com> [B4Restore on LinkedIn] <https://www.linkedin.com/company/b4restore-a-s/> [B4Restore on Facebook] <https://twitter.com/b4restore> [B4Restore on Facebook] <https://www.facebook.com/B4Restore> [Sign up for our newsletter] <https://www.b4restore.com/en/about-us/newsletter> [Download Report]<https://www.b4restore.com/report> _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
_______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
