I have once set up a small system with just a few SSDs in two NSD servers, providin a scratch file system in a computing cluster. No RAID, two replica. works, as long the admins do not do silly things (like rebooting servers in sequence without checking for disks being up in between). Going for RAIDs without GPFS replication protects you against single disk failures, but you're lost if just one of your NSD servers goes off.
FPO makes sense only sense IMHO if your NSD servers are also processing the data (and then you need to control that somehow). Other ideas? what else can you do with GPFS and local disks than what you considered? I suppose nothing reasonable ... Mit freundlichen Grüßen / Kind regards Dr. Uwe Falke IT Specialist High Performance Computing Services / Integrated Technology Services / Data Center Services ------------------------------------------------------------------------------------------------------------------------------------------- IBM Deutschland Rathausstr. 7 09111 Chemnitz Phone: +49 371 6978 2165 Mobile: +49 175 575 2877 E-Mail: [email protected] ------------------------------------------------------------------------------------------------------------------------------------------- IBM Deutschland Business & Technology Services GmbH / Geschäftsführung: Frank Hammer, Thorsten Moehring Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart, HRB 17122 From: "Oesterlin, Robert" <[email protected]> To: gpfsug main discussion list <[email protected]> Date: 11/30/2016 03:34 PM Subject: [gpfsug-discuss] Strategies - servers with local SAS disks Sent by: [email protected] Looking for feedback/strategies in setting up several GPFS servers with local SAS. They would all be part of the same file system. The systems are all similar in configuration - 70 4TB drives. Options I?m considering: - Create RAID arrays of the disks on each server (worried about the RAID rebuild time when a drive fails with 4, 6, 8TB drives) - No RAID with 2 replicas, single drive per NSD. When a drive fails, recreate the NSD ? but then I need to fix up the data replication via restripe - FPO ? with multiple failure groups - letting the system manage replica placement and then have GPFS due the restripe on disk failure automatically Comments or other ideas welcome. Bob Oesterlin Sr Principal Storage Engineer, Nuance 507-269-0413 _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
