the limit is not a hard coded limit
- technically spoken, you can raise it easily.
But as always, it is a question of test 'n support ..
I've seen customer cases, where the use of much smaller amount of independent filesets generates a lot performance issues, hangs ... at least noise and partial trouble ..
it might be not the case with your specific workload, because due to the fact, that you 're running already close to 1000 ...
I suspect , this number of 1000 file sets - at the time of introducing it - was as also just that one had to pick a number...
... turns out.. that a general commitment to support > 1000 ind.fileset is more or less hard.. because what uses cases should we test / support
I think , there might be a good chance for you , that for your specific workload, one would allow and support more than 1000
do you still have a PMR for your side for this ? - if not - I know .. open PMRs is an additional ...but could you please ..
then we can decide .. if raising the limit is an option for you ..
Mit freundlichen Grüßen / Kind regards
Olaf Weiser
EMEA Storage Competence Center Mainz, German / IBM Systems, Storage Platform,
-------------------------------------------------------------------------------------------------------------------------------------------
IBM Deutschland
IBM Allee 1
71139 Ehningen
Phone: +49-170-579-44-66
E-Mail: [email protected]
-------------------------------------------------------------------------------------------------------------------------------------------
IBM Deutschland GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter
Geschäftsführung: Martina Koederitz (Vorsitzende), Susanne Peter, Norbert Janzen, Dr. Christian Keller, Ivo Koerner, Markus Koerner
Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart, HRB 14562 / WEEE-Reg.-Nr. DE 99369940
From: "Peinkofer, Stephan" <[email protected]>
To: gpfsug main discussion list <[email protected]>
Cc: Doris Franke <[email protected]>, Uwe Tron <[email protected]>, Dorian Krause <[email protected]>
Date: 08/10/2018 01:29 PM
Subject: [gpfsug-discuss] GPFS Independent Fileset Limit
Sent by: [email protected]
Dear IBM and GPFS List,
we at the Leibniz Supercomputing Centre and our GCS Partners from the Jülich Supercomputing Centre will soon be hitting the current Independent Fileset Limit of 1000 on a number of our GPFS Filesystems.
There are also a number of RFEs from other users open, that target this limitation:
https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=56780
https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=120534
https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=106530
https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=85282
I know GPFS Development was very busy fulfilling the CORAL requirements but maybe now there is again some time to improve something else.
If there are any other users on the list that are approaching the current limitation in independent filesets, please take some time and vote for the RFEs above.
Many thanks in advance and have a nice weekend.
Best Regards,
Stephan Peinkofer
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
But as always, it is a question of test 'n support ..
I've seen customer cases, where the use of much smaller amount of independent filesets generates a lot performance issues, hangs ... at least noise and partial trouble ..
it might be not the case with your specific workload, because due to the fact, that you 're running already close to 1000 ...
I suspect , this number of 1000 file sets - at the time of introducing it - was as also just that one had to pick a number...
... turns out.. that a general commitment to support > 1000 ind.fileset is more or less hard.. because what uses cases should we test / support
I think , there might be a good chance for you , that for your specific workload, one would allow and support more than 1000
do you still have a PMR for your side for this ? - if not - I know .. open PMRs is an additional ...but could you please ..
then we can decide .. if raising the limit is an option for you ..
Mit freundlichen Grüßen / Kind regards
Olaf Weiser
EMEA Storage Competence Center Mainz, German / IBM Systems, Storage Platform,
-------------------------------------------------------------------------------------------------------------------------------------------
IBM Deutschland
IBM Allee 1
71139 Ehningen
Phone: +49-170-579-44-66
E-Mail: [email protected]
-------------------------------------------------------------------------------------------------------------------------------------------
IBM Deutschland GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter
Geschäftsführung: Martina Koederitz (Vorsitzende), Susanne Peter, Norbert Janzen, Dr. Christian Keller, Ivo Koerner, Markus Koerner
Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart, HRB 14562 / WEEE-Reg.-Nr. DE 99369940
From: "Peinkofer, Stephan" <[email protected]>
To: gpfsug main discussion list <[email protected]>
Cc: Doris Franke <[email protected]>, Uwe Tron <[email protected]>, Dorian Krause <[email protected]>
Date: 08/10/2018 01:29 PM
Subject: [gpfsug-discuss] GPFS Independent Fileset Limit
Sent by: [email protected]
Dear IBM and GPFS List,
we at the Leibniz Supercomputing Centre and our GCS Partners from the Jülich Supercomputing Centre will soon be hitting the current Independent Fileset Limit of 1000 on a number of our GPFS Filesystems.
There are also a number of RFEs from other users open, that target this limitation:
https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=56780
https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=120534
https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=106530
https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=85282
I know GPFS Development was very busy fulfilling the CORAL requirements but maybe now there is again some time to improve something else.
If there are any other users on the list that are approaching the current limitation in independent filesets, please take some time and vote for the RFEs above.
Many thanks in advance and have a nice weekend.
Best Regards,
Stephan Peinkofer
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
_______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
