Make a better storage system and they will find a better way to abuse it. A PI during an annual talk to the facility: Because databases are hard and file systems have done a far better job of scaling we have implemented our datastore using files, file name and directory names. It handles the high concurrency far better than any database server we could have built for the amount we are charged for that same very tiny amount of data. Ignoring that the internal pricing for storage is based on sane usage and not packing your entire data set into small enough files that it all lives in the SSD tier.
So I feel for you. Rob From: <[email protected]> on behalf of "Oesterlin, Robert" <[email protected]> Reply-To: gpfsug main discussion list <[email protected]> Date: Wednesday, August 22, 2018 at 1:12 PM To: gpfsug main discussion list <[email protected]> Subject: [gpfsug-discuss] Those users.... Sometimes, I look at the data that's being stored in my file systems and just shake my head: /gpfs/<path removed>/Restricted/EventChangeLogs/deduped/working contains 17,967,350 files (in ONE directory) Bob Oesterlin Sr Principal Storage Engineer, Nuance 507-269-0413
_______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
