We have a similar process. One of our customers has a web app that their managers use to provision spaces. That web app drops a json file into a specific location and a cron job kicks off a python script every so often to process the files and provision the space(fileset creation, link, quota, owner, group, perms, etc). Failures are queued and a jira ticket opened. Successes update the database for the web app. They are not requiring instant processing, so we process hourly on the back end side of things.
Chad -- Chad Kerner, Senior Storage Engineer Storage Enabling Technologies National Center for Supercomputing Applications University of Illinois, Urbana-Champaign On 3/2/21, 4:38 PM, "gpfsug-discuss-boun...@spectrumscale.org on behalf of Simon Thompson" <gpfsug-discuss-boun...@spectrumscale.org on behalf of s.j.thomp...@bham.ac.uk> wrote: Not quite user self-service .... But we have some web tooling for project registration that pushes sanitised messages onto a redis (rq) backed message bus which then does "stuff". For example create and populate groups in AD and LDAP. Create and link a fileset, set quota etc ... Our consumer code is all built to be tolerant to running it a second time safely and has quite a bit of internal locking to prevent multiple instances running at the same time (though we have multiple consumer entities to handle fail-over). The fault tolerant thing is quite important as create a fileset can fail for a number of reasons (e.g. restripefs running), so we can always just requeue the requests again. Simon On 02/03/2021, 19:40, "gpfsug-discuss-boun...@spectrumscale.org on behalf of russ...@nordquist.info" <gpfsug-discuss-boun...@spectrumscale.org on behalf of russ...@nordquist.info> wrote: Hi all We are trying to use filesets quite a bit, but it’s a hassle that only the admins can create them. To the users it’s just a directory so it slows things down. Has anyone deployed a self service model for creating filesets? Maybe using the API? This feels like shared pain that someone has already worked on…. thanks Russell _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org https://urldefense.com/v3/__http://gpfsug.org/mailman/listinfo/gpfsug-discuss__;!!DZ3fjg!uQVokpQk0pPyjpae7a_Aui1wGk3k7xJzIxzX1DBNfOyNOfzZeJFUjVOqN3OVEyVqdw$ _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org https://urldefense.com/v3/__http://gpfsug.org/mailman/listinfo/gpfsug-discuss__;!!DZ3fjg!uQVokpQk0pPyjpae7a_Aui1wGk3k7xJzIxzX1DBNfOyNOfzZeJFUjVOqN3OVEyVqdw$ _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss