Quoting Daniel Pittman <[email protected]>:
If you're curious, this is a large render farm controlled by a homegrown job
scheduler, the users submit jobs and the scheduler takes over - hence our
current problem.
See, this is why I like tools like Condor, PBS, or the Sun Grid Engine. You
get to let other people pay the big money to build features like cleaning up
for you, so you don't have to. You get to play more golf.[1]
Heh-heh. Unfortunately we're in full blown production, golf is not an
option. Neither is replacing our systems.
Might it be easier to provide a compatible API to users, and replace the
inside with one of these tools?
Not my call, but I can guarantee it's never going to happen, it is way
too entrenched!
We have pre and post hooks available though, so maybe doing a chmod or chown
on the directory at the start and end of every job would suffice to keep
everyone happy?
If you can do that, can't you just remove the files as root? Unless you are
running on some strange platform that allows giving away file ownership to
unprivileged users or something...
Not quite as the cleanup process runs before the job exits. Anyway, it
turns out this is not an option (my bad) as the pre and post hooks
only operate at the farm process start/stop level, not on an
individual job level. Hey-ho.
Daniel
Footnotes:
[1] ...for some value of golf attractive to you, of course. ;)
Our job is to make sure these things play nice in our environment.
That can be a game in itself at times - with the commercial apps more
so than the homegrown ones most of the time ;-)
Thanks again,
Craig
--
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
