If you want to submit a SLURM patch to export more environment
variables I'd be happy to include that in the next major release of
SLURM and you could use it as a local patch until then.
Quoting "Mark A. Grondona" <[email protected]>:
On Fri, 21 Oct 2011 15:17:41 -0700, "Evans, Brandon"
<[email protected]> wrote:
Hey all,
I've written a small wrapper in C that submits jobs via
slurm_submit_batch_job(). Every job I submit needs to run another script
after the job is ran. Among other things this script needs to write
variables such as SLURM_JOB_NAME, SLURM_JOB_DERIVED_EC and
SLURM_JOB_PARTITION to a particular directory on a shared filesystem. Now
those variables are only available in scripts launched by EpilogSlurmctld.
I'm not sure if these variables are exported to the Slurmctld Epilog,
but there is a "job control" environment for the normal prolog/epilog,
which is a set of extra environment variables passed to these scripts
and not to the job itself.
I think this environment can be set in the
char **spank_job_env; /* environment variables for job
prolog/epilog
* scripts as set by SPANK plugins */
uint32_t spank_job_env_size; /* element count in spank_env */
members of job_desc_msg_t. The variables in the prolog/epilog are
always prefixed with SPANK_, so if you set "SGI_DONE_DIR" in
spank_job_env it would appear as SPANK_SGI_DONE_DIR in the scripts.
I have never tried setting these vars directly, but you might be able
to reuse the code in src/srun/opt.c:set_spank_job_env().
Then you'd have to test to see if these vars appear in Slurmctld Epilog.
mark
My problem is I need to pass additional data to the the script launched
by EpilogSlurmctld. I could use the shared filesystem to do this, but
that just doesn't feel right. So what are my options?
I've tried several things including:
- exporting a variable in the command sent to slurm_submit_batch_job() (
char *shebang = "#!/bin/bash\nexport SGI_SLURM_DONE_DIR=";). But the
SGI_SLURM_DONE_DIR doesn't get passed to EpilogSlurmctld.
- I've tried various methods of setting job_desc_msg.environment, but that
doesn't seem to do anything. Or, it's more likely I was doing it wrong.
Here is the code I'm using to submit the job: http://pastebin.com/DThfeVZT
Note: the doneDir data is what I'm trying to pass to the EpilogSlurmctld
script.
I'm open to any and all suggestions.
Thanks,
Brandon
