On 11 July 2011 09:37, Udo Waechter <[email protected]> wrote: > Hi there. > > I have come across a problem that I do not really know how to solve properly. > I would like to implement a GE queue, where one would submit matlab jobs. > The idea is to use the Matlab Compiler to compile the M-File into a binary > and then run the jobs itself. Why? Code compiled with mcc does not use > licenses when it runs. > > Here are some ideas that I came up with: > 1. * Create a prolog script that first compiles the matlab .m file > * Problem: in non-PE envs this is run on each exec host (-> problematic on > shared media, unnecessary compile runs) > ** I could somehow create a lock file, where all other prolog scripts would > wait until compile is finished. A lockfile shouldn't be too hard there are tools for creating lockfiles that work over NFS. Just generate a lockfile name based on the path to the .m file check for the existence of a compiled.
> > 2. * The prolog script submits a compile job and modifies the current job to > hold until that one finishes > ** Is it possible to configure a "default resource request" (like > "-hold_jid mcc_compile") for a queue? > > 3. * use a PE: > ** I could use a parallel env, then the prolog script is run only once on > the master. > ** Problem: When people submit to the matlab queue, they must also request > the PE in order for this to work. > ** Is it possible to configure that the PE is always used on a certain > queue? You can do this by using the JSV to add a request for the PE. But it's not clear to me how this would simplify things since you would presumably have to make up the number of tasks required or run only one in which case it looks like a serial job and they have to submit multiple jobs each of which will run the prolog on its master. > > I would like to configure this process as automagic as possible. The easiest > would be for the users to do: > > qsub -b y -q matlab myMatlabScript.m > > Currently they would need to do: > > qsub -b y -l lic_matlab=1,lic_statistics_toolbox=1,... -q matlab matlab > -nojvm myMatlabScript.m > > Any ideas and comments are highly appreciated. > Have a nice day. > udo > > -- > ---[ Institute of Cognitive Science @ University of Osnabrueck > ---[ Albrechtstrasse 28, D-49076 Osnabrueck, 969-3362 > ---[ Documentation: https://doc.ikw.uni-osnabrueck.de > > > > _______________________________________________ users mailing list [email protected] https://gridengine.org/mailman/listinfo/users
