Hi, I had some time to come back to this and was able to figure out the solution now..
parallel -j+$NumberExtraJobsPerServer --eta --progress --sshlogin $servers --timeout $timeout --joblog $jobLog "sh runCalabash.sh RunSingleAssertionXSLTAgainstXML.xpl $documentSpecficLogs{2/.}-{1/.}Log.txt" {1} {2} $outputDir $logging $debug ::: $sourceXSLDir*.xsl ::: $sourceXMLDir*.xml Thanks again for the advice Regards Alex www.tilogeo.com <http://www.tilogeo.com> On Mon, Feb 16, 2015 at 1:20 PM, Alex Muir <alex.g.m...@gmail.com> wrote: > Thanks Malcolm, > > You've made it very clear! > > I have to focus on some other tasks however when I get back to this I'll > try to work it out based on your feedback and reply to the list. > > Regards > Alex > > - > > Regards > Alex > www.tilogeo.com > > On Sat, Feb 14, 2015 at 5:04 AM, Cook, Malcolm <m...@stowers.org> wrote: > >> Alex, >> >> You have a lot of detail you are specifying that is cluttering up your >> understanding of parallel. >> >> Perhaps the following mini-tutorial will build up the concepts it sounds >> like you want to use. >> >> # create 2 empty xml files and 3 empty xlst files >> $ touch f{1..2}.xml >> $ touch f{1..3}.xlst >> >> # look at them >> $ ls f*.{xml,xlst} >> f1.xlst f1.xml f2.xlst f2.xml f3.xlst >> >> # show off how to process them pairwise >> $ parallel echo do something to {1} and to {2} ::: f*.xml ::: f*.xlst >> do something to f1.xml and to f1.xlst >> do something to f1.xml and to f2.xlst >> do something to f1.xml and to f3.xlst >> do something to f2.xml and to f1.xlst >> do something to f2.xml and to f2.xlst >> do something to f2.xml and to f3.xlst >> >> # show off how to construct named output file also >> $ parallel echo do something to {1} and to {2} putting output into >> {1.}_{2.}.res ::: f*.xml ::: f*.xlst >> do something to f1.xml and to f1.xlst putting output into f1_f1.res >> do something to f1.xml and to f2.xlst putting output into f1_f2.res >> do something to f1.xml and to f3.xlst putting output into f1_f3.res >> do something to f2.xml and to f1.xlst putting output into f2_f1.res >> do something to f2.xml and to f2.xlst putting output into f2_f2.res >> do something to f2.xml and to f3.xlst putting output into f2_f3.res >> >> >> # now replace my echo sentence with your command - your use of advanced >> remote features will make your job harder >> >> ??? >> >> ~ malcolm_c...@stowers.org >> >> ________________________________________ >> From: parallel-bounces+mec=stowers....@gnu.org [parallel-bounces+mec= >> stowers....@gnu.org] on behalf of Alex Muir [alex.g.m...@gmail.com] >> Sent: Friday, February 13, 2015 1:19 PM >> To: Ole Tange >> Cc: parallel@gnu.org >> Subject: Re: Multiple Inputs xml files and multiple xsl files to >> >> On Fri, Feb 13, 2015 at 7:02 PM, Ole Tange <ta...@gnu.org<mailto: >> ta...@gnu.org>> wrote: >> You simply add a : >> >> parallel echo :::: file1 file2 >> >> I do not know Calabash, but your are probably looking for something >> along the lines of: >> >> PARALLEL="-j+$NumberExtraJobsPerServer --bar --sshlogin $servers >> --timeout $timeout --joblog $jobLog" \ >> parallel "sh /mnt/schematron/scripts/runCalabash.sh {2} >> $documentSpecficLogs{1/.}Log.txt {1}" ::: $sourceDir*.xml ::: >> /mnt/schematron/xpl/*.xpl >> >> If the tutorial does not help you, please show 4 the commands that you >> want run given 2 xml-files and 2 xsl-files. >> >> >> >> ::: $sourceDir*.xml ::: -- Okay I didn't know you could do this with >> multiple files. I don't think that is clear on the tutorial. >> >> I've read the tutorial however the use of multiples files only has >> examples such as " ls $sourceXMLDir*.xml | parallel " i that I'm using. >> >> What I'm doing is creating an initial parallel process loading that use >> ls $sourceXMLDir*.xml as input on one cpu which executes a script that >> loads ls $sourceXSLDir*.xsl as input which works. That second script is >> essentially the second line below and the first line below starts the >> process. >> >> >> ls $sourceXMLDir*.xml | parallel -j1 --eta --progress --sshlogin $local >> --timeout $timeout --joblog $jobLog "sh >> /home/ec2-user/lech/bitbucket/schematronification/execute/Run-Parallel-Process-XSL.sh >> {}" $1 >> >> ls $sourceXSLDir*.xsl | parallel -j+$NumberExtraJobsPerServer --eta >> --progress --sshlogin $servers --timeout $timeout --joblog $jobLog "sh >> /home/ec2-user/lech/bitbucket/schematronification/execute/runCalabash.sh >> /home/ec2-user/lech/bitbucket/schematronification/xpl/RunSingleAssertionXSLTAgainstXML.xpl >> $documentSpecficLogs{/.}Log.txt {}" $1 $outputDir $logging $debug >> >> >> Can that be reduced into 1 statement essentially running >> every.combination of *.xml with a *.xslt using their file names as input >> into RunSingleAssertionXSLTAgainstXML.xproc? >> >> Thanks >> Alex >> >> - >> >> Regards >> Alex >> www.tilogeo.com<http://www.tilogeo.com> > > >