Thanks Malcolm,
You've made it very clear!
I have to focus on some other tasks however when I get back to this I'll
try to work it out based on your feedback and reply to the list.
Regards
Alex
-
Regards
Alex
www.tilogeo.com
On Sat, Feb 14, 2015 at 5:04 AM, Cook, Malcolm <m...@stowers.org> wrote:
> Alex,
>
> You have a lot of detail you are specifying that is cluttering up your
> understanding of parallel.
>
> Perhaps the following mini-tutorial will build up the concepts it sounds
> like you want to use.
>
> # create 2 empty xml files and 3 empty xlst files
> $ touch f{1..2}.xml
> $ touch f{1..3}.xlst
>
> # look at them
> $ ls f*.{xml,xlst}
> f1.xlst f1.xml f2.xlst f2.xml f3.xlst
>
> # show off how to process them pairwise
> $ parallel echo do something to {1} and to {2} ::: f*.xml ::: f*.xlst
> do something to f1.xml and to f1.xlst
> do something to f1.xml and to f2.xlst
> do something to f1.xml and to f3.xlst
> do something to f2.xml and to f1.xlst
> do something to f2.xml and to f2.xlst
> do something to f2.xml and to f3.xlst
>
> # show off how to construct named output file also
> $ parallel echo do something to {1} and to {2} putting output into
> {1.}_{2.}.res ::: f*.xml ::: f*.xlst
> do something to f1.xml and to f1.xlst putting output into f1_f1.res
> do something to f1.xml and to f2.xlst putting output into f1_f2.res
> do something to f1.xml and to f3.xlst putting output into f1_f3.res
> do something to f2.xml and to f1.xlst putting output into f2_f1.res
> do something to f2.xml and to f2.xlst putting output into f2_f2.res
> do something to f2.xml and to f3.xlst putting output into f2_f3.res
>
>
> # now replace my echo sentence with your command - your use of advanced
> remote features will make your job harder
>
> ???
>
> ~ malcolm_c...@stowers.org
>
> ________________________________________
> From: parallel-bounces+mec=stowers....@gnu.org [parallel-bounces+mec=
> stowers....@gnu.org] on behalf of Alex Muir [alex.g.m...@gmail.com]
> Sent: Friday, February 13, 2015 1:19 PM
> To: Ole Tange
> Cc: parallel@gnu.org
> Subject: Re: Multiple Inputs xml files and multiple xsl files to
>
> On Fri, Feb 13, 2015 at 7:02 PM, Ole Tange <ta...@gnu.org<mailto:
> ta...@gnu.org>> wrote:
> You simply add a :
>
> parallel echo :::: file1 file2
>
> I do not know Calabash, but your are probably looking for something
> along the lines of:
>
> PARALLEL="-j+$NumberExtraJobsPerServer --bar --sshlogin $servers
> --timeout $timeout --joblog $jobLog" \
> parallel "sh /mnt/schematron/scripts/runCalabash.sh {2}
> $documentSpecficLogs{1/.}Log.txt {1}" ::: $sourceDir*.xml :::
> /mnt/schematron/xpl/*.xpl
>
> If the tutorial does not help you, please show 4 the commands that you
> want run given 2 xml-files and 2 xsl-files.
>
>
>
> ::: $sourceDir*.xml ::: -- Okay I didn't know you could do this with
> multiple files. I don't think that is clear on the tutorial.
>
> I've read the tutorial however the use of multiples files only has
> examples such as " ls $sourceXMLDir*.xml | parallel " i that I'm using.
>
> What I'm doing is creating an initial parallel process loading that use
> ls $sourceXMLDir*.xml as input on one cpu which executes a script that
> loads ls $sourceXSLDir*.xsl as input which works. That second script is
> essentially the second line below and the first line below starts the
> process.
>
>
> ls $sourceXMLDir*.xml | parallel -j1 --eta --progress --sshlogin $local
> --timeout $timeout --joblog $jobLog "sh
> /home/ec2-user/lech/bitbucket/schematronification/execute/Run-Parallel-Process-XSL.sh
> {}" $1
>
> ls $sourceXSLDir*.xsl | parallel -j+$NumberExtraJobsPerServer --eta
> --progress --sshlogin $servers --timeout $timeout --joblog $jobLog "sh
> /home/ec2-user/lech/bitbucket/schematronification/execute/runCalabash.sh
> /home/ec2-user/lech/bitbucket/schematronification/xpl/RunSingleAssertionXSLTAgainstXML.xpl
> $documentSpecficLogs{/.}Log.txt {}" $1 $outputDir $logging $debug
>
>
> Can that be reduced into 1 statement essentially running every.combination
> of *.xml with a *.xslt using their file names as input into
> RunSingleAssertionXSLTAgainstXML.xproc?
>
> Thanks
> Alex
>
> -
>
> Regards
> Alex
> www.tilogeo.com<http://www.tilogeo.com>
