Alex,
You have a lot of detail you are specifying that is cluttering up your
understanding of parallel.
Perhaps the following mini-tutorial will build up the concepts it sounds like
you want to use.
# create 2 empty xml files and 3 empty xlst files
$ touch f{1..2}.xml
$ touch f{1..3}.xlst
# look at them
$ ls f*.{xml,xlst}
f1.xlst f1.xml f2.xlst f2.xml f3.xlst
# show off how to process them pairwise
$ parallel echo do something to {1} and to {2} ::: f*.xml ::: f*.xlst
do something to f1.xml and to f1.xlst
do something to f1.xml and to f2.xlst
do something to f1.xml and to f3.xlst
do something to f2.xml and to f1.xlst
do something to f2.xml and to f2.xlst
do something to f2.xml and to f3.xlst
# show off how to construct named output file also
$ parallel echo do something to {1} and to {2} putting output into
{1.}_{2.}.res ::: f*.xml ::: f*.xlst
do something to f1.xml and to f1.xlst putting output into f1_f1.res
do something to f1.xml and to f2.xlst putting output into f1_f2.res
do something to f1.xml and to f3.xlst putting output into f1_f3.res
do something to f2.xml and to f1.xlst putting output into f2_f1.res
do something to f2.xml and to f2.xlst putting output into f2_f2.res
do something to f2.xml and to f3.xlst putting output into f2_f3.res
# now replace my echo sentence with your command - your use of advanced remote
features will make your job harder
???
~ malcolm_c...@stowers.org
________________________________________
From: parallel-bounces+mec=stowers....@gnu.org
[parallel-bounces+mec=stowers....@gnu.org] on behalf of Alex Muir
[alex.g.m...@gmail.com]
Sent: Friday, February 13, 2015 1:19 PM
To: Ole Tange
Cc: parallel@gnu.org
Subject: Re: Multiple Inputs xml files and multiple xsl files to
On Fri, Feb 13, 2015 at 7:02 PM, Ole Tange
<ta...@gnu.org<mailto:ta...@gnu.org>> wrote:
You simply add a :
parallel echo :::: file1 file2
I do not know Calabash, but your are probably looking for something
along the lines of:
PARALLEL="-j+$NumberExtraJobsPerServer --bar --sshlogin $servers
--timeout $timeout --joblog $jobLog" \
parallel "sh /mnt/schematron/scripts/runCalabash.sh {2}
$documentSpecficLogs{1/.}Log.txt {1}" ::: $sourceDir*.xml :::
/mnt/schematron/xpl/*.xpl
If the tutorial does not help you, please show 4 the commands that you
want run given 2 xml-files and 2 xsl-files.
::: $sourceDir*.xml ::: -- Okay I didn't know you could do this with multiple
files. I don't think that is clear on the tutorial.
I've read the tutorial however the use of multiples files only has examples
such as " ls $sourceXMLDir*.xml | parallel " i that I'm using.
What I'm doing is creating an initial parallel process loading that use ls
$sourceXMLDir*.xml as input on one cpu which executes a script that loads ls
$sourceXSLDir*.xsl as input which works. That second script is essentially the
second line below and the first line below starts the process.
ls $sourceXMLDir*.xml | parallel -j1 --eta --progress --sshlogin $local
--timeout $timeout --joblog $jobLog "sh
/home/ec2-user/lech/bitbucket/schematronification/execute/Run-Parallel-Process-XSL.sh
{}" $1
ls $sourceXSLDir*.xsl | parallel -j+$NumberExtraJobsPerServer --eta
--progress --sshlogin $servers --timeout $timeout --joblog $jobLog "sh
/home/ec2-user/lech/bitbucket/schematronification/execute/runCalabash.sh
/home/ec2-user/lech/bitbucket/schematronification/xpl/RunSingleAssertionXSLTAgainstXML.xpl
$documentSpecficLogs{/.}Log.txt {}" $1 $outputDir $logging $debug
Can that be reduced into 1 statement essentially running every.combination of
*.xml with a *.xslt using their file names as input into
RunSingleAssertionXSLTAgainstXML.xproc?
Thanks
Alex
-
Regards
Alex
www.tilogeo.com<http://www.tilogeo.com>
