Hi All,
Why does Oozie allow duplicate submission of the same coordinator job with same
properties?
Suppose I have a coordinator that runs once a day and aggregates customer
records and writes the result to output file.
For this coordinator, I could have following URI template to specify input
customer report file on HDFS as input condition.
<uri-template>hdfs://<name-node>/Report/01-Jan-2015/customer.txt</uri-template>
Output file could be defined as follows:
hdfs://<name-node>/Report/01-Jan-2015/Aggregated_Customer.txt
Then, I create job.properties for this coordinator and submit the job.
oozie job -oozie http://localhost:8080/oozie -config job.properties -submit
So far so good.
Now, I submit the same job again...
oozie job -oozie http://localhost:8080/oozie -config job.properties -submit
and again...
oozie job -oozie http://localhost:8080/oozie -config job.properties -submit
and so on..
Shouldn't Oozie prevent this? Why does it allow the same submission multiple
times? Is there any rationale for this?
I would have expected Oozie to put some control over multiple submission of the
same job with same properties otherwise it could result into duplicate
processing of the same input producing the same output.
Thanks
Vishal Joshi
_______________________________________________
This message is for information purposes only, it is not a recommendation,
advice, offer or solicitation to buy or sell a product or service nor an
official confirmation of any transaction. It is directed at persons who are
professionals and is not intended for retail customer use. Intended for
recipient only. This message is subject to the terms at:
www.barclays.com/emaildisclaimer.
For important disclosures, please see:
www.barclays.com/salesandtradingdisclaimer regarding market commentary from
Barclays Sales and/or Trading, who are active market participants; and in
respect of Barclays Research, including disclosures relating to specific
issuers, please see http://publicresearch.barclays.com.
_______________________________________________
