Hi, Hi, I’m very new to oozie ,actually I would like to run Spark 2.3 jobs on oozie based on file arrival on aws s3 which is a dependency for the job
I see some examples which uses s3 as input event datasets as below <datasets> <dataset name="ix" frequency="${coord:days(1)}" initial-instance="2015-05-10T15:25Z" timezone="Europe/Zurich"> <uri-template>s3n://mybucket/a/b/${YEAR}/${MONTH}/${DAY}</uri-template> </dataset> </datasets> So my question is does oozie listenes to file arrival on aws s3 to check for dependency before kicking off spark job ?? Thanks