Jaydeep Vishwakarma created OOZIE-2216:
------------------------------------------
Summary: Aperiodic Data handling in oozie
Key: OOZIE-2216
URL: https://issues.apache.org/jira/browse/OOZIE-2216
Project: Oozie
Issue Type: New Feature
Components: coordinator
Reporter: Jaydeep Vishwakarma
Assignee: Jaydeep Vishwakarma
Currently Oozie scheduling works on periodic datasets. It does not have any
mechanism to handle aperiodic datasets, which doesn’t follow a fixed
schedule/frequency.
Use cases
When incoming dataset arrives with no fixed schedule.
Need to trigger the job based all data available since last run with a possible
cap on the max size to process in one run.
Try to avoid creating so many instances when you know input instances will be
very few.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
