[ 
https://issues.apache.org/jira/browse/OOZIE-2216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jaydeep Vishwakarma updated OOZIE-2216:
---------------------------------------
    Attachment:     (was: Oozie_aperiodic_data_handling.pdf)

> Aperiodic Data handling in oozie
> --------------------------------
>
>                 Key: OOZIE-2216
>                 URL: https://issues.apache.org/jira/browse/OOZIE-2216
>             Project: Oozie
>          Issue Type: New Feature
>          Components: coordinator
>            Reporter: Jaydeep Vishwakarma
>            Assignee: Jaydeep Vishwakarma
>
> Currently Oozie scheduling works on periodic datasets. It does not have any 
> mechanism to handle aperiodic datasets, which doesn’t follow a fixed 
> schedule/frequency. 
> Use cases
> When incoming dataset arrives with no fixed schedule.
> Need to trigger the job based all data available since last run with a 
> possible cap on the max size to process in one run.
> Try to avoid creating so many instances when you know input instances will be 
> very few.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to