[
https://issues.apache.org/jira/browse/AIRFLOW-198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Anand updated AIRFLOW-198:
------------------------------------
Description:
Taken from: https://cwiki.apache.org/confluence/display/AIRFLOW/Roadmap
"For cases where we need to only run the latest in a series of task instance
runs and mark the others as skipped. For example, we may have job to execute a
DB snapshot every day. If the DAG is paused for 5 days and then unpaused, we
don’t want to run all 5, just the latest. With this feature, we will provide
“cron” functionality for task scheduling that is not related to ETL"
was:
Taken from: https://cwiki.apache.org/confluence/display/AIRFLOW/Roadmap
"For cases where we need to only run the latest in a series of task instance
runs and mark the others as skipped. For example, we may have job to execute a
DB snapshot every day. If the DAG is paused for 5 days and then unpaused, we
don’t want to run all 5, just the latest. With this feature, we will provide
“cron” functionality for task scheduling that is not related to ETL"
I've decided to implement this as a subclass of ShortCircuitOperator -
OnlyRunCurrentOperator/ShortCircuitIfNotCurrentOperator will skip downstream if
the dag run being executed is not current.
> Create an latest_only_operator
> ------------------------------
>
> Key: AIRFLOW-198
> URL: https://issues.apache.org/jira/browse/AIRFLOW-198
> Project: Apache Airflow
> Issue Type: New Feature
> Reporter: Peter Attardo
> Assignee: George Leslie-Waksman
>
> Taken from: https://cwiki.apache.org/confluence/display/AIRFLOW/Roadmap
> "For cases where we need to only run the latest in a series of task instance
> runs and mark the others as skipped. For example, we may have job to execute
> a DB snapshot every day. If the DAG is paused for 5 days and then unpaused,
> we don’t want to run all 5, just the latest. With this feature, we will
> provide “cron” functionality for task scheduling that is not related to ETL"
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
