Arunprasad created AIRFLOW-642:
----------------------------------

             Summary:  Add dag_run to the task_instance table or add taskUUID 
and use this to uniquely identify a task
                 Key: AIRFLOW-642
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-642
             Project: Apache Airflow
          Issue Type: Improvement
          Components: DagRun, scheduler
            Reporter: Arunprasad


We are planning to run around 40,000 tasks a day using airflow and some of them 
are critical to give quick feedback to developers. 

Currently having execution date to uniquely identify tasks does not work for us 
since we mainly trigger dags (instead of running them on schedule) we collide 
with 1 sec granularity on several occasions.  Having a task uuid or associating 
dag_run to task_instance  table and using this for scheduling and updating 
status will help us here.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to