ashb commented on issue #5079: [AIRFLOW-4285] Update task dependency context 
defination and usage
URL: https://github.com/apache/airflow/pull/5079#issuecomment-561716214
 
 
   @KevinYang21 Confirmed, it still happens, and seems to be an issue when the 
tasks "overflow" the executor.
   
   For example, set:
   
   - AIRFLOW__CORE__PARALLELISM=5
   - ```
     dag = DAG('example_dag',
                max_active_runs=50,
                concurrency=500,```
   
   We've got a one-line fix for it too:
   
   
https://github.com/astronomer/airflow/commit/8d0ee05976db021d4f3185d5ca55ae818fc1f7a0
   
   (It took about 5 person-days to track down! Always the way with one line 
fixes.)
   
   Once we've got unit tests added too we'll open a PR. Unfortunately this bug 
also affects 1.10.6 as we cherry-picked this change :(

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to