jianqiuhuang opened a new issue #17516:
URL: https://github.com/apache/airflow/issues/17516


   **Apache Airflow version**: 2.1.0
   
   **What happened**:
   
   We use a python script that reads JSON configs from db to dynamically 
generate DAGs. Sometimes, when JSON Configs is updated, we expect DAGs to be 
removed in Airflow.  This doesn't always happen. From my observation, one of 
the following happens:
   1) DAG is removed because the python script no longer generates it.
   2) DAG still exists but run history is empty. When trigger the DAG, first 
task is stuck in `queued` status indefinitely.
   
   **What you expected to happen**:
   I expect the right behavior should be 
   >1) DAG is removed because the python script no longer generates it.
   
   **How to reproduce it**:
   * Create a python script in DAG folder that dynamically generates multiple 
DAGs
   * Execute these dynamically generated DAGs a few times
   * Use Airflow Variable to toggle (reduce) the # of DAGs generated
   * Examine if number of dynamically generated DAGs in the web UI
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to