talnagar opened a new issue, #30196: URL: https://github.com/apache/airflow/issues/30196
### Apache Airflow version 2.5.2 ### What happened when trying to delete a dag run with many tasks (>1000) the operation times out and the dag run is not deleted. ### What you think should happen instead _No response_ ### How to reproduce attempt to delete a dag run that contains >1000 tasks (in my case 10k) using the dagrun/list/ page results in a timeout:  code for dag (however it fails on any dag with > 1000 tasks): ``` import json from airflow.providers.cncf.kubernetes.operators.kubernetes_pod import KubernetesPodOperator from datetime import datetime, timedelta from airflow.decorators import dag, task default_args = { 'owner': 'airflow', 'depends_on_past': False, 'retries': 0, 'retry_delay': timedelta(minutes=1), 'start_date': datetime(2023, 2, 26), 'is_delete_operator_pod': True, 'get_logs': True } @dag('system_test', schedule=None, default_args=default_args, catchup=False, tags=['maintenance']) def run_test_airflow(): stress_image = 'dockerhub.prod.evogene.host/progrium/stress' @task def create_cmds(): commands = [] for i in range(10000): commands.append(["stress --cpu 4 --io 1 --vm 2 --vm-bytes 6000M --timeout 60s"]) return commands KubernetesPodOperator.partial( image=stress_image , task_id=f'test_airflow', name=f'test_airflow', cmds=["/bin/sh", "-c"], log_events_on_failure=True, pod_template_file=f'/opt/airflow/dags/repo/templates/cpb_cpu_4_mem_16' ).expand(arguments=create_cmds()) run_test_airflow() ``` ### Operating System kubernetes deployment ### Versions of Apache Airflow Providers _No response_ ### Deployment Official Apache Airflow Helm Chart ### Deployment details _No response_ ### Anything else _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
