ashb commented on PR #54103: URL: https://github.com/apache/airflow/pull/54103#issuecomment-3470289106
This is looking super promising. With this enabled it managed to schedule 22k TIs across 24 different dags in 40min, where as without it the same TI+dag count took the scheduler 2hr10m (Green with, yellow without) <img width="1086" height="282" alt="Screenshot 2025-10-30 at 21 17 13" src="https://github.com/user-attachments/assets/984ef69b-e027-4746-a4d2-87da8a79c833"; /> <img width="1078" height="286" alt="Screenshot 2025-10-30 at 21 17 44" src="https://github.com/user-attachments/assets/ffd0f53f-b959-4cc7-9c40-5d406c2b831a"; /> Right now it's looking super likely that we just always turn this on. I will run more test with different dag heirachy/task dependency layouts patterns tomorrow -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
