xBis7 commented on PR #77032: URL: https://github.com/apache/airflow/pull/77032#issuecomment-6952892096
Example terminal output: ``` airflow-core/tests/integration/performance/test_perf.py::TestPerformance::test_scheduler_load[original_code] original_code: 5 runs of perf_dag, 20 mapped instances per stage, timeout 3600s, profile dynamic [progress 17s] dag_runs: running=5 | tis: none=40 queued=65 running=12 success=28 | finished 28 (1.9/s) [progress 32s] dag_runs: running=5 | tis: none=37 queued=84 running=11 success=70 | finished 70 (2.8/s) [progress 47s] dag_runs: running=5 | tis: none=36 queued=74 running=4 success=107 | finished 107 (2.5/s) [progress 63s] dag_runs: running=5 | tis: none=34 queued=74 running=15 success=136 | finished 136 (1.9/s) [progress 78s] dag_runs: running=5 | tis: none=32 queued=77 running=15 success=173 | finished 173 (2.5/s) [progress 93s] dag_runs: running=5 | tis: none=30 queued=77 running=13 scheduled=4 success=211 | finished 211 (2.5/s) [progress 108s] dag_runs: running=5 | tis: none=27 queued=75 running=8 success=282 | finished 282 (4.7/s) [progress 123s] dag_runs: running=5 | tis: none=23 queued=81 running=15 success=349 | finished 349 (4.5/s) [progress 138s] dag_runs: running=5 | tis: none=20 queued=77 running=7 success=421 | finished 421 (4.8/s) [progress 153s] dag_runs: running=5 | tis: none=16 queued=71 running=4 success=510 | finished 510 (5.9/s) [progress 168s] dag_runs: running=5 | tis: none=12 queued=80 running=5 success=580 | finished 580 (4.7/s) [progress 183s] dag_runs: running=5 | tis: none=7 queued=86 running=2 success=677 | finished 677 (6.5/s) [progress 198s] dag_runs: running=5 | tis: none=4 queued=77 running=11 success=737 | finished 737 (4.0/s) [progress 213s] dag_runs: running=5 | tis: queued=73 running=4 success=828 | finished 828 (6.1/s) [progress 228s] dag_runs: running=1 success=4 | tis: running=3 success=902 | finished 902 (4.9/s) [progress 231s] dag_runs: success=5 | tis: success=905 | finished 905 (0.2/s) original_code: 5 dag_runs finished in 231s PASSED [ 50%] airflow-core/tests/integration/performance/test_perf.py::TestPerformance::test_scheduler_load[new_code] new_code: 5 runs of perf_dag, 20 mapped instances per stage, timeout 3600s, profile dynamic [progress 15s] dag_runs: running=5 | tis: none=39 queued=67 running=10 success=48 | finished 48 (3.2/s) [progress 30s] dag_runs: running=5 | tis: none=33 queued=89 running=4 success=152 | finished 152 (6.9/s) [progress 45s] dag_runs: running=5 | tis: none=29 queued=79 running=13 success=233 | finished 233 (5.4/s) [progress 60s] dag_runs: running=5 | tis: none=25 queued=75 running=4 success=326 | finished 326 (6.2/s) [progress 75s] dag_runs: running=5 | tis: none=21 queued=66 running=5 success=414 | finished 414 (5.9/s) [progress 90s] dag_runs: running=5 | tis: none=16 queued=76 running=4 success=505 | finished 505 (6.1/s) [progress 106s] dag_runs: running=5 | tis: none=12 queued=72 running=14 success=579 | finished 579 (4.9/s) [progress 121s] dag_runs: running=5 | tis: none=8 queued=62 running=6 scheduled=20 success=657 | finished 657 (5.2/s) [progress 136s] dag_runs: running=5 | tis: none=5 queued=61 running=7 success=737 | finished 737 (5.3/s) [progress 151s] dag_runs: running=5 | tis: queued=84 running=12 success=809 | finished 809 (4.8/s) [progress 166s] dag_runs: running=4 success=1 | tis: queued=44 running=14 success=847 | finished 847 (2.5/s) [progress 174s] dag_runs: success=5 | tis: success=905 | finished 905 (3.9/s) new_code: 5 dag_runs finished in 174s PASSED [100%] ``` Example Grafana metrics from the new dashboard: <img width="4104" height="1950" alt="image" src="https://github.com/user-attachments/assets/fd0dbf7e-04f6-4011-b0b1-d513c0ef3805" /> <img width="3988" height="1238" alt="image" src="https://github.com/user-attachments/assets/bb36e157-940a-4aba-ab7d-a38f5b87bd1b" /> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
