alamb commented on issue #25088: URL: https://github.com/apache/datafusion/issues/25088#issuecomment-6319659678
I spent some time on some more analytics this morning on how many runner minutes are used by different projects Here is the data + script I used: [Archive.zip](https://github.com/user-attachments/files/33775594/Archive.zip) Note this only includes the github hosted runners (not the RunsOn runners): My numbers show that airflow has used used 77.2 **days** of runner time in the last 17h ``` 1000 runs of apache/airflow created between 2026-10-20T22:20:11Z and 2026-10-21T15:10:08Z (16.8 h window) jobs loaded: 900 runs from cache, 98 from the API, 2 failed (cache: gh-runner-usage-cache) conclusion jobs share runner-min runner-days success 12235 57.1% 111218 77.2 skipped 7424 34.7% 0 0.0 cancelled 1234 5.8% 5745 4.0 in_progress 274 1.3% 0 0.0 failure 186 0.9% 2304 1.6 queued 65 0.3% 0 0.0 total 21418 119267 82.8 average concurrent jobs over the window: 118 ``` By comparison DataFusion only used 11.7 days of runner time in the last 2 days ``` 1000 runs of apache/arrow-rs created between 2026-10-19T10:20:44Z and 2026-10-21T15:06:27Z (52.8 h window) jobs loaded: 0 runs from cache, 1000 from the API, 0 failed (cache: gh-runner-usage-cache) conclusion jobs share runner-min runner-days success 3492 69.7% 16846 11.7 skipped 913 18.2% 0 0.0 queued 327 6.5% 0 0.0 failure 141 2.8% 853 0.6 cancelled 125 2.5% 1946 1.4 in_progress 12 0.2% 0 0.0 total 5010 19645 13.6 average concurrent jobs over the window: 6 ``` arrow-rs used 2.7 days over 17 hours ``` 1000 runs of apache/datafusion created between 2026-10-20T22:07:51Z and 2026-10-21T15:13:03Z (17.1 h window) warning: jobs for run 39541706327 failed: gh: Server Error (HTTP 502) jobs loaded: 69 runs from cache, 930 from the API, 1 failed (cache: gh-runner-usage-cache) conclusion jobs share runner-min runner-days skipped 1757 48.8% 0 0.0 success 1410 39.2% 3943 2.7 queued 212 5.9% 0 0.0 cancelled 184 5.1% 2762 1.9 failure 24 0.7% 140 0.1 neutral 7 0.2% 0 0.0 in_progress 5 0.1% 0 0.0 total 3599 6845 4.8 average concurrent jobs over the window: 7 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
