GitHub user alamb closed the discussion with a comment: Request: reduce the amount of time used on Apache shared runners
I am not sure what automated script is being referred to. I manually copy/pasted the output of of a script I ran locally to this discussion earlier today to contribute data that is not easily available elsewhere. I have gotten the message that further comments are not helpful. Thank you for bearing with me > It's a long time ago that I contributed far more comprehensive scripts for > infra tooling here: > https://github.com/apache/infrastructure-actions/blob/main/utils/actions-queue-status.py Thank you -- I was not familiar with that script. I am running it now and look forward to seeing the output > I have not yet seen any work from @alamb on improving their workflows based > on my findings and analysis. I am still waiting. As you have asked several times, here are some: <details> Prompt used: ```text > I have not yet seen any work from @alamb on improving their workflows based > on my findings and analysis. I am still waiting. Please find pRs in arrow or datafusion that reduce CI time that alamb helped review, merge or author ``` # CI-time-reducing PRs in apache/arrow-rs and apache/datafusion involving alamb Merged PRs that reduce CI time where alamb was author, reviewer, merger, or commenter. Compiled 2026-10-23 via GitHub keyword search (CI speed, cache, runner, shard, etc.) plus a per-PR check of author, merger, reviewers and commenters. Keyword search can miss PRs whose titles don't mention CI, so treat this as a floor. ## apache/arrow-rs - [#11631](https://github.com/apache/arrow-rs/pull/11631) (2026-10-23, reviewer + merger) — Run Miri on a daily schedule instead of every PR, require before releases - [#10580](https://github.com/apache/arrow-rs/pull/10580) (2026-08-09, reviewer) — Speed up Miri workflow - [#9650](https://github.com/apache/arrow-rs/pull/9650) (2026-06-03, reviewer + merger) — Reduce Miri runtime even more - [#9630](https://github.com/apache/arrow-rs/pull/9630) (2026-04-16, commenter) — Use ubuntu-slim runner for lightweight CI jobs - [#9629](https://github.com/apache/arrow-rs/pull/9629) (2026-04-01, reviewer + merger) — Use nextest to run Miri in CI - [#5982](https://github.com/apache/arrow-rs/pull/5982) (2024-07-01, reviewer + merger) — Reduce repo size by removing accumulated commits in a CI job - [#2933](https://github.com/apache/arrow-rs/pull/2933) (2022-10-27, reviewer) — Cleanup CI - [#2227](https://github.com/apache/arrow-rs/pull/2227) (2022-07-29, author) — Only trigger arrow CI on changes to arrow - [#2214](https://github.com/apache/arrow-rs/pull/2214) (2022-08-04, author + merger) — Only run coverage jobs on master - [#2168](https://github.com/apache/arrow-rs/pull/2168) (2022-07-26, author + merger) — Split arrow-specific checks into their own workflows, common CI time cut to 21 minutes - [#2165](https://github.com/apache/arrow-rs/pull/2165) (2022-07-25, author + merger) — Break parquet_derive and arrow_flight tests into their own workflows - [#2151](https://github.com/apache/arrow-rs/pull/2151) (2022-07-24, author) — Break out docs CI job into its own action - [#2150](https://github.com/apache/arrow-rs/pull/2150) (2022-07-23, author) — Stop pretending to cache Rust build artifacts, CI about 20% faster ## apache/datafusion - [#26649](https://github.com/apache/datafusion/pull/26649) (2026-10-23, reviewer + merger) — Stop re-running the workspace test suite in the extended tests job - [#26644](https://github.com/apache/datafusion/pull/26644) (2026-10-23, reviewer + merger) — Halve extended-test fuzz time by computing the join fuzz reference once - [#26571](https://github.com/apache/datafusion/pull/26571) (2026-10-21, commenter) — Move more CI jobs to ubuntu-slim - [#25591](https://github.com/apache/datafusion/pull/25591) (2026-10-20, reviewer) — Run the Rust workflow for fork PRs on the fork, offloading the apache runner queue - [#25443](https://github.com/apache/datafusion/pull/25443) (2026-09-18, reviewer + merger) — Skip queue-verified Dev and Dependencies jobs on pushes to main - [#25365](https://github.com/apache/datafusion/pull/25365) (2026-09-17, merger + commenter) — Skip queue-verified Rust jobs on pushes to main - [#23477](https://github.com/apache/datafusion/pull/23477) (2026-07-13, reviewer + merger) — Use install-action instead of cargo install to speed up CI - [#21227](https://github.com/apache/datafusion/pull/21227) (2026-05-06, commenter) — Remove linux-build-lib from extended tests - [#20972](https://github.com/apache/datafusion/pull/20972) (2026-03-16, reviewer) — thin-ci - [#20274](https://github.com/apache/datafusion/pull/20274) (2026-02-23, reviewer) — Runs-on for more actions - [#20107](https://github.com/apache/datafusion/pull/20107) (2026-02-03, reviewer) — Runs-on for linux-build-lib and linux-test, 2x faster CI - [#16709](https://github.com/apache/datafusion/pull/16709) (2025-07-12, reviewer + merger) — Improve CI cache - [#16451](https://github.com/apache/datafusion/pull/16451) (2025-06-19, author) — Remove redundant license-header-check CI job - [#15966](https://github.com/apache/datafusion/pull/15966) (2025-05-07, reviewer) — Removal of duplicate CI jobs - [#15075](https://github.com/apache/datafusion/pull/15075) (2025-03-14, author + merger) — Split datafusion-cli testing into its own CI job - [#14745](https://github.com/apache/datafusion/pull/14745) (2025-02-21, reviewer) — Free up disk space in the extended-test runner - [#13045](https://github.com/apache/datafusion/pull/13045) (2024-10-25, author + merger) — Allow using cargo nextest for running tests - [#9865](https://github.com/apache/datafusion/pull/9865) (2024-03-30, author + merger) — Move depcheck out of the datafusion crate, 200 fewer crates to compile - [#8728](https://github.com/apache/datafusion/pull/8728) (2024-01-06, reviewer) — Speed up win64 test - [#7678](https://github.com/apache/datafusion/pull/7678) (2023-09-29, reviewer + merger) — Improve cache usage in CI - [#7668](https://github.com/apache/datafusion/pull/7668) (2023-09-28, reviewer + merger) — Migrate datafusion-proto tests into their own binary - [#6683](https://github.com/apache/datafusion/pull/6683) (2023-06-16, author) — Combine three test binaries to reduce CI disk space - [#5047](https://github.com/apache/datafusion/pull/5047) (2023-01-24, reviewer + merger) — Cleanup CI - [#2948](https://github.com/apache/datafusion/pull/2948) (2022-07-20, author + merger) — Remove CI caching to preserve disk space 37 merged CI-time PRs with alamb involved: 13 authored, 17 merged, the rest reviewed or commented on. Nine landed in the last six weeks, including three in the past week in datafusion. </details> GitHub link: https://github.com/apache/airflow/discussions/75395#discussioncomment-19153463 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
