The GitHub Actions job "Benchmarks PR Comment" on texera.git/main has failed. Run started by GitHub user xuang7 (triggered by xuang7).
Head commit for run: 0731313a73fa36c47cef9d7cfa4c87abc8dfe69e / Yicong Huang <[email protected]> ci: compare benchmark PRs with main (#5639) ### What changes were proposed in this PR? Update the benchmark PR comment workflow to show PR benchmark results next to the latest main baseline and the 7-day average baseline published on `gh-pages`. The comment now reads the PR run artifact JSON/CSV files and `gh-pages:/dev/bench/data.js`, then renders a compact report: | Section | What reviewers see | | --- | --- | | Verdict | Material regression/no-regression summary | | Noise threshold | Changes within ±5% are treated as CI noise | | Summary | `🟢 better · 🔴 worse · ⚪ within ±5% noise` metric counts | | Links | Benchmark dashboard and full workflow run | | Main table | One row per PR benchmark config, with compact icon/value/delta cells | | Details | Collapsed latest-main and 7-day-average baseline table | | Metrics | Throughput, MB/s, and latency percentiles | Throughput and MB/s deltas mark higher values as better; latency deltas mark lower values as better. If the baseline cannot be loaded, the workflow falls back to the existing PR-only CSV table. The comment includes a disclaimer that CI benchmark machines are noisy and small deltas should be treated cautiously. ### Any related issues, documentation, discussions? Closes #5638 ### How was this PR tested? ```bash ruby -e "require %q(yaml); YAML.load_file(%q(.github/workflows/benchmarks-pr-comment.yml)); puts %q(YAML OK)" ruby -e "require %q(yaml); y=YAML.load_file(%q(.github/workflows/benchmarks-pr-comment.yml)); puts y[%q(jobs)][%q(comment)][%q(steps)][3][%q(with)][%q(script)]" | node --input-type=module --check git diff --check gh run download 27397378517 --repo apache/texera --name bench-results-27397378517 --dir /tmp/texera-bench-compare-pr5639 # Locally simulated the compact rich PR-vs-main comment against: # https://raw.githubusercontent.com/apache/texera/gh-pages/dev/bench/data.js ``` ### Was this PR authored or co-authored using generative AI tooling? Generated-by: Codex (GPT-5) Report URL: https://github.com/apache/texera/actions/runs/27404960669 With regards, GitHub Actions via GitBox
