renu-123-pixel commented on issue #37264: URL: https://github.com/apache/beam/issues/37264#issuecomment-3752880412
Thanks for the alert. Looking at the recent history of test_cloudml_benchmark_cirteo_no_shuffle_10GB-runtime_sec, there is a noticeable drop in runtime starting on Jan 6 (2399s) compared to the previous baseline (~2800–3000s), following a short period of higher runtimes on Jan 4–5 (~3500s). This appears to be a performance improvement, but the magnitude and sudden change suggest it could also be influenced by environmental factors (e.g., runner configuration, caching effects, or infrastructure differences) rather than a confirmed code-level optimization. Next steps: Check for any recent code changes affecting the CloudML / TFT pipeline around Jan 5–6. If no relevant changes are found, consider re-running the benchmark to validate repeatability. If the improvement is consistent across runs, we can mark this as an expected performance gain; otherwise, treat it as a potential flaky measurement. No immediate action required until repeatability or a causal change is identified. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
