github-actions[bot] opened a new issue, #35885:
URL: https://github.com/apache/beam/issues/35885
Performance change found in the
test:
`pytorch_image_classification_benchmarks-resnet101-mean_load_model_latency_milli_secs`
for the metric: `mean_load_model_latency_milli_secs`.
For more information on how to triage the alerts, please look at
`Triage performance alert issues` section of the
[README](https://github.com/apache/beam/tree/master/sdks/python/apache_beam/testing/analyzers/README.md#triage-performance-alert-issues).
`Test description:` Pytorch image classification on 50k images of size 224 x
224 with resnet 101.
Test link -
https://github.com/apache/beam/blob/42d0a6e3564d8b9c5d912428a6de18fb22a13ac1/.test-infra/jenkins/job_InferenceBenchmarkTests_Python.groovy#L34
Test dashboard -
http://metrics.beam.apache.org/d/ZpS8Uf44z/python-ml-runinference-benchmarks?orgId=1&viewPanel=7
```
timestamp: Fri Aug 15 07:23:30 2025, metric_value: 88896.19
timestamp: Thu Aug 14 07:04:36 2025, metric_value: 94900.10
timestamp: Wed Aug 13 07:20:50 2025, metric_value: 88371.23 <---- Anomaly
timestamp: Tue Aug 12 05:58:16 2025, metric_value: 84418.94
timestamp: Mon Aug 11 06:18:00 2025, metric_value: 82595.21
timestamp: Sun Aug 10 06:06:35 2025, metric_value: 85096.26
timestamp: Sat Aug 9 06:17:00 2025, metric_value: 82237.81
timestamp: Fri Aug 8 20:41:54 2025, metric_value: 85100.98
timestamp: Fri Aug 8 06:05:15 2025, metric_value: 81777.66
timestamp: Thu Aug 7 06:26:47 2025, metric_value: 82021.04
timestamp: Wed Aug 6 06:15:45 2025, metric_value: 87629.36
timestamp: Tue Aug 5 06:07:25 2025, metric_value: 87828.79
timestamp: Mon Aug 4 06:06:58 2025, metric_value: 87352.46
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
