github-actions[bot] commented on issue #33704:
URL: https://github.com/apache/beam/issues/33704#issuecomment-2641182202
Performance change found in the
test:
`pytorch_image_classification_benchmarks-resnet152-GPU-mean_load_model_latency_milli_secs`
for the metric: `mean_load_model_latency_milli_secs`.
For more information on how to triage the alerts, please look at
`Triage performance alert issues` section of the
[README](https://github.com/apache/beam/tree/master/sdks/python/apache_beam/testing/analyzers/README.md#triage-performance-alert-issues).
`Test description:` Pytorch image classification on 50k images of size 224 x
224 with resnet 152 with Tesla T4 GPU.
Test link -
https://github.com/apache/beam/blob/42d0a6e3564d8b9c5d912428a6de18fb22a13ac1/.test-infra/jenkins/job_InferenceBenchmarkTests_Python.groovy#L151
Test dashboard -
http://metrics.beam.apache.org/d/ZpS8Uf44z/python-ml-runinference-benchmarks?orgId=1&viewPanel=7
```
timestamp: Mon Feb 3 06:14:52 2025, metric_value: 120352.85
timestamp: Sun Feb 2 06:25:12 2025, metric_value: 123105.87
timestamp: Sat Feb 1 06:19:08 2025, metric_value: 122917.00
timestamp: Fri Jan 31 06:15:15 2025, metric_value: 125189.10
timestamp: Wed Jan 29 06:34:31 2025, metric_value: 119985.23
timestamp: Tue Jan 28 06:32:22 2025, metric_value: 123488.70
timestamp: Mon Jan 27 06:15:54 2025, metric_value: 120767.65
timestamp: Sun Jan 26 06:17:44 2025, metric_value: 121232.82
timestamp: Sat Jan 25 06:37:00 2025, metric_value: 123815.07
timestamp: Fri Jan 24 06:29:51 2025, metric_value: 122248.15
timestamp: Thu Jan 23 06:20:08 2025, metric_value: 123471.17 <---- Anomaly
timestamp: Wed Jan 22 06:41:47 2025, metric_value: 118871.80
timestamp: Tue Jan 21 06:36:10 2025, metric_value: 120691.52
timestamp: Mon Jan 20 06:41:34 2025, metric_value: 115474.82
timestamp: Sun Jan 19 06:41:50 2025, metric_value: 116304.58
timestamp: Sat Jan 18 06:59:57 2025, metric_value: 124728.72
timestamp: Fri Jan 17 06:38:08 2025, metric_value: 124745.48
timestamp: Thu Jan 16 06:37:10 2025, metric_value: 129002.75
timestamp: Wed Jan 15 06:41:40 2025, metric_value: 128322.32
timestamp: Tue Jan 14 06:39:24 2025, metric_value: 126983.60
timestamp: Mon Jan 13 06:34:22 2025, metric_value: 123951.52
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
