github-actions[bot] commented on issue #29492:
URL: https://github.com/apache/beam/issues/29492#issuecomment-1872616189
Performance change found in the
test:
`pytorch_image_classification_benchmarks-resnet152-GPU-mean_load_model_latency_milli_secs`
for the metric: `mean_load_model_latency_milli_secs`.
For more information on how to triage the alerts, please look at
`Triage performance alert issues` section of the
[README](https://github.com/apache/beam/tree/master/sdks/python/apache_beam/testing/analyzers/README.md#triage-performance-alert-issues).
`Test description:` Pytorch image classification on 50k images of size 224 x
224 with resnet 152 with Tesla T4 GPU.
Test link -
https://github.com/apache/beam/blob/42d0a6e3564d8b9c5d912428a6de18fb22a13ac1/.test-infra/jenkins/job_InferenceBenchmarkTests_Python.groovy#L151
Test dashboard -
http://metrics.beam.apache.org/d/ZpS8Uf44z/python-ml-runinference-benchmarks?orgId=1&viewPanel=7
```
timestamp: Sat Dec 30 06:46:27 2023, metric_value: 202143.13
timestamp: Fri Dec 29 06:45:37 2023, metric_value: 210222.32
timestamp: Thu Dec 28 00:16:10 2023, metric_value: 207040.46
timestamp: Wed Dec 27 06:44:56 2023, metric_value: 217219.49
timestamp: Tue Dec 26 06:44:21 2023, metric_value: 203994.03
timestamp: Sun Dec 24 07:04:48 2023, metric_value: 205072.90
timestamp: Sat Dec 23 06:58:13 2023, metric_value: 205543.48
timestamp: Fri Dec 22 06:52:50 2023, metric_value: 209199.66 <---- Anomaly
timestamp: Thu Dec 21 06:52:04 2023, metric_value: 221007.77
timestamp: Wed Dec 20 07:04:02 2023, metric_value: 223566.49
timestamp: Tue Dec 19 06:54:26 2023, metric_value: 215618.13
timestamp: Mon Dec 18 16:43:04 2023, metric_value: 231189.45
timestamp: Fri Dec 15 06:54:00 2023, metric_value: 217229.54
timestamp: Thu Dec 14 06:45:17 2023, metric_value: 207335.30
timestamp: Wed Dec 13 06:55:32 2023, metric_value: 213023.18
timestamp: Tue Dec 12 06:40:05 2023, metric_value: 213582.44
timestamp: Mon Dec 11 06:37:05 2023, metric_value: 218185.46
timestamp: Sun Dec 10 06:32:59 2023, metric_value: 209092.40
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
