github-actions[bot] commented on issue #27986:
URL: https://github.com/apache/beam/issues/27986#issuecomment-1773457492
Performance change found in the
test:
`pytorch_image_classification_benchmarks-resnet152-GPU-mean_inference_batch_latency_micro_secs`
for the metric: `mean_inference_batch_latency_micro_secs`.
For more information on how to triage the alerts, please look at
`Triage performance alert issues` section of the
[README](https://github.com/apache/beam/tree/master/sdks/python/apache_beam/testing/analyzers/README.md#triage-performance-alert-issues).
`Test description:` Pytorch image classification on 50k images of size 224 x
224 with resnet 152 with Tesla T4 GPU.
Test link -
https://github.com/apache/beam/blob/42d0a6e3564d8b9c5d912428a6de18fb22a13ac1/.test-infra/jenkins/job_InferenceBenchmarkTests_Python.groovy#L151).
Test dashboard -
http://metrics.beam.apache.org/d/ZpS8Uf44z/python-ml-runinference-benchmarks?from=now-90d&to=now&viewPanel=2
```
timestamp: Fri Oct 20 07:08:05 2023, metric_value: 2688509.52
timestamp: Fri Oct 20 06:39:18 2023, metric_value: 2458050.99
timestamp: Thu Oct 19 07:17:14 2023, metric_value: 2043164.31 <---- Anomaly
timestamp: Tue Oct 17 20:40:46 2023, metric_value: 3899543.47
timestamp: Tue Oct 17 06:53:08 2023, metric_value: 3570869.75
timestamp: Sun Oct 15 20:34:39 2023, metric_value: 3960132.67
timestamp: Sat Oct 14 20:44:21 2023, metric_value: 3336088.22
timestamp: Sat Oct 14 06:28:48 2023, metric_value: 4056443.40
timestamp: Thu Oct 12 20:23:43 2023, metric_value: 5029367.36
timestamp: Wed Oct 11 20:24:49 2023, metric_value: 3878865.37
timestamp: Wed Oct 11 11:30:25 2023, metric_value: 3437622.54
timestamp: Tue Oct 10 21:59:48 2023, metric_value: 3985866.40
timestamp: Tue Oct 10 18:42:44 2023, metric_value: 3502661.44
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
