github-actions[bot] commented on issue #27077:
URL: https://github.com/apache/beam/issues/27077#issuecomment-1641056497
Performance change found in the
test:
`pytorch_image_classification_benchmarks-resnet152-GPU-mean_load_model_latency_milli_secs`
for the metric: `mean_load_model_latency_milli_secs`.
For more information on how to triage the alerts, please look at
`Triage performance alert issues` section of the
[README](https://github.com/apache/beam/tree/master/sdks/python/apache_beam/testing/analyzers/README.md#triage-performance-alert-issues).
`Test description:` Pytorch image classification on 50k images of size 224 x
224 with resnet 152 with Tesla T4 GPU. Test link -
https://github.com/apache/beam/blob/42d0a6e3564d8b9c5d912428a6de18fb22a13ac1/.test-infra/jenkins/job_InferenceBenchmarkTests_Python.groovy#L151
Test dashboard -
http://104.154.241.245/d/ZpS8Uf44z/python-ml-runinference-benchmarks?orgId=1&viewPanel=7
```
timestamp: Tue Jul 18 20:18:01 2023, metric_value: 169408.30
timestamp: Mon Jul 17 20:17:35 2023, metric_value: 179341.26
timestamp: Sun Jul 16 20:12:41 2023, metric_value: 163747.60
timestamp: Fri Jul 14 20:20:19 2023, metric_value: 172176.19
timestamp: Thu Jul 13 20:23:24 2023, metric_value: 181711.54
timestamp: Tue Jul 11 20:34:43 2023, metric_value: 193342.36
timestamp: Mon Jul 10 20:19:11 2023, metric_value: 189409.14
timestamp: Sat Jul 8 20:11:56 2023, metric_value: 157463.11
timestamp: Fri Jul 7 20:20:13 2023, metric_value: 181411.25 <---- Anomaly
timestamp: Thu Jul 6 20:18:41 2023, metric_value: 211548.54
timestamp: Wed Jul 5 20:28:56 2023, metric_value: 205620.69
timestamp: Tue Jul 4 20:25:33 2023, metric_value: 205096.16
timestamp: Mon Jul 3 20:30:00 2023, metric_value: 208163.29
timestamp: Sun Jul 2 20:24:06 2023, metric_value: 195112.75
timestamp: Sat Jul 1 20:23:14 2023, metric_value: 195221.70
timestamp: Fri Jun 30 20:29:06 2023, metric_value: 197976.39
timestamp: Wed Jun 28 20:36:25 2023, metric_value: 197206.00
timestamp: Sat Jun 24 20:22:25 2023, metric_value: 173418.86
timestamp: Thu Jun 22 20:33:39 2023, metric_value: 194870.17
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
