[
https://issues.apache.org/jira/browse/BEAM-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512776#comment-17512776
]
Valentyn Tymofieiev commented on BEAM-14163:
--------------------------------------------
I think I can reproduce the regression comparing master vs older commit
Master
INFO:apache_beam.runners.dataflow.dataflow_runner:Job
2022-03-25_19_08_11-10128193585164656190 is in state JOB_STATE_DONE
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Load test results
for test: 2ba385094277483889f4bbc7dea9e489 and timestamp: 1648261523.4674542:
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric:
default_runtime Value: 602
with :beam$ git checkout 9833b7be17b1a1ffbddd9ae5457ffee2aa9fee55 :
INFO:apache_beam.runners.dataflow.dataflow_runner:Job
2022-03-25_19_19_48-17065797399608426583 is in state JOB_STATE_DONE
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Load test results
for test: c39f12b85a6444648bc9747694970ab5 and timestamp: 1648262283.1458037:
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric:
default_runtime Value: 383
Will do a couple more runs to see if this is reproducible and then try to
narrow down the culprit.
> Performance Regressions in streaming python ParDo and GBK Load Tests
> --------------------------------------------------------------------
>
> Key: BEAM-14163
> URL: https://issues.apache.org/jira/browse/BEAM-14163
> Project: Beam
> Issue Type: Bug
> Components: community-metrics, sdk-py-core
> Affects Versions: 2.38.0
> Reporter: Daniel Oliveira
> Assignee: Valentyn Tymofieiev
> Priority: P0
> Fix For: 2.38.0
>
>
> As specified in the [Beam Release
> Guide|https://beam.apache.org/contribute/release-guide/#4-investigate-performance-regressions],
> I'm investigating performance regressions. The following load test metrics
> show a clear and persistant performance regression starting approximately
> around March 17 and affecting version 2.38.0.
> ParDo Load Tests:
> http://metrics.beam.apache.org/d/MOi-kf3Zk/pardo-load-tests?orgId=1&var-processingType=streaming&var-sdk=python
> GBK Load Tests:
> http://metrics.beam.apache.org/d/UYZ-oJ3Zk/gbk-load-tests?orgId=1&var-processingType=streaming&var-sdk=python&from=now-30d&to=now
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
