This is an automated email from the ASF dual-hosted git repository.
mikhail pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from e01f718 Merge pull request #10169: [website] Add Spark Structured
Runner VR badge to the github template
new 2e0a983 [BEAM-6335] Added streaming GroupByKey Test that reads
SyntheticSource from PubSub. Added metrics.
new c50f045 [BEAM-6335] Changed SyntheticDataPublisher to publish String
UTF values insead of pairs, which were difficult to decode.
new 2c89d7f [BEAM-6335] Added custom PubSub Matcher that stops pipeline
after specified number of records or timeout. Added unit tests.
new 5159130 Merge pull request #10029 from
kkucharc/BEAM-6335-consume-data-insertion-pipeline-group-by-key
The 24346 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../beam/sdk/loadtests/SyntheticDataPublisher.java | 9 +-
.../apache_beam/io/gcp/tests/pubsub_matcher.py | 38 +++---
.../io/gcp/tests/pubsub_matcher_test.py | 69 ++++++++---
.../apache_beam/testing/load_tests/load_test.py | 15 ++-
.../testing/load_tests/load_test_metrics_utils.py | 11 +-
.../testing/load_tests/{ => streaming}/__init__.py | 0
.../streaming/group_by_key_streaming_pipeline.py | 98 ++++++++++++++++
.../streaming/group_by_key_streaming_test.py | 130 +++++++++++++++++++++
.../testing/load_tests/streaming}/requirements.txt | 8 +-
9 files changed, 329 insertions(+), 49 deletions(-)
copy sdks/python/apache_beam/testing/load_tests/{ => streaming}/__init__.py
(100%)
create mode 100644
sdks/python/apache_beam/testing/load_tests/streaming/group_by_key_streaming_pipeline.py
create mode 100644
sdks/python/apache_beam/testing/load_tests/streaming/group_by_key_streaming_test.py
copy {.test-infra/metrics/sync/jira =>
sdks/python/apache_beam/testing/load_tests/streaming}/requirements.txt (89%)
