This is an automated email from the ASF dual-hosted git repository.
Amar3tto pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 67018be2650 [runners-spark] Support stateful ParDo in the Structured
Streaming batch runner (#39793)
add 2d94b11acaf normalize KinesisIO
add 02060be7b7a sync Kinesis
add 661862a4ba2 Add LocalStack Kinesis YAML integration test
new 2ff4f0eda94 Merge pull request #39763 from
aIbrahiim/yaml-normalize-kinesis
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../KinesisReadSchemaTransformProvider.java | 315 +++++++++++++++++++++
.../KinesisWriteSchemaTransformProvider.java | 280 ++++++++++++++++++
.../KinesisSchemaTransformProviderTest.java | 221 +++++++++++++++
.../messaging/{kafka.yaml => kinesis.yaml} | 52 ++--
sdks/python/apache_beam/yaml/integration_tests.py | 107 +++++++
sdks/python/apache_beam/yaml/standard_io.yaml | 44 +++
sdks/python/build.gradle | 1 +
sdks/standard_external_transforms.yaml | 134 ++++++++-
8 files changed, 1126 insertions(+), 28 deletions(-)
create mode 100644
sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/kinesis/KinesisReadSchemaTransformProvider.java
create mode 100644
sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/kinesis/KinesisWriteSchemaTransformProvider.java
create mode 100644
sdks/java/io/amazon-web-services2/src/test/java/org/apache/beam/sdk/io/aws2/kinesis/KinesisSchemaTransformProviderTest.java
copy sdks/python/apache_beam/yaml/extended_tests/messaging/{kafka.yaml =>
kinesis.yaml} (59%)
