This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 774008d [BEAM-13015] Start integrating a process wide cache. (#16130)
add 3d75542 [BEAM-11936] Remove suppression in ReadFromKafkaDoFn (#16174)
add 8336b9f [BEAM-12561] method truncate on series and dataframe (#15833)
add e9b2015 [BEAM-13384] Re-exported the metrics subpackage in
apache_beam/__init__.py
add 118bbc9 [BEAM-13384] Re-exported the metrics subpackage in
apache_beam #16139
add 2f247bf [BEAM-13294] Widen key schema for all keys before use (#16158)
add 163ac6a [BEAM-13171] Support for stopReadTime on KafkaIO SDF (#15951)
add 8a7ad0e [BEAM-13399] Add functionality to download Beam JARs from
Maven (#16153)
add 487ede6 [BEAM-13401] Wait for worker start to reduce flakiness in
pubsublite.ReadWriteIT
add bf73b5f Merge pull request #16155: [BEAM-13401] Wait for worker start
to reduce flakiness in pubsubliteReadWriteIT
add 34d750e Fix pytest unknown markers warning.
add d68e8ed Merge pull request #16173: Fix pytest unknown markers warning.
add ba49cd9 [BEAM-13402] Add another workaround for
https://github.com/googleapis/gax-java/issues/1577 and bump Pub/Sub Lite
version to pick up another similar workaround (#16190)
No new revisions were added by this update.
Summary of changes:
CHANGES.md | 32 +++++
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 2 +-
.../core/runtime/xlangx/expansionx/download.go | 121 +++++++++++++++++
.../runtime/xlangx/expansionx/download_test.go | 143 +++++++++++++++++++++
.../beam/sdk/schemas/transforms/CoGroup.java | 10 +-
.../beam/sdk/schemas/transforms/JoinTest.java | 97 ++++++++++++--
.../internal/TopicBacklogReaderSettings.java | 4 +-
.../beam/sdk/io/gcp/pubsublite/ReadWriteIT.java | 3 +
.../java/org/apache/beam/sdk/io/kafka/KafkaIO.java | 48 ++++++-
.../beam/sdk/io/kafka/KafkaSourceDescriptor.java | 36 +++++-
.../beam/sdk/io/kafka/ReadFromKafkaDoFn.java | 26 +++-
.../sdk/io/kafka/WatchKafkaTopicPartitionDoFn.java | 9 +-
.../beam/sdk/io/kafka/ReadFromKafkaDoFnTest.java | 86 ++++++++++---
.../io/kafka/WatchKafkaTopicPartitionDoFnTest.java | 20 +--
sdks/python/apache_beam/__init__.py | 1 +
sdks/python/apache_beam/dataframe/frames.py | 21 +++
sdks/python/apache_beam/dataframe/frames_test.py | 13 ++
.../apache_beam/dataframe/pandas_doctests_test.py | 5 +-
sdks/python/pytest.ini | 1 +
19 files changed, 624 insertions(+), 54 deletions(-)
create mode 100644 sdks/go/pkg/beam/core/runtime/xlangx/expansionx/download.go
create mode 100644
sdks/go/pkg/beam/core/runtime/xlangx/expansionx/download_test.go