This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 0faa3b9 Merge pull request #15885 from ibzib/wc-twister2
add ec99053 [BEAM-11440] Add integration test for KinesisIO using
Localstack on javaPostCommit
add aa5f06f Bump localstack container version for more robust version
with respect to HTTP/HTTPS and simplify KinesisIOIT in kinesis module.
add 0831b75 Bump localstack container version for DynamoDBIOTest to
version used in KinesisIOIT
add b60f732 Apply format
add aa67b0f Apply format
add f829123 Use vendored guava deps
add 0262dd6 Merge pull request #15841: [BEAM-11440] Add integration test
for KinesisIO using Localstack (aws2)
add 1e388f9 [BEAM-13164] Address most of a race condition between
instantiation and usage of member variables.
add 164a458 [BEAM-13164] Address most of a race condition between
instantiation and usage of member variables.
add 2bd53d6 [BEAM-13021] Deduplicate Python artifact not only by hash but
also by source path
add 59d9d8c add test
add 4063502 rename variables
add 219bca3 rearrange comparison order
add 963cf92 s/pathes/paths/
add f488802 Merge pull request #15692 from ihji/BEAM-13021
add 0b47f1b Merge pull request #15835: [BEAM-11205] Google Libraries BOM
24.0.0 and associated deps
add fafe9d1 Merge pull request #15810: [BEAM-2791] Support low-latency
StorageApi sink with no exactly-once guarantees
add 6054856 Defer filesToStage construction until after full jar
resolution.
add 7497a2c Merge pull request #15891: [BEAM-13187] Set filesToStage
after full jar resolution.
add e4f8f4b [BEAM-3811] Code clean-up of the CancelleableQueue to not
throw InterruptedException on cancel/reset since we are never stuck in a loop
here or waiting on a signal.
add 5e00300 [BEAM-3811] Code clean-up of the CancelleableQueue to not
throw InterruptedException on cancel/reset since we are never stuck in a loop
here or waiting on a signal.
add cb5913a [BEAM-13081] Fixes a compatible issue of decoding null-value
bitmap between JVM coder and Python Coder (#15829)
No new revisions were added by this update.
Summary of changes:
CHANGES.md | 3 +
build.gradle.kts | 1 +
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 30 +--
examples/java/build.gradle | 1 +
.../container/license_scripts/dep_urls_java.yaml | 4 +-
.../java/org/apache/beam/sdk/util/ApiSurface.java | 20 +-
.../org/apache/beam/sdk/fn/CancellableQueue.java | 24 +--
.../sdk/fn/data/BeamFnDataGrpcMultiplexer2.java | 4 +-
.../sdk/fn/stream/BufferingStreamObserver.java | 116 +++++------
.../fn/harness/control/BeamFnControlClient.java | 4 +-
.../sdk/io/aws/dynamodb/DynamoDBIOTestHelper.java | 2 +-
.../beam/sdk/io/aws2/kinesis/KinesisIOIT.java | 136 +++++++++++--
.../sdk/io/aws2/kinesis/KinesisTestOptions.java | 25 +++
.../beam/sdk/io/gcp/bigquery/BigQueryIO.java | 22 ++-
.../beam/sdk/io/gcp/bigquery/BigQueryOptions.java | 7 +
.../sdk/io/gcp/bigquery/SplittingIterable.java | 69 +++++++
.../beam/sdk/io/gcp/bigquery/StorageApiLoads.java | 32 ++-
.../StorageApiWriteRecordsInconsistent.java | 75 +++++++
.../bigquery/StorageApiWriteUnshardedRecords.java | 220 ++++++++++++++-------
.../bigquery/StorageApiWritesShardedRecords.java | 49 -----
.../sdk/io/gcp/testing/FakeDatasetService.java | 38 +++-
.../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java | 41 +++-
.../apache/beam/sdk/io/kinesis/KinesisIOIT.java | 115 ++++++-----
.../beam/sdk/io/kinesis/KinesisTestOptions.java | 6 +
sdks/python/apache_beam/coders/row_coder.py | 4 +-
sdks/python/apache_beam/coders/row_coder_test.py | 26 +++
.../runners/dataflow/internal/apiclient.py | 20 +-
.../runners/dataflow/internal/apiclient_test.py | 85 +++++++-
sdks/python/apache_beam/transforms/external.py | 4 +-
29 files changed, 851 insertions(+), 332 deletions(-)
create mode 100644
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/SplittingIterable.java
create mode 100644
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/StorageApiWriteRecordsInconsistent.java
