This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from d108da4cf66 Push multi-arch Python SDK containers built by GH tests to
GCR and remove auto delete (#27840)
add 488279c236e Bump commons-io to 2.13.0 (#27776)
add b40ca796d8d propagate fewKeys to hot-key path
add 1f90261aef4 Merge pull request #27845: propagate fewKeys to hot-key
path
add f953d7156d5 Bump github.com/fsouza/fake-gcs-server from 1.47.2 to
1.47.3 in /sdks (#27844)
add 7e365d78c79 Update settings.gradle.kts to include project `arm`
(#27831)
add 5289d6bfbcb Move changes from #27635 to the right section in CHANGES.md
add 887560b35ff Merge pull request #27849: Move changes from #27635 to the
right section in CHANGES.md
add 55414129a93 Setup Java Flink runner PreCommit (#27721)
add 1877c887140 Remove reconciled partitions from list of missing
partitions (#27755)
add 408d766d55f [Python]Don't stage beam SDK in Stager (#27436)
add 76290b83c50 Add logging at error to Bootloader logger (#27813)
add fb6d1675890 Allow usage of GCThrashing settings on Fn Harness (#27850)
add cff332d7e02 Change repo to push, make steps for diff versions run in
parallel. (#27855)
add 8cfff66ef88 Rebuild generated protobuf code to reflect fnapi proto
update for data sampling #25065 (#27837)
add cc804905da5 Use a lighter size estimation for StateFetchingIterators
(use number of bytes read)
add 771d7727dc2 Fix weight tests to consider the element overhead of 8
add f7bdf0edab4 Changes based on the recent code review
add 4c402768a64 Merge pull request #27461 Light cache weigher for
StateFetchingIterators.
add 8bd2c97351a Add javaHome for building Java 11 and 17 multi-arch
containers. (#27861)
add c654dc0203f Add setup Java for different Java versions. (#27863)
No new revisions were added by this update.
Summary of changes:
.github/workflows/README.md | 1 +
.../beam_PostCommit_Java_Examples_Dataflow_ARM.yml | 36 +-
....yml => beam_PreCommit_Java_Flink_Versions.yml} | 36 +-
CHANGES.md | 3 +-
build.gradle.kts | 32 +-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 2 +-
.../google-cloud-dataflow-java/arm/build.gradle | 52 +-
.../options/DataflowPipelineDebugOptions.java | 16 -
.../dataflow/worker/util/MemoryMonitor.java | 4 +-
sdks/go.mod | 2 +-
sdks/go.sum | 4 +-
sdks/go/container/tools/logging.go | 5 +
sdks/go/container/tools/logging_test.go | 16 +
.../beam/model/fnexecution_v1/beam_fn_api.pb.go | 2995 ++++++++++++--------
.../model/fnexecution_v1/beam_fn_api_grpc.pb.go | 2 +-
.../model/fnexecution_v1/beam_provision_api.pb.go | 2 +-
.../fnexecution_v1/beam_provision_api_grpc.pb.go | 2 +-
.../model/jobmanagement_v1/beam_artifact_api.pb.go | 2 +-
.../jobmanagement_v1/beam_artifact_api_grpc.pb.go | 2 +-
.../jobmanagement_v1/beam_expansion_api.pb.go | 2 +-
.../jobmanagement_v1/beam_expansion_api_grpc.pb.go | 2 +-
.../beam/model/jobmanagement_v1/beam_job_api.pb.go | 2 +-
.../model/jobmanagement_v1/beam_job_api_grpc.pb.go | 2 +-
.../beam/model/pipeline_v1/beam_runner_api.pb.go | 2991 +++++++++----------
.../model/pipeline_v1/beam_runner_api_grpc.pb.go | 2 +-
sdks/go/pkg/beam/model/pipeline_v1/endpoints.pb.go | 2 +-
.../model/pipeline_v1/external_transforms.pb.go | 2 +-
sdks/go/pkg/beam/model/pipeline_v1/metrics.pb.go | 2 +-
sdks/go/pkg/beam/model/pipeline_v1/schema.pb.go | 3 +-
.../model/pipeline_v1/standard_window_fns.pb.go | 2 +-
.../apache/beam/sdk/options/SdkHarnessOptions.java | 16 +
.../org/apache/beam/sdk/transforms/Combine.java | 23 +-
.../org/apache/beam/sdk/fn/data/WeightedList.java | 78 +
.../org/apache/beam/sdk/fn/stream/DataStreams.java | 21 +-
.../apache/beam/sdk/fn/stream/DataStreamsTest.java | 23 +-
.../java/org/apache/beam/fn/harness/FnHarness.java | 6 +-
.../fn/harness/state/StateFetchingIterators.java | 119 +-
.../beam/fn/harness/status/MemoryMonitor.java | 13 +-
.../action/DetectNewPartitionsAction.java | 45 +-
.../reconciler/PartitionReconciler.java | 45 +-
.../action/DetectNewPartitionsActionTest.java | 102 +-
.../GenerateInitialPartitionsActionTest.java | 1 +
.../ResumeFromPreviousPipelineActionTest.java | 1 +
.../reconciler/PartitionReconcilerTest.java | 58 +-
.../python/apache_beam/options/pipeline_options.py | 10 +-
.../apache_beam/runners/portability/stager.py | 192 +-
.../apache_beam/runners/portability/stager_test.py | 92 +-
sdks/python/container/boot.go | 19 +-
sdks/python/container/piputil.go | 16 +-
settings.gradle.kts | 1 +
50 files changed, 3975 insertions(+), 3132 deletions(-)
copy .github/workflows/{beam_PreCommit_Whitespace.yml =>
beam_PreCommit_Java_Flink_Versions.yml} (73%)
create mode 100644
sdks/java/fn-execution/src/main/java/org/apache/beam/sdk/fn/data/WeightedList.java
