This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/go_modules/sdks/cloud.google.com/go/bigquery-1.73.1
in repository https://gitbox.apache.org/repos/asf/beam.git
discard f096d385c1f Bump cloud.google.com/go/bigquery from 1.72.0 to 1.73.1 in
/sdks
add 80b49029c64 Fix Playground Frontend Test job (#37642)
add 9ee4fe64f2b [yaml] : add available yaml io connectors to website
(#37605)
add e755b53b5a5 Add an instruction for using Docker buildx when building
containers. (#37706)
add 27a5fca9cca Moves expectMessage to before creating BeamFnLoggingClient
since exception can be thrown inside createAndStart method.
add 6b647c7e3d6 Merge pull request #37692: Moves expectMessage to before
creating BeamFnLoggingClient
add 940a8ca5db9 Bigtable: clean up client side metrics flag
add 193db392a93 Merge pull request #37596: Bigtable: clean up client side
metrics flag
add caf661798f7 Fix PreCommit tests involving docker-in-docker after
Milvus dependency rearrangements (#37711)
add 06dd48e9313 Revert "Update cibuildwheel dependency (#37504)" (#37713)
add 72027e11d1f Fix DebeziumIO resuming from worker restart (#37689)
add c51e244bb95 revert 'Optimize data size estimation for proto coder.'
(#37709)
add 2403014afce Stabilize
test_check_standard_external_transforms_config_in_sync (#37717)
add 9eb3a18ae70 fix conflict (#37594)
add 32d6bce8c23 Enable pickling main by reference option within
CloudpickleConfig (#37554)
add 5c2c3530411 Add Pyrefly configuration for Beam Python (#37700)
add e9f4c99206a fix Python 3.12 PostCommit by installing setuptools
(#37719)
add 67c3183913a Revise title and header in YAML documentation (#37722)
add 9524b56c148 Add observability (#37716)
add 30518c840bf [Stateful] Implement length-aware keying to minimize
padding in BatchElements (Part 2/3) (#37565)
add 5bee123ce8e Add monitoring for model manager (#37703)
add 4b3dcf26142 Fix GroupBy snippet tests for issue #30778 (#37672)
add 342de16b2f2 Fix Python PostCommit Flink runner log spam switching to
simple logger (#37720)
add af81a0c1635 Fix ml_base dependency (#37721)
add 5a6f763da54 [Drain] OnTimer - propagate caused by drain bit up to
DoFnRunner (#37012)
add fcbb0340800 Bump go.opentelemetry.io/otel/sdk from 1.38.0 to 1.40.0 in
/sdks (#37730)
add 685e72c6148 Bump cloud.google.com/go/bigquery from 1.72.0 to 1.73.1 in
/sdks
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (f096d385c1f)
\
N -- N -- N
refs/heads/dependabot/go_modules/sdks/cloud.google.com/go/bigquery-1.73.1
(685e72c6148)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.agent/skills/gradle-build/SKILL.md | 26 ++-
.agent/skills/python-development/SKILL.md | 12 +-
.../workflows/beam_PreCommit_Python_Coverage.yml | 35 +---
.github/workflows/beam_PreCommit_Python_ML.yml | 6 +-
.github/workflows/build_wheels.yml | 4 +-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 13 +-
examples/terraform/envoy-ratelimiter/README.md | 58 ++++-
examples/terraform/envoy-ratelimiter/deploy.sh | 66 ++++++
.../terraform/envoy-ratelimiter/prerequisites.tf | 1 +
examples/terraform/envoy-ratelimiter/ratelimit.tf | 114 +++++-----
examples/terraform/envoy-ratelimiter/variables.tf | 4 +-
playground/frontend/build.gradle | 3 +-
.../integration_test/embedded_run_test.dart | 2 +-
.../frontend/playground_components/pubspec.yaml | 6 +-
.../lib/src/widget_tester.dart | 13 +-
.../playground_components_dev/pubspec.yaml | 4 +-
playground/frontend/pubspec.yaml | 4 +-
.../org/apache/beam/runners/core/DoFnRunner.java | 4 +-
.../runners/core/LateDataDroppingDoFnRunner.java | 7 +-
...TimeBoundedSplittableProcessElementInvoker.java | 6 +
.../apache/beam/runners/core/ProcessFnRunner.java | 4 +-
.../runners/core/PushbackSideInputDoFnRunner.java | 4 +-
.../apache/beam/runners/core/SimpleDoFnRunner.java | 25 ++-
.../core/SimplePushbackSideInputDoFnRunner.java | 7 +-
.../core/SplittableParDoViaKeyedWorkItems.java | 2 +-
.../beam/runners/core/StatefulDoFnRunner.java | 16 +-
.../beam/runners/core/SimpleDoFnRunnerTest.java | 17 +-
.../SimplePushbackSideInputDoFnRunnerTest.java | 20 +-
.../beam/runners/core/StatefulDoFnRunnerTest.java | 3 +-
.../apache/beam/runners/direct/ParDoEvaluator.java | 3 +-
.../wrappers/streaming/DoFnOperator.java | 3 +-
.../functions/FlinkStatefulDoFnFunction.java | 3 +-
.../wrappers/streaming/DoFnOperator.java | 3 +-
.../flink/metrics/DoFnRunnerWithMetricsUpdate.java | 14 +-
.../functions/FlinkStatefulDoFnFunction.java | 3 +-
.../wrappers/streaming/DoFnOperator.java | 12 +-
.../streaming/ExecutableStageDoFnOperator.java | 7 +-
.../streaming/stableinput/BufferedElements.java | 10 +-
.../streaming/stableinput/BufferingDoFnRunner.java | 4 +-
.../wrappers/streaming/DoFnOperatorTest.java | 4 +-
.../streaming/ExecutableStageDoFnOperatorTest.java | 13 +-
.../dataflow/worker/DataflowProcessFnRunner.java | 4 +-
.../dataflow/worker/GroupAlsoByWindowFnRunner.java | 4 +-
.../runners/dataflow/worker/SimpleParDoFn.java | 3 +-
.../StreamingKeyedWorkItemSideInputDoFnRunner.java | 4 +-
.../worker/StreamingSideInputDoFnRunner.java | 4 +-
.../fnexecution/control/TimerReceiverFactory.java | 3 +-
.../translation/PipelineTranslatorUtils.java | 3 +-
.../fnexecution/control/RemoteExecutionTest.java | 4 +-
.../runners/fnexecution/wire/CommonCoderTest.java | 4 +-
.../runners/jet/processors/StatefulParDoP.java | 3 +-
.../samza/metrics/DoFnRunnerWithMetrics.java | 13 +-
.../runners/samza/runtime/AsyncDoFnRunner.java | 7 +-
.../apache/beam/runners/samza/runtime/DoFnOp.java | 3 +-
.../runtime/DoFnRunnerWithKeyedInternals.java | 13 +-
.../beam/runners/samza/runtime/PortableDoFnOp.java | 3 +-
.../runners/samza/runtime/SamzaDoFnRunners.java | 7 +-
.../translation/batch/DoFnRunnerFactory.java | 4 +-
.../translation/batch/DoFnRunnerWithMetrics.java | 14 +-
.../spark/translation/AbstractInOutIterator.java | 3 +-
.../spark/translation/DoFnRunnerWithMetrics.java | 14 +-
.../translation/AbstractInOutIteratorTest.java | 9 +-
.../translation/SparkInputDataProcessorTest.java | 4 +-
sdks/go.mod | 26 +--
sdks/go.sum | 56 ++---
.../java/org/apache/beam/sdk/transforms/DoFn.java | 7 +
.../org/apache/beam/sdk/transforms/DoFnTester.java | 6 +
.../construction/SplittableParDoNaiveBounded.java | 6 +
.../apache/beam/sdk/util/construction/Timer.java | 29 ++-
.../beam/sdk/util/construction/TimerTest.java | 28 ++-
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 29 ++-
.../beam/fn/harness/FnApiDoFnRunnerTest.java | 4 +-
...plittablePairWithRestrictionDoFnRunnerTest.java | 4 +-
.../harness/control/ProcessBundleHandlerTest.java | 13 +-
.../harness/logging/BeamFnLoggingClientTest.java | 2 +-
sdks/java/io/debezium/src/README.md | 7 +-
.../org/apache/beam/io/debezium/DebeziumIO.java | 28 +--
.../beam/io/debezium/KafkaSourceConsumerFn.java | 151 ++++++-------
.../io/debezium/KafkaSourceConsumerFnTest.java | 89 +++++++-
.../apache/beam/io/debezium/OffsetTrackerTest.java | 25 +--
.../io/gcp/bigtable/BigtableServiceFactory.java | 13 --
sdks/python/apache_beam/coders/coder_impl.py | 6 -
.../transforms/aggregation/groupby_attr.py | 13 +-
.../transforms/aggregation/groupby_attr_expr.py | 10 +-
.../transforms/aggregation/groupby_expr.py | 5 +-
.../aggregation/groupby_expr_aggregate.py | 10 +-
.../aggregation/groupby_global_aggregate.py | 6 +-
.../aggregation/groupby_simple_aggregate.py | 5 +-
.../transforms/aggregation/groupby_test.py | 20 +-
.../transforms/aggregation/groupby_two_exprs.py | 9 +-
.../internal/cloudpickle/cloudpickle.py | 23 +-
sdks/python/apache_beam/metrics/metric.py | 30 ++-
sdks/python/apache_beam/ml/inference/base.py | 17 ++
sdks/python/apache_beam/ml/inference/base_test.py | 39 ++++
.../apache_beam/ml/inference/model_manager.py | 28 +++
.../apache_beam/ml/inference/model_manager_test.py | 65 ++++++
.../external_transform_provider_it_test.py | 12 +-
sdks/python/apache_beam/transforms/util.py | 60 +++++-
sdks/python/apache_beam/transforms/util_test.py | 233 +++++++++++++++++++++
.../yaml/examples/testing/examples_test.py | 3 +-
.../examples/transforms/io/bigquery_write.yaml | 59 ++++++
sdks/python/build.gradle | 3 +-
sdks/python/gen_xlang_wrappers.py | 6 +-
sdks/python/pyrefly.toml | 62 ++++++
sdks/python/setup.py | 26 ++-
sdks/python/test-suites/portable/common.gradle | 37 ++--
.../site/content/en/documentation/io/connectors.md | 140 +++++++++++--
.../www/site/content/en/documentation/sdks/yaml.md | 6 +-
108 files changed, 1619 insertions(+), 532 deletions(-)
create mode 100755 examples/terraform/envoy-ratelimiter/deploy.sh
create mode 100644
sdks/python/apache_beam/yaml/examples/transforms/io/bigquery_write.yaml
create mode 100644 sdks/python/pyrefly.toml
