This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/go_modules/sdks/github.com/nats-io/nats.go-1.42.0
in repository https://gitbox.apache.org/repos/asf/beam.git
discard 2d041c60ef2 Bump github.com/nats-io/nats.go from 1.41.2 to 1.42.0 in
/sdks
add 7f1e14bb909 Use checkerframework Nullable/NonNull (#34851)
add 1398655862d Revert "Bump @octokit/request and @octokit/rest in
/scripts/ci/issue-report (…" (#34857)
add 1e010b3f3b9 Fix Tour of Beam Go Integration tests (#34854)
add 4c213e5a796 Update breaking changes with PaneInfoCoder change. (#34865)
add 91b09c8c763 Add label when PR gets reassigned (#34866)
add db3b8332770 Fix checkstyle rule for guava within vendored grpc
add a23cc4dce18 Improve clarity of PTransformRunnerFactory in Java SDK
harness
add e1804030702 Merge pull request #34846: Improve clarity of
PTransformRunnerFactory in Java SDK harness
add b3636fab625 fix: correct spanner column schema type parser (#34867)
add f935ec7962a Add yapf version upgrade doc to discussion-docs for 2025
(#34871)
add e543c6b33e7 Fix github client variable (#34877)
add 6261411d199 reorder opt-out review comment (#34872)
add 399ae726a54 [IcebergIO] Support column pruning (#34856)
add 35c1e32e3a1 Replace deprecated model version. (#34875)
add 93ec4e09663 Bump google.golang.org/api from 0.231.0 to 0.232.0 in
/sdks (#34876)
add cbf57c4c608 [AnomalyDetection] Add a notebook for using iforest for
anomaly detection (#34845)
add c72b351275d [AnomalyDetection] Add a notebook for anomaly detection
with Z-Score (#34459)
add deeb4c45049 Streamline non-cached state backed iterable.
add 6b8ef134636 Address reviewer comments.
add 877f1112d2c Remove tests wrongly asserting that reiteration is still
cached.
add 5b862dd510b Merge pull request #34746 Streamline non-cached state
backed iterable.
add 1caa1c23120 [AnomalyDetection] Update notebook. (#34884)
add d799c958af1 Reference managed-io page in our docs (#34882)
add 4a349769854 yapf 0.43.0 migration (#34801)
add d7fdefe20af Fix typecoders_test.py formatting (#34889)
add cccf870ad24 Add empty outputs to notebooks which can't run without
help (#34895)
add b7d1e068d0c Remove type suppressions from MetricsPusher and MetricsSink
add ee22eacf669 Merge pull request #33918: Remove type suppressions from
MetricsPusher and MetricsSink
add 4f5b78f5ccb Update Iceberg table field documentation (#34847)
add dc874bd5b9e Add PyTorch DistilBERT Sentiment Analysis Batch/Streaming
pipelines for ML Benchmarks (#34577)
add b6038e6ce41 Correcting regex for _PROJECT_PATTERN for bigquery table
name (resolves #32611) (#34898)
add 3a967752fdd Enable certain Beam module compile with newer Java version
(#34858)
add d15a1639fbe Revert "Unpin Dataflow legacy worker container for Nexmark
test (#33224)" (#34804)
add 4c59b6a736d Add cloudpickle default to changes.md. (#34904)
add d427d3731e4 Revert "Correcting regex for _PROJECT_PATTERN for bigquery
table name (resolv…" (#34901)
add 1f31eb0a04d use blob.exists to check the GCS file (#34818)
add c2c9275c680 [Python] Added the validate support for
ReadAllFromBigQuery (#34910)
add e7cdee37bb3 [Dataflow Streaming] Remove unused quota throttling
metrics from windmill streams (#34891)
add 63242c9413a [Java SDK] Added cache for AvroCoder
DatumReader/DatumWriter to reduce memory footprint (#34873)
add 23dc4470592 [Dataflow] Fix flaky BoundedQueueExecutor test (#34878)
add 28df7cb27f6 [AnomalyDetection] Support unkeyed input for the
transform. (#34897)
add 0c92ee9343d Adding release-2.65.0-postrelease to protected branches in
.asf.yaml
add 0ddfb14c9f1 Update Beam website to release 2.65.0 (#34821)
add 92050fb6048 Prevent ValueError when passing resource_hints in
StandardOptions (#34886)
add c68bab4c5a4 Specify pip version for ML and Transformers tests (#34917)
add 61ad7e10ca3 Fix minor issues in various PTransformRunner classes
add e27c927c009 Merge pull request #34881: Fix minor issues in various
PTransformRunner classes
add fac8b31f160 ✨ Upgrade sidepanel extension to JupyterLab 4.x
compatibility (#34495)
add 5b0df88b36b Bump golang.org/x/text from 0.24.0 to 0.25.0 in /sdks
(#34853)
add daf12fc2562 Add empty outputs. (#34923)
add a38cb8a50f0 Fix for emojis rendering issue for yaml examples (resolves
#34770)
add 3ef32bbe61c Merge pull request #34795 Fix charset declaration for docs.
add 63193feed46 Fix empty outputs. (#34927)
add f6d209ff6a3 Update trivial inference for Python 3.13 (#34870)
add 7abb297e8db fix linting (#34935)
add 6996738f640 Update setup.py (#34932)
add a9559e924e4 check the audit key exists before adding it (#34922)
add 5c289665e6a [IcebergIO] Support filter pushdown during reads (#34827)
add 0e212782d02 Update republish_released_docker_containers.yml (#34936)
add 41d70211c81 Refactor: separate PairWithRestriction from FnApiDoFnRunner
add f258f0cb11f Merge pull request #34883: Refactor: separate
PairWithRestriction from FnApiDoFnRunner
add ee72f5e1849 Allow psycopg2 2.9.10 (#34893)
add 51f77637c9c Add 2.63 breaking incompatibility to CHANGES.md (#34931)
add 25525b4d276 Bump golang.org/x/net from 0.39.0 to 0.40.0 in /sdks
(#34885)
add 046b1b25787 Bump github.com/testcontainers/testcontainers-go in /sdks
(#34815)
add 936b42bc3f5 Bump github.com/nats-io/nats.go from 1.41.2 to 1.42.0 in
/sdks
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (2d041c60ef2)
\
N -- N -- N
refs/heads/dependabot/go_modules/sdks/github.com/nats-io/nats.go-1.42.0
(936b42bc3f5)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 1 +
.../arc/images/Dockerfile | 8 +-
.../IO_Iceberg_Integration_Tests_Dataflow.json | 2 +-
.../beam_PostCommit_Java_Nexmark_Dataflow.json | 2 +-
.../beam_Inference_Python_Benchmarks_Dataflow.yml | 24 +
...ch_Sentiment_Batch_DistilBert_Base_Uncased.txt} | 15 +-
...entiment_Streaming_DistilBert_Base_Uncased.txt} | 15 +-
.../republish_released_docker_containers.yml | 2 +-
.../workflows/tour_of_beam_backend_integration.yml | 2 +
.pre-commit-config.yaml | 4 +-
.test-infra/tools/refresh_looker_metrics.py | 2 +
CHANGES.md | 14 +-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 135 +++-
contributor-docs/discussion-docs/2025.md | 1 +
.../alloydb_product_catalog_embeddings.ipynb | 116 +--
.../anomaly_detection_iforest.ipynb | 650 +++++++++++++++++
.../anomaly_detection_zscore.ipynb | 779 +++++++++++++++++++++
.../beam-ml/bigquery_enrichment_transform.ipynb | 42 +-
.../bigquery_vector_ingestion_and_search.ipynb | 74 +-
.../gemma_2_sentiment_and_summarization.ipynb | 16 +-
.../notebooks/beam-ml/run_inference_vllm.ipynb | 30 +-
.../emulators/firebase/Dockerfile | 2 +-
.../beam/runners/core/metrics/MetricsPusher.java | 5 +-
.../core/metrics/SimpleMonitoringInfoBuilder.java | 6 +
.../extensions/metrics/MetricsGraphiteSink.java | 7 +-
.../extensions/metrics/MetricsHttpSink.java | 27 +-
.../dataflow/worker/DataflowSystemMetrics.java | 1 -
.../dataflow/worker/StreamingDataflowWorker.java | 77 +-
.../FanOutStreamingEngineWorkerHarness.java | 19 +-
.../harness/SingleSourceWorkerHarness.java | 13 +-
.../streaming/harness/StreamingCounters.java | 4 -
.../streaming/harness/StreamingWorkerHarness.java | 3 +-
.../harness/StreamingWorkerStatusReporter.java | 10 -
.../streaming/harness/WindmillStreamSender.java | 16 +-
.../worker/windmill/WindmillServerBase.java | 6 -
.../worker/windmill/WindmillServerStub.java | 3 -
.../windmill/client/AbstractWindmillStream.java | 12 -
.../windmill/client/grpc/GrpcCommitWorkStream.java | 13 -
.../client/grpc/GrpcDirectGetWorkStream.java | 12 -
.../windmill/client/grpc/GrpcGetDataStream.java | 12 -
.../windmill/client/grpc/GrpcGetWorkStream.java | 12 -
.../client/grpc/GrpcGetWorkerMetadataStream.java | 11 -
.../windmill/client/grpc/GrpcWindmillServer.java | 15 +-
.../client/grpc/GrpcWindmillStreamFactory.java | 23 +-
.../throttling/StreamingEngineThrottleTimers.java | 41 --
.../windmill/client/throttling/ThrottleTimer.java | 69 --
.../client/throttling/ThrottledTimeTracker.java | 32 -
.../dataflow/worker/FakeWindmillServer.java | 5 -
.../FanOutStreamingEngineWorkerHarnessTest.java | 14 +-
.../harness/SingleSourceWorkerHarnessTest.java | 2 -
.../harness/StreamingWorkerStatusReporterTest.java | 2 -
.../harness/WindmillStreamSenderTest.java | 32 +-
.../worker/util/BoundedQueueExecutorTest.java | 5 +-
.../client/AbstractWindmillStreamTest.java | 3 -
.../client/grpc/GrpcCommitWorkStreamTest.java | 5 +-
.../client/grpc/GrpcDirectGetWorkStreamTest.java | 38 +-
.../client/grpc/GrpcGetDataStreamTest.java | 5 +-
.../grpc/GrpcGetWorkerMetadataStreamTest.java | 2 -
.../client/grpc/GrpcWindmillServerTest.java | 116 ---
.../beam/runners/spark/SparkPipelineRunner.java | 4 +-
scripts/ci/issue-report/package-lock.json | 465 ++++++------
scripts/ci/issue-report/package.json | 2 +-
scripts/ci/pr-bot/findPrsNeedingAttention.ts | 6 +
scripts/ci/pr-bot/shared/commentStrings.ts | 5 +-
sdks/go.mod | 20 +-
sdks/go.sum | 44 +-
.../main/resources/beam/checkstyle/checkstyle.xml | 2 +-
sdks/java/container/agent/build.gradle | 47 +-
.../java/org/apache/beam/sdk/util/RowFilter.java | 22 +
.../beam/sdk/extensions/avro/coders/AvroCoder.java | 172 ++++-
.../extensions/avro/coders/AvroGenericCoder.java | 12 +-
.../sdk/extensions/avro/coders/AvroCoderTest.java | 92 +++
.../sdk/extensions/gcp/options/GcsOptions.java | 5 +-
.../sql/impl/LazyAggregateCombineFn.java | 2 +-
sdks/java/harness/build.gradle | 1 +
.../beam/fn/harness/BeamFnDataReadRunner.java | 55 +-
.../beam/fn/harness/BeamFnDataWriteRunner.java | 26 +-
.../org/apache/beam/fn/harness/CombineRunners.java | 45 +-
.../org/apache/beam/fn/harness/FlattenRunner.java | 18 +-
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 80 +--
.../org/apache/beam/fn/harness/MapFnRunners.java | 17 +-
.../beam/fn/harness/PTransformRunnerFactory.java | 11 +-
.../SplittablePairWithRestrictionDoFnRunner.java | 384 ++++++++++
.../fn/harness/control/ProcessBundleHandler.java | 336 +++++----
.../beam/fn/harness/state/StateBackedIterable.java | 4 +-
.../fn/harness/state/StateFetchingIterators.java | 92 +++
.../beam/fn/harness/AssignWindowsRunnerTest.java | 2 +-
.../beam/fn/harness/BeamFnDataReadRunnerTest.java | 6 +-
.../beam/fn/harness/BeamFnDataWriteRunnerTest.java | 2 +-
.../apache/beam/fn/harness/CombineRunnersTest.java | 10 +-
.../apache/beam/fn/harness/FlattenRunnerTest.java | 4 +-
.../beam/fn/harness/FnApiDoFnRunnerTest.java | 591 +---------------
.../apache/beam/fn/harness/MapFnRunnersTest.java | 6 +-
.../NonWindowObservingTestSplittableDoFn.java | 201 ++++++
.../PTransformRunnerFactoryTestContext.java | 5 +
...plittablePairWithRestrictionDoFnRunnerTest.java | 550 +++++++++++++++
.../harness/WindowObservingTestSplittableDoFn.java | 107 +++
.../harness/control/ProcessBundleHandlerTest.java | 114 ++-
.../fn/harness/state/StateBackedIterableTest.java | 70 --
.../beam/sdk/io/gcp/spanner/SpannerSchema.java | 6 +-
.../beam/sdk/io/gcp/firestore/RpcQosTest.java | 2 +-
.../gcp/firestore/it/FirestoreTestingHelper.java | 2 +-
.../beam/sdk/io/gcp/spanner/SpannerSchemaTest.java | 33 +-
sdks/java/io/iceberg/build.gradle | 5 +
.../beam/sdk/io/iceberg/CreateReadTasksDoFn.java | 11 +-
.../apache/beam/sdk/io/iceberg/FilterUtils.java | 283 ++++++++
.../IcebergCdcReadSchemaTransformProvider.java | 25 +-
.../org/apache/beam/sdk/io/iceberg/IcebergIO.java | 141 +---
.../IcebergReadSchemaTransformProvider.java | 25 +-
.../beam/sdk/io/iceberg/IcebergScanConfig.java | 71 ++
.../IcebergWriteSchemaTransformProvider.java | 4 +-
.../beam/sdk/io/iceberg/IncrementalScanSource.java | 2 +-
.../apache/beam/sdk/io/iceberg/ReadFromTasks.java | 10 +-
.../org/apache/beam/sdk/io/iceberg/ReadUtils.java | 20 +-
.../org/apache/beam/sdk/io/iceberg/ScanSource.java | 4 +-
.../apache/beam/sdk/io/iceberg/ScanTaskReader.java | 6 +-
.../apache/beam/sdk/io/iceberg/ScanTaskSource.java | 7 +-
.../beam/sdk/io/iceberg/FilterUtilsTest.java | 622 ++++++++++++++++
.../beam/sdk/io/iceberg/IcebergIOReadTest.java | 182 ++++-
.../apache/beam/sdk/io/iceberg/ReadUtilsTest.java | 3 +-
.../catalog/BigQueryMetastoreCatalogIT.java | 11 +-
.../sdk/io/iceberg/catalog/HadoopCatalogIT.java | 5 -
.../io/iceberg/catalog/IcebergCatalogBaseIT.java | 119 +++-
.../java/org/apache/beam/sdk/managed/Managed.java | 3 +-
sdks/java/testing/nexmark/build.gradle | 4 +
sdks/python/apache_beam/coders/coder_impl.py | 10 +-
sdks/python/apache_beam/coders/coders.py | 5 +-
.../coders/coders_property_based_test.py | 4 +-
.../apache_beam/coders/coders_test_common.py | 11 +-
sdks/python/apache_beam/coders/row_coder_test.py | 3 +-
.../apache_beam/coders/standard_coders_test.py | 91 +--
sdks/python/apache_beam/coders/typecoders_test.py | 7 +-
sdks/python/apache_beam/dataframe/convert.py | 10 +-
sdks/python/apache_beam/dataframe/doctests.py | 36 +-
sdks/python/apache_beam/dataframe/frames.py | 181 ++---
sdks/python/apache_beam/dataframe/frames_test.py | 105 ++-
sdks/python/apache_beam/dataframe/io.py | 20 +-
.../apache_beam/dataframe/pandas_doctests_test.py | 143 ++--
.../dataframe/pandas_top_level_functions.py | 11 +-
sdks/python/apache_beam/dataframe/transforms.py | 14 +-
.../apache_beam/dataframe/transforms_test.py | 6 +-
sdks/python/apache_beam/examples/avro_nyc_trips.py | 10 +-
.../inference/pytorch_language_modeling.py | 27 +-
.../examples/inference/pytorch_sentiment.py | 290 ++++++++
.../inference/xgboost_iris_classification.py | 4 +-
.../ml_transform/vocab_tfidf_processing.py | 3 +-
.../apache_beam/examples/snippets/snippets_test.py | 17 +-
.../aggregation/approximatequantiles_test.py | 3 +-
.../aggregation/approximateunique_test.py | 3 +-
.../combineperkey_side_inputs_singleton.py | 3 +-
.../combinevalues_side_inputs_singleton.py | 3 +-
.../snippets/transforms/aggregation/top_of.py | 7 +-
.../snippets/transforms/aggregation/top_per_key.py | 7 +-
.../elementwise/filter_side_inputs_dict.py | 3 +-
.../elementwise/filter_side_inputs_iter.py | 3 +-
.../elementwise/filter_side_inputs_singleton.py | 3 +-
.../elementwise/flatmap_side_inputs_singleton.py | 3 +-
.../snippets/transforms/elementwise/map_context.py | 5 +-
.../transforms/elementwise/map_side_inputs_iter.py | 3 +-
.../elementwise/map_side_inputs_singleton.py | 3 +-
.../elementwise/withtimestamps_event_time.py | 23 +-
.../examples/snippets/transforms/other/window.py | 48 +-
sdks/python/apache_beam/examples/sql_taxi.py | 15 +-
.../internal/cloudpickle/cloudpickle.py | 12 +-
sdks/python/apache_beam/internal/dill_pickler.py | 3 +-
sdks/python/apache_beam/internal/metrics/metric.py | 4 +-
sdks/python/apache_beam/internal/util.py | 7 +-
sdks/python/apache_beam/io/avroio.py | 9 +-
sdks/python/apache_beam/io/avroio_test.py | 4 +-
.../io/external/xlang_debeziumio_it_test.py | 4 +-
.../io/external/xlang_jdbcio_it_test.py | 8 +-
sdks/python/apache_beam/io/filebasedsink.py | 8 +-
sdks/python/apache_beam/io/fileio.py | 13 +-
sdks/python/apache_beam/io/fileio_test.py | 8 +-
sdks/python/apache_beam/io/filesystem_test.py | 7 +-
sdks/python/apache_beam/io/gcp/bigquery.py | 44 +-
.../apache_beam/io/gcp/bigquery_file_loads.py | 6 +-
.../apache_beam/io/gcp/bigquery_file_loads_test.py | 17 +-
.../apache_beam/io/gcp/bigquery_read_internal.py | 7 +-
sdks/python/apache_beam/io/gcp/bigquery_test.py | 69 +-
sdks/python/apache_beam/io/gcp/bigquery_tools.py | 4 +-
.../apache_beam/io/gcp/bigquery_tools_test.py | 10 +-
.../apache_beam/io/gcp/bigquery_write_it_test.py | 6 +-
.../apache_beam/io/gcp/experimental/spannerio.py | 35 +-
.../apache_beam/io/gcp/gcsfilesystem_test.py | 6 +-
sdks/python/apache_beam/io/gcp/gcsio.py | 9 +-
sdks/python/apache_beam/io/gcp/gcsio_test.py | 5 +-
sdks/python/apache_beam/io/gcp/pubsub_test.py | 6 +-
.../apache_beam/io/gcp/tests/bigquery_matcher.py | 8 +-
sdks/python/apache_beam/io/gcp/tests/utils_test.py | 9 +-
sdks/python/apache_beam/io/localfilesystem_test.py | 4 +-
sdks/python/apache_beam/io/mongodbio.py | 12 +-
sdks/python/apache_beam/io/mongodbio_test.py | 7 +-
sdks/python/apache_beam/io/range_trackers.py | 6 +-
sdks/python/apache_beam/io/source_test_utils.py | 8 +-
sdks/python/apache_beam/metrics/cells.py | 3 +-
sdks/python/apache_beam/metrics/cells_test.py | 3 +-
sdks/python/apache_beam/metrics/execution.py | 22 +-
.../python/apache_beam/metrics/monitoring_infos.py | 3 +-
sdks/python/apache_beam/ml/anomaly/specifiable.py | 3 +-
.../apache_beam/ml/anomaly/specifiable_test.py | 3 +-
sdks/python/apache_beam/ml/anomaly/transforms.py | 156 +++--
.../apache_beam/ml/anomaly/transforms_test.py | 308 ++++----
sdks/python/apache_beam/ml/inference/base_test.py | 10 +-
.../ml/inference/huggingface_inference.py | 19 +-
.../ml/inference/huggingface_inference_test.py | 6 +-
.../ml/inference/onnx_inference_test.py | 69 +-
.../ml/inference/pytorch_inference_it_test.py | 4 +-
.../ml/inference/pytorch_inference_test.py | 80 +--
.../ml/inference/sklearn_inference_test.py | 4 +-
.../ml/inference/tensorflow_inference_test.py | 33 +-
.../ml/inference/tensorrt_inference_test.py | 24 +-
sdks/python/apache_beam/ml/inference/utils.py | 4 +-
.../ml/rag/embeddings/vertex_ai_test.py | 2 +-
.../enrichment/bigquery_vector_search_it_test.py | 16 +-
.../ml/rag/ingestion/alloydb_it_test.py | 32 +-
.../apache_beam/ml/rag/ingestion/bigquery.py | 11 +-
.../ml/rag/ingestion/bigquery_it_test.py | 3 +-
sdks/python/apache_beam/ml/transforms/base.py | 4 +-
sdks/python/apache_beam/ml/transforms/base_test.py | 15 +-
.../ml/transforms/embeddings/huggingface.py | 4 +-
.../ml/transforms/embeddings/vertex_ai_test.py | 8 +-
sdks/python/apache_beam/ml/transforms/tft_test.py | 18 +-
.../python/apache_beam/options/pipeline_options.py | 11 +-
.../options/pipeline_options_validator.py | 4 +-
sdks/python/apache_beam/pipeline.py | 26 +-
sdks/python/apache_beam/pipeline_test.py | 18 +-
sdks/python/apache_beam/pvalue.py | 13 +-
sdks/python/apache_beam/runners/common.py | 211 +++---
sdks/python/apache_beam/runners/common_test.py | 5 +-
.../apache_beam/runners/dask/dask_runner_test.py | 9 +-
.../dataflow/dataflow_exercise_metrics_pipeline.py | 10 +-
.../runners/dataflow/dataflow_job_service.py | 3 +-
.../runners/dataflow/dataflow_metrics.py | 4 +-
.../runners/dataflow/dataflow_metrics_test.py | 10 +-
.../runners/dataflow/dataflow_runner.py | 4 +-
.../runners/dataflow/dataflow_runner_test.py | 4 +-
.../runners/dataflow/internal/apiclient.py | 16 +-
.../clients/cloudbuild/cloudbuild_v1_client.py | 168 ++---
.../consumer_tracking_pipeline_visitor_test.py | 6 +-
.../apache_beam/runners/direct/direct_metrics.py | 20 +-
.../runners/direct/evaluation_context.py | 4 +-
.../runners/direct/transform_evaluator.py | 3 +-
.../interactive/background_caching_job_test.py | 24 +-
.../runners/interactive/cache_manager.py | 11 +-
.../runners/interactive/caching/read_cache.py | 4 +-
.../runners/interactive/caching/write_cache.py | 17 +-
.../apache-beam-jupyterlab-sidepanel/README.md | 3 +-
.../jest.config.js | 4 +-
.../jest.setup.js} | 17 +-
.../apache-beam-jupyterlab-sidepanel/package.json | 69 +-
.../src/SidePanel.ts | 9 +-
.../src/__tests__/clusters/Clusters.test.tsx | 85 ++-
.../src/__tests__/common/HtmlView.test.tsx | 89 ++-
.../__tests__/inspector/InspectableList.test.tsx | 54 +-
.../inspector/InspectableListItem.test.tsx | 44 +-
.../__tests__/inspector/InspectableView.test.tsx | 68 +-
.../src/__tests__/inspector/Inspectables.test.tsx | 69 +-
.../inspector/InteractiveInspector.test.tsx | 107 +--
.../kernel/InterruptKernelButton.test.tsx | 91 ++-
.../src/clusters/Clusters.tsx | 14 +-
.../src/common/HtmlView.tsx | 2 +-
.../src/inspector/InspectableList.tsx | 2 +-
.../src/inspector/InspectableListItem.tsx | 2 +-
.../src/inspector/InspectableView.tsx | 10 +-
.../src/inspector/Inspectables.tsx | 4 +-
.../src/inspector/InteractiveInspector.tsx | 2 +-
.../src/kernel/InterruptKernelButton.tsx | 2 +-
.../runners/interactive/interactive_environment.py | 3 +-
.../runners/interactive/pipeline_instrument.py | 14 +-
.../runners/interactive/recording_manager.py | 11 +-
.../interactive/sql/beam_sql_magics_test.py | 24 +-
.../runners/interactive/sql/sql_chain.py | 3 +-
.../apache_beam/runners/interactive/sql/utils.py | 4 +-
sdks/python/apache_beam/runners/pipeline_utils.py | 11 +-
.../runners/portability/abstract_job_service.py | 12 +-
.../runners/portability/artifact_service.py | 3 +-
.../runners/portability/expansion_service.py | 15 +-
.../runners/portability/flink_runner_test.py | 4 +-
.../runners/portability/fn_api_runner/execution.py | 7 +-
.../runners/portability/fn_api_runner/fn_runner.py | 28 +-
.../portability/fn_api_runner/fn_runner_test.py | 49 +-
.../portability/fn_api_runner/translations.py | 41 +-
.../portability/fn_api_runner/translations_test.py | 4 +-
.../fn_api_runner/trigger_manager_test.py | 12 +-
.../portability/fn_api_runner/worker_handlers.py | 155 ++--
.../runners/portability/local_job_service.py | 12 +-
.../runners/portability/portable_runner.py | 3 +-
.../runners/portability/prism_runner.py | 4 +-
.../runners/portability/prism_runner_test.py | 8 +-
.../apache_beam/runners/portability/stager.py | 4 +-
sdks/python/apache_beam/runners/render.py | 5 +-
sdks/python/apache_beam/runners/trivial_runner.py | 8 +-
.../apache_beam/runners/worker/bundle_processor.py | 28 +-
.../apache_beam/runners/worker/data_plane.py | 5 +-
.../apache_beam/runners/worker/data_sampler.py | 8 +-
.../apache_beam/runners/worker/log_handler.py | 4 +-
.../apache_beam/runners/worker/log_handler_test.py | 3 +-
.../apache_beam/runners/worker/opcounters.py | 15 +-
.../apache_beam/runners/worker/operation_specs.py | 23 +-
.../apache_beam/runners/worker/operations.py | 112 +--
.../apache_beam/runners/worker/sdk_worker.py | 16 +-
.../apache_beam/runners/worker/sdk_worker_main.py | 3 +-
.../runners/worker/sdk_worker_main_test.py | 8 +-
.../apache_beam/runners/worker/sdk_worker_test.py | 55 +-
.../apache_beam/runners/worker/statecache_test.py | 31 +-
.../apache_beam/runners/worker/worker_status.py | 4 +-
.../apache_beam/testing/analyzers/perf_analysis.py | 4 +-
.../benchmarks/cloudml/pipelines/workflow.py | 3 +-
...nchmarks.py => pytorch_sentiment_benchmarks.py} | 14 +-
.../testing/benchmarks/nexmark/queries/query1.py | 5 +-
.../testing/benchmarks/nexmark/queries/query3.py | 6 +-
.../apache_beam/testing/datatype_inference.py | 13 +-
.../apache_beam/testing/datatype_inference_test.py | 4 +-
.../testing/load_tests/load_test_metrics_utils.py | 7 +-
.../apache_beam/testing/synthetic_pipeline.py | 3 +-
.../apache_beam/transforms/batch_dofn_test.py | 3 +-
sdks/python/apache_beam/transforms/combiners.py | 21 +-
sdks/python/apache_beam/transforms/core.py | 58 +-
sdks/python/apache_beam/transforms/display.py | 3 +-
sdks/python/apache_beam/transforms/environments.py | 81 ++-
sdks/python/apache_beam/transforms/external.py | 30 +-
.../fully_qualified_named_transform_test.py | 13 +-
sdks/python/apache_beam/transforms/managed.py | 14 +-
sdks/python/apache_beam/transforms/ptransform.py | 34 +-
.../apache_beam/transforms/ptransform_test.py | 45 +-
sdks/python/apache_beam/transforms/resources.py | 4 +
.../apache_beam/transforms/resources_test.py | 23 +
.../apache_beam/transforms/sideinputs_test.py | 32 +-
sdks/python/apache_beam/transforms/sql_test.py | 4 +-
sdks/python/apache_beam/transforms/trigger.py | 7 +-
sdks/python/apache_beam/transforms/trigger_test.py | 98 +--
sdks/python/apache_beam/transforms/util.py | 8 +-
sdks/python/apache_beam/transforms/util_test.py | 203 +++---
sdks/python/apache_beam/transforms/window.py | 5 +-
.../typehints/arrow_type_compatibility.py | 19 +-
.../typehints/arrow_type_compatibility_test.py | 39 +-
sdks/python/apache_beam/typehints/batch.py | 3 +-
sdks/python/apache_beam/typehints/decorators.py | 13 +-
sdks/python/apache_beam/typehints/opcodes.py | 74 +-
.../typehints/pandas_type_compatibility.py | 9 +-
.../typehints/pandas_type_compatibility_test.py | 26 +-
.../typehints/pytorch_type_compatibility.py | 3 +-
sdks/python/apache_beam/typehints/row_type.py | 3 +-
sdks/python/apache_beam/typehints/schemas_test.py | 22 +-
.../apache_beam/typehints/trivial_inference.py | 68 +-
.../typehints/trivial_inference_test.py | 89 +--
sdks/python/apache_beam/typehints/typehints.py | 4 +-
sdks/python/apache_beam/utils/urns.py | 6 +-
.../yaml/examples/testing/examples_test.py | 3 +-
sdks/python/apache_beam/yaml/generate_yaml_docs.py | 4 +-
sdks/python/apache_beam/yaml/json_utils.py | 6 +-
sdks/python/apache_beam/yaml/readme_test.py | 8 +-
sdks/python/apache_beam/yaml/yaml_io.py | 8 +-
sdks/python/apache_beam/yaml/yaml_io_test.py | 7 +-
sdks/python/apache_beam/yaml/yaml_join_test.py | 4 +-
sdks/python/apache_beam/yaml/yaml_mapping.py | 7 +-
sdks/python/apache_beam/yaml/yaml_provider.py | 26 +-
.../apache_beam/yaml/yaml_provider_unit_test.py | 18 +-
sdks/python/apache_beam/yaml/yaml_testing.py | 3 +-
sdks/python/apache_beam/yaml/yaml_transform.py | 9 +-
.../python/apache_beam/yaml/yaml_transform_test.py | 13 +-
sdks/python/apache_beam/yaml/yaml_udf_test.py | 8 +-
sdks/python/apache_beam/yaml/yaml_utils.py | 4 +-
sdks/python/gen_managed_doc.py | 12 +
sdks/python/pyproject.toml | 2 +-
sdks/python/setup.cfg | 2 +
sdks/python/setup.py | 43 +-
sdks/python/tox.ini | 10 +-
website/www/site/config.toml | 2 +-
website/www/site/content/en/blog/beam-2.65.0.md | 88 +++
.../site/content/en/documentation/io/managed-io.md | 86 ++-
.../www/site/content/en/get-started/downloads.md | 8 +
website/www/site/content/en/performance/_index.md | 9 +-
.../en/performance/pytorchbertbase/_index.md | 6 +
.../en/performance/pytorchbertlarge/_index.md | 6 +
.../_index.md | 16 +-
.../_index.md | 16 +-
.../en/performance/pytorchresnet101/_index.md | 6 +
.../en/performance/pytorchresnet152/_index.md | 6 +
.../en/performance/pytorchresnet152tesla/_index.md | 6 +
.../en/performance/tensorflowmnist/_index.md | 9 +-
website/www/site/data/performance.yaml | 32 +
383 files changed, 8867 insertions(+), 5092 deletions(-)
copy
.github/workflows/load-tests-pipeline-options/{beam_Inference_Python_Benchmarks_Dataflow_Pytorch_Language_Modeling_Bert_Base_Uncased.txt
=>
beam_Inference_Python_Benchmarks_Dataflow_Pytorch_Sentiment_Batch_DistilBert_Base_Uncased.txt}
(75%)
copy
.github/workflows/load-tests-pipeline-options/{beam_Inference_Python_Benchmarks_Dataflow_Pytorch_Language_Modeling_Bert_Base_Uncased.txt
=>
beam_Inference_Python_Benchmarks_Dataflow_Pytorch_Sentiment_Streaming_DistilBert_Base_Uncased.txt}
(76%)
create mode 100644
examples/notebooks/beam-ml/anomaly_detection/anomaly_detection_iforest.ipynb
create mode 100644
examples/notebooks/beam-ml/anomaly_detection/anomaly_detection_zscore.ipynb
delete mode 100644
runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/windmill/client/throttling/StreamingEngineThrottleTimers.java
delete mode 100644
runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/windmill/client/throttling/ThrottleTimer.java
delete mode 100644
runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/windmill/client/throttling/ThrottledTimeTracker.java
create mode 100644
sdks/java/harness/src/main/java/org/apache/beam/fn/harness/SplittablePairWithRestrictionDoFnRunner.java
create mode 100644
sdks/java/harness/src/test/java/org/apache/beam/fn/harness/NonWindowObservingTestSplittableDoFn.java
create mode 100644
sdks/java/harness/src/test/java/org/apache/beam/fn/harness/SplittablePairWithRestrictionDoFnRunnerTest.java
create mode 100644
sdks/java/harness/src/test/java/org/apache/beam/fn/harness/WindowObservingTestSplittableDoFn.java
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/FilterUtils.java
create mode 100644
sdks/java/io/iceberg/src/test/java/org/apache/beam/sdk/io/iceberg/FilterUtilsTest.java
create mode 100644
sdks/python/apache_beam/examples/inference/pytorch_sentiment.py
copy
sdks/{java/core/src/main/java/org/apache/beam/sdk/testing/UsesSdkHarnessEnvironment.java
=>
python/apache_beam/runners/interactive/extensions/apache-beam-jupyterlab-sidepanel/jest.setup.js}
(76%)
copy
sdks/python/apache_beam/testing/benchmarks/inference/{pytorch_language_modeling_benchmarks.py
=> pytorch_sentiment_benchmarks.py} (75%)
create mode 100644 website/www/site/content/en/blog/beam-2.65.0.md
copy website/www/site/content/en/performance/{pytorchbertbase =>
pytorchbertsentimentbatch}/_index.md (52%)
copy website/www/site/content/en/performance/{pytorchbertbase =>
pytorchbertsentimentstreaming}/_index.md (51%)
