This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 82a9be5709d added test_accessing_valueprovider_info_after_run to test
accessing_valueprovider_info_after_run (#34315)
add 41cac5956e0 Fix Precommit SQL (#34320)
add b8505511d9b Fix PostCommit Python ValidatesContainer with RC workflow
(#34332)
add 1bf14ad0745 Bump golang.org/x/net from 0.35.0 to 0.37.0 in /sdks
(#34328)
add df5dd4e0b87 Update roadmap page 28342 (#34330)
add e71fdce4d69 [KafkaIO] Fix average record size data race and backlog
estimation (#34165)
add f8a6783add0 Expose add-modules JVM option in SDKHarnessOptions (#34289)
add 99eee0f1e68 [AnomalyDetection] Refactor and improve Specifiable
(#34310)
add 9340965ce33 Bump golang.org/x/oauth2 from 0.26.0 to 0.28.0 in /sdks
(#34190)
add 42b15a1aa58 Support directory separator for Python local filesystem
(#34318)
add 5a8964c0d34 Bump github.com/nats-io/nats.go from 1.39.0 to 1.39.1 in
/sdks (#34029)
add e8d05a6f6bf Make yaml provider an abstract class.
add 5128a608fbc Add support for python package dependencies on UDFs.
add 99b340f57a0 Add dependency support for delegating providers.
add e4030417033 Allow dependency declarations for java.
add 18f237eeb18 Make yapf, lint, and mypy happy, fix test.
add e0b9d03038a Merge pull request #34073 Allow declaration of external
dependencies for YAML UDFs.
add 38281489a03 [AnomalyDetection] Support offline detectors (#34311)
add be19d132c56 add option to disable metrics (#34303)
No new revisions were added by this update.
Summary of changes:
..._Python_ValidatesContainer_Dataflow_With_RC.yml | 2 +
CHANGES.md | 3 +-
build.gradle.kts | 1 +
sdks/go.mod | 18 +-
sdks/go.sum | 32 +--
sdks/java/container/boot.go | 8 +-
.../apache/beam/sdk/options/SdkHarnessOptions.java | 19 +-
sdks/java/io/kafka/build.gradle | 5 +-
.../build.gradle => io/kafka/jmh/build.gradle.kts} | 19 +-
.../sdk/io/kafka/jmh/KafkaIOUtilsBenchmark.java | 235 +++++++++++++++++++++
.../beam/sdk/io/kafka/jmh}/package-info.java | 4 +-
.../beam/sdk/io/kafka/KafkaIOInitializer.java | 5 +-
.../org/apache/beam/sdk/io/kafka/KafkaIOUtils.java | 43 +++-
.../beam/sdk/io/kafka/KafkaUnboundedReader.java | 20 +-
.../beam/sdk/io/kafka/ReadFromKafkaDoFn.java | 94 +++------
sdks/python/apache_beam/io/textio.py | 3 +
sdks/python/apache_beam/io/textio_test.py | 18 ++
sdks/python/apache_beam/ml/anomaly/base.py | 4 +-
.../apache_beam/ml/anomaly/detectors/offline.py | 59 ++++++
sdks/python/apache_beam/ml/anomaly/specifiable.py | 175 ++++++++++-----
.../apache_beam/ml/anomaly/specifiable_test.py | 54 ++++-
sdks/python/apache_beam/ml/anomaly/transforms.py | 98 ++++++++-
.../apache_beam/ml/anomaly/transforms_test.py | 197 +++++++++++++++++
.../python/apache_beam/options/pipeline_options.py | 14 +-
.../runners/portability/expansion_service_main.py | 2 +-
.../portability/fn_api_runner/worker_handlers.py | 1 +
sdks/python/apache_beam/utils/subprocess_server.py | 35 ++-
.../yaml/examples/testing/examples_test.py | 27 +++
...rce_hints.yaml => map_to_fields_with_deps.yaml} | 39 ++--
.../elementwise/map_to_fields_with_java_deps.yaml | 57 +++++
.../apache_beam/yaml/yaml_enrichment_test.py | 3 +
sdks/python/apache_beam/yaml/yaml_mapping.py | 5 +-
sdks/python/apache_beam/yaml/yaml_provider.py | 99 ++++++++-
sdks/python/apache_beam/yaml/yaml_transform.py | 14 ++
sdks/python/setup.py | 4 +-
settings.gradle.kts | 1 +
website/www/site/content/en/roadmap/_index.md | 14 +-
website/www/site/content/en/roadmap/python-sdk.md | 6 +-
38 files changed, 1177 insertions(+), 260 deletions(-)
copy sdks/java/{container/java17/build.gradle =>
io/kafka/jmh/build.gradle.kts} (64%)
create mode 100644
sdks/java/io/kafka/jmh/src/main/java/org/apache/beam/sdk/io/kafka/jmh/KafkaIOUtilsBenchmark.java
copy sdks/java/{core/jmh/src/main/java/org/apache/beam/sdk/jmh/io =>
io/kafka/jmh/src/main/java/org/apache/beam/sdk/io/kafka/jmh}/package-info.java
(91%)
create mode 100644 sdks/python/apache_beam/ml/anomaly/detectors/offline.py
copy
sdks/python/apache_beam/yaml/examples/transforms/elementwise/{map_to_fields_with_resource_hints.yaml
=> map_to_fields_with_deps.yaml} (60%)
create mode 100644
sdks/python/apache_beam/yaml/examples/transforms/elementwise/map_to_fields_with_java_deps.yaml
