This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 7ff25d89625 [YAML] Allow windowing to be done in Java or Python.
(#30055)
add b22fe9287b0 [YAML] LogForTesting improvements. (#30005)
add 0eefb797765 [YAML] Expose flatten implementation from Java. (#30057)
add 8f3887bb512 [YAML] Require numStreams for unbounded
BigQueryStorageWriteApiSchemaTransform xlang transform
add 11646ca7da2 Merge pull request #30059 [YAML] Require numStreams for
unbounded BigQueryStorageWrite
add 582d5c03569 fix for #30078 (#30079)
add 98a86b11cc7 [MLTransform]Throw an error when specifiend columns are
not present in the input data (#30085)
add f7da756ac6d Update container build version to Go 1.21.6 (#30090)
add e85d070a32b Ignore DicomMetadataRead tests (#30096)
add 27214149d34 Support dynamic destinations with Python Storage API
(#30045)
add 674fe77df47 [Python] Add an option to retain timestamp returned from
the BigTable row (#30088)
add e3f45249620 Moving to 2.55.0-SNAPSHOT on master branch.
add d759f970139 Add StreamingStepMetricsContainer::extractPerWorkerMetrics
method. (#30089)
add d62ae0144cc Add section for 2.55.0, cleanup 2.54.0 due to cut. (#30101)
add 61a62e19c4a rename ExternalSchemaTransform to ExternalTransform
(#30102)
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 1 +
.../beam_PostCommit_Python_Xlang_Gcp_Dataflow.json | 0
.../beam_PostCommit_Python_Xlang_Gcp_Direct.json | 1 +
CHANGES.md | 45 +++-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 3 +-
gradle.properties | 4 +-
.../worker/StreamingStepMetricsContainer.java | 128 ++++++++-
.../worker/StreamingStepMetricsContainerTest.java | 159 +++++++++++
sdks/go/pkg/beam/core/core.go | 2 +-
.../providers/FlattenTransformProvider.java} | 69 ++---
...Provider.java => LoggingTransformProvider.java} | 145 +++++-----
...ueryStorageWriteApiSchemaTransformProvider.java | 67 ++++-
.../apache/beam/sdk/io/gcp/pubsub/PubsubIO.java | 2 +
...StorageWriteApiSchemaTransformProviderTest.java | 54 +++-
.../beam/sdk/io/gcp/healthcare/DicomIOReadIT.java | 3 +
.../io/external/xlang_bigqueryio_it_test.py | 77 +++++-
sdks/python/apache_beam/io/gcp/bigquery.py | 293 ++++++++++++---------
sdks/python/apache_beam/ml/transforms/base.py | 13 +
sdks/python/apache_beam/ml/transforms/base_test.py | 47 +++-
.../transforms/enrichment_handlers/bigtable.py | 24 +-
.../enrichment_handlers/bigtable_it_test.py | 63 ++++-
..._provider.py => external_transform_provider.py} | 34 +--
...test.py => external_transform_provider_test.py} | 18 +-
sdks/python/apache_beam/version.py | 2 +-
sdks/python/apache_beam/yaml/standard_io.yaml | 2 +
.../apache_beam/yaml/standard_providers.yaml | 27 ++
sdks/python/apache_beam/yaml/yaml_provider.py | 36 ++-
.../apache_beam/yaml/yaml_transform_unit_test.py | 4 +
sdks/typescript/package.json | 2 +-
29 files changed, 994 insertions(+), 331 deletions(-)
copy
learning/tour-of-beam/learning-content/io/text-io/text-io-local-write/go-example/myfile.txt
=> .github/trigger_files/beam_PostCommit_Python_Xlang_Gcp_Dataflow.json (100%)
create mode 100644
.github/trigger_files/beam_PostCommit_Python_Xlang_Gcp_Direct.json
copy
sdks/java/{expansion-service/src/main/java/org/apache/beam/sdk/expansion/service/WindowIntoTransformProvider.java
=>
core/src/main/java/org/apache/beam/sdk/schemas/transforms/providers/FlattenTransformProvider.java}
(57%)
copy
sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/transforms/providers/{JavaFilterTransformProvider.java
=> LoggingTransformProvider.java} (50%)
rename
sdks/python/apache_beam/transforms/{external_schematransform_provider.py =>
external_transform_provider.py} (90%)
rename
sdks/python/apache_beam/transforms/{external_schematransform_provider_test.py
=> external_transform_provider_test.py} (87%)
