This is an automated email from the ASF dual-hosted git repository.
derrickaw pushed a change to branch 20260609_spotlessVersion
in repository https://gitbox.apache.org/repos/asf/beam.git
discard dc6febae9c1 exclude generated code from checkstyle and declare task
execution order
discard 2c777022cba try earlier dependency resolution
discard 21951d73ea3 revert prior changes
discard 9d37c01d643 hopefully fix timeout and run spotlessApply again
discard 82d6a1d8e08 try a different idea with narrower scope
discard e51780e620f try some more ideas on spotless timing out
discard dd4108fadda exclude build and gradle files to help with timeouts
discard 0f5a676dd5a remove getRatchetBranch and ratchetFrom from
BeamModulePlugin
discard c7b6b6cd5a8 fix settings
discard 874a800ad90 add another mavenCentral block
discard 49912fd614a add repositories
discard a680d13d315 try minimizing checks
discard 35183a4c9e7 centralize resolution and exclude build folders
discard 4f1b9fa15e1 increase heap memory and change resolution strategy
discard 81b50ec1c64 try to limit memory
discard 39a3c682b38 set java version
discard a30a0bf264d exclude hadoop and cassandra and run spotless again
discard b303a5482f9 Exclude spotless configurations from forced Guava 25.1-jre
dependency in hadoop-file-system
discard bf5e7a7e7d7 Add mavenCentral repository to runners flink/spark
spotless build files for dependency resolution
discard 3bf9b518d84 Downgrade com.diffplug.spotless to 7.2.1 for JRE 11 CI
compatibility
discard 7d1cf3fa7d7 update spotless to 8.4 and reformat
add ea2fde7a020 Fix race condition in statesampler_fast.pyx (#38851)
add a3cb642db76 Merge pull request #38878: Fix OnWindowExpirationContext.
add 872cb901dca Bump github.com/aws/aws-sdk-go-v2/config in /sdks (#38884)
add 530d0f91b10 Bump google.golang.org/api from 0.283.0 to 0.284.0 in
/sdks (#38887)
add d7948d07b80 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#38886)
add be50185053f Bump actions/checkout from 4 to 6 (#38885)
add 6eed130a176 update iceberg add files parameters (#38879)
add 20ac8c4f35a add datadog io normalization and yaml (#38362)
add 6a2dbb67985 Bump torch (#38896)
add 02168d3babe Revert "[Python] Honor disableCounterMetrics,
disableStringSetMetrics, and disableBoundedTrieMetrics experiments" (#38901)
add 043556c4b90 Bump torch (#38897)
add 3eb0031274e Bump torch (#38903)
add 081c61ee5b4 Fix Xlang IO Direct installGcpTest uv cache lock (#38862)
add 8051efce4c2 Turn to manual build for Go for CodeQL (#38907)
add 1cf3545e5b7 Fix Dataflow legacy worker abort loop thread death issue
(#38894)
add 8e859798a6f Bump cloud.google.com/go/bigtable from 1.48.0 to 1.49.0 in
/sdks (#38913)
add 48fe93cb0eb Bump github.com/aws/aws-sdk-go-v2/config in /sdks (#38916)
add 60621107046 Bump golang.org/x/net from 0.55.0 to 0.56.0 in /sdks
(#38915)
add 51e35e52440 [IcebergIO] Improve TableCache (#38882)
add c297c0dc4ab Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#38912)
add 61a7368bdb7 Use p310_ml_test (#38890)
add 69f25398f31 update spotless to 8.4 and reformat
add 6584d728df4 Downgrade com.diffplug.spotless to 7.2.1 for JRE 11 CI
compatibility
add 026b69eabda Add mavenCentral repository to runners flink/spark
spotless build files for dependency resolution
add 4f4e76afb99 Exclude spotless configurations from forced Guava 25.1-jre
dependency in hadoop-file-system
add 47ebe266106 exclude hadoop and cassandra and run spotless again
add 8b6c9a7e06e set java version
add b0df55a008e try to limit memory
add 3f3553bb8df increase heap memory and change resolution strategy
add 0baee278c95 centralize resolution and exclude build folders
add c9afc3c1248 try minimizing checks
add 51421019829 add repositories
add cc0877f992c add another mavenCentral block
add 6675cf55975 fix settings
add 84d09f8e4dd remove getRatchetBranch and ratchetFrom from
BeamModulePlugin
add ac4625bff98 exclude build and gradle files to help with timeouts
add 61110b143cc try some more ideas on spotless timing out
add 58c206a8156 try a different idea with narrower scope
add 374e3949b61 hopefully fix timeout and run spotlessApply again
add c987d16bdc7 revert prior changes
add 942d158fcd1 try earlier dependency resolution
add 1424569706c exclude generated code from checkstyle and declare task
execution order
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (dc6febae9c1)
\
N -- N -- N refs/heads/20260609_spotlessVersion (1424569706c)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../IO_Iceberg_Integration_Tests.json | 2 +-
.github/trigger_files/beam_PostCommit_Python.json | 2 +-
.../beam_PostCommit_Python_Xlang_IO_Direct.json | 2 +-
.../beam_PostCommit_Yaml_Xlang_Direct.json | 2 +-
.../beam_PostCommit_Yaml_Xlang_Direct.yml | 2 +-
.github/workflows/codeql.yml | 32 +-
CHANGES.md | 1 -
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 4 +-
.../apache/beam/runners/core/SimpleDoFnRunner.java | 20 +
.../worker/util/common/worker/MapTaskExecutor.java | 3 -
sdks/go.mod | 34 +-
sdks/go.sum | 78 +--
.../reflect/ByteBuddyDoFnInvokerFactory.java | 12 +
.../beam/sdk/transforms/reflect/DoFnInvoker.java | 17 +
.../beam/sdk/transforms/reflect/DoFnSignature.java | 9 +
.../sdk/transforms/reflect/DoFnSignatures.java | 3 +-
.../construction/SplittableParDoNaiveBounded.java | 6 +
.../org/apache/beam/sdk/transforms/ParDoTest.java | 4 +
.../sdk/transforms/reflect/DoFnSignaturesTest.java | 8 +-
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 13 +
.../apache/beam/sdk/io/datadog/DatadogEvent.java | 6 +
.../DatadogWriteSchemaTransformConfiguration.java | 114 +++++
.../DatadogWriteSchemaTransformProvider.java | 294 +++++++++++
.../DatadogWriteSchemaTransformProviderTest.java | 535 +++++++++++++++++++++
sdks/java/io/expansion-service/build.gradle | 1 +
.../iceberg/AssignDestinationsAndPartitions.java | 5 +-
.../beam/sdk/io/iceberg/CreateReadTasksDoFn.java | 7 +-
.../org/apache/beam/sdk/io/iceberg/IcebergIO.java | 2 +-
.../beam/sdk/io/iceberg/IcebergScanConfig.java | 3 +-
.../beam/sdk/io/iceberg/IncrementalScanSource.java | 6 +-
.../apache/beam/sdk/io/iceberg/ReadFromTasks.java | 7 +-
.../beam/sdk/io/iceberg/RecordWriterManager.java | 140 ++----
.../org/apache/beam/sdk/io/iceberg/ScanSource.java | 3 +-
.../org/apache/beam/sdk/io/iceberg/TableCache.java | 199 ++++++--
.../beam/sdk/io/iceberg/WatchForSnapshots.java | 7 +-
.../sdk/io/iceberg/WriteDirectRowsToFiles.java | 12 +-
.../sdk/io/iceberg/WriteGroupedRowsToFiles.java | 12 +-
.../io/iceberg/WritePartitionedRowsToFiles.java | 166 +++----
.../sdk/io/iceberg/WriteUngroupedRowsToFiles.java | 12 +-
.../sdk/io/iceberg/RecordWriterManagerTest.java | 121 +++--
.../apache/beam/sdk/io/iceberg/TableCacheTest.java | 126 +++++
.../anomaly_detection_pipeline/setup.py | 2 +-
.../online_clustering/clustering_pipeline/setup.py | 2 +-
.../kfp/components/train/requirements.txt | 2 +-
sdks/python/apache_beam/metrics/metric.py | 54 +--
sdks/python/apache_beam/metrics/metric_test.py | 104 ----
sdks/python/apache_beam/pipeline.py | 2 -
.../apache_beam/runners/worker/sdk_worker_main.py | 2 -
.../runners/worker/statesampler_fast.pyx | 8 +-
.../runners/worker/statesampler_test.py | 43 ++
sdks/python/apache_beam/yaml/integration_tests.py | 34 ++
sdks/python/apache_beam/yaml/standard_io.yaml | 23 +
.../testing => yaml/test_utils}/__init__.py | 2 +-
.../yaml/test_utils/datadog_test_utils.py | 131 +++++
sdks/python/apache_beam/yaml/tests/datadog.yaml | 63 +++
.../apache_beam/yaml/tests/iceberg_add_files.yaml | 3 +
sdks/standard_external_transforms.yaml | 35 ++
57 files changed, 1952 insertions(+), 590 deletions(-)
create mode 100644
sdks/java/io/datadog/src/main/java/org/apache/beam/sdk/io/datadog/DatadogWriteSchemaTransformConfiguration.java
create mode 100644
sdks/java/io/datadog/src/main/java/org/apache/beam/sdk/io/datadog/DatadogWriteSchemaTransformProvider.java
create mode 100644
sdks/java/io/datadog/src/test/java/org/apache/beam/sdk/io/datadog/DatadogWriteSchemaTransformProviderTest.java
create mode 100644
sdks/java/io/iceberg/src/test/java/org/apache/beam/sdk/io/iceberg/TableCacheTest.java
copy sdks/python/apache_beam/{typehints/testing =>
yaml/test_utils}/__init__.py (93%)
create mode 100644
sdks/python/apache_beam/yaml/test_utils/datadog_test_utils.py
create mode 100644 sdks/python/apache_beam/yaml/tests/datadog.yaml
