This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from b802c023b27 Revert "Shard python precommit (#24204)" (#24855)
add a4cf26fdc99 [Spark Dataset runner] Fix initialization of metrics
accumulator on driver (fixes #24809) (#24810)
add 1b1acb08baf Improve error message (#24843)
add 1fa97825e62 Playground Example CI fix for 24807 (#24819)
add 803bfa6e2b1 Bump github.com/tetratelabs/wazero from 1.0.0-pre.4 to
1.0.0-pre.7 in /sdks (#24858)
add 6d058d9ee47 Fix beam_CleanUpGCPResources job (#24770)
add f9fd293fff3 Set DELETE_BEFORE_DAY in accordance with release period
(#24867)
add 9a22bf68767 adding parameters flag to support schema based transforms
(#24864)
add 2898db97a45 Fix SQLIO Performance Test (#24824)
add 0b8f0b4db7a Reduce redundant Get API call when creating bq temp
dataset (#24831)
No new revisions were added by this update.
Summary of changes:
.test-infra/jenkins/README.md | 13 +--
.../jenkins/job_PerformanceTests_SQLIO_Java.groovy | 8 +-
.test-infra/tools/stale_bq_datasets_cleaner.sh | 22 +++-
.../tools/stale_dataflow_prebuilt_image_cleaner.sh | 3 +-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 3 +-
playground/backend/cmd/server/controller_test.go | 2 +-
playground/backend/configs/SDK_JAVA.json | 1 +
.../code_processing/code_processing_test.go | 2 +-
.../environment/environment_service_test.go | 6 +-
.../backend/internal/executors/executor_test.go | 4 +-
playground/infrastructure/checker.py | 7 +-
playground/infrastructure/test_checker.py | 19 +++-
.../SparkStructuredStreamingPipelineResult.java | 9 +-
.../SparkStructuredStreamingRunner.java | 37 ++++---
.../metrics/MetricsAccumulator.java | 117 +++++++++++++++------
.../MetricsContainerStepMapAccumulator.java | 65 ------------
.../metrics/SparkBeamMetric.java | 12 ++-
.../metrics/SparkBeamMetricSource.java | 4 +-
.../metrics/SparkMetricsContainerStepMap.java | 43 --------
.../batch/DoFnPartitionIteratorFactory.java | 26 +++--
.../translation/batch/DoFnRunnerWithMetrics.java | 31 +++---
.../translation/batch/ParDoTranslatorBatch.java | 5 +-
sdks/go.mod | 2 +-
sdks/go.sum | 4 +-
sdks/go/examples/wasm/wasm.go | 11 +-
.../provider/bigquery/BigQueryIOPushDownIT.java | 11 +-
.../meta/provider/bigquery/BigQueryPerfTable.java | 7 +-
sdks/python/apache_beam/io/gcp/bigquery_tools.py | 39 +++----
28 files changed, 256 insertions(+), 257 deletions(-)
delete mode 100644
runners/spark/3/src/main/java/org/apache/beam/runners/spark/structuredstreaming/metrics/MetricsContainerStepMapAccumulator.java
delete mode 100644
runners/spark/3/src/main/java/org/apache/beam/runners/spark/structuredstreaming/metrics/SparkMetricsContainerStepMap.java
