This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from bee495f (commit)
to bcced0c (commit)
from bee495f Merge pull request #14407: [BEAM-12060] Fix failing Go
Postcommits, jenkins support for Gradle tasks.
add 4477b41 [BEAM-12067] Bump elasticsearch-rest-high-level-client to
7.12.0
add c4d1ab3 Merge pull request #14424: [BEAM-12067] Bump
elasticsearch-rest-high-level-client to 7.12.0
add 5ffb3ee [BEAM-9615] Misc final schema cleanups. (#14285)
add abbe14f [BEAM-12083] Nexmark Query 13. (#14404)
add 37db190 [BEAM-4106] Add FileStagingOptions and merge staging file
options between runners
add 7134cfd Merge pull request #14423: [BEAM-4106] Add FileStagingOptions
and merge staging file options between runners
add 99a3998 [BEAM-12060] Remove overwriting jenkins property. (#14432)
add 3420488 [BEAM-10925] Roundtrip tests for literals through Java UDF.
add 7845c58 [BEAM-10925] Simplify test setup.
add a01bc08 Merge pull request #14418 from ibzib/java-udf-types
add 3e2e630 [BEAM-12095] Fix Spark job server path.
add 312c6eb Merge pull request #14429 from ibzib/BEAM-12095
add 09bc53a remove typo in encoding.go
add 6988b94 Merge pull request #14430: remove typo in encoding.go
add 91e35b5 Updates Dataflow worker pool config to include all
environments used by transforms. Sets environment Ids in the Dataflow worker
pool config which will be used to map bundles to SDK Harnesses.
add fe9a406 Merge pull request #14408: [BEAM-11935] Updates Dataflow
config to include all environments used by transforms
add 6ddf0c2 Optimize reservoir sampling calculation
add bcced0c Merge pull request #14406 from [BEAM-11836] Optimize
reservoir sampling calculation in PCollectionConsumerRegistry
No new revisions were added by this update.
Summary of changes:
.test-infra/jenkins/job_PostCommit_Go.groovy | 1 -
.../job_PostCommit_Go_ValidatesRunner_Flink.groovy | 1 -
.../job_PostCommit_Go_ValidatesRunner_Spark.groovy | 1 -
.../jenkins/job_PreCommit_Go_Portable.groovy | 1 -
.../beam/runners/flink/FlinkPipelineOptions.java | 18 +-
.../beam/runners/dataflow/DataflowRunner.java | 80 +++---
.../options/DataflowPipelineWorkerPoolOptions.java | 19 +-
.../beam/runners/dataflow/DataflowRunnerTest.java | 54 ++--
.../runners/spark/SparkCommonPipelineOptions.java | 18 +-
.../runners/twister2/Twister2PipelineOptions.java | 11 +-
sdks/go/pkg/beam/coder.go | 14 +-
sdks/go/pkg/beam/core/graph/coder/row.go | 3 +-
sdks/go/pkg/beam/core/graph/coder/row_decoder.go | 2 +-
sdks/go/pkg/beam/core/graph/coder/row_encoder.go | 2 +-
sdks/go/pkg/beam/encoding.go | 50 +++-
sdks/go/pkg/beam/util/shimx/generate.go | 15 ++
sdks/go/pkg/beam/util/shimx/generate_test.go | 2 +-
sdks/go/test/build.gradle | 8 +-
.../beam/sdk/options/FileStagingOptions.java} | 30 +--
.../beam/sdk/options/PortablePipelineOptions.java | 18 +-
.../org/apache/beam/sdk/transforms/Reshuffle.java | 52 ++--
.../sql/zetasql/ZetaSqlJavaUdfTypeTest.java | 276 +++++++++++++++++++++
.../harness/data/PCollectionConsumerRegistry.java | 49 +++-
sdks/java/io/hadoop-format/build.gradle | 2 +-
.../beam/sdk/nexmark/NexmarkConfiguration.java | 13 +
.../apache/beam/sdk/nexmark/NexmarkLauncher.java | 4 +
.../apache/beam/sdk/nexmark/NexmarkQueryName.java | 1 +
.../apache/beam/sdk/nexmark/queries/Query13.java | 107 ++++++++
.../apache_beam/runners/portability/job_server.py | 5 +-
.../runners/portability/spark_runner.py | 4 +-
sdks/python/apache_beam/utils/subprocess_server.py | 10 +-
31 files changed, 671 insertions(+), 200 deletions(-)
copy
sdks/java/{extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/BeamSqlSeekableTable.java
=> core/src/main/java/org/apache/beam/sdk/options/FileStagingOptions.java}
(58%)
create mode 100644
sdks/java/extensions/sql/zetasql/src/test/java/org/apache/beam/sdk/extensions/sql/zetasql/ZetaSqlJavaUdfTypeTest.java
create mode 100644
sdks/java/testing/nexmark/src/main/java/org/apache/beam/sdk/nexmark/queries/Query13.java