This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from 15c89fd (commit)
to 49b9d1b (commit)
from 15c89fd Merge pull request #14221: Add example of Spark rest URL.
add ee29766 Better error for missing java.
add 6e799fa Merge pull request #14266 from robertwb/java-error
add f561a83 Revert "Add License file for the Go SDK for pkg.go.dev"
add ec64a81 Merge pull request #14267 from
apache/revert-11657-lostluck-patch-2
add d6436b3 [BEAM-11979] Ignore not serializable filter fields in python
MongoDBIO display data
add 9791ef9 Merge pull request #14237 from [BEAM-11979] Ignore not
serializable filter fields in python MongoDBI…
add abc7b20 [BEAM-11992] Run CrossLanguage ValidatesRunner tests only for
Spark 2
add 540957e Merge pull request #14253: [BEAM-11992] Run CrossLanguage
ValidatesRunner tests only for Spark 2
add 6db22c6 [BEAM-8778] Bump software.amazon.awssdk version to 2.15.31
add c4f62ca Merge pull request #14264: [BEAM-8778] Bump
software.amazon.awssdk version to 2.15.31
add 3fc2ab1 [BEAM-9547] Add NDFrame to doctests, implement a few more
operations (#14236)
add 9113c6f [BEAM-9283] Add Java 11 Jpms compatibility tests for Spark
runner
add aee24ad Merge pull request #14270: [BEAM-9283] Add Java 11 Jpms
compatibility tests for Spark runner
add c4ddb59 Remove change detector tests for Java-on-JRH
add 1b4d2ff Make beam_fn_api, use_runner_v2, and use_unified_worker all
trigger the same behavior in the SDK
add 0619de8 Merge pull request #14226: Eliminate use_runner_v2, and
use_unified_worker in the Java SDK, since beam_fn_api suffices
add e96f69a Revert "Increase the timeout for ValidatesContainer suite"
(#14219)
add ff4366d [BEAM-11023] Fix testGroupByKeyWithBadEqualsHashCode failing
on Spark Structured Streaming runner
add 96bf00a [BEAM-11023] Fix testLargeKeys100MB on Spark Structured
Streaming runner
add 3ac902a [BEAM-11023] Change access level GroupByKeyTest
add 5c9c8c0 Merge pull request #14275: [BEAM-11023] Fix GroupByKeyTest
testLargeKeys100MB and testGroupByKeyWithBadEqualsHashCode failing on Spark
Structured Streaming runner
add e67ba2b [BEAM-5949] Remove trivial __ne__ implementations. (#13887)
add 7a60699 Returning successes from FhirIO executeBundles. Needed for
healthcare solutions accuracy in logging what was written to the fhir store.
add 7f891c3 Syncing with milenas change
add ba4a111 Undo formatting changes from Google auto-formatter.
add e4768a4 Adding the tuple tag check for FhirIO.Write.Result creation.
add 95201ac Updating the contains TupleTag check to use the
PCollectionTuple .has() method, casting TupleTagList -> Collection creates an
exception for some.
add 05f6aaf Fix build
add 655b29b Running spotless apply
add 61004f3 Merge branch 'master' of https://github.com/apache/beam
add 5de886d Merge remote-tracking branch 'upstream/master'
add 03d5364 adding LRO counters to import/export/deidentify
add 8611174 running spotless apply
add 62320cf changing NAME -> KEY after feedback from an internal review
add 3bef3da Adding a log statement for when failures occur.
add 5f7358d Removing ignores from tests
add 1a4cb59 spotless apply
add 14f2371 Updating counter names
add b2f84d7 Merge pull request #14233 from [BEAM-11733] Adding LRO
counters to FhirIO and re-enable FhirIO tests
add 93417ce [BEAM-9038] Fix typo for setting_global_window example
add 195bbf3 Merge pull request #14271 from [BEAM-9038] Fix typo for
setting_global_window example
add aa6c075 [BEAM-12010] Create separate merge rules for different Calc
implementations.
add 3a096ee [BEAM-12010] Use simpler rule constructor so we don't have to
pass null.
add 49b9d1b Merge pull request #14265 from ibzib/BEAM-12010
No new revisions were added by this update.
Summary of changes:
...ommit_CrossLanguageValidatesRunner_Spark.groovy | 1 -
...> job_PostCommit_Java_Jpms_Spark_Java11.groovy} | 8 +-
...ommit_Python_ValidatesContainer_Dataflow.groovy | 2 +-
LICENSE | 462 +++++++++++++++++++++
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 5 +-
.../dataflow/DataflowPipelineTranslator.java | 3 +-
.../dataflow/DataflowPipelineTranslatorTest.java | 147 -------
runners/spark/spark_runner.gradle | 2 +
.../org/apache/beam/sdk/transforms/Combine.java | 4 +-
.../java/org/apache/beam/sdk/transforms/View.java | 16 +-
.../beam/sdk/testing/PCollectionViewTesting.java | 4 +-
.../apache/beam/sdk/transforms/GroupByKeyTest.java | 4 +-
.../extensions/sql/impl/planner/BeamRuleSets.java | 8 +-
.../BeamCalcMergeRule.java} | 34 +-
.../LogicalCalcMergeRule.java} | 34 +-
.../sql/zetasql/BeamZetaSqlCalcMergeRule.java} | 37 +-
.../sql/zetasql/ZetaSQLQueryPlanner.java | 4 +-
.../io/{kinesis => amazon-web-services}/OWNERS | 0
.../io/{kinesis => amazon-web-services2}/OWNERS | 0
sdks/java/io/amazon-web-services2/build.gradle | 10 +-
.../apache/beam/sdk/io/gcp/healthcare/FhirIO.java | 60 ++-
.../beam/sdk/io/gcp/healthcare/FhirIOLROIT.java | 2 -
.../beam/sdk/io/gcp/healthcare/FhirIOWriteIT.java | 2 -
sdks/java/testing/jpms-tests/build.gradle | 8 +
sdks/python/apache_beam/coders/coders.py | 4 -
sdks/python/apache_beam/coders/coders_test.py | 4 -
sdks/python/apache_beam/coders/typecoders_test.py | 4 -
sdks/python/apache_beam/dataframe/expressions.py | 3 -
sdks/python/apache_beam/dataframe/frames.py | 114 ++++-
sdks/python/apache_beam/dataframe/frames_test.py | 18 +
.../apache_beam/dataframe/pandas_doctests_test.py | 119 ++++++
sdks/python/apache_beam/dataframe/partitionings.py | 12 +-
.../apache_beam/examples/snippets/snippets_test.py | 4 +-
sdks/python/apache_beam/internal/metrics/cells.py | 8 -
sdks/python/apache_beam/internal/util.py | 4 -
sdks/python/apache_beam/io/concat_source_test.py | 4 -
sdks/python/apache_beam/io/filebasedsink.py | 4 -
sdks/python/apache_beam/io/filesystem.py | 4 -
sdks/python/apache_beam/io/gcp/pubsub.py | 4 -
.../python/apache_beam/io/hadoopfilesystem_test.py | 4 -
sdks/python/apache_beam/io/mongodbio.py | 28 +-
sdks/python/apache_beam/io/mongodbio_test.py | 42 --
sdks/python/apache_beam/io/restriction_trackers.py | 4 -
sdks/python/apache_beam/metrics/cells.py | 20 -
sdks/python/apache_beam/metrics/execution.py | 11 -
sdks/python/apache_beam/metrics/metricbase.py | 4 -
sdks/python/apache_beam/options/value_provider.py | 4 -
sdks/python/apache_beam/pvalue.py | 7 -
sdks/python/apache_beam/runners/common.py | 8 -
sdks/python/apache_beam/testing/test_stream.py | 4 -
sdks/python/apache_beam/testing/util.py | 4 -
sdks/python/apache_beam/transforms/core.py | 8 -
sdks/python/apache_beam/transforms/cy_combiners.py | 4 -
sdks/python/apache_beam/transforms/display.py | 4 -
sdks/python/apache_beam/transforms/environments.py | 24 --
sdks/python/apache_beam/transforms/trigger.py | 8 -
sdks/python/apache_beam/transforms/window.py | 18 -
sdks/python/apache_beam/typehints/decorators.py | 3 -
sdks/python/apache_beam/typehints/row_type.py | 4 -
.../apache_beam/typehints/trivial_inference.py | 8 -
sdks/python/apache_beam/typehints/typehints.py | 4 -
sdks/python/apache_beam/utils/subprocess_server.py | 3 +
sdks/python/apache_beam/utils/timestamp.py | 11 -
sdks/python/apache_beam/utils/windowed_value.py | 11 -
64 files changed, 879 insertions(+), 538 deletions(-)
copy .test-infra/jenkins/{job_PostCommit_Java_Jpms_Flink_Java11.groovy =>
job_PostCommit_Java_Jpms_Spark_Java11.groovy} (85%)
copy
sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/{parser/SqlDropTable.java
=> rule/BeamCalcMergeRule.java} (60%)
copy
sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/{parser/SqlDropTable.java
=> rule/LogicalCalcMergeRule.java} (63%)
copy
sdks/java/extensions/sql/{src/main/java/org/apache/beam/sdk/extensions/sql/impl/parser/SqlDropTable.java
=>
zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/BeamZetaSqlCalcMergeRule.java}
(59%)
copy sdks/java/io/{kinesis => amazon-web-services}/OWNERS (100%)
copy sdks/java/io/{kinesis => amazon-web-services2}/OWNERS (100%)
