This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 2bec82c05895 [MINOR][TESTS] Remove unused test jar (udf_noA.jar)
add 60fc6a0710ae [SPARK-48794][CONNECT] df.mergeInto support for Spark
Connect (Scala and Python)
No new revisions were added by this update.
Summary of changes:
.../src/main/protobuf/spark/connect/commands.proto | 24 ++
.../main/protobuf/spark/connect/expressions.proto | 29 +++
.../sql/connect/planner/SparkConnectPlanner.scala | 60 ++++-
.../main/scala/org/apache/spark/sql/Dataset.scala | 33 +++
.../org/apache/spark/sql/MergeIntoWriter.scala | 278 +++++++++++++--------
.../apache/spark/sql/MergeIntoE2ETestSuite.scala | 187 ++++++++++++++
.../CheckConnectJvmClientCompatibility.scala | 32 ++-
dev/sparktestsupport/modules.py | 2 +
python/pyspark/sql/connect/dataframe.py | 10 +-
python/pyspark/sql/connect/merge.py | 253 +++++++++++++++++++
python/pyspark/sql/connect/proto/commands_pb2.py | 198 +++++++--------
python/pyspark/sql/connect/proto/commands_pb2.pyi | 98 ++++++++
.../pyspark/sql/connect/proto/expressions_pb2.py | 138 +++++-----
.../pyspark/sql/connect/proto/expressions_pb2.pyi | 109 ++++++++
python/pyspark/sql/dataframe.py | 4 +
python/pyspark/sql/merge.py | 1 -
.../sql/tests/connect/test_parity_dataframe.py | 4 -
17 files changed, 1167 insertions(+), 293 deletions(-)
copy {sql/core =>
connector/connect/client/jvm}/src/main/scala/org/apache/spark/sql/MergeIntoWriter.scala
(52%)
create mode 100644
connector/connect/client/jvm/src/test/scala/org/apache/spark/sql/MergeIntoE2ETestSuite.scala
create mode 100644 python/pyspark/sql/connect/merge.py
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
