This is an automated email from the ASF dual-hosted git repository.
jose-torres pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 69a934425b03 [SPARK-60878][SQL] Fix wrong results by dynamic partition
pruning in group-based DELETE and UPDATE
add ce561d691bc2 [SPARK-60097][SDP] SCD1 Ignore-null support; Define
version map construction
No new revisions were added by this update.
Summary of changes:
.../sql/pipelines/autocdc/AutoCdcSchemaUtils.scala | 23 ++
.../sql/pipelines/autocdc/Scd1VersionMap.scala | 91 ++++-
.../sql/pipelines/autocdc/Scd2BatchProcessor.scala | 2 +-
.../sql/pipelines/autocdc/Scd2VersionMap.scala | 28 +-
.../autocdc/AutoCdcSchemaUtilsSuite.scala | 72 ++++
.../pipelines/autocdc/Scd1VersionMapSuite.scala | 374 +++++++++++++++++++++
.../pipelines/autocdc/Scd2VersionMapSuite.scala | 63 ----
7 files changed, 563 insertions(+), 90 deletions(-)
create mode 100644
sql/pipelines/src/test/scala/org/apache/spark/sql/pipelines/autocdc/Scd1VersionMapSuite.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]