This is an automated email from the ASF dual-hosted git repository.
yihua pushed a change to branch release-0.13.0
in repository https://gitbox.apache.org/repos/asf/hudi.git
from e6d44c015b7 [HUDI-5633] Fixing performance regression in
`HoodieSparkRecord` (#7769)
new 22b634b0815 [HUDI-5585][flink] Fix flink creates and writes the table,
the spark alter table reports an error (#7706)
new 1ccf37f2287 [HUDI-5540] Close write client after usage of
DeleteMarker/RollbackToInstantTime/RunClean/RunCompactionProcedure (#7655)
new 9d3a8d5924d [HUDI-5317] Fix insert overwrite table for partitioned
table (#7793)
new b3fa99685ed [HUDI-5646] Guard dropping columns by a config, do not
allow by default (#7787)
new 6ef2135b2fa [MINOR] Restoring existing behavior for `DeltaStreamer`
Incremental Source (#7810)
new 4a61e82576d [HUDI-5681] Fixing Kryo being instantiated w/ invalid
`SparkConf` (#7821)
new c487ee428d5 [HUDI-5676] Fix BigQuerySyncTool standalone mode (#7816)
new 40d534e878b [HUDI-5647] Automate savepoint and restore tests (#7796)
The 8 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../org/apache/hudi/config/HoodieWriteConfig.java | 20 +-
.../java/org/apache/hudi/table/HoodieTable.java | 12 +-
.../hudi/client/TestTableSchemaEvolution.java | 125 +++++++----
.../TestSavepointRestoreCopyOnWrite.java | 173 ++++++++++++++
.../TestSavepointRestoreMergeOnRead.java | 248 +++++++++++++++++++++
.../hudi/testutils/HoodieClientTestBase.java | 62 +++++-
.../hudi/testutils/HoodieClientTestUtils.java | 19 +-
.../java/org/apache/hudi/avro/AvroSchemaUtils.java | 23 +-
.../apache/hudi/common/config/HoodieConfig.java | 8 -
.../hudi/common/table/TableSchemaResolver.java | 36 ---
.../org/apache/hudi/common/util/ParquetUtils.java | 34 +--
.../apache/hudi/table/catalog/HiveSchemaUtils.java | 8 +-
.../hudi/table/catalog/HoodieHiveCatalog.java | 2 +-
.../hudi/table/catalog/TableOptionProperties.java | 25 ++-
.../hudi/table/catalog/TestHoodieHiveCatalog.java | 15 ++
.../hudi/gcp/bigquery/BigQuerySyncConfig.java | 38 ++--
.../gcp/bigquery/TestBigQuerySyncToolArgs.java | 70 ++++++
.../org/apache/hudi/HoodieSparkSqlWriter.scala | 68 +++---
.../org/apache/spark/sql/hudi/SerDeUtils.scala | 44 ----
.../AlterHoodieTableChangeColumnCommand.scala | 2 +-
.../command/InsertIntoHoodieTableCommand.scala | 4 +-
.../hudi/command/MergeIntoHoodieTableCommand.scala | 8 +-
.../hudi/command/payload/ExpressionPayload.scala | 54 ++++-
.../command/procedures/DeleteMarkerProcedure.scala | 8 +-
.../RollbackToInstantTimeProcedure.scala | 50 +++--
.../command/procedures/RunCleanProcedure.scala | 27 ++-
.../procedures/RunCompactionProcedure.scala | 126 ++++++-----
.../hudi/TestAvroSchemaResolutionSupport.scala | 19 +-
.../org/apache/hudi/TestHoodieSparkSqlWriter.scala | 49 ++--
.../hudi/functional/TestBasicSchemaEvolution.scala | 21 +-
.../hudi/functional/TestCOWDataSourceStorage.scala | 10 +-
.../hudi/functional/TestColumnStatsIndex.scala | 7 +-
.../apache/spark/sql/hudi/TestInsertTable.scala | 120 +---------
.../org/apache/hudi/utilities/UtilHelpers.java | 13 ++
.../hudi/utilities/deltastreamer/DeltaSync.java | 8 +-
.../hudi/utilities/sources/HoodieIncrSource.java | 23 +-
packaging/hudi-gcp-bundle/pom.xml | 8 +-
37 files changed, 1108 insertions(+), 479 deletions(-)
create mode 100644
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/functional/TestSavepointRestoreCopyOnWrite.java
create mode 100644
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/functional/TestSavepointRestoreMergeOnRead.java
create mode 100644
hudi-gcp/src/test/java/org/apache/hudi/gcp/bigquery/TestBigQuerySyncToolArgs.java
delete mode 100644
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/SerDeUtils.scala
