This is an automated email from the ASF dual-hosted git repository.
yihua pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from c02706ed4c1f [HUDI-9798][RFC-101] Updates to the HoodieRecordMerger
Interface (#13865)
add 4d95b2c2d165 refactor: Update ParquetWriteSupport for Rows to match
Avro writer behavior (#13882)
No new revisions were added by this update.
Summary of changes:
.../MultipleSparkJobExecutionStrategy.java | 7 +-
.../io/storage/HoodieSparkFileWriterFactory.java | 13 -
.../storage/row/HoodieRowParquetWriteSupport.java | 433 ++++++++++++++++++++-
.../org/apache/spark/sql/HoodieDataTypeUtils.scala | 76 ----
.../org/apache/spark/sql/hudi/SparkAdapter.scala | 7 +
.../apache/spark/sql/TestHoodieDataTypeUtils.java | 115 ------
.../org/apache/hudi/common/util/ParquetUtils.java | 1 +
.../apache/hudi/spark/internal/DefaultSource.java | 2 -
.../org/apache/hudi/HoodieSparkSqlWriter.scala | 6 -
.../spark/sql/adapter/BaseSpark3Adapter.scala | 5 +-
.../functional/TestSparkSortAndSizeClustering.java | 157 +++++++-
.../test/resources/schema_with_logical_types.avsc | 194 +++++++++
.../TestPartitionedRecordLevelIndex.scala | 28 +-
.../apache/spark/sql/adapter/Spark3_3Adapter.scala | 10 +
.../apache/spark/sql/adapter/Spark3_4Adapter.scala | 15 +-
.../apache/spark/sql/adapter/Spark3_5Adapter.scala | 16 +-
.../apache/hudi/utilities/streamer/StreamSync.java | 3 +-
17 files changed, 832 insertions(+), 256 deletions(-)
delete mode 100644
hudi-client/hudi-spark-client/src/test/java/org/apache/spark/sql/TestHoodieDataTypeUtils.java
create mode 100644
hudi-spark-datasource/hudi-spark/src/test/resources/schema_with_logical_types.avsc