This is an automated email from the ASF dual-hosted git repository.
yihua pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from 26b719a7fba [HUDI-2608] Support json schema in SchemaRegistryProvider
(#7727)
add 1769ff8fb90 [HUDI-5443] Fixing exception trying to read MOR table
after `NestedSchemaPruning` rule has been applied (#7528)
No new revisions were added by this update.
Summary of changes:
.../spark/sql/HoodieCatalystExpressionUtils.scala | 28 +++-
.../AvroProjection.scala} | 36 ++--
.../org/apache/hudi/BaseFileOnlyRelation.scala | 46 ++---
.../main/scala/org/apache/hudi/DefaultSource.scala | 4 +-
.../scala/org/apache/hudi/HoodieBaseRelation.scala | 185 ++++++++-------------
.../org/apache/hudi/HoodieMergeOnReadRDD.scala | 65 ++++----
.../src/main/scala/org/apache/hudi/Iterators.scala | 60 ++++---
.../hudi/MergeOnReadIncrementalRelation.scala | 20 ++-
.../apache/hudi/MergeOnReadSnapshotRelation.scala | 70 ++++++--
.../scala/org/apache/hudi/SafeAvroProjection.scala | 73 --------
.../scala/org/apache/hudi/cdc/HoodieCDCRDD.scala | 30 +---
.../sql/hudi/streaming/HoodieStreamSource.scala | 2 +-
.../spark/sql/hudi/analysis/HoodieAnalysis.scala | 3 +-
.../apache/hudi/functional/TestMORDataSource.scala | 2 +
.../spark/sql/hudi/HoodieSparkSqlTestBase.scala | 2 +-
.../hudi/TestNestedSchemaPruningOptimization.scala | 133 +++++++++++----
16 files changed, 384 insertions(+), 375 deletions(-)
copy
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/{spark/sql/avro/HoodieSparkAvroSchemaConverters.scala
=> hudi/AvroProjection.scala} (51%)
delete mode 100644
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/SafeAvroProjection.scala