This is an automated email from the ASF dual-hosted git repository.
akudinkin pushed a change to branch release-0.12.2-blockers-candidate
in repository https://gitbox.apache.org/repos/asf/hudi.git
omit 4e205d20595 Disable some metadata bootstrap tests
omit 51f15f500b3 [HUDI-5348] Cache file slices in HoodieBackedTableMetadata
(#7436)
omit 70e4615c26a [HUDI-5296] Allow disable schema on read after enabling
(#7421)
omit 4085f27cfb0 [HUDI-5078] Fixing isTableService for replace commits
(#7037)
omit 6e6940fc59e [HUDI-5353] Close file readers (#7412)
omit 68361fae88e [MINOR] Fix Out of Bounds Exception for
DayBasedCompactionStrategy (#7360)
omit 39031d3c9ef [HUDI-5372] Fix NPE caused by alter table add column.
(#7236)
omit 438f3ab6ae3 [HUDI-5347] Cleaned up transient state from
`ExpressionPayload` making it non-serializable (#7424)
omit 08b414dd15c [HUDI-5336] Fixing parsing of log files while building
file groups (#7393)
omit 7b8a7208602 [HUDI-5338] Adjust coalesce behavior within NONE sort mode
for bulk insert (#7396)
omit bca85f376c1 [HUDI-5342] Add new bulk insert sort modes repartitioning
data by partition path (#7402)
omit 172c438d64b [HUDI-5358] Fix flaky tests in
TestCleanerInsertAndCleanByCommits (#7420)
omit f1d643e8f9e [HUDI-5350] Fix oom cause compaction event lost problem
(#7408)
omit d15bbbb6989 [HUDI-5346][HUDI-5320] Fixing Create Table as Select
(CTAS) performance gaps (#7370)
omit 725a9b210a1 [HUDI-5291] Fixing NPE in MOR column stats accounting
(#7349)
omit 4a28b8389f9 [HUDI-5345] Avoid fs.exists calls for metadata table in
HFileBootstrapIndex (#7404)
omit 8510aacba8e [HUDI-5347] FIxing performance traps in Spark SQL `MERGE
INTO` implementation (#7395)
add ee60a6a23e7 [HUDI-5345] Avoid fs.exists calls for metadata table in
HFileBootstrapIndex (#7404)
add 6fa7ff9bddb [HUDI-5291] Fixing NPE in MOR column stats accounting
(#7349)
add 0e17e18c4a0 [HUDI-5346][HUDI-5320] Fixing Create Table as Select
(CTAS) performance gaps (#7370)
add 1a2ffddd064 [HUDI-5350] Fix oom cause compaction event lost problem
(#7408)
add 5d4f59c734c [HUDI-5358] Fix flaky tests in
TestCleanerInsertAndCleanByCommits (#7420)
add fb552aee6f1 [HUDI-5342] Add new bulk insert sort modes repartitioning
data by partition path (#7402)
add bbde3a93e8b [HUDI-5338] Adjust coalesce behavior within NONE sort mode
for bulk insert (#7396)
add 01ba6502aac [HUDI-5336] Fixing parsing of log files while building
file groups (#7393)
add 5e312233f5d [HUDI-5372] Fix NPE caused by alter table add column.
(#7236)
add 8f5723b9f53 [MINOR] Fix Out of Bounds Exception for
DayBasedCompactionStrategy (#7360)
add 106d216af2e [HUDI-5353] Close file readers (#7412)
add 1743d059b6c [HUDI-5078] Fixing isTableService for replace commits
(#7037)
add 8bc9fa5ca95 [HUDI-5296] Allow disable schema on read after enabling
(#7421)
add 4fd25ca804f [HUDI-5348] Cache file slices in HoodieBackedTableMetadata
(#7436)
add 292630b4808 Avoiding costly lookups into the schema cache in
`SqlTypedRecord`
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (4e205d20595)
\
N -- N -- N refs/heads/release-0.12.2-blockers-candidate
(292630b4808)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../org/apache/hudi/AvroConversionUtils.scala | 3 -
.../org/apache/hudi/sql/IExpressionEvaluator.java} | 23 +-
.../org/apache/hudi/HoodieSparkSqlWriter.scala | 59 +---
.../sql/hudi/command/payload/SqlTypedRecord.scala | 73 +++++
.../hudi/command/payload/ExpressionCodeGen.scala | 193 +++++++++++
.../hudi/command/payload/ExpressionPayload.scala | 352 ++++++++-------------
.../functional/TestDataSourceForBootstrap.scala | 6 +-
.../sql/catalyst/expressions/SafeProjection.scala | 75 -----
8 files changed, 411 insertions(+), 373 deletions(-)
copy
hudi-spark-datasource/hudi-spark-common/src/main/{scala/org/apache/spark/sql/catalyst/trees/HoodieLeafLike.scala
=> java/org/apache/hudi/sql/IExpressionEvaluator.java} (64%)
create mode 100644
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/command/payload/SqlTypedRecord.scala
create mode 100644
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/payload/ExpressionCodeGen.scala
delete mode 100644
hudi-spark-datasource/hudi-spark2/src/main/scala/org/apache/spark/sql/catalyst/expressions/SafeProjection.scala
