This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a change to branch bot/trino-pin
in repository https://gitbox.apache.org/repos/asf/hudi.git
discard f78c32192b8d chore(trino): advance trino master pin to cb486aaf8a96
add a6b8744d7fb2 fix(flink): defer instant creation until earlier
checkpoints finish (#20389)
add a0313d198384 feat(utilities): add HoodieTableLayoutAnalyzer for
small-file, micro-partition and hot-partition detection (#20152)
add b5b05d1cafdd fix(flink): unwrap the list element type when creating
vectors for nested arrays (#20337)
add 5b8323f88891 fix(spark): resolve nested ordering fields for Spark
deletes written to delete blocks (#20368)
add 59561a8d8c1f test(common): cover array fields in parquet-avro
GenericData reader test (#20190)
add 31f4a5ef2de3 fix(common): write ordering values to native delete logs
in their stored form (#20373)
new 568efc6253bb chore(trino): advance trino master pin to a15a40cadc9a
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (f78c32192b8d)
\
N -- N -- N refs/heads/bot/trino-pin (568efc6253bb)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../skills/hudi-table-layout/README.md | 65 +
hudi-ai-operator/skills/hudi-table-layout/SKILL.md | 139 ++
.../hudi-table-layout/references/detectors.md | 137 ++
.../hudi/io/cdc/HoodieNativeLogFormatWriter.java | 7 +-
.../io/cdc/TestHoodieNativeLogFormatWriter.java | 52 +
.../hudi/common/model/HoodieSparkRecord.java | 8 +-
.../hudi/BaseSparkInternalRecordContext.java | 17 +-
.../TestBaseSparkInternalRowReaderContext.java | 14 +
.../apache/hudi/common/engine/RecordContext.java | 3 +-
.../hudi/sink/StreamWriteOperatorCoordinator.java | 14 +-
.../org/apache/hudi/sink/utils/CommitGuard.java | 105 --
.../org/apache/hudi/sink/utils/EventBuffers.java | 19 +-
.../sink/TestStreamWriteOperatorCoordinator.java | 125 ++
.../apache/hudi/sink/utils/TestCommitGuard.java | 78 -
.../apache/hudi/sink/utils/TestEventBuffers.java | 61 +-
.../table/format/cow/ParquetSplitReaderUtil.java | 85 +-
.../table/format/cow/utils/NestedPositionUtil.java | 4 +-
.../cow/vector/reader/NestedColumnReader.java | 13 +
.../reader/ParquetColumnarRowSplitReader.java | 1 +
.../format/cow/TestParquetSplitReaderUtil.java | 415 +++++
.../format/cow/utils/TestNestedPositionUtil.java | 66 +
.../avro/TestAvroStringableClassResolution.java | 17 +-
.../apache/hudi/functional/TestMORDataSource.scala | 87 +
.../hudi/utilities/HoodieTableLayoutAnalyzer.java | 1918 ++++++++++++++++++++
.../hudi/utilities/HoodieTableLayoutAnalyzer.md | 246 +++
.../utilities/TestHoodieTableLayoutAnalyzer.java | 1310 +++++++++++++
pom.xml | 2 +-
27 files changed, 4741 insertions(+), 267 deletions(-)
create mode 100644 hudi-ai-operator/skills/hudi-table-layout/README.md
create mode 100644 hudi-ai-operator/skills/hudi-table-layout/SKILL.md
create mode 100644
hudi-ai-operator/skills/hudi-table-layout/references/detectors.md
delete mode 100644
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/utils/CommitGuard.java
delete mode 100644
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/utils/TestCommitGuard.java
create mode 100644
hudi-flink-datasource/hudi-flink1.18.x/src/test/java/org/apache/hudi/table/format/cow/TestParquetSplitReaderUtil.java
create mode 100644
hudi-flink-datasource/hudi-flink1.18.x/src/test/java/org/apache/hudi/table/format/cow/utils/TestNestedPositionUtil.java
create mode 100644
hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieTableLayoutAnalyzer.java
create mode 100644
hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieTableLayoutAnalyzer.md
create mode 100644
hudi-utilities/src/test/java/org/apache/hudi/utilities/TestHoodieTableLayoutAnalyzer.java
