This is an automated email from the ASF dual-hosted git repository.
vhs pushed a change to branch phase-18-HoodieAvroUtils-removal
in repository https://gitbox.apache.org/repos/asf/hudi.git
discard 762b1e3f52b9 Address comment 1
discard a940eb91610a Remove HoodieAvroUtils from hudi-client-common Additional
compilation error fixes - AvroOrcUtils - HoodieBootstrapSchemaProvider -
HoodieSparkBootstrapSchemaProvider - TestOrcBootstrap
discard ee419f8db97b Fix HiveTypeUtils#generateTypeInfo behaviour and ensure
that it is not changed
discard b9e691a62a66 Add more test to cover generateColumnTypes
discard 13ac4946e9a7 Remove AvroSchemaUtils#resolveUnionSchema
discard 0d168dde0db2 Address comments
discard 1bb89caaacef Address comments
discard af3d76f8d3bf Remove AvroSchemaUtils from HiveAvroSerializer and
HiveTypeUtils
add 39ae177baec1 perf: optimize removeCommitMetadata method in
HoodieCDCLogger (#17669)
add 387752218cf3 feat(schema): Phase 24 - Restore O(1) reference equality
comparison in HoodieMetadataPayload (#17672)
add 117f8da56fd8 feat: Add HoodieBaseLanceFileWriter and implementation
for SparkFileWriter (#17629)
add cf8e6e4bab07 refactor: Remove org.jetbrains.annotations imports
(#17680)
add 321b4299b2bd test: Fix flaky test
ITTestHoodieFlinkCompactor#testHoodieFlinkCompactorService (#17677)
add 43569426895d chore: Test Runtime Improvements: lower number of files,
parallelize reads (#17671)
add 91c15b10d5d4 feat(schema): phase 17 - Remove AvroSchemaUtils usage
(part 2) (#17581)
add 24b1721f4548 Remove HoodieAvroUtils from hudi-client-common Additional
compilation error fixes - AvroOrcUtils - HoodieBootstrapSchemaProvider -
HoodieSparkBootstrapSchemaProvider - TestOrcBootstrap
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (762b1e3f52b9)
\
N -- N -- N refs/heads/phase-18-HoodieAvroUtils-removal
(24b1721f4548)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
azure-pipelines-20230430.yml | 4 +-
.../transaction/lock/StorageBasedLockProvider.java | 4 +-
.../index/bucket/ConsistentBucketIdentifier.java | 5 +-
.../java/org/apache/hudi/io/HoodieCDCLogger.java | 17 +-
.../rollback/ListingBasedRollbackStrategy.java | 7 +-
.../hudi/testutils/HoodieMergeOnReadTestUtils.java | 52 +--
.../hudi/utils/HoodieWriterClientTestHarness.java | 11 +-
.../io/log/block/HoodieFlinkAvroDataBlock.java | 8 +-
hudi-client/hudi-spark-client/pom.xml | 6 +
...quetWriter.java => HoodieSparkLanceWriter.java} | 104 +++--
.../testutils/HoodieSparkClientTestHarness.java | 6 -
.../client/transaction/lock/NoopLockProvider.java | 4 +-
.../versioning/v1/ArchivedTimelineLoaderV1.java | 3 +-
.../versioning/v2/ArchivedTimelineLoaderV2.java | 3 +-
.../hudi/metadata/HoodieMetadataPayload.java | 16 +-
.../examples/quickstart/HoodieFlinkQuickstart.java | 7 +-
.../apache/hudi/source/ExpressionEvaluators.java | 21 +-
.../org/apache/hudi/table/HoodieTableSink.java | 3 +-
.../hudi/table/lookup/HoodieLookupTableReader.java | 3 +-
.../sink/compact/ITTestHoodieFlinkCompactor.java | 8 +-
.../test/java/org/apache/hudi/utils/TestUtils.java | 19 +
.../gcp/transaction/lock/GCSStorageLockClient.java | 4 +-
hudi-hadoop-common/pom.xml | 14 +
.../hudi/io/lance/HoodieBaseLanceWriter.java | 191 +++++++++
.../apache/hudi/hadoop/utils/HiveTypeUtils.java | 28 +-
.../hudi/client/TestHoodieClientMultiWriter.java | 2 +-
.../hudi/functional/TestBufferedRecordMerger.java | 3 +-
.../hudi/functional/TestConsistentBucketIndex.java | 2 +-
.../hudi/functional/TestHoodieBackedMetadata.java | 9 +-
.../hudi/functional/TestHoodieFileSystemViews.java | 4 +
.../io/storage/TestHoodieSparkLanceWriter.java | 462 +++++++++++++++++++++
.../TestHoodieSparkMergeOnReadTableCompaction.java | 103 +++--
.../TestMetadataTableWithSparkDataSource.scala | 10 +-
.../hudi/functional/TestRecordLevelIndex.scala | 16 +-
.../hudi/timeline/service/RequestHandler.java | 5 +-
.../apache/hudi/utilities/HoodieClusteringJob.java | 4 +-
.../org/apache/hudi/utilities/HoodieIndexer.java | 4 +-
.../hudi/utilities/util/BloomFilterData.java | 4 +-
pom.xml | 41 +-
39 files changed, 1018 insertions(+), 199 deletions(-)
copy
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/io/storage/{HoodieSparkParquetWriter.java
=> HoodieSparkLanceWriter.java} (52%)
create mode 100644
hudi-hadoop-common/src/main/java/org/apache/hudi/io/lance/HoodieBaseLanceWriter.java
create mode 100644
hudi-spark-datasource/hudi-spark/src/test/java/org/apache/hudi/io/storage/TestHoodieSparkLanceWriter.java
