This is an automated email from the ASF dual-hosted git repository.
voonhous pushed a change to branch release-1.2.1
in repository https://gitbox.apache.org/repos/asf/hudi.git
from e22eaadd06bf fix(build): import Spark Metadata/StructField types in
TestHoodieSparkLanceWriter
new a7b2f889fa7a Remove spaces around partition columns (#18423)
new 12d25eb2bef8 fix: align log4j2 and slf4j versions to resolve IntelliJ
test failures (#18177)
new 1f52a3a78101 fix(spark): match the staged table, not LogicalWriteInfo,
in BasicStagedTable.newWriteBuilder (#19251)
new 85550a2b6034 test(spark): cover the legacy parquet read path with
file-group reader disabled (#19133)
new 19674a3c2c21 fix: reuse Inflater/Deflater in BitCaskDiskMap to avoid
JDK8 finalizer contention (#18818)
new dde78ad6200c fix: Improve error message for conflict resolution
(#18119)
new 706f920da978 fix(flink): remove the Source V2 read teardown race via
materialized bounded minibatches (#19202)
new 63b7a3415e15 docs: claim RFC-108 Multi-dataset incremental reads in
Hudi Streamer (#19308)
new c200e71e2abd fix(test): stabilize flaky
testReattemptOfFailedClusteringCommit (#19120)
new 9e65e525e906 test(common): add log-format reader and scanner coverage
(#19223)
new a9d2e8140743 fix(metadata-table): add config to skip zero-size data
files on MDT initialization (#18611)
new f0f9598d57f5 fix(build): use CURRENT_VERSION for the inline log-format
header on release-1.2.1
new b653a5edc5e7 fix(hive-sync): sync column and partition column comments
to HMS (#19289)
new 1eefd1b0a274 test(spark): add unit coverage for Spark row, schema and
sort utilities (#19219)
new 51f693c0cb4e test(common): add unit coverage for config and utility
classes (#19220)
new 688c5c24448d test(client): add unit coverage for client utilities and
services (#19222)
new cdf8e9e768e6 fix(hive-sync): close proxied IMetaStoreClient in
HoodieHiveSyncClient.close() to prevent HMS connection leak (#19331)
new 5e17c57b282c fix(flink): avoid reusing split reader functions across
fetchers (#19315)
new c57db60266be fix(build): import HoodieStorageUtils from its
release-branch package
new d0b2a88020a0 test(common): add unit coverage for metrics reporters and
schema utilities (#19221)
new 9b99311f94fa fix(hive-sync): fix partition-value parsing on '=' and
pushdown comparator overflow (#19336)
new 6d50d8289201 fix: relax existing column to nullable in reconcileSchema
when source made it nullable (#19337)
new d175f92a41d4 fix(hive-sync): set HMS table createTime in seconds
instead of milliseconds (#19335)
new 2147325bc30c chore: upload Flink integration-test coverage (#19343)
new 82c957fa1a9e fix: do not fall back to timeline server markers on
transient HDFS failures (#18887)
new 70982d8d0dbd refactor(spark): share the Spark 3.x legacy parquet file
format via a common base (#19341)
new 4d143a884fb0 fix(build): move TestSparkValueMetadataUtils to the
release-branch stats package
new c48eb02cfd81 [HUDI-18060] Improve error message when ordering field
value is null (#18061)
new c026a7706b1b fix(hive-sync): keep HMS lock heartbeat alive and release
its thread pool on close (#19334)
new 93cb853668de fix(utilities): guard Source.releaseResources() against
transient RDD unpersist failures (#19328)
new 6bec73452958 chore(utilities): add SQS backlog / in-flight visibility
to S3 events source (#19333)
new 85e49e73b842 fix(reader): derive pre-v9 CDC delete markers from the
effective payload class (#19348)
new 16f6573669be test(common): add LSM file group read path coverage
(#19347)
new 7e46473c1758 fix(flink): make hudi-flink-bundle built with
flink-bundle-shade-hive usable for Hive sync (#19330)
new 6fa05d5cb20e fix: Handle map/array-nested leaf columns in column stats
collection during MOR log-append (#19126)
new b963291b9fe9 test(spark): Fix flaky TestSparkFilterHelper by giving it
its own SparkSession (#19356)
new fd231034e166 docs(docker): document build_docker_images.sh flags
(#18687)
new 97279c5de6c9 fix(metadata-table): follow-ups for the zero-size file
skip (#18611) (#19355)
new 78f27a475cec fix(flink): normalize row logical conversions and improve
coverage (#19351)
new f7eecba4bd0d fix(flink): deduplicate delete keys and cover write paths
(#19354)
new 1bc5d3869653 fix(timeline-service): fail marker creation requests when
marker flush fails (#19368)
new 944e86d39bd1 test(hudi-client): improve metadata table writer coverage
(#19363)
new 06f3c925c88a chore(deps): bump io.airlift:aircompressor from 0.27 to
2.0.3 (#18247)
new 9913db7ed8e8 chore(deps): bump org.apache.thrift:libthrift (#18910)
new 212ede61384a chore(deps): bump
org.apache.commons:commons-configuration2 (#18801)
new 7f843e6d786c fix(hive-sync): stop the HMS lock heartbeat once the
metastore drops the lock (#19370)
new 5dbbe50dd481 fix(record-index-bootstrap): sort record index keys by
UTF-8 bytes to match HFile sorting (#18941)
new 591401fc3e46 perf(flink): Parse bucket index hash-field config once
instead of per record (#18993)
new 3730b6015405 fix(build): use log4j-slf4j2-impl in hudi-flink1.17.x
new 3d4edab74f49 fix: Fix lock expiration metric (#18492)
new cdc9c565208f feat(trino): Migrate the Trino-Hudi connector into the
Hudi repo (RFC-105) (#18837)
new 2a584ca8b8de feat(hive-sync): batch and parallelize HiveQL partition
operations (#18984)
new 391324bdea73 fix(hive-sync): drop the unreachable HMS lock
timeout-recovery path (#19371)
new f624d8781f76 fix(metadata): correct index definition lookup and
improve mdt read coverage (#19359)
new d12eb478849e fix(common): load single archived instant details (#19385)
The 55 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/bot.yml | 48 +-
.github/workflows/hudi_trino_ci.yml | 147 +++++
.github/workflows/hudi_trino_compat.yml | 105 +++
azure-pipelines-20230430.yml | 1 -
docker/README.md | 125 ++--
docker/hoodie/hadoop/pom.xml | 3 -
docker/hoodie/hadoop/sparkadhoc/adhoc.sh | 2 -
docker/hoodie/hadoop/trinobase/Dockerfile | 67 --
docker/hoodie/hadoop/trinobase/pom.xml | 116 ----
docker/hoodie/hadoop/trinobase/scripts/trino.sh | 25 -
docker/hoodie/hadoop/trinocoordinator/Dockerfile | 29 -
.../trinocoordinator/etc/catalog/hive.properties | 22 -
.../hadoop/trinocoordinator/etc/config.properties | 26 -
.../hoodie/hadoop/trinocoordinator/etc/jvm.config | 27 -
.../hadoop/trinocoordinator/etc/log.properties | 19 -
.../hadoop/trinocoordinator/etc/node.properties | 21 -
docker/hoodie/hadoop/trinocoordinator/pom.xml | 96 ---
docker/hoodie/hadoop/trinoworker/Dockerfile | 29 -
.../hadoop/trinoworker/etc/catalog/hive.properties | 22 -
.../hadoop/trinoworker/etc/config.properties | 24 -
docker/hoodie/hadoop/trinoworker/etc/jvm.config | 27 -
.../hoodie/hadoop/trinoworker/etc/log.properties | 19 -
.../hoodie/hadoop/trinoworker/etc/node.properties | 21 -
docker/hoodie/hadoop/trinoworker/pom.xml | 96 ---
.../src/hudi_agent_gateway.egg-info/PKG-INFO | 163 +++++
.../src/hudi_agent_gateway.egg-info/SOURCES.txt | 43 ++
.../dependency_links.txt | 1 +
.../hudi_agent_gateway.egg-info/entry_points.txt | 2 +
.../src/hudi_agent_gateway.egg-info/requires.txt | 20 +
.../src/hudi_agent_gateway.egg-info/top_level.txt | 1 +
...urrentFileWritesConflictResolutionStrategy.java | 62 +-
.../lock/FileSystemBasedLockProvider.java | 6 +-
.../transaction/lock/StorageBasedLockProvider.java | 20 +-
.../java/org/apache/hudi/io/BaseCreateHandle.java | 7 +-
.../org/apache/hudi/io/HoodieAppendHandle.java | 5 +-
.../apache/hudi/io/HoodieSortedMergeHandle.java | 5 +-
.../metadata/HoodieBackedTableMetadataWriter.java | 20 +-
.../table/marker/MarkerBasedRollbackUtils.java | 15 +-
.../TestHoodieTableServiceManagerClient.java | 215 ++++++
...urrentFileWritesConflictResolutionStrategy.java | 171 +++++
.../lock/TestFileSystemBasedLockProvider.java | 228 +++++++
.../lock/TestStorageBasedLockProvider.java | 45 +-
.../table/timeline/TestArchivedTimelineV2.java | 69 +-
.../org/apache/hudi/io/TestHoodieWriteHandle.java | 1 +
.../TestHoodieBackedTableMetadataWriter.java | 191 ++++++
...ieBackedTableMetadataWriterTableVersionSix.java | 153 +++++
.../metadata/TestHoodieMetadataWriteUtils.java | 46 ++
.../TestSecondaryIndexRecordGenerationUtils.java | 73 +++
.../table/marker/TestMarkerBasedRollbackUtils.java | 134 ++++
hudi-client/hudi-flink-client/pom.xml | 2 +-
.../apache/hudi/client/HoodieFlinkWriteClient.java | 5 +-
.../hudi/client/model/HoodieFlinkRecord.java | 6 +-
.../table/action/commit/FlinkDeleteHelper.java | 7 +-
.../apache/hudi/util/AvroToRowDataConverters.java | 3 +-
.../apache/hudi/client/TestFlinkWriteClient.java | 36 ++
.../client/TestFlinkWriteClientFunctional.java | 491 ++++++++++++++
.../client/TestHoodieFlinkTableServiceClient.java | 185 ++++++
.../TestHoodieFlinkInternalRowSerializer.java | 125 ++++
.../hudi/client/model/TestHoodieFlinkRecord.java | 116 ++++
.../row/parquet/TestParquetSchemaConverter.java | 63 ++
.../table/TestHoodieFlinkTableActionRouting.java | 263 ++++++++
.../table/action/commit/TestFlinkDeleteHelper.java | 174 +++++
.../org/apache/hudi/util/TestRowDataUtils.java | 127 ++++
.../JavaHoodieMetadataBulkInsertPartitioner.java | 3 +-
.../hudi/table/action/commit/JavaDeleteHelper.java | 16 +-
.../hudi/client/TestJavaHoodieBackedMetadata.java | 121 +++-
...estJavaHoodieMetadataBulkInsertPartitioner.java | 100 +++
.../table/action/commit/TestJavaDeleteHelper.java | 72 +++
.../SparkHoodieMetadataBulkInsertPartitioner.java | 2 +-
.../commit/BaseSparkCommitActionExecutor.java | 5 +-
.../hudi/client/TestFileBasedLockProvider.java | 114 ----
...stSparkHoodieMetadataBulkInsertPartitioner.java | 61 ++
.../functional/TestHoodieMetadataBootstrap.java | 28 +
.../TestSparkHoodieBackedTableMetadataWriter.java | 183 ++++++
.../hudi/stats/TestSparkValueMetadataUtils.java | 196 ++++++
.../sql/hudi/execution/TestRangeSampleSort.java | 168 +++++
.../org/apache/hudi/avro/AvroRecordContext.java | 10 +-
.../apache/hudi/common/config/ConfigGroups.java | 4 +
.../hudi/common/config/HoodieIndexingConfig.java | 8 +-
.../hudi/common/config/HoodieMetadataConfig.java | 19 +
.../config/HoodieTableServiceManagerConfig.java | 2 +-
.../hudi/common/model/WriteOperationType.java | 11 +
.../hudi/common/table/HoodieTableConfig.java | 13 +-
.../SortedKeyBasedFileGroupRecordBuffer.java | 12 +-
.../timeline/versioning/v2/ArchivedTimelineV2.java | 4 +-
.../org/apache/hudi/common/util/ConfigUtils.java | 8 +-
.../common/util/collection/BitCaskDiskMap.java | 33 +-
.../schema/utils/AvroSchemaEvolutionUtils.java | 17 +-
.../io/storage/HoodieNativeAvroHFileReader.java | 8 +-
.../hudi/metadata/HoodieBackedTableMetadata.java | 15 +-
.../hudi/metadata/HoodieMetadataMetrics.java | 1 +
.../hudi/metadata/HoodieTableMetadataUtil.java | 19 +-
.../hudi/metadata/MetadataPartitionType.java | 9 +-
.../apache/hudi/avro/TestAvroRecordContext.java | 67 +-
.../hudi/common/config/TestConfigGroups.java | 68 ++
.../common/config/TestHoodieIndexingConfig.java | 177 +++++
.../schema/TestHoodieSchemaTypePromotion.java | 138 ++++
.../read/TestBufferedRecordMergerFactory.java | 84 +++
.../table/read/TestIncrementalQueryAnalyzer.java | 89 +++
.../TestSortedKeyBasedFileGroupRecordBuffer.java | 35 +
.../common/util/TestBufferedRandomAccessFile.java | 132 ++++
.../hudi/common/util/TestCollectionUtils.java | 170 +++++
.../apache/hudi/common/util/TestConfigUtils.java | 83 ++-
.../apache/hudi/common/util/TestDateTimeUtils.java | 108 ++++
.../InflaterDeflaterReuseRLIBenchmark.java | 327 ++++++++++
.../common/util/collection/InspectRLISize.java | 58 ++
.../schema/utils/TestAvroSchemaEvolutionUtils.java | 60 ++
.../metadata/TestBaseFileRecordParsingUtils.java | 90 +++
.../TestHoodieBackedTableMetadataDataCleanup.java | 389 ++++++++++-
.../hudi/metadata/TestHoodieTableMetadataUtil.java | 555 +++++++++++++++-
.../hudi/metadata/TestMetadataPartitionType.java | 78 +++
.../metrics/m3/TestM3ScopeReporterAdaptor.java | 163 +++++
.../java/org/apache/hudi/stats/TestValueType.java | 229 +++++++
hudi-flink-datasource/hudi-flink/pom.xml | 2 +-
.../apache/hudi/configuration/OptionsResolver.java | 7 +
.../sink/bucket/BucketBulkInsertWriterHelper.java | 15 +-
.../sink/bucket/BucketStreamWriteFunction.java | 9 +-
.../sink/partitioner/BucketIndexPartitioner.java | 12 +-
.../java/org/apache/hudi/sink/utils/Pipelines.java | 14 +-
.../java/org/apache/hudi/source/HoodieSource.java | 12 +-
.../apache/hudi/source/reader/BatchRecords.java | 64 +-
.../hudi/source/reader/HoodieSourceReader.java | 5 +-
.../source/reader/HoodieSourceSplitReader.java | 87 ++-
.../function/AbstractSplitReaderFunction.java | 107 ++-
.../function/HoodieCdcSplitReaderFunction.java | 27 +-
.../reader/function/HoodieSplitReaderFunction.java | 43 +-
.../reader/function/SplitReaderFunction.java | 46 +-
.../org/apache/hudi/table/HoodieTableSource.java | 27 +-
.../apache/hudi/table/format/cdc/CdcIterators.java | 5 +
.../hudi/sink/utils/BulkInsertFunctionWrapper.java | 7 +-
.../org/apache/hudi/source/TestHoodieSource.java | 18 +-
.../hudi/source/reader/TestBatchRecords.java | 249 ++-----
.../source/reader/TestHoodieSourceSplitReader.java | 482 ++++++++++++--
.../function/TestAbstractSplitReaderFunction.java | 153 ++++-
.../function/TestHoodieCdcSplitReaderFunction.java | 11 +-
.../function/TestHoodieSplitReaderFunction.java | 92 ++-
.../apache/hudi/table/ITTestHoodieDataSource.java | 148 ++---
hudi-flink-datasource/hudi-flink1.17.x/pom.xml | 2 +-
hudi-flink-datasource/hudi-flink1.18.x/pom.xml | 2 +-
hudi-flink-datasource/hudi-flink1.19.x/pom.xml | 2 +-
hudi-flink-datasource/hudi-flink1.20.x/pom.xml | 2 +-
hudi-flink-datasource/hudi-flink2.0.x/pom.xml | 2 +-
hudi-flink-datasource/hudi-flink2.1.x/pom.xml | 2 +-
.../common/functional/TestHoodieLogFormat.java | 202 ++++++
.../hudi/common/table/TestHoodieTableConfig.java | 4 +-
.../hudi/metadata/TestBaseTableMetadata.java | 299 +++++++++
.../TestFileSystemBackedTableMetadata.java | 36 ++
.../hudi/metadata/TestHoodieMetadataPayload.java | 63 ++
hudi-io/pom.xml | 2 +-
.../org/apache/hudi/common/util/StringUtils.java | 36 ++
.../apache/hudi/common/util/TestStringUtils.java | 64 ++
hudi-platform-service/hudi-metaserver/pom.xml | 2 +-
.../org/apache/hudi/HoodieCreateRecordUtils.scala | 45 +-
.../spark/sql/hudi/catalog/BasicStagedTable.scala | 2 +-
.../spark/sql/hudi/catalog/HoodieCatalog.scala | 20 +-
.../org/apache/hudi/TestHoodieSchemaUtils.java | 19 +
.../sql/hudi/catalog/TestBasicStagedTable.scala | 52 ++
.../hudi/functional/TestHoodieBackedMetadata.java | 176 +++++
.../java/org/apache/hudi/io/TestMergeHandle.java | 59 ++
.../apache/hudi/TestHoodieCreateRecordUtils.scala | 291 +++++++++
.../org/apache/hudi/TestSparkFilterHelper.scala | 12 +-
.../functional/TestLegacyParquetReadPath.scala | 473 ++++++++++++++
.../functional/TestMetadataTableWithSparkSQL.scala | 313 +++++++++
.../functional/TestPayloadDeprecationFlow.scala | 72 ++-
.../hudi/functional/TestRecordLevelIndex.scala | 102 +++
.../functional/TestSecondaryIndexPruning.scala | 72 +++
.../catalog/TestHoodieCatalogStagedTable.scala | 112 ++++
.../Spark3LegacyHoodieParquetFileFormat.scala} | 96 +--
.../Spark33LegacyHoodieParquetFileFormat.scala | 460 +------------
.../Spark34LegacyHoodieParquetFileFormat.scala | 438 +------------
.../Spark35LegacyHoodieParquetFileFormat.scala | 439 +------------
hudi-sync/hudi-adb-sync/pom.xml | 2 +-
.../hive/HiveStylePartitionValueExtractor.java | 4 +-
.../org/apache/hudi/hive/HiveSyncConfigHolder.java | 22 +
.../java/org/apache/hudi/hive/HiveSyncTool.java | 3 +-
.../org/apache/hudi/hive/HoodieHiveSyncClient.java | 61 +-
.../hudi/hive/MultiPartKeysValueExtractor.java | 4 +-
.../java/org/apache/hudi/hive/ddl/DDLExecutor.java | 7 +
.../org/apache/hudi/hive/ddl/HMSDDLExecutor.java | 38 +-
.../apache/hudi/hive/ddl/HiveQueryDDLExecutor.java | 91 ++-
.../hudi/hive/ddl/QueryBasedDDLExecutor.java | 80 ++-
.../hudi/hive/transaction/lock/Heartbeat.java | 32 +-
.../lock/HiveMetastoreBasedLockProvider.java | 153 +++--
.../org/apache/hudi/hive/util/HiveDriverPool.java | 463 +++++++++++++
.../org/apache/hudi/hive/util/HiveSchemaUtil.java | 51 +-
.../hudi/hive/util/PartitionFilterGenerator.java | 11 +-
.../org/apache/hudi/hive/TestHiveSyncTool.java | 287 ++++++++
.../hudi/hive/TestHoodieHiveSyncClientClose.java | 78 +++
.../hudi/hive/TestMultiPartKeysValueExtractor.java | 15 +
.../hudi/hive/TestPartitionValueExtractor.java | 8 +
.../org/apache/hudi/hive/TestSparkSchemaUtils.java | 25 +
.../hive/ddl/TestHMSDDLExecutorCreateTable.java | 70 ++
.../TestQueryBasedDDLExecutorTouchBatching.java | 192 ++++++
.../apache/hudi/hive/testutils/HiveTestUtil.java | 6 +-
.../HiveMetastoreBasedLockProviderTestBase.java | 95 +++
.../hudi/hive/transaction/lock/TestHeartbeat.java | 124 ++++
...veMetastoreBasedLockProviderAcquireTimeout.java | 90 +++
.../TestHiveMetastoreBasedLockProviderClose.java | 73 +++
...TestHiveMetastoreBasedLockProviderLockLoss.java | 362 +++++++++++
.../apache/hudi/hive/util/TestHiveDriverPool.java | 316 +++++++++
.../hive/util/TestPartitionFilterGenerator.java | 24 +
.../common/util/SparkDataSourceTableUtils.java | 13 +-
.../hudi/sync/common/util/SparkSchemaUtils.java | 79 ++-
hudi-tests-common/pom.xml | 2 +-
.../service/handlers/marker/MarkerDirState.java | 122 ++--
.../handlers/marker/TestMarkerDirState.java | 170 +++++
hudi-trino-plugin/pom.xml | 482 --------------
.../plugin/hudi/reader/HudiTrinoReaderContext.java | 227 -------
.../trino/plugin/hudi/reader/HudiTrinoRecord.java | 183 ------
.../modernizer/violations-production-code-only.xml | 0
.../.mvn/modernizer/violations.xml | 0
hudi-trino/README.md | 57 ++
hudi-trino/pom.xml | 718 +++++++++++++++++++++
.../io/trino/plugin/hudi/ForHudiSplitManager.java | 0
.../io/trino/plugin/hudi/ForHudiSplitSource.java | 0
.../plugin/hudi/HudiBaseFileOnlyPageSource.java | 12 +-
.../main/java/io/trino/plugin/hudi/HudiConfig.java | 18 +-
.../java/io/trino/plugin/hudi/HudiConnector.java | 0
.../io/trino/plugin/hudi/HudiConnectorFactory.java | 28 +-
.../java/io/trino/plugin/hudi/HudiErrorCode.java | 0
.../java/io/trino/plugin/hudi/HudiFileStatus.java | 0
.../java/io/trino/plugin/hudi/HudiMetadata.java | 30 +-
.../io/trino/plugin/hudi/HudiMetadataFactory.java | 0
.../main/java/io/trino/plugin/hudi/HudiModule.java | 4 +-
.../java/io/trino/plugin/hudi/HudiPageSource.java | 74 ++-
.../trino/plugin/hudi/HudiPageSourceProvider.java | 159 +++--
.../main/java/io/trino/plugin/hudi/HudiPlugin.java | 0
.../java/io/trino/plugin/hudi/HudiPredicates.java | 0
.../trino/plugin/hudi/HudiSessionProperties.java | 19 +
.../main/java/io/trino/plugin/hudi/HudiSplit.java | 1 -
.../io/trino/plugin/hudi/HudiSplitManager.java | 11 +-
.../java/io/trino/plugin/hudi/HudiSplitSource.java | 16 +-
.../java/io/trino/plugin/hudi/HudiTableHandle.java | 75 ++-
.../java/io/trino/plugin/hudi/HudiTableInfo.java | 0
.../java/io/trino/plugin/hudi/HudiTableName.java | 0
.../io/trino/plugin/hudi/HudiTableProperties.java | 0
.../trino/plugin/hudi/HudiTransactionManager.java | 0
.../main/java/io/trino/plugin/hudi/HudiUtil.java | 175 ++++-
.../main/java/io/trino/plugin/hudi/TableType.java | 0
.../java/io/trino/plugin/hudi/TimelineTable.java | 0
.../plugin/hudi/cache/HudiCacheKeyProvider.java | 0
.../io/trino/plugin/hudi/file/HudiBaseFile.java | 0
.../java/io/trino/plugin/hudi/file/HudiFile.java | 0
.../io/trino/plugin/hudi/file/HudiLogFile.java | 0
.../plugin/hudi/io/HudiTrinoFileReaderFactory.java | 39 +-
.../trino/plugin/hudi/io/HudiTrinoIOFactory.java | 12 +-
.../hudi/io/HudiTrinoParquetFileFormatUtils.java | 210 ++++++
.../hudi/io/InlineSeekableDataInputStream.java | 2 +-
.../hudi/io/TrinoSeekableDataInputStream.java | 0
.../hudi/partition/HiveHudiPartitionInfo.java | 0
.../plugin/hudi/partition/HudiPartitionInfo.java | 0
.../hudi/partition/HudiPartitionInfoLoader.java | 0
.../plugin/hudi/query/HudiDirectoryLister.java | 0
.../hudi/query/HudiSnapshotDirectoryLister.java | 2 +-
.../hudi/query/index/HudiBaseIndexSupport.java | 2 +-
.../query/index/HudiColumnStatsIndexSupport.java | 12 +-
.../plugin/hudi/query/index/HudiIndexSupport.java | 0
.../hudi/query/index/HudiNoOpIndexSupport.java | 2 +-
.../index/HudiPartitionStatsIndexSupport.java | 11 +-
.../query/index/HudiRecordLevelIndexSupport.java | 6 +-
.../query/index/HudiSecondaryIndexSupport.java | 6 +-
.../hudi/query/index/IndexSupportFactory.java | 4 +-
.../plugin/hudi/reader/HudiTrinoReaderContext.java | 288 +++++++++
.../hudi/split/HudiBackgroundSplitLoader.java | 6 +-
.../trino/plugin/hudi/split/HudiSplitFactory.java | 28 +-
.../plugin/hudi/split/HudiSplitWeightProvider.java | 0
.../hudi/split/SizeBasedSplitWeightProvider.java | 0
.../plugin/hudi/stats/ForHudiTableStatistics.java | 0
.../plugin/hudi/stats/HudiTableStatistics.java | 0
.../plugin/hudi/stats/TableMetadataReader.java | 56 +-
.../plugin/hudi/stats/TableStatisticsReader.java | 4 +-
.../hudi/storage/HudiTrinoInlineStorage.java | 0
.../plugin/hudi/storage/HudiTrinoStorage.java | 0
.../hudi/storage/TrinoStorageConfiguration.java | 0
.../trino/plugin/hudi/util/HudiAvroSerializer.java | 2 +-
.../trino/plugin/hudi/util/HudiTableTypeUtils.java | 0
.../plugin/hudi/util/SynthesizedColumnHandler.java | 0
.../hudi/util/SynthesizedColumnStrategy.java | 0
.../trino/plugin/hudi/util/TupleDomainUtils.java | 0
.../plugin/hudi/BaseHudiConnectorSmokeTest.java | 0
.../java/io/trino/plugin/hudi/HudiQueryRunner.java | 8 +-
.../java/io/trino/plugin/hudi/HudiUtilTest.java | 0
.../java/io/trino/plugin/hudi/SessionBuilder.java | 21 +
.../hudi/TestHudiAlluxioCacheFileOperations.java | 10 -
.../hudi/TestHudiAlluxioCachingSmokeTest.java | 0
.../java/io/trino/plugin/hudi/TestHudiConfig.java | 9 +-
.../plugin/hudi/TestHudiConnectorFactory.java | 0
.../TestHudiConnectorParquetColumnNamesTest.java | 0
.../trino/plugin/hudi/TestHudiConnectorTest.java | 5 +
.../io/trino/plugin/hudi/TestHudiCustomMerger.java | 104 +++
.../plugin/hudi/TestHudiCustomMergerEndToEnd.java | 128 ++++
.../hudi/TestHudiMemoryCacheFileOperations.java | 10 -
.../hudi/TestHudiMinioConnectorSmokeTest.java | 0
.../plugin/hudi/TestHudiNoCacheFileOperations.java | 10 -
.../io/trino/plugin/hudi/TestHudiPageSource.java | 2 +-
.../hudi/TestHudiPageSourceProviderTest.java | 0
.../java/io/trino/plugin/hudi/TestHudiPlugin.java | 0
.../plugin/hudi/TestHudiSessionProperties.java | 14 +
.../trino/plugin/hudi/TestHudiSharedMetastore.java | 13 +-
.../io/trino/plugin/hudi/TestHudiSmokeTest.java | 12 +-
.../io/trino/plugin/hudi/TestHudiSystemTables.java | 0
.../plugin/hudi/TestingHudiConnectorFactory.java | 0
.../io/trino/plugin/hudi/TestingHudiPlugin.java | 0
.../hudi/io/TestInlineSeekableDataInputStream.java | 0
.../partition/TestHudiPartitionInfoLoader.java | 6 +-
.../index/HudiRecordLevelIndexSupportTest.java | 0
.../hudi/query/index/TestingColumnHandle.java | 0
.../plugin/hudi/split/TestHudiSplitFactory.java | 7 +-
.../testing/CustomMergerHudiTablesInitializer.java | 239 +++++++
.../plugin/hudi/testing/HudiTableUnzipper.java | 0
.../plugin/hudi/testing/HudiTablesInitializer.java | 0
.../trino/plugin/hudi/testing/HudiTestUtils.java | 0
...crementalCustomMergerHudiTablesInitializer.java | 481 ++++++++++++++
.../hudi/testing/KeyBasedTestRecordMerger.java | 84 +++
.../plugin/hudi/testing/MaxRankRecordMerger.java | 108 ++++
.../NonProjectionCompatibleTestRecordMerger.java | 34 +
.../testing/ResourceHudiTablesInitializer.java | 0
.../hudi/testing/TpchHudiTablesInitializer.java | 21 +-
.../trino/plugin/hudi/testing/TypeInfoHelper.java | 0
.../plugin/hudi/util/FileOperationAssertions.java | 176 +++++
.../trino/plugin/hudi/util/FileOperationUtils.java | 0
...TestTupleDomainUtilsExtendedNullFilterTest.java | 0
.../plugin/hudi/util/TestTupleDomainUtilsTest.java | 0
.../hudi_comprehensive_types_v6_mor.md | 17 +
.../hudi_comprehensive_types_v6_mor.zip | Bin
.../hudi_comprehensive_types_v8_mor.md | 17 +
.../hudi_comprehensive_types_v8_mor.zip | Bin
.../hudi_cow_pt_table_with_field_names_in_caps.md | 17 +
.../hudi_cow_pt_table_with_field_names_in_caps.zip | Bin
.../hudi-testing-data/hudi_cow_pt_tbl.zip | Bin 11750 -> 11752 bytes
.../hudi_cow_table_with_field_names_in_caps.md | 17 +
.../hudi_cow_table_with_field_names_in_caps.zip | Bin
...able_with_multi_keys_and_field_names_in_caps.md | 17 +
...ble_with_multi_keys_and_field_names_in_caps.zip | Bin
.../hudi_custom_keygen_pt_v8_mor.md | 17 +
.../hudi_custom_keygen_pt_v8_mor.zip | Bin
.../hudi_mor_table_with_field_names_in_caps.md | 17 +
.../hudi_mor_table_with_field_names_in_caps.zip | Bin
.../hudi-testing-data/hudi_multi_fg_pt_v6_mor.md | 17 +
.../hudi-testing-data/hudi_multi_fg_pt_v6_mor.zip | Bin
.../hudi-testing-data/hudi_multi_fg_pt_v8_mor.md | 17 +
.../hudi-testing-data/hudi_multi_fg_pt_v8_mor.zip | Bin
.../hudi-testing-data/hudi_multi_pt_v8_mor.md | 17 +
.../hudi-testing-data/hudi_multi_pt_v8_mor.zip | Bin
.../hudi_non_extractable_partition_path.md | 17 +
.../hudi_non_extractable_partition_path.zip | Bin
.../hudi-testing-data/hudi_non_part_cow.md | 17 +
.../hudi-testing-data/hudi_non_part_cow.zip | Bin 5980 -> 5966 bytes
.../hudi-testing-data/hudi_non_part_mor.md | 17 +
.../hudi-testing-data/hudi_non_part_mor.zip | Bin
.../hudi-testing-data/hudi_stock_ticks_cow.zip | Bin
.../hudi-testing-data/hudi_stock_ticks_mor.zip | Bin
...tamp_keygen_pt_epoch_to_yyyy_mm_dd_hh_v8_mor.md | 17 +
...amp_keygen_pt_epoch_to_yyyy_mm_dd_hh_v8_mor.zip | Bin
...amp_keygen_pt_scalar_to_yyyy_mm_dd_hh_v8_mor.md | 17 +
...mp_keygen_pt_scalar_to_yyyy_mm_dd_hh_v8_mor.zip | Bin
.../hudi-testing-data/hudi_trips_cow_v8.md | 17 +
.../hudi-testing-data/hudi_trips_cow_v8.zip | Bin
.../hudi-testing-data/stock_ticks_cow.zip | Bin
.../hudi-testing-data/stock_ticks_mor.zip | Bin
.../src/test/resources/long_timestamp.parquet | Bin
.../hudi/utilities/sources/S3EventsSource.java | 6 +
.../org/apache/hudi/utilities/sources/Source.java | 12 +
.../apache/hudi/utilities/sources/TestSource.java | 73 +++
packaging/hudi-cli-bundle/pom.xml | 2 +-
packaging/hudi-flink-bundle/pom.xml | 200 ++++++
packaging/hudi-integ-test-bundle/pom.xml | 2 +-
packaging/hudi-metaserver-server-bundle/pom.xml | 4 +-
packaging/hudi-trino-bundle/pom.xml | 236 -------
.../java/org/apache/hudi/trino/bundle/Main.java | 36 --
pom.xml | 64 +-
rfc/README.md | 3 +
scripts/release/validate_source_copyright.sh | 4 +-
scripts/release/validate_staged_bundles.sh | 2 +-
style/checkstyle-suppressions.xml | 4 +-
375 files changed, 18442 insertions(+), 4527 deletions(-)
create mode 100644 .github/workflows/hudi_trino_ci.yml
create mode 100644 .github/workflows/hudi_trino_compat.yml
delete mode 100644 docker/hoodie/hadoop/trinobase/Dockerfile
delete mode 100644 docker/hoodie/hadoop/trinobase/pom.xml
delete mode 100644 docker/hoodie/hadoop/trinobase/scripts/trino.sh
delete mode 100644 docker/hoodie/hadoop/trinocoordinator/Dockerfile
delete mode 100644
docker/hoodie/hadoop/trinocoordinator/etc/catalog/hive.properties
delete mode 100644 docker/hoodie/hadoop/trinocoordinator/etc/config.properties
delete mode 100644 docker/hoodie/hadoop/trinocoordinator/etc/jvm.config
delete mode 100644 docker/hoodie/hadoop/trinocoordinator/etc/log.properties
delete mode 100644 docker/hoodie/hadoop/trinocoordinator/etc/node.properties
delete mode 100644 docker/hoodie/hadoop/trinocoordinator/pom.xml
delete mode 100644 docker/hoodie/hadoop/trinoworker/Dockerfile
delete mode 100644 docker/hoodie/hadoop/trinoworker/etc/catalog/hive.properties
delete mode 100644 docker/hoodie/hadoop/trinoworker/etc/config.properties
delete mode 100644 docker/hoodie/hadoop/trinoworker/etc/jvm.config
delete mode 100644 docker/hoodie/hadoop/trinoworker/etc/log.properties
delete mode 100644 docker/hoodie/hadoop/trinoworker/etc/node.properties
delete mode 100644 docker/hoodie/hadoop/trinoworker/pom.xml
create mode 100644 hudi-agent-gateway/src/hudi_agent_gateway.egg-info/PKG-INFO
create mode 100644
hudi-agent-gateway/src/hudi_agent_gateway.egg-info/SOURCES.txt
create mode 100644
hudi-agent-gateway/src/hudi_agent_gateway.egg-info/dependency_links.txt
create mode 100644
hudi-agent-gateway/src/hudi_agent_gateway.egg-info/entry_points.txt
create mode 100644
hudi-agent-gateway/src/hudi_agent_gateway.egg-info/requires.txt
create mode 100644
hudi-agent-gateway/src/hudi_agent_gateway.egg-info/top_level.txt
create mode 100644
hudi-client/hudi-client-common/src/test/java/org/apache/hudi/client/TestHoodieTableServiceManagerClient.java
create mode 100644
hudi-client/hudi-client-common/src/test/java/org/apache/hudi/client/transaction/lock/TestFileSystemBasedLockProvider.java
create mode 100644
hudi-client/hudi-client-common/src/test/java/org/apache/hudi/metadata/TestSecondaryIndexRecordGenerationUtils.java
create mode 100644
hudi-client/hudi-client-common/src/test/java/org/apache/hudi/table/marker/TestMarkerBasedRollbackUtils.java
create mode 100644
hudi-client/hudi-flink-client/src/test/java/org/apache/hudi/client/TestFlinkWriteClientFunctional.java
create mode 100644
hudi-client/hudi-flink-client/src/test/java/org/apache/hudi/client/model/TestHoodieFlinkInternalRowSerializer.java
create mode 100644
hudi-client/hudi-flink-client/src/test/java/org/apache/hudi/table/TestHoodieFlinkTableActionRouting.java
create mode 100644
hudi-client/hudi-flink-client/src/test/java/org/apache/hudi/table/action/commit/TestFlinkDeleteHelper.java
create mode 100644
hudi-client/hudi-flink-client/src/test/java/org/apache/hudi/util/TestRowDataUtils.java
create mode 100644
hudi-client/hudi-java-client/src/test/java/org/apache/hudi/metadata/TestJavaHoodieMetadataBulkInsertPartitioner.java
create mode 100644
hudi-client/hudi-java-client/src/test/java/org/apache/hudi/table/action/commit/TestJavaDeleteHelper.java
delete mode 100644
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/TestFileBasedLockProvider.java
create mode 100644
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/metadata/TestSparkHoodieBackedTableMetadataWriter.java
create mode 100644
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/stats/TestSparkValueMetadataUtils.java
create mode 100644
hudi-common/src/test/java/org/apache/hudi/common/config/TestConfigGroups.java
create mode 100644
hudi-common/src/test/java/org/apache/hudi/common/config/TestHoodieIndexingConfig.java
create mode 100644
hudi-common/src/test/java/org/apache/hudi/common/schema/TestHoodieSchemaTypePromotion.java
create mode 100644
hudi-common/src/test/java/org/apache/hudi/common/table/read/TestBufferedRecordMergerFactory.java
create mode 100644
hudi-common/src/test/java/org/apache/hudi/common/table/read/TestIncrementalQueryAnalyzer.java
create mode 100644
hudi-common/src/test/java/org/apache/hudi/common/util/TestBufferedRandomAccessFile.java
create mode 100644
hudi-common/src/test/java/org/apache/hudi/common/util/collection/InflaterDeflaterReuseRLIBenchmark.java
create mode 100644
hudi-common/src/test/java/org/apache/hudi/common/util/collection/InspectRLISize.java
create mode 100644
hudi-common/src/test/java/org/apache/hudi/metadata/TestBaseFileRecordParsingUtils.java
create mode 100644
hudi-common/src/test/java/org/apache/hudi/metrics/m3/TestM3ScopeReporterAdaptor.java
create mode 100644
hudi-hadoop-common/src/test/java/org/apache/hudi/metadata/TestBaseTableMetadata.java
create mode 100644
hudi-spark-datasource/hudi-spark-common/src/test/scala/org/apache/spark/sql/hudi/catalog/TestBasicStagedTable.scala
create mode 100644
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/TestHoodieCreateRecordUtils.scala
create mode 100644
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestLegacyParquetReadPath.scala
create mode 100644
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestMetadataTableWithSparkSQL.scala
create mode 100644
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/catalog/TestHoodieCatalogStagedTable.scala
copy
hudi-spark-datasource/{hudi-spark3.5.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark35LegacyHoodieParquetFileFormat.scala
=>
hudi-spark3-common/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark3LegacyHoodieParquetFileFormat.scala}
(88%)
create mode 100644
hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/util/HiveDriverPool.java
create mode 100644
hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/TestHoodieHiveSyncClientClose.java
create mode 100644
hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/ddl/TestHMSDDLExecutorCreateTable.java
create mode 100644
hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/ddl/TestQueryBasedDDLExecutorTouchBatching.java
create mode 100644
hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/transaction/lock/HiveMetastoreBasedLockProviderTestBase.java
create mode 100644
hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/transaction/lock/TestHeartbeat.java
create mode 100644
hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/transaction/lock/TestHiveMetastoreBasedLockProviderAcquireTimeout.java
create mode 100644
hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/transaction/lock/TestHiveMetastoreBasedLockProviderClose.java
create mode 100644
hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/transaction/lock/TestHiveMetastoreBasedLockProviderLockLoss.java
create mode 100644
hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/util/TestHiveDriverPool.java
create mode 100644
hudi-timeline-service/src/test/java/org/apache/hudi/timeline/service/handlers/marker/TestMarkerDirState.java
delete mode 100644 hudi-trino-plugin/pom.xml
delete mode 100644
hudi-trino-plugin/src/main/java/io/trino/plugin/hudi/reader/HudiTrinoReaderContext.java
delete mode 100644
hudi-trino-plugin/src/main/java/io/trino/plugin/hudi/reader/HudiTrinoRecord.java
rename {hudi-trino-plugin =>
hudi-trino}/.mvn/modernizer/violations-production-code-only.xml (100%)
rename {hudi-trino-plugin => hudi-trino}/.mvn/modernizer/violations.xml (100%)
create mode 100644 hudi-trino/README.md
create mode 100644 hudi-trino/pom.xml
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/ForHudiSplitManager.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/ForHudiSplitSource.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiBaseFileOnlyPageSource.java
(91%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiConfig.java (95%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiConnector.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiConnectorFactory.java (79%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiErrorCode.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiFileStatus.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiMetadata.java (94%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiMetadataFactory.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiModule.java (95%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiPageSource.java (60%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiPageSourceProvider.java (78%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiPlugin.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiPredicates.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiSessionProperties.java (95%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiSplit.java (99%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiSplitManager.java (93%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiSplitSource.java (94%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiTableHandle.java (77%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiTableInfo.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiTableName.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiTableProperties.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiTransactionManager.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/HudiUtil.java (65%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/TableType.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/TimelineTable.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/cache/HudiCacheKeyProvider.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/file/HudiBaseFile.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/file/HudiFile.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/file/HudiLogFile.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/io/HudiTrinoFileReaderFactory.java
(55%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/io/HudiTrinoIOFactory.java (80%)
create mode 100644
hudi-trino/src/main/java/io/trino/plugin/hudi/io/HudiTrinoParquetFileFormatUtils.java
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/io/InlineSeekableDataInputStream.java
(98%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/io/TrinoSeekableDataInputStream.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/partition/HiveHudiPartitionInfo.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/partition/HudiPartitionInfo.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/partition/HudiPartitionInfoLoader.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/query/HudiDirectoryLister.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/query/HudiSnapshotDirectoryLister.java
(99%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/query/index/HudiBaseIndexSupport.java
(98%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/query/index/HudiColumnStatsIndexSupport.java
(97%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/query/index/HudiIndexSupport.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/query/index/HudiNoOpIndexSupport.java
(96%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/query/index/HudiPartitionStatsIndexSupport.java
(94%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/query/index/HudiRecordLevelIndexSupport.java
(98%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/query/index/HudiSecondaryIndexSupport.java
(97%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/query/index/IndexSupportFactory.java
(98%)
create mode 100644
hudi-trino/src/main/java/io/trino/plugin/hudi/reader/HudiTrinoReaderContext.java
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/split/HudiBackgroundSplitLoader.java
(98%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/split/HudiSplitFactory.java (85%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/split/HudiSplitWeightProvider.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/split/SizeBasedSplitWeightProvider.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/stats/ForHudiTableStatistics.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/stats/HudiTableStatistics.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/stats/TableMetadataReader.java
(50%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/stats/TableStatisticsReader.java
(97%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/storage/HudiTrinoInlineStorage.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/storage/HudiTrinoStorage.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/storage/TrinoStorageConfiguration.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/util/HudiAvroSerializer.java
(99%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/util/HudiTableTypeUtils.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/util/SynthesizedColumnHandler.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/util/SynthesizedColumnStrategy.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/main/java/io/trino/plugin/hudi/util/TupleDomainUtils.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/BaseHudiConnectorSmokeTest.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/HudiQueryRunner.java (97%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/HudiUtilTest.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/SessionBuilder.java (86%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiAlluxioCacheFileOperations.java
(91%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiAlluxioCachingSmokeTest.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiConfig.java (94%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiConnectorFactory.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiConnectorParquetColumnNamesTest.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiConnectorTest.java (89%)
create mode 100644
hudi-trino/src/test/java/io/trino/plugin/hudi/TestHudiCustomMerger.java
create mode 100644
hudi-trino/src/test/java/io/trino/plugin/hudi/TestHudiCustomMergerEndToEnd.java
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiMemoryCacheFileOperations.java
(89%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiMinioConnectorSmokeTest.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiNoCacheFileOperations.java
(88%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiPageSource.java (91%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiPageSourceProviderTest.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiPlugin.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiSessionProperties.java
(68%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiSharedMetastore.java
(94%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiSmokeTest.java (99%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestHudiSystemTables.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestingHudiConnectorFactory.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/TestingHudiPlugin.java (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/io/TestInlineSeekableDataInputStream.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/partition/TestHudiPartitionInfoLoader.java
(98%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/query/index/HudiRecordLevelIndexSupportTest.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/query/index/TestingColumnHandle.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/split/TestHudiSplitFactory.java
(98%)
create mode 100644
hudi-trino/src/test/java/io/trino/plugin/hudi/testing/CustomMergerHudiTablesInitializer.java
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/testing/HudiTableUnzipper.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/testing/HudiTablesInitializer.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/testing/HudiTestUtils.java (100%)
create mode 100644
hudi-trino/src/test/java/io/trino/plugin/hudi/testing/IncrementalCustomMergerHudiTablesInitializer.java
create mode 100644
hudi-trino/src/test/java/io/trino/plugin/hudi/testing/KeyBasedTestRecordMerger.java
create mode 100644
hudi-trino/src/test/java/io/trino/plugin/hudi/testing/MaxRankRecordMerger.java
create mode 100644
hudi-trino/src/test/java/io/trino/plugin/hudi/testing/NonProjectionCompatibleTestRecordMerger.java
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/testing/ResourceHudiTablesInitializer.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/testing/TpchHudiTablesInitializer.java
(95%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/testing/TypeInfoHelper.java
(100%)
create mode 100644
hudi-trino/src/test/java/io/trino/plugin/hudi/util/FileOperationAssertions.java
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/util/FileOperationUtils.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/util/TestTupleDomainUtilsExtendedNullFilterTest.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/java/io/trino/plugin/hudi/util/TestTupleDomainUtilsTest.java
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_comprehensive_types_v6_mor.md
(91%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_comprehensive_types_v6_mor.zip
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_comprehensive_types_v8_mor.md
(91%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_comprehensive_types_v8_mor.zip
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_cow_pt_table_with_field_names_in_caps.md
(72%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_cow_pt_table_with_field_names_in_caps.zip
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_cow_pt_tbl.zip (74%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_cow_table_with_field_names_in_caps.md
(59%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_cow_table_with_field_names_in_caps.zip
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_cow_table_with_multi_keys_and_field_names_in_caps.md
(60%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_cow_table_with_multi_keys_and_field_names_in_caps.zip
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_custom_keygen_pt_v8_mor.md
(78%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_custom_keygen_pt_v8_mor.zip
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_mor_table_with_field_names_in_caps.md
(59%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_mor_table_with_field_names_in_caps.zip
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_multi_fg_pt_v6_mor.md
(72%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_multi_fg_pt_v6_mor.zip
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_multi_fg_pt_v8_mor.md
(75%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_multi_fg_pt_v8_mor.zip
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_multi_pt_v8_mor.md (78%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_multi_pt_v8_mor.zip (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_non_extractable_partition_path.md
(66%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_non_extractable_partition_path.zip
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_non_part_cow.md (65%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_non_part_cow.zip (62%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_non_part_mor.md (74%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_non_part_mor.zip (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_stock_ticks_cow.zip (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_stock_ticks_mor.zip (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_timestamp_keygen_pt_epoch_to_yyyy_mm_dd_hh_v8_mor.md
(77%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_timestamp_keygen_pt_epoch_to_yyyy_mm_dd_hh_v8_mor.zip
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_timestamp_keygen_pt_scalar_to_yyyy_mm_dd_hh_v8_mor.md
(78%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_timestamp_keygen_pt_scalar_to_yyyy_mm_dd_hh_v8_mor.zip
(100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_trips_cow_v8.md (59%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/hudi_trips_cow_v8.zip (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/stock_ticks_cow.zip (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/hudi-testing-data/stock_ticks_mor.zip (100%)
rename {hudi-trino-plugin =>
hudi-trino}/src/test/resources/long_timestamp.parquet (100%)
create mode 100644
hudi-utilities/src/test/java/org/apache/hudi/utilities/sources/TestSource.java
delete mode 100644 packaging/hudi-trino-bundle/pom.xml
delete mode 100644
packaging/hudi-trino-bundle/src/main/java/org/apache/hudi/trino/bundle/Main.java