This is an automated email from the ASF dual-hosted git repository.
voonhous pushed a change to branch bump-trino-plugin-to-1.1
in repository https://gitbox.apache.org/repos/asf/hudi.git
omit 114656fb00fe chore: Bump hudi-trino-plugin to 1.1.0
omit 7f72eaaeb992 test: disable resolve column name casing by default
omit 050a1589bb22 fix: Append Only Required Hudi Meta Fields for MOR Tables
add 1f0dfb37d39a fix(flink): Add customized partitioner for global RLI
bucket assigner operator (#18725)
add f2fdca26fef4 fix(metadata): Exclude Variant/Blob/Vector from V1 column
stats (#18695)
add 0d5b442e266d fix: remove the pk check for Flink append only table
(#18738)
add 1b26f2b4e2ba fix(variant): align Spark 4.1 MOR merge with
PushVariantIntoScan and restore Spark 4.0 reads (#18674)
add 50efb2edc51b feat(blob): RFC-100: Clarify inline vs out-of-line blob
read behavior (#18728)
add e5afbba54f3e fix(flink): shade codehale in flink bundle (#18730)
add 071b3f125b41 fix: clear Hive work map after combine split failures
(#18719)
add 21271e4f115d fix: Fix Scanner resource leak in HiveIncrementalPuller
(#18441)
add fcc211e0038c fix: Add Apache Licence to
hudi-notebooks/requirements.txt (#18745)
add 9230f7c13952 test(spark): Add tests for batch-mode blob reads (#18736)
add ce1f5f0f8c53 fix: Use the latest docker image in hudi-integ-test for
Macbook (#18746)
add d50ccf2fd5ab chore: Update scripts to deploy staging jars as part of
the release process (#18748)
add 971634bb3e4b chore: Enhance validate_staged_bundles.sh to validate
bundles before closing the staging repo (#18749)
add 21cc7c63be9b chore: Add script to copy release artifacts to the same
staging repo (#18747)
add 3d32596a741d fix(docker): tag base image per Java version to avoid
latest collision (#18663)
add dca76ca279fc fix: Support data pruning using nested partition columns
(#18126)
add 6e32f36b6456 fix: Follow-ups to JsonKinesisSource: numeric sequence
comparison and call-site fixes (#18689)
add ae9866a16c75 fix: Enable schema merging for incremental and dfs
sources (#18385)
add 4035f707f8a1 chore: Fix license for copy_staging_repo.sh (#18753)
add 780595b73c99 fix(flink): fix the write handle close for append write
(#18756)
add b934633f066a feat(utilities): add Spark/HoodieStreamer validators for
pre-commit validation - Phase 3 (#18405)
add cd2c8b831c8b [MINOR] Fix typos in comments and assertion messages
(#18763)
add db460814d365 fix(flink): Fix minibatch lookup for global record level
index (#18759)
add 055aa41fd7fa fix(lance): Support Lance file format on Spark 4.1
(#18760)
add 0983c0ddd56a chore: Harden workflow against command injection in PR
title validation (#18771)
add 9026c7defd5d test(trino): de-flake TestHudi*FileOperations by polling
for span stability (#18766)
add 71aa121035cf fix(flink): enforce Parquet VARIANT annotation in Flink
schema conversion for unshredded variant (#18539)
add e406e5d092d0 feat(spark): add restore_to_instant stored procedure
(#18696)
add d94b2e2c3162 feat(spark): add show_inflight_commits and
cleanup_stale_inflight_com… (#18709)
add 162cac2910ee fix(lance): fail fast when write schema contains VARIANT
columns (#18775)
add a5d8fe153067 test(azure): skip ITAzureStorageLockClientAzurite when
MCR image pull fails (#18772)
add 58957a7926e2 fix(aws): implement writer-version update in Glue sync
client (#18707)
add f67dc268211b fix: Enhance hudi-azure-bundle (#18472)
add 642d88c594ff [MINOR] Reserve RFC-105 for Trino Hudi Connector —
Shim/Bundle Refactor (#18781)
add 0b80239a1d61 fix: Disable column stats and partition stats indices for
Lance base files (#18588)
add 89f49b18d0af fix: Skip pre-compaction rollback metadata reads in
getValidInstantTimestamps (#18544)
add 4ac661a8314c fix: Fix SQL syntax parser for CREATE TABLE on Spark 4.1
(#18779)
add f044d3d6396b fix(spark): handle Avro 1.12 logical type values in Spark
4.1 read path (#18773)
add 990fc29f5609 feat(flink): add metrics for RLI load time for bucket
assign functions (#18762)
add 3abe066f3ad5 feat(common): per-partition event-time rollup and
decouple watermark tracking from EVENT_TIME_ORDERING (#18778)
add d78b702c64d5 fix(spark): use HoodieStorageUtils factory in Spark 4.1
legacy parquet read (#18785)
add 0138f41bd421 perf: Improve global index performance for commit time
ordering (#17797)
add 12e87b80afe8 fix: Fix dangling lock from storage based lock (#18439)
add 9565926dfda9 feat(blob): default blob.inline.mode to DESCRIPTOR for
Lance (#18744)
add a687786833a6 chore: add spark4.1 and flink2.1 profile entries to RC
bundle validation (#18796)
add 50eb95c7d6f5 fix(flink): fix disable table service not effective in
hudi-flink (#13875)
add b82a5b2fe835 feat: add metrics for bucketassign.minibatch cache hit
ratio (#18761)
add facb517ef957 feat(spark): Drop Apache Spark 3.3 integration support
(#18786)
add e299b84b10b5 chore: fix asf.yaml invalid key (#18808)
add 7690e33c9368 fix: Append Only Required Hudi Meta Fields for MOR Tables
add 8ca4688eeee6 test: disable resolve column name casing by default
add 01142d4341ac chore: Bump hudi-trino-plugin to 1.1.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (114656fb00fe)
\
N -- N -- N refs/heads/bump-trino-plugin-to-1.1 (01142d4341ac)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 9 +-
.github/workflows/bot.yml | 30 +-
.github/workflows/maven_artifact_validation.yml | 4 +-
.github/workflows/pr_title_validation.yml | 6 +-
.github/workflows/release_candidate_validation.yml | 12 +-
README.md | 1 -
azure-pipelines-20230430.yml | 1 +
docker/README.md | 34 +-
docker/build_docker_images.sh | 6 +-
docker/hoodie/hadoop/datanode/Dockerfile | 5 +-
docker/hoodie/hadoop/historyserver/Dockerfile | 5 +-
docker/hoodie/hadoop/hive_base/Dockerfile | 5 +-
docker/hoodie/hadoop/namenode/Dockerfile | 5 +-
docker/hoodie/hadoop/prestobase/Dockerfile | 3 +-
docker/hoodie/hadoop/trinobase/Dockerfile | 3 +-
.../hudi/aws/sync/AWSGlueCatalogSyncClient.java | 16 +
.../aws/transaction/lock/S3StorageLockClient.java | 1 +
.../hudi/aws/sync/TestAWSGlueSyncClient.java | 51 +
.../transaction/lock/TestS3StorageLockClient.java | 6 +-
.../transaction/lock/AzureStorageLockClient.java | 5 +-
.../lock/ITAzureStorageLockClientAzurite.java | 72 +-
.../lock/TestAzureStorageLockClient.java | 4 +-
.../apache/hudi/client/BaseHoodieWriteClient.java | 120 +-
.../transaction/lock/StorageBasedLockProvider.java | 139 +-
.../lock/metrics/HoodieLockMetrics.java | 9 +
.../transaction/lock/models/LockUpsertResult.java | 4 +-
.../hudi/client/utils/LazyIterableIterator.java | 2 +-
.../client/validator/StreamingOffsetValidator.java | 93 +-
.../config/HoodiePreCommitValidatorConfig.java | 8 +-
.../org/apache/hudi/index/HoodieIndexUtils.java | 5 +-
.../java/org/apache/hudi/io/HoodieWriteHandle.java | 5 +-
.../keygen/TimestampBasedAvroKeyGenerator.java | 2 +-
.../metadata/HoodieBackedTableMetadataWriter.java | 2 +-
.../client/transaction/TestHoodieLockMetrics.java | 37 +
.../lock/TestStorageBasedLockProvider.java | 113 +
.../validator/TestStreamingOffsetValidator.java | 2 +-
.../org/apache/hudi/io/TestHoodieWriteHandle.java | 13 +-
.../row/parquet/ParquetSchemaConverter.java | 31 +-
.../apache/hudi/util/HoodieSchemaConverter.java | 4 +
.../row/parquet/TestParquetSchemaConverter.java | 148 +
.../hudi/util/TestHoodieSchemaConverter.java | 34 +-
.../hudi/client/utils/SparkValidatorUtils.java | 25 +-
.../io/storage/HoodieSparkFileWriterFactory.java | 1 +
.../hudi/io/storage/HoodieSparkLanceWriter.java | 44 +
.../hudi/io/storage/HoodieSparkParquetReader.java | 11 +-
.../scala/org/apache/hudi/HoodieSparkUtils.scala | 2 -
.../org/apache/hudi/SparkAdapterSupport.scala | 4 +-
.../SparkFileFormatInternalRowReaderContext.scala | 76 +-
.../sql/avro/HoodieSparkSchemaConverters.scala | 20 +-
.../parquet/HoodieParquetReadSupport.scala | 48 +-
.../org/apache/spark/sql/hudi/SparkAdapter.scala | 40 +-
.../hudi/client/TestCoalescingPartitioner.java | 2 +-
.../TestSavepointRestoreCopyOnWrite.java | 89 +
.../apache/hudi/table/TestHoodieSparkTable.java | 2 +-
.../table/action/compact/CompactionTestBase.java | 4 +-
.../parquet/TestHoodieParquetReadSupport.scala | 34 -
.../java/org/apache/hudi/avro/HoodieAvroUtils.java | 145 +-
.../apache/hudi/avro/HoodieAvroWrapperUtils.java | 26 +-
.../hudi/client/validator/ValidationContext.java | 14 +
.../hudi/common/config/HoodieReaderConfig.java | 10 +-
.../hudi/common/engine/HoodieReaderContext.java | 10 +
.../hudi/common/model/HoodieCommitMetadata.java | 36 +
.../table/read/buffer/FileGroupRecordBuffer.java | 27 +-
.../buffer/PositionBasedFileGroupRecordBuffer.java | 10 +-
.../hudi/metadata/HoodieTableMetadataUtil.java | 22 +-
.../hudi/metadata/MetadataPartitionType.java | 13 +-
.../org/apache/hudi/avro/TestHoodieAvroUtils.java | 144 +
.../common/model/TestHoodieCommitMetadata.java | 85 +
.../hudi/metadata/TestHoodieTableMetadataUtil.java | 21 +
.../src/test/python/HoodiePySparkQuickstart.py | 2 +-
.../hudi-examples-spark/src/test/python/README.md | 6 +-
.../apache/hudi/configuration/FlinkOptions.java | 6 +
.../apache/hudi/configuration/OptionsResolver.java | 69 +-
.../hudi/metrics/FlinkBucketAssignMetrics.java | 64 +
.../hudi/metrics/FlinkIndexBackendMetrics.java | 144 +
.../hudi/sink/append/AppendWriteFunction.java | 11 +
.../AppendWriteFunctionWithBIMBufferSort.java | 12 +-
.../apache/hudi/sink/bulk/AutoRowDataKeyGen.java | 2 +-
.../org/apache/hudi/sink/bulk/RowDataKeyGens.java | 11 +-
.../sink/partitioner/BucketAssignFunction.java | 132 +-
.../partitioner/MinibatchBucketAssignFunction.java | 78 +-
.../index/GlobalRecordLevelIndexBackend.java | 41 +-
.../partitioner/index/IndexBackendFactory.java | 5 +-
.../java/org/apache/hudi/sink/utils/Pipelines.java | 5 +-
.../org/apache/hudi/sink/v2/utils/PipelinesV2.java | 8 +-
.../hudi/source/prune/PrimaryKeyPruners.java | 2 +-
.../apache/hudi/streamer/HoodieFlinkStreamer.java | 6 +-
.../org/apache/hudi/table/HoodieTableFactory.java | 19 +-
.../org/apache/hudi/table/HoodieTableSink.java | 6 +-
.../apache/hudi/table/catalog/HoodieCatalog.java | 6 +-
.../hudi/table/catalog/HoodieHiveCatalog.java | 2 +-
.../java/org/apache/hudi/util/StreamerUtil.java | 1 -
.../hudi/configuration/TestOptionsResolver.java | 95 +
.../hudi/metrics/TestFlinkBucketAssignMetrics.java | 133 +
.../hudi/metrics/TestFlinkIndexBackendMetrics.java | 255 ++
.../org/apache/hudi/sink/TestWriteCopyOnWrite.java | 29 +
.../hudi/sink/TestWriteMergeOnReadWithCompact.java | 31 +
.../hudi/sink/append/TestAppendWriteFunction.java | 17 +
.../TestAppendWriteFunctionWithBIMBufferSort.java | 106 +
.../apache/hudi/sink/bulk/TestRowDataKeyGens.java | 21 +-
.../TestMinibatchBucketAssignFunction.java | 132 +-
.../index/TestGlobalRecordLevelIndexBackend.java | 136 +-
.../sink/utils/StreamWriteFunctionWrapper.java | 67 +-
.../org/apache/hudi/sink/utils/TestPipelines.java | 91 +
.../apache/hudi/table/ITTestHoodieDataSource.java | 15 +-
.../ITTestVariantCrossEngineCompatibility.java | 3 +-
.../apache/hudi/table/TestHoodieTableFactory.java | 40 +
.../hudi/table/catalog/TestHoodieCatalog.java | 47 +
.../org/apache/hudi/utils/TestConfigurations.java | 23 +-
.../org/apache/hudi/adapter/DataTypeAdapter.java | 20 +-
.../org/apache/hudi/adapter/DataTypeAdapter.java | 20 +-
.../org/apache/hudi/adapter/DataTypeAdapter.java | 20 +-
.../org/apache/hudi/adapter/DataTypeAdapter.java | 20 +-
.../org/apache/hudi/adapter/DataTypeAdapter.java | 20 +-
.../org/apache/hudi/adapter/DataTypeAdapter.java | 35 +
.../gcp/transaction/lock/GCSStorageLockClient.java | 1 +
.../transaction/lock/TestGCSStorageLockClient.java | 5 +-
.../avro/AvroSchemaConverterWithTimestampNTZ.java | 11 +-
.../hudi/metadata/TestHoodieTableMetadataUtil.java | 108 +
.../hadoop/hive/HoodieCombineHiveInputFormat.java | 174 +-
.../hive/TestHoodieCombineHiveInputFormat.java | 32 +
hudi-integ-test/pom.xml | 2 +-
.../GenericRecordPartialPayloadGenerator.java | 2 +-
.../integ/testsuite/TestFileDeltaInputWriter.java | 2 +-
hudi-notebooks/requirements.txt | 18 +
hudi-spark-datasource/README.md | 4 +-
.../org/apache/hudi/HoodieTimelineCleanupUtil.java | 59 +
.../scala/org/apache/hudi/HoodieFileIndex.scala | 122 +-
.../apache/hudi/SparkHoodieTableFileIndex.scala | 165 +-
.../HoodieFileGroupReaderBasedFileFormat.scala | 23 +-
.../spark/sql/hudi/blob/BatchedBlobReader.scala | 39 +-
.../spark/sql/hudi/blob/ScalarFunctions.scala | 4 +
.../spark/sql/hudi/analysis/HoodieAnalysis.scala | 21 +-
.../CleanupStaleInflightCommitsProcedure.scala | 224 ++
.../hudi/command/procedures/HoodieProcedures.scala | 3 +
.../procedures/RestoreToInstantProcedure.scala | 309 ++
.../procedures/ShowInflightCommitsProcedure.scala | 113 +
.../hudi/TestSparkSqlHudiPackageStructure.java | 1 +
.../TestGlobalIndexCommitTimeOrdering.java | 473 +++
.../io/storage/TestHoodieSparkLanceWriter.java | 72 +
.../org/apache/hudi/TestHoodieFileIndex.scala | 94 +-
.../org/apache/hudi/TestHoodieSparkUtils.scala | 28 +-
.../apache/hudi/blob/TestReadBlobBatching.scala | 223 ++
.../apache/hudi/functional/TestCOWDataSource.scala | 309 +-
.../hudi/functional/TestLanceDataSource.scala | 554 ++-
.../apache/hudi/functional/TestMORDataSource.scala | 18 +-
.../sql/hudi/blob/TestBatchedBlobReaderMerge.scala | 183 +
.../spark/sql/hudi/ddl/TestCreateTable.scala | 12 +-
.../apache/spark/sql/hudi/ddl/TestSpark3DDL.scala | 4 -
.../sql/hudi/dml/others/TestMergeIntoTable.scala | 4 +-
.../sql/hudi/dml/others/TestMergeIntoTable2.scala | 7 +-
.../sql/hudi/dml/schema/TestVariantDataType.scala | 10 -
.../TestCleanupStaleInflightCommitsProcedure.scala | 413 +++
.../sql/hudi/procedure/TestRestoreProcedure.scala | 258 ++
.../TestShowInflightCommitsProcedure.scala | 151 +
.../Spark3HoodiePruneFileSourcePartitions.scala | 18 +-
hudi-spark-datasource/hudi-spark3.3.x/pom.xml | 318 --
.../src/main/antlr4/imports/SqlBase.g4 | 1940 -----------
.../apache/hudi/spark/sql/parser/HoodieSqlBase.g4 | 40 -
.../org/apache/hudi/Spark33HoodieFileScanRDD.scala | 36 -
.../sql/HoodieSpark33CatalystExpressionUtils.scala | 119 -
.../spark/sql/HoodieSpark33CatalystPlanUtils.scala | 151 -
.../spark/sql/HoodieSpark33SchemaUtils.scala | 51 -
.../apache/spark/sql/adapter/Spark3_3Adapter.scala | 214 --
.../apache/spark/sql/avro/AvroDeserializer.scala | 531 ---
.../org/apache/spark/sql/avro/AvroSerializer.scala | 490 ---
.../org/apache/spark/sql/avro/AvroUtils.scala | 227 --
.../sql/avro/HoodieSpark3_3AvroDeserializer.scala | 32 -
.../sql/avro/HoodieSpark3_3AvroSerializer.scala | 29 -
.../HoodieSpark33PartitionedFileUtils.scala | 56 -
.../datasources/Spark33NestedSchemaPruning.scala | 62 -
.../datasources/orc/Spark33OrcReader.scala | 85 -
.../parquet/Spark33DataSourceUtils.scala | 77 -
.../Spark33LegacyHoodieParquetFileFormat.scala | 451 ---
.../datasources/parquet/Spark33ParquetReader.scala | 317 --
.../hudi/Spark33ResolveHudiAlterTableCommand.scala | 67 -
.../sql/hudi/analysis/HoodieSpark33Analysis.scala | 66 -
.../Spark33HoodiePruneFileSourcePartitions.scala | 133 -
.../HoodieSpark3_3ExtendedSqlAstBuilder.scala | 3534 --------------------
.../parser/HoodieSpark3_3ExtendedSqlParser.scala | 204 --
.../hudi/TestHoodieStreamingSinkConstants.scala | 37 -
.../spark/sql/adapter/BaseSpark4Adapter.scala | 19 +-
.../Spark4HoodiePruneFileSourcePartitions.scala | 16 +-
.../apache/spark/sql/adapter/Spark4_0Adapter.scala | 16 +-
.../parquet/Spark40HoodieParquetReadSupport.scala | 115 +
.../Spark40LegacyHoodieParquetFileFormat.scala | 4 +-
.../datasources/parquet/Spark40ParquetReader.scala | 2 +-
.../TestSpark40HoodieParquetReadSupport.scala | 59 +
.../src/main/antlr4/imports/SqlBase.g4 | 2 +-
.../apache/spark/sql/adapter/Spark4_1Adapter.scala | 59 +-
.../apache/spark/sql/avro/AvroDeserializer.scala | 22 +
.../Spark41LegacyHoodieParquetFileFormat.scala | 7 +-
.../datasources/parquet/Spark41ParquetReader.scala | 2 +-
.../HoodieSpark4_1ExtendedSqlAstBuilder.scala | 2 +-
.../hudi/TestSpark4_1AvroLogicalTypeBytes.scala | 127 +
.../plugin/hudi/util/FileOperationAssertions.java | 35 +-
.../hudi/utilities/HiveIncrementalPuller.java | 44 +-
.../hudi/utilities/config/CloudSourceConfig.java | 13 +
...FSSourceConfig.java => ORCDFSSourceConfig.java} | 24 +-
.../utilities/config/ParquetDFSSourceConfig.java | 15 +-
.../hudi/utilities/sources/JsonKinesisSource.java | 4 +-
.../hudi/utilities/sources/KinesisSource.java | 6 +-
.../hudi/utilities/sources/ORCDFSSource.java | 6 +-
.../hudi/utilities/sources/ParquetDFSSource.java | 4 +-
.../helpers/CloudObjectsSelectorCommon.java | 31 +-
.../sources/helpers/KinesisOffsetGen.java | 22 +-
.../sources/helpers/KinesisReadConfig.java | 4 +-
.../apache/hudi/utilities/streamer/StreamSync.java | 37 +-
.../validator/SparkKafkaOffsetValidator.java | 34 +-
.../validator/SparkStreamerValidatorUtils.java | 194 ++
.../streamer/validator/SparkValidationContext.java | 72 +-
.../TestHiveIncrementalPullerExecuteSQL.java | 125 +
.../deltastreamer/TestHoodieDeltaStreamer.java | 436 ++-
.../TestHoodieDeltaStreamerWithMultiWriter.java | 2 +-
.../hudi/utilities/sources/TestAvroDFSSource.java | 103 +
.../helpers/TestCloudObjectsSelectorCommon.java | 62 +
.../TestMercifulJsonToRowConverterBase.java | 56 +-
.../validator/TestSparkKafkaOffsetValidator.java | 157 +-
.../validator/TestSparkStreamerValidatorUtils.java | 290 ++
.../validator/TestSparkValidationContext.java | 156 +
packaging/bundle-validation/Dockerfile | 2 -
packaging/bundle-validation/README.md | 12 +-
.../base/build_flink1171hive313spark334.sh | 27 -
packaging/bundle-validation/ci_run.sh | 28 +-
packaging/bundle-validation/run_docker_java17.sh | 22 +-
packaging/hudi-azure-bundle/pom.xml | 39 +-
packaging/hudi-flink-bundle/pom.xml | 4 +
pom.xml | 51 +-
release/release_guide.md | 40 +-
rfc/README.md | 3 +-
rfc/rfc-100/rfc-100.md | 82 +
scripts/pr_compliance.py | 2 +-
scripts/release/copy_staging_repo.sh | 175 +
scripts/release/deploy_staging_jars.sh | 27 +-
scripts/release/deploy_staging_jars_java11.sh | 82 -
scripts/release/deploy_staging_jars_java17.sh | 11 +
scripts/release/validate_staged_bundles.sh | 105 +-
237 files changed, 9900 insertions(+), 10770 deletions(-)
create mode 100644
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/metrics/FlinkBucketAssignMetrics.java
create mode 100644
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/metrics/FlinkIndexBackendMetrics.java
create mode 100644
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/metrics/TestFlinkBucketAssignMetrics.java
create mode 100644
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/metrics/TestFlinkIndexBackendMetrics.java
create mode 100644
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/append/TestAppendWriteFunctionWithBIMBufferSort.java
create mode 100644
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/utils/TestPipelines.java
create mode 100644
hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/HoodieTimelineCleanupUtil.java
create mode 100644
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/CleanupStaleInflightCommitsProcedure.scala
create mode 100644
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/RestoreToInstantProcedure.scala
create mode 100644
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/ShowInflightCommitsProcedure.scala
create mode 100644
hudi-spark-datasource/hudi-spark/src/test/java/org/apache/hudi/functional/TestGlobalIndexCommitTimeOrdering.java
create mode 100644
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/blob/TestReadBlobBatching.scala
create mode 100644
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/blob/TestBatchedBlobReaderMerge.scala
create mode 100644
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/procedure/TestCleanupStaleInflightCommitsProcedure.scala
create mode 100644
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/procedure/TestRestoreProcedure.scala
create mode 100644
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/procedure/TestShowInflightCommitsProcedure.scala
delete mode 100644 hudi-spark-datasource/hudi-spark3.3.x/pom.xml
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/antlr4/imports/SqlBase.g4
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/antlr4/org/apache/hudi/spark/sql/parser/HoodieSqlBase.g4
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/hudi/Spark33HoodieFileScanRDD.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/HoodieSpark33CatalystExpressionUtils.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/HoodieSpark33CatalystPlanUtils.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/HoodieSpark33SchemaUtils.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/adapter/Spark3_3Adapter.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/avro/AvroDeserializer.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/avro/AvroSerializer.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/avro/AvroUtils.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/avro/HoodieSpark3_3AvroDeserializer.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/avro/HoodieSpark3_3AvroSerializer.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/execution/datasources/HoodieSpark33PartitionedFileUtils.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/execution/datasources/Spark33NestedSchemaPruning.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/execution/datasources/orc/Spark33OrcReader.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark33DataSourceUtils.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark33LegacyHoodieParquetFileFormat.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark33ParquetReader.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/hudi/Spark33ResolveHudiAlterTableCommand.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieSpark33Analysis.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/hudi/analysis/Spark33HoodiePruneFileSourcePartitions.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/parser/HoodieSpark3_3ExtendedSqlAstBuilder.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/parser/HoodieSpark3_3ExtendedSqlParser.scala
delete mode 100644
hudi-spark-datasource/hudi-spark3.3.x/src/test/scala/org/apache/hudi/TestHoodieStreamingSinkConstants.scala
create mode 100644
hudi-spark-datasource/hudi-spark4.0.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark40HoodieParquetReadSupport.scala
create mode 100644
hudi-spark-datasource/hudi-spark4.0.x/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/TestSpark40HoodieParquetReadSupport.scala
create mode 100644
hudi-spark-datasource/hudi-spark4.1.x/src/test/scala/org/apache/hudi/TestSpark4_1AvroLogicalTypeBytes.scala
copy
hudi-utilities/src/main/java/org/apache/hudi/utilities/config/{ParquetDFSSourceConfig.java
=> ORCDFSSourceConfig.java} (62%)
copy
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/validator/FlinkKafkaOffsetValidator.java
=>
hudi-utilities/src/main/java/org/apache/hudi/utilities/streamer/validator/SparkKafkaOffsetValidator.java
(54%)
create mode 100644
hudi-utilities/src/main/java/org/apache/hudi/utilities/streamer/validator/SparkStreamerValidatorUtils.java
copy
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/validator/FlinkValidationContext.java
=>
hudi-utilities/src/main/java/org/apache/hudi/utilities/streamer/validator/SparkValidationContext.java
(53%)
create mode 100644
hudi-utilities/src/test/java/org/apache/hudi/utilities/TestHiveIncrementalPullerExecuteSQL.java
copy
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/validator/TestFlinkKafkaOffsetValidator.java
=>
hudi-utilities/src/test/java/org/apache/hudi/utilities/streamer/validator/TestSparkKafkaOffsetValidator.java
(64%)
create mode 100644
hudi-utilities/src/test/java/org/apache/hudi/utilities/streamer/validator/TestSparkStreamerValidatorUtils.java
create mode 100644
hudi-utilities/src/test/java/org/apache/hudi/utilities/streamer/validator/TestSparkValidationContext.java
delete mode 100644
packaging/bundle-validation/base/build_flink1171hive313spark334.sh
create mode 100755 scripts/release/copy_staging_repo.sh
delete mode 100755 scripts/release/deploy_staging_jars_java11.sh
