This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/gradle/com.azure-azure-sdk-bom-1.2.35
in repository https://gitbox.apache.org/repos/asf/iceberg.git
discard 022bed432d Build: Bump com.azure:azure-sdk-bom from 1.2.31 to 1.2.35
add 2cdff36698 chore: Update status.md (#13182)
add ee82cdf287 Docs: Reorganize Spark Time Travel Doc (#13113)
add 4218554f37 AWS: update test cases to verify credentials for the
prefixed S3 client (#13118)
add a4b2a0dab0 API, Core: Rename RowDelta deleteFile() to removeRows()
(#13184)
add 08bed1303e Build: Bump testcontainers from 1.21.0 to 1.21.1 (#13199)
add 7537c3c3a2 Build: Bump guava from 33.4.7-jre to 33.4.8-jre (#12851)
add 9fa50f3b82 Build: Bump com.google.errorprone:error_prone_annotations
(#12852)
add 1d8b91a345 Build, Core: Move assertions to AssertJ / Fix checkstyle
rules (#13213)
add 73758ed9a7 Core: Catch IAE when decoding JWT (#13192)
add e5b97d3449 Hive: Throw NSNE when listing a non-existing namespace
(#13130)
add ee1dea0a49 Docs: Add column descriptions for entries metadata table
(#13104)
add f9cc62eb0d Arrow: Reduce code duplication in
VectorizedParquetDefinitionLevelReader (#11661)
add a1a9ba1230 Docs: Add custom table location description for Flink
(#13214)
add 8e803312cf Spark: Remove dependency on hadoop's filesystem class from
remove orphan files (#12254)
add 959351677b Core: Improve pagination logic to handle null pageToken
(#13129)
add 4755b76d2d Build: Bump
org.apache.hadoop.thirdparty:hadoop-shaded-guava (#12684)
add 931865ecaf Flink: port range distribution to v2 iceberg sink (#12071)
add 1260522673 Flink: Dynamic Iceberg Sink: Add table update code for
schema comparison and evolution (#13032)
add b38573dcfb Core: Add basic classes for writing table format-version 4
(#13123)
add 5b62fecde3 Spark: Fix flaky
testParallelPartialProgressWithMaxFailedCommitsLargerThanTotalFileGroup (#13208)
add 73802f63c5 Flink: Backport IcerbegSink RANGE distribution to Flink
1.19 and 2.0 (#13228)
add b8cc8eb846 Flink: Dynamic Iceberg Sink: Add dynamic writer and
committer (#13080)
add b3adeb12e2 [REST] Add option to configure TLS settings in REST client
(#13190)
add 3e478d2feb Docs: Document DataFrame API support for MERGE INTO in
Spark 4.0 (#13231)
add 809e4d8a74 Docs: Add Redpanda to vendor-related documentation (#13242)
add 4079a4fbb8 Flink: Support compact in iceberg sink v2 (#12979)
add 1996ff9f80 Flink: Backport add DynamicRecord / DynamicRecordInternal /
DynamicRecordInternalSerializer to Flink 1.19 / 1.20 (#13246)
add 6c9e641968 Flink: Backport Dynamic Iceberg Sink: Add table update code
for schema comparison and evolution to Flink 1.19 / 1.20 (#13247)
add e631db69ab Flink: Backport Dynamic Iceberg Sink: Add dynamic writer
and committer to Flink 1.19 / 1.20 (#13248)
add d3ebea5ada AWS, GCS: Fix issue with Kryo and empty immutable
collections for storage credential (#13216)
add 73b179c3c1 Spark 3.5, Arrow: Support for Row lineage when using the
Parquet Vectorized reader (#12928)
add 78156e7f4c Spark 4.0: Add a test for DataFrame API support for MERGE
INTO (#13230)
add b4f5da906e Flink: Backport support compact in sink v2 to 1.19 and 2.0
(#13250)
add 7b510ad48d API, AWS, Azure, Core, GCP: Use parametrized tests for
Kryo/Java serialization verification (#13244)
add d59ea1ea84 Docs: Remove obsolete version attribute in quick start
docker-compose.yml (#13139)
add e2da23c0cd Docs: use latest minio client command configuration
parameters (#13221)
add 5b40f9f88f Build: Upgrade to Gradle 8.14.2 (#13259)
add aae14bee61 Build: Bump openapi-spec-validator from 0.7.1 to 0.7.2
(#13275)
add d1027fc645 Build: Bump datamodel-code-generator from 0.30.1 to 0.30.2
(#13274)
add 77c2f4484e Flink, Spark: Backport ThreadPools introduce
newExitingWorkerPool and newFixedThreadPool for clearer semantics to Flink 1.19
and Spark 3.4(#13265)
add 7b8bd29ce8 Spark: Port prefix listing option in remove orphan files to
Spark 3.4 and Spark 4.0 (#13264)
add 76972ef77b Flink: Dynamic Iceberg Sink: Add HashKeyGenerator /
RowDataEvolver / TableUpdateOperator (#13277)
add f5eab59c92 View Spec: Fix engine-version key in the JSON example
(#13292)
add ee93ffb591 Build: Bump io.netty:netty-buffer from 4.2.1.Final to
4.2.2.Final (#13273)
add e141ff73b8 Flink: Backport dynamic Iceberg Sink: Add HashKeyGenerator
/ RowDataEvolver / TableUpdateOperator to Flink 1.19 / 1.20 (#13303)
add a8d111eaa7 Docs: Fix list rendering and typos (#13214) (#13267)
add 26d5c1c4f8 Docs: Fix broken links in Flink Configuration documentation
(#13288)
add 62d9ff5d04 Spark: RewriteTablePath should filter returned content
files by snapshotId (#12885)
add 17f9a9fd28 REST: Add property for configuring user agent in http
client (#13234)
add a0d9f06728 Build: Bump software.amazon.awssdk:bom from 2.31.50 to
2.31.63 (#13316)
add bb7f5f05f2 Build: Bump com.azure:azure-sdk-bom from 1.2.31 to 1.2.35
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (022bed432d)
\
N -- N -- N
refs/heads/dependabot/gradle/com.azure-azure-sdk-bom-1.2.35 (bb7f5f05f2)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.baseline/checkstyle/checkstyle.xml | 4 +-
api/src/main/java/org/apache/iceberg/RowDelta.java | 4 +-
.../test/java/org/apache/iceberg/TestHelpers.java | 24 +-
.../iceberg/arrow/vectorized/VectorHolder.java | 7 +-
.../arrow/vectorized/VectorizedArrowReader.java | 211 ++++++-
.../arrow/vectorized/VectorizedReaderBuilder.java | 41 +-
.../VectorizedParquetDefinitionLevelReader.java | 483 ++++++++--------
.../org/apache/iceberg/aws/s3/TestS3FileIO.java | 243 +++++---
.../java/org/apache/iceberg/aws/s3/S3FileIO.java | 3 +-
.../apache/iceberg/aws/TestAwsClientFactories.java | 32 +-
.../org/apache/iceberg/aws/TestAwsProperties.java | 11 +-
.../iceberg/azure/adlsv2/ADLSFileIOTest.java | 23 +-
.../apache/iceberg/azure/AzurePropertiesTest.java | 11 +-
.../adlsv2/VendedAdlsCredentialProviderTest.java | 11 +-
.../main/java/org/apache/iceberg/BaseRowDelta.java | 12 +-
.../java/org/apache/iceberg/ManifestFiles.java | 4 +
.../org/apache/iceberg/ManifestListWriter.java | 58 ++
.../java/org/apache/iceberg/ManifestLists.java | 3 +
.../java/org/apache/iceberg/ManifestWriter.java | 75 +++
.../apache/iceberg/MergingSnapshotProducer.java | 7 +
.../org/apache/iceberg/RewriteTablePathUtil.java | 113 +++-
.../java/org/apache/iceberg/TableMetadata.java | 2 +-
.../iceberg/{V3Metadata.java => V4Metadata.java} | 12 +-
.../org/apache/iceberg/io/ResolvingFileIO.java | 3 +-
.../org/apache/iceberg/rest/CatalogHandlers.java | 3 +-
.../java/org/apache/iceberg/rest/HTTPClient.java | 67 ++-
.../org/apache/iceberg/rest/auth/OAuth2Util.java | 2 +-
.../{NoopAuthManager.java => TLSConfigurer.java} | 28 +-
.../apache/iceberg/DeleteFileIndexTestBase.java | 4 +-
.../iceberg/ScanPlanningAndReportingTestBase.java | 5 +-
.../src/test/java/org/apache/iceberg/TestBase.java | 3 +
.../org/apache/iceberg/TestCommitReporting.java | 5 +-
.../java/org/apache/iceberg/TestDeleteFiles.java | 10 +-
.../org/apache/iceberg/TestFormatVersions.java | 7 +-
.../org/apache/iceberg/TestLocalFilterFiles.java | 7 +-
.../java/org/apache/iceberg/TestMergeAppend.java | 12 +-
.../apache/iceberg/TestMetadataTableFilters.java | 46 +-
.../test/java/org/apache/iceberg/TestMetrics.java | 6 +-
.../java/org/apache/iceberg/TestMetricsModes.java | 6 +-
.../java/org/apache/iceberg/TestOverwrite.java | 11 +-
.../iceberg/TestOverwriteWithValidation.java | 11 +-
.../org/apache/iceberg/TestPartitionSpecInfo.java | 6 +-
.../java/org/apache/iceberg/TestRewriteFiles.java | 2 +-
.../test/java/org/apache/iceberg/TestRowDelta.java | 39 +-
.../org/apache/iceberg/TestRowLineageMetadata.java | 22 +-
.../iceberg/TestScansAndSchemaEvolution.java | 6 +-
.../java/org/apache/iceberg/TestSortOrder.java | 6 +-
.../apache/iceberg/hadoop/HadoopFileIOTest.java | 23 +-
.../org/apache/iceberg/io/TestResolvingIO.java | 78 +--
.../apache/iceberg/io/TestStorageCredential.java | 18 +-
.../org/apache/iceberg/rest/TestHTTPClient.java | 65 ++-
.../org/apache/iceberg/rest/TestRESTCatalog.java | 14 +-
.../apache/iceberg/rest/auth/TestOAuth2Util.java | 1 +
.../org/apache/iceberg/util/TestDataFileSet.java | 18 +-
.../org/apache/iceberg/util/TestDeleteFileSet.java | 19 +-
.../resources/TableMetadataUnsupportedVersion.json | 2 +-
docs/docs/aws.md | 2 +
docs/docs/flink-configuration.md | 3 +-
docs/docs/flink-ddl.md | 12 +
docs/docs/flink-writes.md | 8 +-
docs/docs/hive.md | 2 +
docs/docs/spark-procedures.md | 6 +
docs/docs/spark-queries.md | 73 +--
docs/docs/spark-writes.md | 21 +
docs/mkdocs.yml | 1 +
flink/v1.19/build.gradle | 3 +
.../org/apache/iceberg/flink/FlinkConfParser.java | 22 +-
.../org/apache/iceberg/flink/FlinkWriteConf.java | 9 +
.../apache/iceberg/flink/FlinkWriteOptions.java | 3 +
.../maintenance/api/FlinkMaintenanceConfig.java | 112 ++++
.../flink/maintenance/api/JdbcLockFactory.java | 6 +-
.../iceberg/flink/maintenance/api/LockConfig.java | 183 ++++++
.../flink/maintenance/api/RewriteDataFiles.java | 31 +-
.../maintenance/api/RewriteDataFilesConfig.java | 150 +++++
.../flink/maintenance/api/TableMaintenance.java | 10 +-
.../maintenance/operator/LockFactoryBuilder.java | 87 +++
.../flink/maintenance/operator/TableChange.java | 5 +-
.../iceberg/flink/sink/BaseDeltaTaskWriter.java | 4 +-
.../apache/iceberg/flink/sink/CommitSummary.java | 52 +-
.../sink/CommittableToTableChangeConverter.java | 107 ++++
.../apache/iceberg/flink/sink/DeltaManifests.java | 6 +-
.../flink/sink/DeltaManifestsSerializer.java | 6 +-
.../flink/sink/EqualityFieldKeySelector.java | 12 +-
.../iceberg/flink/sink/FlinkManifestUtil.java | 27 +-
.../org/apache/iceberg/flink/sink/FlinkSink.java | 8 +-
.../flink/sink/IcebergCommittableSerializer.java | 2 +-
.../iceberg/flink/sink/IcebergCommitter.java | 12 +-
.../iceberg/flink/sink/IcebergFilesCommitter.java | 2 +-
.../flink/sink/IcebergFilesCommitterMetrics.java | 12 +-
.../org/apache/iceberg/flink/sink/IcebergSink.java | 327 ++++++++---
.../flink/sink/IcebergStreamWriterMetrics.java | 18 +-
.../flink/sink/ManifestOutputFileFactory.java | 6 +-
.../iceberg/flink/sink/PartitionKeySelector.java | 6 +-
.../iceberg/flink/sink/PartitionedDeltaWriter.java | 4 +-
.../flink/sink/RowDataTaskWriterFactory.java | 42 +-
.../org/apache/iceberg/flink/sink/SinkUtil.java | 7 +-
.../flink/sink/UnpartitionedDeltaWriter.java | 4 +-
.../iceberg/flink/sink/WriteResultSerializer.java | 4 +-
.../flink/sink/dynamic/CompareSchemasVisitor.java | 266 +++++++++
.../flink/sink/dynamic/DynamicCommittable.java} | 61 +-
.../DynamicCommittableSerializer.java} | 21 +-
.../flink/sink/dynamic/DynamicCommitter.java | 422 ++++++++++++++
.../sink/dynamic/DynamicCommitterMetrics.java | 50 ++
.../iceberg/flink/sink/dynamic/DynamicRecord.java | 8 +-
.../flink/sink/dynamic/DynamicRecordInternal.java | 10 +-
.../dynamic/DynamicRecordInternalSerializer.java | 16 +-
.../sink/dynamic/DynamicRecordInternalType.java | 7 +
.../flink/sink/dynamic/DynamicSinkUtil.java | 65 +++
.../sink/dynamic/DynamicTableUpdateOperator.java | 78 +++
.../flink/sink/dynamic/DynamicWriteResult.java} | 18 +-
.../sink/dynamic/DynamicWriteResultAggregator.java | 188 +++++++
.../dynamic/DynamicWriteResultSerializer.java} | 27 +-
.../iceberg/flink/sink/dynamic/DynamicWriter.java | 217 +++++++
.../flink/sink/dynamic/DynamicWriterMetrics.java | 49 ++
.../flink/sink/dynamic/EvolveSchemaVisitor.java | 204 +++++++
.../flink/sink/dynamic/HashKeyGenerator.java | 379 +++++++++++++
.../flink/sink/dynamic/PartitionSpecEvolution.java | 137 +++++
.../iceberg/flink/sink/dynamic/RowDataEvolver.java | 190 +++++++
.../flink/sink/dynamic/TableMetadataCache.java | 261 +++++++++
.../flink/sink/dynamic/TableSerializerCache.java | 0
.../iceberg/flink/sink/dynamic/TableUpdater.java | 207 +++++++
.../iceberg/flink/sink/dynamic/WriteTarget.java | 144 +++++
.../iceberg/flink/source/FlinkInputFormat.java | 2 +-
.../apache/iceberg/flink/source/IcebergSource.java | 2 +-
.../flink/source/StreamingMonitorFunction.java | 2 +-
.../enumerator/ContinuousSplitPlannerImpl.java | 2 +-
.../flink/TestFlinkTableSinkCompaction.java | 178 ++++++
.../api/TestRewriteDataFilesConfig.java | 142 +++++
.../flink/maintenance/operator/TestLockConfig.java | 84 +++
.../operator/TestLockFactoryBuilder.java | 109 ++++
.../TestCommittableToTableChangeConverter.java | 319 +++++++++++
.../iceberg/flink/sink/TestDeltaTaskWriter.java | 18 +-
.../TestFlinkIcebergSinkV2DistributionMode.java} | 63 ++-
.../iceberg/flink/sink/TestIcebergCommitter.java | 3 +-
.../apache/iceberg/flink/sink/TestIcebergSink.java | 70 ---
.../iceberg/flink/sink/TestIcebergSinkCompact.java | 149 +++++
.../DynamicRecordInternalSerializerTestBase.java | 2 +-
.../sink/dynamic/TestCompareSchemasVisitor.java | 209 +++++++
.../dynamic/TestDynamicCommittableSerializer.java | 62 ++
.../flink/sink/dynamic/TestDynamicCommitter.java | 381 +++++++++++++
...DynamicRecordInternalSerializerWriteSchema.java | 0
...namicRecordInternalSerializerWriteSchemaId.java | 0
.../dynamic/TestDynamicTableUpdateOperator.java | 113 ++++
.../dynamic/TestDynamicWriteResultAggregator.java | 82 +++
.../dynamic/TestDynamicWriteResultSerializer.java | 82 +++
.../flink/sink/dynamic/TestDynamicWriter.java | 183 ++++++
.../sink/dynamic/TestEvolveSchemaVisitor.java | 623 +++++++++++++++++++++
.../flink/sink/dynamic/TestHashKeyGenerator.java | 354 ++++++++++++
.../sink/dynamic/TestPartitionSpecEvolution.java | 188 +++++++
.../flink/sink/dynamic/TestRowDataEvolver.java | 256 +++++++++
.../flink/sink/dynamic/TestTableMetadataCache.java | 94 ++++
.../sink/dynamic/TestTableSerializerCache.java | 0
.../flink/sink/dynamic/TestTableUpdater.java | 160 ++++++
.../flink/source/TestProjectMetaColumn.java | 11 +-
flink/v1.20/build.gradle | 3 +
.../org/apache/iceberg/flink/FlinkConfParser.java | 22 +-
.../org/apache/iceberg/flink/FlinkWriteConf.java | 9 +
.../apache/iceberg/flink/FlinkWriteOptions.java | 3 +
.../maintenance/api/FlinkMaintenanceConfig.java | 112 ++++
.../flink/maintenance/api/JdbcLockFactory.java | 6 +-
.../iceberg/flink/maintenance/api/LockConfig.java | 183 ++++++
.../flink/maintenance/api/RewriteDataFiles.java | 31 +-
.../maintenance/api/RewriteDataFilesConfig.java | 150 +++++
.../flink/maintenance/api/TableMaintenance.java | 10 +-
.../maintenance/operator/LockFactoryBuilder.java | 87 +++
.../flink/maintenance/operator/TableChange.java | 5 +-
.../iceberg/flink/sink/BaseDeltaTaskWriter.java | 4 +-
.../apache/iceberg/flink/sink/CommitSummary.java | 52 +-
.../sink/CommittableToTableChangeConverter.java | 107 ++++
.../apache/iceberg/flink/sink/DeltaManifests.java | 6 +-
.../flink/sink/DeltaManifestsSerializer.java | 6 +-
.../flink/sink/EqualityFieldKeySelector.java | 12 +-
.../iceberg/flink/sink/FlinkManifestUtil.java | 27 +-
.../org/apache/iceberg/flink/sink/FlinkSink.java | 8 +-
.../flink/sink/IcebergCommittableSerializer.java | 2 +-
.../iceberg/flink/sink/IcebergCommitter.java | 9 +-
.../flink/sink/IcebergFilesCommitterMetrics.java | 12 +-
.../org/apache/iceberg/flink/sink/IcebergSink.java | 327 ++++++++---
.../flink/sink/IcebergStreamWriterMetrics.java | 18 +-
.../flink/sink/ManifestOutputFileFactory.java | 6 +-
.../iceberg/flink/sink/PartitionKeySelector.java | 6 +-
.../iceberg/flink/sink/PartitionedDeltaWriter.java | 4 +-
.../flink/sink/RowDataTaskWriterFactory.java | 42 +-
.../org/apache/iceberg/flink/sink/SinkUtil.java | 7 +-
.../flink/sink/UnpartitionedDeltaWriter.java | 4 +-
.../iceberg/flink/sink/WriteResultSerializer.java | 4 +-
.../flink/sink/dynamic/CompareSchemasVisitor.java | 266 +++++++++
.../DynamicCommittable.java} | 61 +-
.../dynamic/DynamicCommittableSerializer.java} | 21 +-
.../flink/sink/dynamic/DynamicCommitter.java | 422 ++++++++++++++
.../sink/dynamic/DynamicCommitterMetrics.java | 50 ++
.../iceberg/flink/sink/dynamic/DynamicRecord.java | 8 +-
.../flink/sink/dynamic/DynamicRecordInternal.java | 10 +-
.../dynamic/DynamicRecordInternalSerializer.java | 16 +-
.../sink/dynamic/DynamicRecordInternalType.java | 7 +
.../flink/sink/dynamic/DynamicSinkUtil.java | 65 +++
.../sink/dynamic/DynamicTableUpdateOperator.java | 78 +++
.../flink/sink/dynamic/DynamicWriteResult.java} | 18 +-
.../sink/dynamic/DynamicWriteResultAggregator.java | 188 +++++++
.../dynamic/DynamicWriteResultSerializer.java} | 27 +-
.../iceberg/flink/sink/dynamic/DynamicWriter.java | 217 +++++++
.../flink/sink/dynamic/DynamicWriterMetrics.java | 49 ++
.../flink/sink/dynamic/EvolveSchemaVisitor.java | 204 +++++++
.../flink/sink/dynamic/HashKeyGenerator.java | 379 +++++++++++++
.../flink/sink/dynamic/PartitionSpecEvolution.java | 137 +++++
.../iceberg/flink/sink/dynamic/RowDataEvolver.java | 190 +++++++
.../flink/sink/dynamic/TableMetadataCache.java | 261 +++++++++
.../flink/sink/dynamic/TableSerializerCache.java | 0
.../iceberg/flink/sink/dynamic/TableUpdater.java | 207 +++++++
.../iceberg/flink/sink/dynamic/WriteTarget.java | 144 +++++
.../flink/TestFlinkTableSinkCompaction.java | 178 ++++++
.../api/TestRewriteDataFilesConfig.java | 142 +++++
.../flink/maintenance/operator/TestLockConfig.java | 84 +++
.../operator/TestLockFactoryBuilder.java | 109 ++++
.../TestCommittableToTableChangeConverter.java | 319 +++++++++++
.../iceberg/flink/sink/TestDeltaTaskWriter.java | 18 +-
...=> TestFlinkIcebergSinkV2DistributionMode.java} | 63 ++-
.../iceberg/flink/sink/TestIcebergCommitter.java | 3 +-
.../apache/iceberg/flink/sink/TestIcebergSink.java | 70 ---
.../iceberg/flink/sink/TestIcebergSinkCompact.java | 149 +++++
.../DynamicRecordInternalSerializerTestBase.java | 2 +-
.../sink/dynamic/TestCompareSchemasVisitor.java | 209 +++++++
.../dynamic/TestDynamicCommittableSerializer.java | 62 ++
.../flink/sink/dynamic/TestDynamicCommitter.java | 381 +++++++++++++
...DynamicRecordInternalSerializerWriteSchema.java | 0
...namicRecordInternalSerializerWriteSchemaId.java | 0
.../dynamic/TestDynamicTableUpdateOperator.java | 113 ++++
.../dynamic/TestDynamicWriteResultAggregator.java | 82 +++
.../dynamic/TestDynamicWriteResultSerializer.java | 82 +++
.../flink/sink/dynamic/TestDynamicWriter.java | 183 ++++++
.../sink/dynamic/TestEvolveSchemaVisitor.java | 623 +++++++++++++++++++++
.../flink/sink/dynamic/TestHashKeyGenerator.java | 354 ++++++++++++
.../sink/dynamic/TestPartitionSpecEvolution.java | 188 +++++++
.../flink/sink/dynamic/TestRowDataEvolver.java | 256 +++++++++
.../flink/sink/dynamic/TestTableMetadataCache.java | 94 ++++
.../sink/dynamic/TestTableSerializerCache.java | 0
.../flink/sink/dynamic/TestTableUpdater.java | 160 ++++++
.../flink/source/TestProjectMetaColumn.java | 11 +-
.../org/apache/iceberg/flink/FlinkConfParser.java | 22 +-
.../org/apache/iceberg/flink/FlinkWriteConf.java | 9 +
.../apache/iceberg/flink/FlinkWriteOptions.java | 3 +
.../maintenance/api/FlinkMaintenanceConfig.java | 112 ++++
.../flink/maintenance/api/JdbcLockFactory.java | 6 +-
.../iceberg/flink/maintenance/api/LockConfig.java | 183 ++++++
.../flink/maintenance/api/RewriteDataFiles.java | 31 +-
.../maintenance/api/RewriteDataFilesConfig.java | 150 +++++
.../flink/maintenance/api/TableMaintenance.java | 10 +-
.../maintenance/operator/LockFactoryBuilder.java | 87 +++
.../flink/maintenance/operator/TableChange.java | 5 +-
.../iceberg/flink/sink/BaseDeltaTaskWriter.java | 4 +-
.../apache/iceberg/flink/sink/CommitSummary.java | 52 +-
.../sink/CommittableToTableChangeConverter.java | 107 ++++
.../apache/iceberg/flink/sink/DeltaManifests.java | 6 +-
.../flink/sink/DeltaManifestsSerializer.java | 6 +-
.../flink/sink/EqualityFieldKeySelector.java | 12 +-
.../iceberg/flink/sink/FlinkManifestUtil.java | 27 +-
.../org/apache/iceberg/flink/sink/FlinkSink.java | 8 +-
.../flink/sink/IcebergCommittableSerializer.java | 2 +-
.../iceberg/flink/sink/IcebergCommitter.java | 9 +-
.../flink/sink/IcebergFilesCommitterMetrics.java | 12 +-
.../org/apache/iceberg/flink/sink/IcebergSink.java | 327 ++++++++---
.../flink/sink/IcebergStreamWriterMetrics.java | 18 +-
.../flink/sink/ManifestOutputFileFactory.java | 6 +-
.../iceberg/flink/sink/PartitionKeySelector.java | 6 +-
.../iceberg/flink/sink/PartitionedDeltaWriter.java | 4 +-
.../flink/sink/RowDataTaskWriterFactory.java | 42 +-
.../org/apache/iceberg/flink/sink/SinkUtil.java | 7 +-
.../flink/sink/UnpartitionedDeltaWriter.java | 4 +-
.../iceberg/flink/sink/WriteResultSerializer.java | 4 +-
.../flink/sink/dynamic/CompareSchemasVisitor.java | 266 +++++++++
.../flink/sink/dynamic/DynamicCommittable.java} | 61 +-
.../dynamic/DynamicCommittableSerializer.java} | 21 +-
.../flink/sink/dynamic/DynamicCommitter.java | 422 ++++++++++++++
.../sink/dynamic/DynamicCommitterMetrics.java | 50 ++
.../iceberg/flink/sink/dynamic/DynamicRecord.java | 8 +-
.../flink/sink/dynamic/DynamicRecordInternal.java | 10 +-
.../dynamic/DynamicRecordInternalSerializer.java | 16 +-
.../flink/sink/dynamic/DynamicSinkUtil.java | 65 +++
.../sink/dynamic/DynamicTableUpdateOperator.java | 78 +++
.../DynamicWriteResult.java} | 18 +-
.../sink/dynamic/DynamicWriteResultAggregator.java | 188 +++++++
.../DynamicWriteResultSerializer.java} | 27 +-
.../iceberg/flink/sink/dynamic/DynamicWriter.java | 217 +++++++
.../flink/sink/dynamic/DynamicWriterMetrics.java | 49 ++
.../flink/sink/dynamic/EvolveSchemaVisitor.java | 204 +++++++
.../flink/sink/dynamic/HashKeyGenerator.java | 379 +++++++++++++
.../flink/sink/dynamic/PartitionSpecEvolution.java | 137 +++++
.../iceberg/flink/sink/dynamic/RowDataEvolver.java | 190 +++++++
.../flink/sink/dynamic/TableMetadataCache.java | 261 +++++++++
.../iceberg/flink/sink/dynamic/TableUpdater.java | 207 +++++++
.../iceberg/flink/sink/dynamic/WriteTarget.java | 144 +++++
.../flink/TestFlinkTableSinkCompaction.java | 178 ++++++
.../api/TestRewriteDataFilesConfig.java | 142 +++++
.../flink/maintenance/operator/TestLockConfig.java | 84 +++
.../operator/TestLockFactoryBuilder.java | 109 ++++
.../TestCommittableToTableChangeConverter.java | 319 +++++++++++
.../iceberg/flink/sink/TestDeltaTaskWriter.java | 18 +-
.../TestFlinkIcebergSinkV2DistributionMode.java} | 63 ++-
.../iceberg/flink/sink/TestIcebergCommitter.java | 3 +-
.../apache/iceberg/flink/sink/TestIcebergSink.java | 70 ---
.../iceberg/flink/sink/TestIcebergSinkCompact.java | 149 +++++
.../DynamicRecordInternalSerializerTestBase.java | 2 +-
.../sink/dynamic/TestCompareSchemasVisitor.java | 209 +++++++
.../dynamic/TestDynamicCommittableSerializer.java | 62 ++
.../flink/sink/dynamic/TestDynamicCommitter.java | 381 +++++++++++++
.../dynamic/TestDynamicTableUpdateOperator.java | 112 ++++
.../dynamic/TestDynamicWriteResultAggregator.java | 82 +++
.../dynamic/TestDynamicWriteResultSerializer.java | 82 +++
.../flink/sink/dynamic/TestDynamicWriter.java | 183 ++++++
.../sink/dynamic/TestEvolveSchemaVisitor.java | 623 +++++++++++++++++++++
.../flink/sink/dynamic/TestHashKeyGenerator.java | 354 ++++++++++++
.../sink/dynamic/TestPartitionSpecEvolution.java | 188 +++++++
.../flink/sink/dynamic/TestRowDataEvolver.java | 256 +++++++++
.../flink/sink/dynamic/TestTableMetadataCache.java | 94 ++++
.../sink/dynamic/TestTableSerializerCache.java | 2 +-
.../flink/sink/dynamic/TestTableUpdater.java | 160 ++++++
.../flink/source/TestProjectMetaColumn.java | 11 +-
format/view-spec.md | 6 +-
.../java/org/apache/iceberg/gcp/gcs/GCSFileIO.java | 3 +-
.../org/apache/iceberg/gcp/gcs/GCSFileIOTest.java | 115 ++--
gradle/libs.versions.toml | 10 +-
gradle/wrapper/gradle-wrapper.properties | 4 +-
gradlew | 2 +-
.../java/org/apache/iceberg/hive/HiveCatalog.java | 2 +-
.../org/apache/iceberg/hive/TestHiveCatalog.java | 8 -
kafka-connect/build.gradle | 2 +-
open-api/requirements.txt | 4 +-
site/README.md | 6 +-
site/docs/blogs.md | 5 +
site/docs/spark-quickstart.md | 3 +-
site/docs/status.md | 22 +-
site/docs/vendors.md | 4 +
.../org/apache/iceberg/spark/SparkTableUtil.java | 20 +-
.../actions/DeleteOrphanFilesSparkAction.java | 111 +++-
.../spark/actions/RewriteTablePathSparkAction.java | 38 +-
.../procedures/RemoveOrphanFilesProcedure.java | 6 +
.../spark/actions/TestRemoveOrphanFilesAction.java | 236 ++++++--
.../spark/actions/TestRewriteDataFilesAction.java | 5 +-
.../spark/actions/TestRewriteTablePathsAction.java | 38 +-
.../TestRowLevelOperationsWithLineage.java | 79 ++-
.../actions/DeleteOrphanFilesSparkAction.java | 110 +++-
.../spark/actions/RewriteTablePathSparkAction.java | 38 +-
.../procedures/RemoveOrphanFilesProcedure.java | 6 +
.../spark/actions/TestRemoveOrphanFilesAction.java | 169 +++++-
.../spark/actions/TestRewriteDataFilesAction.java | 5 +-
.../spark/actions/TestRewriteTablePathsAction.java | 38 +-
.../apache/iceberg/spark/data/GenericsHelpers.java | 12 +-
.../org/apache/iceberg/spark/data/TestHelpers.java | 27 -
.../vectorized/TestParquetVectorizedReads.java | 79 ++-
.../apache/iceberg/spark/extensions/TestMerge.java | 54 +-
.../actions/DeleteOrphanFilesSparkAction.java | 110 +++-
.../spark/actions/RewriteTablePathSparkAction.java | 38 +-
.../procedures/RemoveOrphanFilesProcedure.java | 6 +
.../spark/actions/TestRemoveOrphanFilesAction.java | 169 +++++-
.../spark/actions/TestRewriteDataFilesAction.java | 5 +-
.../spark/actions/TestRewriteTablePathsAction.java | 38 +-
356 files changed, 26291 insertions(+), 2155 deletions(-)
copy core/src/main/java/org/apache/iceberg/{V3Metadata.java =>
V4Metadata.java} (98%)
copy core/src/main/java/org/apache/iceberg/rest/auth/{NoopAuthManager.java =>
TLSConfigurer.java} (61%)
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/maintenance/api/FlinkMaintenanceConfig.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/maintenance/api/LockConfig.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/maintenance/api/RewriteDataFilesConfig.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/maintenance/operator/LockFactoryBuilder.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/CommittableToTableChangeConverter.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/CompareSchemasVisitor.java
copy
flink/{v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergCommittable.java
=>
v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicCommittable.java}
(66%)
copy
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/{IcebergCommittableSerializer.java
=> dynamic/DynamicCommittableSerializer.java} (75%)
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicCommitter.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicCommitterMetrics.java
copy flink/{v2.0 =>
v1.19}/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicRecord.java
(94%)
copy flink/{v2.0 =>
v1.19}/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicRecordInternal.java
(95%)
copy flink/{v2.0 =>
v1.19}/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicRecordInternalSerializer.java
(96%)
copy flink/{v2.0 =>
v1.19}/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicRecordInternalType.java
(89%)
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicSinkUtil.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicTableUpdateOperator.java
copy
flink/{v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/FlinkWriteResult.java
=>
v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicWriteResult.java}
(72%)
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicWriteResultAggregator.java
copy
flink/{v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/WriteResultSerializer.java
=>
v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicWriteResultSerializer.java}
(65%)
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicWriter.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicWriterMetrics.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/EvolveSchemaVisitor.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/HashKeyGenerator.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/PartitionSpecEvolution.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/RowDataEvolver.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/TableMetadataCache.java
copy flink/{v2.0 =>
v1.19}/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/TableSerializerCache.java
(100%)
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/TableUpdater.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/WriteTarget.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/TestFlinkTableSinkCompaction.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/maintenance/api/TestRewriteDataFilesConfig.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/TestLockConfig.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/TestLockFactoryBuilder.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/TestCommittableToTableChangeConverter.java
copy
flink/{v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/TestFlinkIcebergSinkDistributionMode.java
=>
v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/TestFlinkIcebergSinkV2DistributionMode.java}
(93%)
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/TestIcebergSinkCompact.java
copy flink/{v2.0 =>
v1.19}/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/DynamicRecordInternalSerializerTestBase.java
(99%)
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestCompareSchemasVisitor.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicCommittableSerializer.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicCommitter.java
copy flink/{v2.0 =>
v1.19}/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicRecordInternalSerializerWriteSchema.java
(100%)
copy flink/{v2.0 =>
v1.19}/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicRecordInternalSerializerWriteSchemaId.java
(100%)
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicTableUpdateOperator.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicWriteResultAggregator.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicWriteResultSerializer.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicWriter.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestEvolveSchemaVisitor.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestHashKeyGenerator.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestPartitionSpecEvolution.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestRowDataEvolver.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestTableMetadataCache.java
copy flink/{v2.0 =>
v1.19}/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestTableSerializerCache.java
(100%)
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestTableUpdater.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/maintenance/api/FlinkMaintenanceConfig.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/maintenance/api/LockConfig.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/maintenance/api/RewriteDataFilesConfig.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/maintenance/operator/LockFactoryBuilder.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/CommittableToTableChangeConverter.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/CompareSchemasVisitor.java
copy
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/{IcebergCommittable.java
=> dynamic/DynamicCommittable.java} (66%)
copy
flink/{v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergCommittableSerializer.java
=>
v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicCommittableSerializer.java}
(75%)
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicCommitter.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicCommitterMetrics.java
copy flink/{v2.0 =>
v1.20}/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicRecord.java
(94%)
copy flink/{v2.0 =>
v1.20}/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicRecordInternal.java
(95%)
copy flink/{v2.0 =>
v1.20}/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicRecordInternalSerializer.java
(96%)
copy flink/{v2.0 =>
v1.20}/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicRecordInternalType.java
(89%)
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicSinkUtil.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicTableUpdateOperator.java
copy
flink/{v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/FlinkWriteResult.java
=>
v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicWriteResult.java}
(72%)
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicWriteResultAggregator.java
copy
flink/{v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/WriteResultSerializer.java
=>
v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicWriteResultSerializer.java}
(65%)
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicWriter.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicWriterMetrics.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/EvolveSchemaVisitor.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/HashKeyGenerator.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/PartitionSpecEvolution.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/RowDataEvolver.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/TableMetadataCache.java
copy flink/{v2.0 =>
v1.20}/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/TableSerializerCache.java
(100%)
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/TableUpdater.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/WriteTarget.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/TestFlinkTableSinkCompaction.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/maintenance/api/TestRewriteDataFilesConfig.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/TestLockConfig.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/TestLockFactoryBuilder.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/TestCommittableToTableChangeConverter.java
copy
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/{TestFlinkIcebergSinkDistributionMode.java
=> TestFlinkIcebergSinkV2DistributionMode.java} (93%)
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/TestIcebergSinkCompact.java
copy flink/{v2.0 =>
v1.20}/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/DynamicRecordInternalSerializerTestBase.java
(99%)
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestCompareSchemasVisitor.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicCommittableSerializer.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicCommitter.java
copy flink/{v2.0 =>
v1.20}/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicRecordInternalSerializerWriteSchema.java
(100%)
copy flink/{v2.0 =>
v1.20}/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicRecordInternalSerializerWriteSchemaId.java
(100%)
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicTableUpdateOperator.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicWriteResultAggregator.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicWriteResultSerializer.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicWriter.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestEvolveSchemaVisitor.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestHashKeyGenerator.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestPartitionSpecEvolution.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestRowDataEvolver.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestTableMetadataCache.java
copy flink/{v2.0 =>
v1.20}/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestTableSerializerCache.java
(100%)
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestTableUpdater.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/maintenance/api/FlinkMaintenanceConfig.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/maintenance/api/LockConfig.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/maintenance/api/RewriteDataFilesConfig.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/maintenance/operator/LockFactoryBuilder.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/CommittableToTableChangeConverter.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/CompareSchemasVisitor.java
copy
flink/{v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergCommittable.java
=>
v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicCommittable.java}
(66%)
copy
flink/{v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergCommittableSerializer.java
=>
v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicCommittableSerializer.java}
(75%)
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicCommitter.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicCommitterMetrics.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicSinkUtil.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicTableUpdateOperator.java
copy
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/{FlinkWriteResult.java
=> dynamic/DynamicWriteResult.java} (72%)
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicWriteResultAggregator.java
copy
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/{WriteResultSerializer.java
=> dynamic/DynamicWriteResultSerializer.java} (65%)
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicWriter.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/DynamicWriterMetrics.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/EvolveSchemaVisitor.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/HashKeyGenerator.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/PartitionSpecEvolution.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/RowDataEvolver.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/TableMetadataCache.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/TableUpdater.java
create mode 100644
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/sink/dynamic/WriteTarget.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/TestFlinkTableSinkCompaction.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/maintenance/api/TestRewriteDataFilesConfig.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/TestLockConfig.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/TestLockFactoryBuilder.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/TestCommittableToTableChangeConverter.java
copy
flink/{v1.20/flink/src/test/java/org/apache/iceberg/flink/sink/TestFlinkIcebergSinkDistributionMode.java
=>
v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/TestFlinkIcebergSinkV2DistributionMode.java}
(93%)
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/TestIcebergSinkCompact.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestCompareSchemasVisitor.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicCommittableSerializer.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicCommitter.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicTableUpdateOperator.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicWriteResultAggregator.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicWriteResultSerializer.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestDynamicWriter.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestEvolveSchemaVisitor.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestHashKeyGenerator.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestPartitionSpecEvolution.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestRowDataEvolver.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestTableMetadataCache.java
create mode 100644
flink/v2.0/flink/src/test/java/org/apache/iceberg/flink/sink/dynamic/TestTableUpdater.java
