This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/gradle/junit-5.12.1
in repository https://gitbox.apache.org/repos/asf/iceberg.git
discard 4aba41e6e5 Build: Bump junit from 5.11.4 to 5.12.1
add fb5740d3d5 Build: Bump mkdocs-material from 9.6.7 to 9.6.8 (#12542)
add fcea78fc35 Build: Bump datamodel-code-generator from 0.28.2 to 0.28.4
(#12541)
add d35cf23eb6 Core: Add missing table-override property to REST catalog
(#12548)
add 57ec405a65 Spark: Call configureTable in ScanTestBase (#12546)
add 4816bf3b5a AWS, Core, GCP: Auth Manager API enablement (#12197)
add bf2f552722 Core: Close FileIO instance in JdbcCatalog (#12540)
add 15a9cbc7e3 Spark 3.4: Migrate TestBase related tests in spark and
actions to JUnit5 (#12552)
add c7f3919f84 API: Implement Variant#toString (#12531)
add 3cc4b045c6 Avro: Add variant readers and writers (#12457)
add 8f6ebb5b36 Core: Add `view-override` catalog property (#12534)
add 731ff73326 Kafka: Suppress warnings around java.util.Date usage / fix
var names (#12561)
add 6417719ad4 REST: HTTPRequest.baseUri() should be nullable (#12556)
add 952fcd451f Parquet, Core: Enable passing Variant tests (#12559)
add 04eecd61be Core: JDBCCatalog's dropView() should purge metadata files
if GC is enabled (#12511)
add 4dbcdfc85a Core, Spark 3.5: Apply Ignore Residuals to Delete Filtering
(#12479)
add cf980650ed Core: Make totalRecordCount optional in PartitionStats
(#12226)
add 5ce86a3e8d Core: Replace withFailMessage() with as() (#12570)
add 29612e80ea Spark: Improve assertions for better debuggability (#12569)
add 82044624da Docs: Update statements mentioning Hive's alpha/beta
versions (#12430)
add b821c24c3b Infra: Update Bug report template for 1.7.2 (#12574)
add b6325c4993 Docs: update go impl status (#12578)
add f6a5ba0b44 Core: Use InternalData when reading manifests in
FileCleanupStrategy (#12575)
add c8d8b8ca57 Docs: Site updates for 1.7.2 (#12576)
add 608345b351 ORC: Support timestamp(9), variant, and unknown in generics
(#12567)
add 2c746e6785 Flink: Support source watermark for flink sql windows
(#12191)
add 017559ecdc Spark: Detect dangling DVs properly (#12270)
add 8ed1c21650 OpenAPI: Handle NamespaceNotEmptyException when dropping a
namespace (#12518)
add ff5004ef6d Use correct statistics file in
SparkScan::estimateStatistics(Snapshot) (#12482)
add 31e0f19dff Flink: fix read config of
connector.iceberg.max-allowed-planning-failures (#12585)
add 6779a15759 Flink: backport for fix read config of
connector.iceberg.max-allowed-planning-failures (#12589)
add 21497fd385 Use InternalData with Avro for readers. (#12476)
add 7217417641 Core, Parquet, ORC: Fix missing data when writing unknown
(#12581)
add e47e99a0dd Core: Handle NamespaceNotEmptyException in
NamespaceErrorHandler (#12505)
add df27946bac Spark 3.4: Read DVs when reading from .position_deletes
table
add a4816c1c99 Spark 3.4: Include content offset/size in
PositionDeletesTable
add 2c157cbaf5 Spark 3.4: Migrate TestBase-related remaining tests in
actions (#12579)
add d14298fe9e Spark 3.4: Test metadata tables with format-version=v3 /
add ExtensionsTestBase (#12600)
add 845ef51498 Core: Bulk deletion in RemoveSnapshots (#11837)
add 74051b44f9 Spark 3.4: Backport DVs related parts (#12603)
add ded06702a8 Parquet: Implement Variant metrics (#12496)
add 980212e700 Spark 3.4: Rewrite data files with high delete ratio
add 263c62ee66 Spark 3.4: Rewrite V2 deletes to V3 DVs
add c2a7d9f0ad Spark 3.4: Detect dangling DVs properly
add 49353ff2db Build: Bump mkdocs-material from 9.6.8 to 9.6.9 (#12614)
add c94fae4fac Build: Bump nessie from 0.103.0 to 0.103.2 (#12615)
add 1a94bc0346 Spec: Geo spec simplifications (#12533)
add cb7d5a827b Spark 3.5: Reduce repeated logs in SparkWrite and
SparkPositionDeltaWrite (#12404)
add f12d200108 Spark 3.4: Backport Spark actions changes in Spark
rewrite_table_path procedure (#12006 #12172 #11929 #12282 #12569) (#12568)
add 6bd6887db1 Core: Add update event for rewrite manifests (#12627)
add cbf34a6ab9 Build: Enforce error message check on Exception assertions
(#12624)
add a908f92017 Build: Bump com.google.errorprone:error_prone_annotations
from 2.36.0 to 2.37.0 (#12622)
add 4f06b0911e Core: Add commit metrics for rewriting manifests (#12630)
add 62005e72a5 Data: Refactor PartitionStatsHandler (#12550)
add 50c8697f93 Spark 3.4: Propagate snapshot properties / Add max allowed
failed commits
add 5cb8715c15 Docs: Fix lifecycle and versions in multi-engine-support
(#12370)
add 6f0dfd976e Build: Bump parquet from 1.15.0 to 1.15.1 (#12616)
add 80f07c02da Build: Bump calcite from 1.10.0 to 1.39.0 (#12617)
add 2a0fee50e8 Add Estuary blog post showing how to load data into Apache
Iceberg (#12587)
add 03ff41c189 Core: Fallback to thread classloader when loading classes
(#12613)
add 6263298637 Core: child HTTPClient should not close shared resources
(#12566)
add e1e0a74047 API, Core: Add geometry and geography types support (#12346)
add 07ad9a635c AWS: Use correct parent session when calling delegate auth
manager (#12582)
add af99da6c2d Docs: Update block spacing guideline in contribute.md
(#12641)
add 695374d8bf Docs: Fix ASF sponsorship links (#12646)
add 25409c624e Spark 3.4: Migrate SparkRowLevelOperationsTestBase related
tests to JUnit 5 (#12656)
add d54d81ecc1 Spark 3.4: Use correct statistics file in
SparkScan::estimateStatistics(Snapshot) (#12647)
add aa4ed6041b Core: Enhance TestRemoveSnapshots (#12662)
add 3385d05343 Update PyIceberg status page (#12645)
add 8ca7f9bf1a Build: Bump jetty from 11.0.24 to 11.0.25 (#12618)
add 18bb163279 Build: Bump junit from 5.11.4 to 5.12.1
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (4aba41e6e5)
\
N -- N -- N refs/heads/dependabot/gradle/junit-5.12.1
(18bb163279)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.baseline/checkstyle/checkstyle.xml | 14 +
.github/ISSUE_TEMPLATE/iceberg_bug_report.yml | 1 +
.palantir/revapi.yml | 5 +
.../aliyun/oss/mock/TestLocalAliyunOSS.java | 1 +
.../main/java/org/apache/iceberg/ManifestFile.java | 4 +-
api/src/main/java/org/apache/iceberg/Metrics.java | 4 +
api/src/main/java/org/apache/iceberg/Schema.java | 4 +-
.../org/apache/iceberg/transforms/Identity.java | 11 +-
.../org/apache/iceberg/types/EdgeAlgorithm.java | 61 ++
.../main/java/org/apache/iceberg/types/Type.java | 2 +
.../java/org/apache/iceberg/types/TypeUtil.java | 6 +
.../main/java/org/apache/iceberg/types/Types.java | 152 ++++
.../java/org/apache/iceberg/util/BinaryUtil.java | 22 +-
.../java/org/apache/iceberg/util/UnicodeUtil.java | 27 +-
.../org/apache/iceberg/variants/Serialized.java | 2 +-
.../apache/iceberg/variants/SerializedObject.java | 10 +
.../iceberg/variants/SerializedPrimitive.java | 10 +
.../iceberg/variants/SerializedShortString.java | 10 +
.../java/org/apache/iceberg/variants/Variant.java | 4 +
.../org/apache/iceberg/variants/VariantData.java | 5 +
.../apache/iceberg/variants/VariantMetadata.java | 4 +
.../org/apache/iceberg/variants/VariantObject.java | 35 +
.../apache/iceberg/variants/VariantPrimitive.java | 18 +
.../org/apache/iceberg/variants/VariantUtil.java | 4 +
.../iceberg/TestPartitionSpecValidation.java | 31 +-
.../test/java/org/apache/iceberg/TestSchema.java | 7 +-
.../iceberg/expressions/TestExpressionBinding.java | 3 +-
.../iceberg/expressions/TestPathParsing.java | 4 +-
.../TestTimestampLiteralConversions.java | 24 +-
.../org/apache/iceberg/io/TestCloseableGroup.java | 9 +-
.../apache/iceberg/io/TestCloseableIterable.java | 4 +-
.../apache/iceberg/transforms/TestBucketing.java | 28 +
.../apache/iceberg/transforms/TestIdentity.java | 28 +-
.../iceberg/types/TestReadabilityChecks.java | 7 +-
.../iceberg/types/TestSerializableTypes.java | 7 +-
.../org/apache/iceberg/types/TestTypeUtil.java | 6 +-
.../java/org/apache/iceberg/types/TestTypes.java | 90 +++
.../org/apache/iceberg/util/TestExceptionUtil.java | 4 +
.../iceberg/variants/TestSerializedMetadata.java | 20 +-
.../iceberg/arrow/vectorized/ArrowReaderTest.java | 2 +-
.../aws/TestAssumeRoleAwsClientFactory.java | 4 +-
.../iceberg/aws/glue/TestGlueCatalogTable.java | 3 +-
.../TestLakeFormationAwsClientFactory.java | 3 +-
.../apache/iceberg/aws/RESTSigV4AuthManager.java | 27 +-
.../apache/iceberg/aws/RESTSigV4AuthSession.java | 4 +
.../org/apache/iceberg/aws/RESTSigV4Signer.java | 3 +
.../iceberg/aws/s3/VendedCredentialsProvider.java | 27 +-
.../aws/s3/signer/S3V4RestSignerClient.java | 171 +----
.../iceberg/aws/TestRESTSigV4AuthManager.java | 130 ++--
.../apache/iceberg/aws/TestRESTSigV4Signer.java | 47 +-
.../iceberg/aws/s3/signer/TestS3RestSigner.java | 33 +-
.../aws/s3/signer/TestS3V4RestSignerClient.java | 129 ++++
build.gradle | 3 +
.../org/apache/iceberg/common/DynConstructors.java | 16 +-
.../apache/iceberg/common/TestDynConstructors.java | 18 +-
.../java/org/apache/iceberg/AllManifestsTable.java | 11 +-
.../org/apache/iceberg/BaseRewriteManifests.java | 29 +-
.../main/java/org/apache/iceberg/BaseTable.java | 2 +-
.../java/org/apache/iceberg/BaseTransaction.java | 3 +-
.../java/org/apache/iceberg/CatalogProperties.java | 1 +
.../java/org/apache/iceberg/DeleteFileIndex.java | 28 +-
.../main/java/org/apache/iceberg/FieldMetrics.java | 12 +
.../org/apache/iceberg/FileCleanupStrategy.java | 53 +-
.../java/org/apache/iceberg/ManifestGroup.java | 1 +
.../java/org/apache/iceberg/ManifestLists.java | 11 +-
.../java/org/apache/iceberg/ManifestReader.java | 14 +-
.../main/java/org/apache/iceberg/MetricsUtil.java | 15 +
.../java/org/apache/iceberg/PartitionStats.java | 22 +-
.../java/org/apache/iceberg/RemoveSnapshots.java | 10 +-
.../main/java/org/apache/iceberg/SchemaParser.java | 4 -
.../java/org/apache/iceberg/SnapshotSummary.java | 4 +
.../main/java/org/apache/iceberg/avro/Avro.java | 1 +
.../iceberg/avro/AvroWithPartnerVisitor.java | 31 +-
.../org/apache/iceberg/avro/BaseWriteBuilder.java | 6 +
.../org/apache/iceberg/avro/GenericAvroReader.java | 6 +
.../org/apache/iceberg/avro/InternalReader.java | 6 +
.../java/org/apache/iceberg/avro/ValueReaders.java | 35 +
.../java/org/apache/iceberg/avro/ValueWriters.java | 85 +++
.../org/apache/iceberg/avro/VariantConversion.java | 68 ++
.../org/apache/iceberg/data/avro/DataWriter.java | 6 +
.../iceberg/data/avro/PlannedDataReader.java | 6 +
.../main/java/org/apache/iceberg/io/IOUtil.java | 15 +
.../java/org/apache/iceberg/jdbc/JdbcCatalog.java | 14 +
.../iceberg/metrics/CommitMetricsResult.java | 33 +
.../iceberg/metrics/CommitMetricsResultParser.java | 29 +-
.../org/apache/iceberg/rest/ErrorHandlers.java | 26 +-
.../java/org/apache/iceberg/rest/HTTPClient.java | 64 +-
.../java/org/apache/iceberg/rest/HTTPRequest.java | 15 +-
.../java/org/apache/iceberg/rest/RESTClient.java | 13 +-
.../apache/iceberg/rest/RESTSessionCatalog.java | 691 +++++++----------
.../org/apache/iceberg/rest/auth/AuthManager.java | 10 +
.../apache/iceberg/rest/auth/OAuth2Manager.java | 37 +-
.../apache/iceberg/variants/PrimitiveWrapper.java | 10 +
.../java/org/apache/iceberg/variants/Variants.java | 65 ++
.../iceberg/view/BaseMetastoreViewCatalog.java | 18 +
.../apache/iceberg/DeleteFileIndexTestBase.java | 8 +-
.../org/apache/iceberg/RandomInternalData.java | 5 +
.../java/org/apache/iceberg/RandomVariants.java | 127 ++++
.../org/apache/iceberg/TestClientPoolImpl.java | 9 +-
.../org/apache/iceberg/TestCommitReporting.java | 34 +-
.../org/apache/iceberg/TestGeospatialTable.java | 77 ++
.../apache/iceberg/TestManifestReaderStats.java | 20 +-
.../test/java/org/apache/iceberg/TestMetrics.java | 15 +-
.../org/apache/iceberg/TestPartitionStats.java | 135 ++++
.../org/apache/iceberg/TestPartitionStatsUtil.java | 52 +-
.../org/apache/iceberg/TestRemoveSnapshots.java | 265 ++++---
.../java/org/apache/iceberg/TestSchemaParser.java | 5 +
.../apache/iceberg/TestSchemaUnionByFieldName.java | 9 +-
.../java/org/apache/iceberg/TestSchemaUpdate.java | 7 +-
.../org/apache/iceberg/TestSnapshotProducer.java | 2 +-
.../org/apache/iceberg/TestSnapshotSummary.java | 25 +
.../java/org/apache/iceberg/TestSortOrder.java | 16 +
.../org/apache/iceberg/avro/AvroTestHelpers.java | 10 +
.../org/apache/iceberg/avro/RandomAvroData.java | 6 +
.../apache/iceberg/avro/TestAvroEncoderUtil.java | 5 +
.../org/apache/iceberg/avro/TestGenericAvro.java | 5 +
.../org/apache/iceberg/avro/TestInternalAvro.java | 5 +
.../apache/iceberg/avro/TestReadProjection.java | 2 +
.../org/apache/iceberg/catalog/CatalogTests.java | 116 +++
.../java/org/apache/iceberg/data/DataTest.java | 24 +-
.../apache/iceberg/hadoop/TestHadoopCommits.java | 3 +-
.../iceberg/inmemory/TestInMemoryCatalog.java | 9 +
.../iceberg/inmemory/TestInMemoryFileIO.java | 9 +-
.../iceberg/inmemory/TestInMemoryViewCatalog.java | 3 +
.../org/apache/iceberg/jdbc/TestJdbcCatalog.java | 7 +
.../iceberg/jdbc/TestJdbcCatalogWithV1Schema.java | 6 +
.../apache/iceberg/jdbc/TestJdbcViewCatalog.java | 52 ++
.../metrics/TestCommitMetricsResultParser.java | 24 +
.../apache/iceberg/rest/RESTCatalogAdapter.java | 2 +-
.../org/apache/iceberg/rest/TestHTTPClient.java | 43 +-
.../org/apache/iceberg/rest/TestHTTPRequest.java | 14 +-
.../org/apache/iceberg/rest/TestRESTCatalog.java | 33 +-
.../apache/iceberg/rest/TestRESTViewCatalog.java | 3 +
.../TestRESTViewCatalogWithAssumedViewSupport.java | 8 +-
.../iceberg/rest/auth/TestOAuth2Manager.java | 44 +-
.../org/apache/iceberg/util/TestPartitionMap.java | 17 +-
.../org/apache/iceberg/view/ViewCatalogTests.java | 33 +
.../iceberg/GenericParquetReaderBenchmark.java | 2 +-
.../iceberg/data/GenericAppenderFactory.java | 6 +-
.../iceberg/data/GenericFileWriterFactory.java | 6 +-
.../apache/iceberg/data/PartitionStatsHandler.java | 110 ++-
.../org/apache/iceberg/TestMergingMetrics.java | 77 +-
.../org/apache/iceberg/data/DataTestHelpers.java | 8 +
.../java/org/apache/iceberg/data/FileHelpers.java | 8 +-
.../org/apache/iceberg/data/RandomGenericData.java | 6 +
.../data/TestDataFileIndexStatsFilters.java | 152 ++++
.../data/TestMetricsRowGroupFilterTypes.java | 2 +-
.../iceberg/data/TestPartitionStatsHandler.java | 72 +-
.../apache/iceberg/data/TestReadProjection.java | 2 +
.../apache/iceberg/data/avro/TestGenericData.java | 5 +
.../apache/iceberg/data/orc/TestGenericData.java | 14 +
.../iceberg/data/parquet/TestGenericData.java | 2 +-
.../data/parquet/TestGenericReadProjection.java | 2 +-
.../TestParquetEncryptionWithWriteSupport.java | 17 +-
.../io/TestGenericSortedPosDeleteWriter.java | 1 +
.../apache/iceberg/parquet/TestParquetMetrics.java | 2 +-
.../iceberg/dell/mock/ecs/TestExceptionCode.java | 1 +
docs/docs/hive.md | 23 +-
docs/docs/spark-configuration.md | 1 +
.../iceberg/flink/data/FlinkParquetWriters.java | 22 +-
.../apache/iceberg/flink/source/ScanContext.java | 2 +-
.../iceberg/flink/TestFlinkCatalogTable.java | 4 +
.../flink/actions/TestRewriteDataFilesAction.java | 3 +-
.../iceberg/flink/data/TestFlinkParquetReader.java | 2 +-
.../iceberg/flink/data/FlinkParquetWriters.java | 22 +-
.../apache/iceberg/flink/source/ScanContext.java | 2 +-
.../iceberg/flink/TestFlinkCatalogTable.java | 4 +
.../flink/actions/TestRewriteDataFilesAction.java | 3 +-
.../iceberg/flink/data/TestFlinkParquetReader.java | 2 +-
.../iceberg/flink/data/FlinkParquetWriters.java | 22 +-
.../iceberg/flink/source/IcebergTableSource.java | 16 +-
.../apache/iceberg/flink/source/ScanContext.java | 2 +-
.../iceberg/flink/TestFlinkCatalogTable.java | 4 +
.../flink/actions/TestRewriteDataFilesAction.java | 3 +-
.../iceberg/flink/data/TestFlinkParquetReader.java | 2 +-
.../iceberg/flink/source/TestIcebergSourceSql.java | 54 +-
.../apache/iceberg/flink/source/TestSqlBase.java | 15 +
format/spec.md | 6 +-
gcp-bundle/LICENSE | 2 +-
.../java/org/apache/iceberg/gcp/gcs/GCSFileIO.java | 7 +-
.../gcp/gcs/OAuth2RefreshCredentialsHandler.java | 70 +-
.../apache/iceberg/gcp/gcs/GCSInputStreamTest.java | 4 +-
gradle/libs.versions.toml | 10 +-
.../org/apache/iceberg/hive/TestHiveCatalog.java | 8 +-
.../org/apache/iceberg/hive/TestHiveCommits.java | 3 +-
.../apache/iceberg/hive/TestHiveViewCatalog.java | 8 +-
.../apache/iceberg/hive/TestHiveViewCommits.java | 3 +-
kafka-connect/kafka-connect-runtime/hive/LICENSE | 16 +-
kafka-connect/kafka-connect-runtime/main/LICENSE | 16 +-
.../connect/transforms/DebeziumTransform.java | 1 +
.../mongodb/transforms/MongoDataConverter.java | 83 +-
.../connect/transforms/JsonToMapTransformTest.java | 8 +-
.../connect/transforms/JsonToMapUtilsTest.java | 19 +-
.../transforms/KafkaMetadataTransformTest.java | 11 +-
.../transforms/MongoDebeziumTransformTest.java | 4 +-
.../transforms/MongoArrayConverterTest.java | 6 +-
.../apache/iceberg/nessie/TestNessieCatalog.java | 8 +-
.../org/apache/iceberg/nessie/TestNessieTable.java | 3 +-
.../iceberg/nessie/TestNessieViewCatalog.java | 8 +-
open-api/LICENSE | 14 +-
open-api/requirements.txt | 2 +-
open-api/rest-catalog-open-api.yaml | 19 +
.../java/org/apache/iceberg/rest/RCKUtils.java | 12 +
.../apache/iceberg/data/orc/GenericOrcReader.java | 13 +
.../apache/iceberg/data/orc/GenericOrcReaders.java | 27 +
.../apache/iceberg/data/orc/GenericOrcWriter.java | 26 +-
.../apache/iceberg/data/orc/GenericOrcWriters.java | 137 +++-
.../org/apache/iceberg/orc/ApplyNameMapping.java | 7 +
.../iceberg/orc/EstimateOrcAvgWidthVisitor.java | 5 +
.../main/java/org/apache/iceberg/orc/HasIds.java | 5 +
.../java/org/apache/iceberg/orc/ORCSchemaUtil.java | 69 +-
.../java/org/apache/iceberg/orc/OrcMetrics.java | 32 +-
.../org/apache/iceberg/orc/OrcSchemaVisitor.java | 27 +-
.../iceberg/orc/OrcSchemaWithTypeVisitor.java | 29 +-
.../apache/iceberg/orc/OrcToIcebergVisitor.java | 120 ++-
.../org/apache/iceberg/orc/OrcValueReaders.java | 4 +-
.../java/org/apache/iceberg/orc/RemoveIds.java | 6 +
.../apache/iceberg/orc/TestORCFileIOProxies.java | 6 +-
.../org/apache/iceberg/orc/TestORCSchemaUtil.java | 21 +-
.../java/org/apache/iceberg/InternalParquet.java | 2 +-
.../iceberg/data/parquet/BaseParquetReaders.java | 3 +-
.../iceberg/data/parquet/BaseParquetWriter.java | 7 +-
.../iceberg/data/parquet/GenericParquetWriter.java | 28 +-
.../iceberg/data/parquet/InternalWriter.java | 30 +-
.../java/org/apache/iceberg/parquet/Parquet.java | 28 +-
.../apache/iceberg/parquet/ParquetConversions.java | 37 +-
.../org/apache/iceberg/parquet/ParquetMetrics.java | 639 ++++++++++++++++
.../org/apache/iceberg/parquet/ParquetUtil.java | 239 +-----
.../iceberg/parquet/ParquetValueWriters.java | 55 +-
.../apache/iceberg/parquet/ParquetVariantUtil.java | 476 ++++++++++++
.../iceberg/parquet/ParquetVariantWriters.java | 12 +-
.../iceberg/parquet/ParquetWriteAdapter.java | 6 +-
.../org/apache/iceberg/parquet/ParquetWriter.java | 5 +-
.../org/apache/iceberg/parquet/PruneColumns.java | 3 +-
.../iceberg/parquet/TypeWithSchemaVisitor.java | 10 +-
.../iceberg/parquet/TestInternalParquet.java | 7 +-
.../iceberg/parquet/TestParquetDataWriter.java | 6 +-
.../iceberg/parquet/TestParquetDeleteWriters.java | 6 +-
.../apache/iceberg/parquet/TestVariantMetrics.java | 503 +++++++++++++
.../apache/iceberg/parquet/TestVariantWriters.java | 157 +---
site/docs/blogs.md | 5 +
site/docs/contribute.md | 43 ++
site/docs/multi-engine-support.md | 6 +-
site/docs/releases.md | 18 +
site/docs/status.md | 70 +-
site/nav.yml | 5 +-
site/requirements.txt | 2 +-
spark/v3.4/build.gradle | 5 +
.../spark/extensions/ExtensionsTestBase.java | 0
.../SparkRowLevelOperationsTestBase.java | 108 ++-
.../spark/extensions/TestCallStatementParser.java | 1 +
.../TestCherrypickSnapshotProcedure.java | 1 +
.../spark/extensions/TestCopyOnWriteDelete.java | 106 ++-
.../spark/extensions/TestCopyOnWriteMerge.java | 45 +-
.../spark/extensions/TestCopyOnWriteUpdate.java | 63 +-
.../iceberg/spark/extensions/TestDelete.java | 303 ++++----
.../extensions/TestExpireSnapshotsProcedure.java | 1 +
.../extensions/TestFastForwardBranchProcedure.java | 1 +
.../apache/iceberg/spark/extensions/TestMerge.java | 266 +++----
.../spark/extensions/TestMergeOnReadDelete.java | 58 +-
.../spark/extensions/TestMergeOnReadMerge.java | 36 +-
.../spark/extensions/TestMergeOnReadUpdate.java | 37 +-
.../spark/extensions/TestMetadataTables.java | 480 +++++++++---
.../extensions/TestPublishChangesProcedure.java | 1 +
.../extensions/TestRemoveOrphanFilesProcedure.java | 1 +
.../extensions/TestRewriteDataFilesProcedure.java | 1 +
.../extensions/TestRewriteManifestsProcedure.java | 1 +
.../TestRollbackToSnapshotProcedure.java | 1 +
.../TestRollbackToTimestampProcedure.java | 1 +
.../TestSetCurrentSnapshotProcedure.java | 1 +
.../iceberg/spark/extensions/TestUpdate.java | 269 +++----
.../org/apache/iceberg/spark/SparkContentFile.java | 27 +
.../actions/BaseSnapshotUpdateSparkAction.java | 5 +
.../actions/RemoveDanglingDeletesSparkAction.java | 38 +-
.../spark/actions/RewriteDataFilesSparkAction.java | 40 +-
.../RewritePositionDeleteFilesSparkAction.java | 35 +-
.../spark/actions/RewriteTablePathSparkAction.java | 51 +-
.../apache/iceberg/spark/source/DVIterator.java | 0
.../spark/source/PositionDeletesRowReader.java | 6 +
.../spark/source/SparkPositionDeletesRewrite.java | 148 +++-
.../org/apache/iceberg/spark/source/SparkScan.java | 7 +-
.../apache/iceberg/spark/source/SparkWrite.java | 4 +-
.../org/apache/iceberg/spark/CatalogTestBase.java | 2 +-
.../org/apache/iceberg/spark/TestSpark3Util.java | 90 ++-
.../iceberg/spark/TestSparkSessionCatalog.java | 66 +-
.../actions/TestDeleteReachableFilesAction.java | 146 ++--
.../spark/actions/TestExpireSnapshotsAction.java | 478 ++++++------
.../actions/TestRemoveDanglingDeleteAction.java | 39 +-
.../spark/actions/TestRemoveOrphanFilesAction.java | 268 +++----
.../actions/TestRemoveOrphanFilesAction3.java | 107 ++-
.../spark/actions/TestRewriteDataFilesAction.java | 834 +++++++++++++++------
.../spark/actions/TestRewriteManifestsAction.java | 411 ++++++----
.../TestRewritePositionDeleteFilesAction.java | 493 ++++++++----
.../spark/actions/TestRewriteTablePathsAction.java | 339 +++++++--
.../spark/actions/TestSparkFileRewriter.java | 82 +-
.../org/apache/iceberg/spark/data/TestHelpers.java | 3 +-
.../spark/source/TestPositionDeletesReader.java | 0
.../spark/source/TestPositionDeletesTable.java | 596 ++++++++++-----
.../iceberg/spark/source/TestReadProjection.java | 2 +
.../apache/iceberg/spark/source/TestSparkScan.java | 59 +-
spark/v3.5/build.gradle | 1 +
.../SparkRowLevelOperationsTestBase.java | 2 +-
.../spark/extensions/TestCallStatementParser.java | 1 +
.../TestCherrypickSnapshotProcedure.java | 1 +
.../spark/extensions/TestCopyOnWriteDelete.java | 61 +-
.../spark/extensions/TestCopyOnWriteMerge.java | 21 +-
.../spark/extensions/TestCopyOnWriteUpdate.java | 21 +-
.../extensions/TestExpireSnapshotsProcedure.java | 1 +
.../extensions/TestFastForwardBranchProcedure.java | 1 +
.../apache/iceberg/spark/extensions/TestMerge.java | 3 +
.../spark/extensions/TestMergeOnReadMerge.java | 3 +
.../extensions/TestPublishChangesProcedure.java | 1 +
.../extensions/TestRemoveOrphanFilesProcedure.java | 1 +
.../extensions/TestRewriteDataFilesProcedure.java | 1 +
.../extensions/TestRewriteManifestsProcedure.java | 1 +
.../TestRollbackToSnapshotProcedure.java | 1 +
.../TestRollbackToTimestampProcedure.java | 1 +
.../TestSetCurrentSnapshotProcedure.java | 1 +
.../actions/RemoveDanglingDeletesSparkAction.java | 30 +-
.../spark/actions/RewriteTablePathSparkAction.java | 2 +-
.../spark/source/SparkPositionDeltaWrite.java | 6 +-
.../org/apache/iceberg/spark/source/SparkScan.java | 7 +-
.../apache/iceberg/spark/source/SparkWrite.java | 6 +-
.../iceberg/spark/TestSparkSessionCatalog.java | 12 +-
.../actions/TestDeleteReachableFilesAction.java | 6 +-
.../spark/actions/TestExpireSnapshotsAction.java | 84 +--
.../actions/TestRemoveDanglingDeleteAction.java | 125 ++-
.../spark/actions/TestRemoveOrphanFilesAction.java | 26 +-
.../actions/TestRemoveOrphanFilesAction3.java | 20 +-
.../spark/actions/TestRewriteDataFilesAction.java | 17 +-
.../spark/actions/TestRewriteManifestsAction.java | 1 -
.../TestRewritePositionDeleteFilesAction.java | 140 +++-
.../spark/actions/TestRewriteTablePathsAction.java | 73 +-
.../spark/actions/TestSparkFileRewriter.java | 70 +-
.../apache/iceberg/spark/source/ScanTestBase.java | 1 +
.../iceberg/spark/source/TestReadProjection.java | 2 +
.../apache/iceberg/spark/source/TestSparkScan.java | 59 +-
337 files changed, 10487 insertions(+), 4594 deletions(-)
create mode 100644
api/src/main/java/org/apache/iceberg/types/EdgeAlgorithm.java
create mode 100644
aws/src/test/java/org/apache/iceberg/aws/s3/signer/TestS3V4RestSignerClient.java
create mode 100644
core/src/main/java/org/apache/iceberg/avro/VariantConversion.java
create mode 100644 core/src/test/java/org/apache/iceberg/RandomVariants.java
create mode 100644
core/src/test/java/org/apache/iceberg/TestGeospatialTable.java
create mode 100644
core/src/test/java/org/apache/iceberg/TestPartitionStats.java
create mode 100644
parquet/src/main/java/org/apache/iceberg/parquet/ParquetMetrics.java
create mode 100644
parquet/src/main/java/org/apache/iceberg/parquet/ParquetVariantUtil.java
create mode 100644
parquet/src/test/java/org/apache/iceberg/parquet/TestVariantMetrics.java
copy spark/{v3.5 =>
v3.4}/spark-extensions/src/test/java/org/apache/iceberg/spark/extensions/ExtensionsTestBase.java
(100%)
copy spark/{v3.5 =>
v3.4}/spark/src/main/java/org/apache/iceberg/spark/source/DVIterator.java (100%)
copy spark/{v3.5 =>
v3.4}/spark/src/test/java/org/apache/iceberg/spark/source/TestPositionDeletesReader.java
(100%)
