This is an automated email from the ASF dual-hosted git repository.
dependabot[bot] pushed a change to branch
dependabot/github_actions/gradle/actions-6.1.0
in repository https://gitbox.apache.org/repos/asf/iceberg.git
discard 490d5ad4d4 Build: Bump gradle/actions from 5.0.2 to 6.1.0
add e2a119c822 Spark: Support writing shredded variant in Iceberg-Spark
(#14297)
add 400ba927de AWS: Fix LICENSE/NOTICE compliance for aws-bundle (#16196)
add 334269cd7d Azure: Fix LICENSE, NOTICE, and runtime-deps for
azure-bundle (#16181)
add e4028bf6a0 GCP: Fix LICENSE, NOTICE, and runtime-deps for gcp-bundle
(#16182)
add 86823e5a51 Spark: Fix LICENSE/NOTICE compliance for all versions of
spark-runtime (v3.4, v3.5, v4.0, v4.1) (#16215)
add 0f657edf12 Flink: Fix LICENSE/NOTICE compliance for all versions of
flink-runtime (1.20, 2.0, 2.1) (#16216)
add 05b2df1bd2 Flink: Backport add Nanosecond Precision Support for
Flink-Iceberg Integration (#16183)
add 153237b568 Flink: Backport add Nanosecond Precision Support for
Flink-Iceberg Integration to Flink 2.0 - missing changes (#16239)
add 9ec1b933ed Spark: Backport support writing shredded variant in
Iceberg-Spark (#16241)
add f767dad20e Flink: Backport add Nanosecond Precision Support for
Flink-Iceberg Integration to Flink 1.20 (#16240)
add 17fc6da837 API, Core: Handle 404 from /v1/config for missing
warehouses (#16059)
add 57b1211b74 Spark: backport PR #15512 to v3.4, v3.5, v4.0 for WAP
branch delete fix (#16245)
add 77e7dbb245 ORC: Add _row_id and _last_updated_sequence_number raeder
in Orc to support lineage (#15776)
add b7e65c9029 Core: Add test to validate we can't delete map value during
schema evolution (#15767)
add 299f7be398 OpenAPI, Core: Disambiguate the intent of REFS snapshot
mode (#16252)
add 4efbda3e45 Add Oracle as an Iceberg vendor (#16251)
add b84d446897 Spec: Update formatting in tables to use material content
tabs (#14656)
add 9b8bde411f ORC: Backport add _row_id and _last_updated_sequence_number
raeder in Orc to support lineage (#16256)
add e7a5a87f26 Azure: Avoid depending on KeyWrapAlgorithm in
AzureProperties (#16186)
add fce2504175 CI: Add PR title check workflow (#16101)
add 1a8fa1e56b Docs: Document CATALOG_* env vars in iceberg-rest-fixture
README (#16007)
add c147796973 Docs: Update Oracle vendor description (#16261)
add 1edde6c936 Build: Bump jackson-bom from 2.21.2 to 2.21.3 (#16269)
add d9b6f00a98 Build: Bump joda-time:joda-time from 2.5 to 2.14.2 (#16270)
add 70ed5d9566 Build: Bump junit-platform from 1.14.3 to 1.14.4 (#16272)
add 34511542e6 Build: Bump github/codeql-action from 4.35.2 to 4.35.3
(#16275)
add a6a0b81316 Build: Bump junit from 5.14.3 to 5.14.4 (#16271)
add 68bab74c77 Build: Bump io.grpc:grpc-netty-shaded from 1.80.0 to 1.81.0
(#16277)
add 6364aaae20 Data: Add TCK tests for Schema Evolution in
BaseFormatModelTests (#15843)
add 0e0e795197 Build: Bump
org.openapitools:openapi-generator-gradle-plugin from 7.21.0 to 7.22.0 (#16278)
add 20d5b31003 Kafka Connect: Add Trivy CVE scan to CI (#15430) (#15430)
add f86a6727a0 Build: Bump software.amazon.awssdk:bom from 2.42.41 to
2.44.0 (#16279)
add e5cae79b44 Build: Bump gradle/actions from 5.0.2 to 6.1.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (490d5ad4d4)
\
N -- N -- N
refs/heads/dependabot/github_actions/gradle/actions-6.1.0 (e5cae79b44)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/codeql.yml | 4 +-
.github/workflows/delta-conversion-ci.yml | 1 +
.github/workflows/flink-ci.yml | 1 +
.github/workflows/hive-ci.yml | 1 +
.github/workflows/java-ci.yml | 1 +
.github/workflows/kafka-connect-ci.yml | 1 +
.github/workflows/kafka-connect-cve-scan.yml | 136 ++
.../workflows/{zizmor.yml => pr-title-check.yml} | 40 +-
.github/workflows/spark-ci.yml | 1 +
...xception.java => NoSuchWarehouseException.java} | 8 +-
aws-bundle/LICENSE | 475 ++++++-
aws-bundle/NOTICE | 5 +
aws-bundle/runtime-deps.txt | 88 +-
azure-bundle/LICENSE | 179 ++-
azure-bundle/NOTICE | 17 +-
azure-bundle/build.gradle | 10 +-
azure-bundle/runtime-deps.txt | 1 -
.../org/apache/iceberg/azure/AzureProperties.java | 11 +-
.../keymanagement/AzureKeyManagementClient.java | 3 +-
build.gradle | 15 +-
.../java/org/apache/iceberg/TableProperties.java | 6 +
.../apache/iceberg/io/BufferedFileAppender.java | 149 ++
.../org/apache/iceberg/rest/ErrorHandlers.java | 19 +
.../apache/iceberg/rest/RESTSessionCatalog.java | 2 +-
.../java/org/apache/iceberg/TestSchemaUpdate.java | 11 +
.../org/apache/iceberg/avro/AvroTestHelpers.java | 8 +
.../org/apache/iceberg/data/DataTestHelpers.java | 0
.../iceberg/io/TestBufferedFileAppender.java | 227 +++
.../org/apache/iceberg/rest/TestErrorHandlers.java | 36 +
.../org/apache/iceberg/rest/TestRESTCatalog.java | 25 +
.../apache/iceberg/data/BaseFormatModelTests.java | 450 ++++++
.../apache/iceberg/data/orc/TestGenericData.java | 11 +-
docker/iceberg-rest-fixture/README.md | 33 +
docs/docs/configuration.md | 2 +
docs/docs/spark-configuration.md | 4 +
flink/v1.20/build.gradle | 3 +
flink/v1.20/flink-runtime/LICENSE | 511 ++++++-
.../org/apache/iceberg/flink/FlinkTypeToType.java | 6 +
.../org/apache/iceberg/flink/RowDataWrapper.java | 36 +-
.../apache/iceberg/flink/data/FlinkOrcReader.java | 9 +-
.../apache/iceberg/flink/data/FlinkOrcReaders.java | 15 +-
.../apache/iceberg/flink/data/FlinkOrcWriter.java | 7 +
.../apache/iceberg/flink/data/FlinkOrcWriters.java | 37 +
.../org/apache/iceberg/flink/data/RowDataUtil.java | 2 +
.../apache/iceberg/flink/data/StructRowData.java | 52 +-
.../formats/avro/AvroToRowDataConverters.java | 0
.../iceberg/flink/formats/avro/JodaConverter.java | 0
.../formats/avro/RowDataToAvroConverters.java | 0
.../avro/typeutils/AvroSchemaConverter.java | 2 +-
.../sink/AvroGenericRecordToRowDataMapper.java | 4 +-
.../RowDataToAvroGenericRecordConverter.java | 4 +-
.../source/reader/AvroGenericRecordConverter.java | 4 +-
.../org/apache/iceberg/flink/DataGenerators.java | 105 +-
.../apache/iceberg/flink/TestRowDataWrapper.java | 13 -
.../flink/data/TestFlinkOrcReaderWriter.java | 5 +
.../iceberg/flink/data/TestRowDataProjection.java | 21 +-
.../maintenance/api/TestRewriteDataFiles.java | 51 +-
.../maintenance/operator/OperatorTestBase.java | 35 +-
flink/v2.0/build.gradle | 3 +
flink/v2.0/flink-runtime/LICENSE | 511 ++++++-
.../org/apache/iceberg/flink/FlinkTypeToType.java | 6 +
.../org/apache/iceberg/flink/RowDataWrapper.java | 36 +-
.../apache/iceberg/flink/data/FlinkOrcReader.java | 9 +-
.../apache/iceberg/flink/data/FlinkOrcReaders.java | 15 +-
.../apache/iceberg/flink/data/FlinkOrcWriter.java | 7 +
.../apache/iceberg/flink/data/FlinkOrcWriters.java | 37 +
.../org/apache/iceberg/flink/data/RowDataUtil.java | 2 +
.../apache/iceberg/flink/data/StructRowData.java | 52 +-
.../formats/avro/AvroToRowDataConverters.java | 0
.../iceberg/flink/formats/avro/JodaConverter.java | 0
.../formats/avro/RowDataToAvroConverters.java | 0
.../avro/typeutils/AvroSchemaConverter.java | 0
.../sink/AvroGenericRecordToRowDataMapper.java | 4 +-
.../RowDataToAvroGenericRecordConverter.java | 4 +-
.../source/reader/AvroGenericRecordConverter.java | 4 +-
.../org/apache/iceberg/flink/DataGenerators.java | 105 +-
.../apache/iceberg/flink/TestRowDataWrapper.java | 13 -
.../flink/data/TestFlinkOrcReaderWriter.java | 5 +
.../iceberg/flink/data/TestRowDataProjection.java | 21 +-
.../maintenance/api/TestRewriteDataFiles.java | 51 +-
.../maintenance/operator/OperatorTestBase.java | 35 +-
flink/v2.1/build.gradle | 2 +
flink/v2.1/flink-runtime/LICENSE | 511 ++++++-
.../apache/iceberg/flink/data/FlinkOrcReader.java | 2 +-
.../apache/iceberg/flink/data/FlinkOrcReaders.java | 15 +-
.../maintenance/api/TestRewriteDataFiles.java | 51 +-
.../maintenance/operator/OperatorTestBase.java | 35 +-
format/spec.md | 322 ++---
gcp-bundle/LICENSE | 1439 +++++++++++++++++++-
gcp-bundle/NOTICE | 139 +-
gcp-bundle/build.gradle | 5 +-
gcp-bundle/runtime-deps.txt | 1 -
gradle/libs.versions.toml | 10 +-
kafka-connect/build.gradle | 2 +-
.../kafka-connect-runtime/runtime-deps.txt | 80 +-
open-api/rest-catalog-open-api.yaml | 6 +-
.../apache/iceberg/data/orc/GenericOrcReader.java | 2 +-
.../apache/iceberg/data/orc/GenericOrcReaders.java | 30 +
orc/src/main/java/org/apache/iceberg/orc/ORC.java | 10 +-
.../org/apache/iceberg/orc/OrcValueReaders.java | 218 ++-
.../apache/iceberg/orc/OrcWritingTestUtils.java | 18 +-
.../org/apache/iceberg/orc/TestORCSchemaUtil.java | 8 +
.../apache/iceberg/parquet/ParquetFormatModel.java | 93 +-
.../iceberg/parquet/ParquetVariantWriters.java | 61 +-
.../iceberg/parquet/VariantShreddingAnalyzer.java | 532 ++++++++
.../iceberg/parquet/VariantWriterBuilder.java | 12 +-
.../iceberg/parquet/ParquetWritingTestUtils.java | 2 +-
.../iceberg/parquet/TestParquetDataWriter.java | 210 +++
.../parquet/TestVariantShreddingAnalyzer.java | 475 +++++++
.../iceberg/parquet/ParquetFileTestUtils.java} | 19 +-
site/docs/vendors.md | 4 +
spark/v3.4/build.gradle | 2 +
.../iceberg/spark/extensions/TestDelete.java | 56 +
spark/v3.4/spark-runtime/LICENSE | 542 +++++++-
spark/v3.4/spark-runtime/NOTICE | 37 +-
.../apache/iceberg/spark/source/SparkTable.java | 31 +-
spark/v3.5/build.gradle | 1 +
.../iceberg/spark/extensions/TestDelete.java | 56 +
spark/v3.5/spark-runtime/LICENSE | 542 +++++++-
spark/v3.5/spark-runtime/NOTICE | 37 +-
.../apache/iceberg/spark/source/SparkTable.java | 31 +-
spark/v4.0/build.gradle | 1 +
.../iceberg/spark/extensions/TestDelete.java | 56 +
spark/v4.0/spark-runtime/LICENSE | 542 +++++++-
spark/v4.0/spark-runtime/NOTICE | 35 +
.../apache/iceberg/spark/SparkSQLProperties.java | 8 +
.../org/apache/iceberg/spark/SparkWriteConf.java | 30 +
.../apache/iceberg/spark/SparkWriteOptions.java | 6 +
.../iceberg/spark/source/SparkFormatModels.java | 4 +-
.../apache/iceberg/spark/source/SparkTable.java | 31 +-
.../source/SparkVariantShreddingAnalyzer.java | 69 +
.../apache/iceberg/spark/TestSparkWriteConf.java | 85 ++
.../spark/variant/TestVariantShredding.java | 1101 +++++++++++++++
spark/v4.1/build.gradle | 1 +
.../TestRowLevelOperationsWithLineage.java | 12 +
spark/v4.1/spark-runtime/LICENSE | 542 +++++++-
spark/v4.1/spark-runtime/NOTICE | 37 +-
.../apache/iceberg/spark/SparkSQLProperties.java | 8 +
.../org/apache/iceberg/spark/SparkWriteConf.java | 30 +
.../apache/iceberg/spark/SparkWriteOptions.java | 6 +
.../apache/iceberg/spark/data/SparkOrcReader.java | 2 +-
.../iceberg/spark/data/SparkOrcValueReaders.java | 15 +-
.../iceberg/spark/source/SparkFormatModels.java | 4 +-
.../source/SparkVariantShreddingAnalyzer.java | 69 +
.../apache/iceberg/spark/TestSparkWriteConf.java | 84 ++
.../spark/variant/TestVariantShredding.java | 1101 +++++++++++++++
146 files changed, 12616 insertions(+), 735 deletions(-)
create mode 100644 .github/workflows/kafka-connect-cve-scan.yml
copy .github/workflows/{zizmor.yml => pr-title-check.yml} (54%)
copy
api/src/main/java/org/apache/iceberg/exceptions/{NoSuchNamespaceException.java
=> NoSuchWarehouseException.java} (79%)
create mode 100644
core/src/main/java/org/apache/iceberg/io/BufferedFileAppender.java
rename {data =>
core}/src/test/java/org/apache/iceberg/data/DataTestHelpers.java (100%)
create mode 100644
core/src/test/java/org/apache/iceberg/io/TestBufferedFileAppender.java
copy flink/{v2.1 =>
v1.20}/flink/src/main/java/org/apache/iceberg/flink/formats/avro/AvroToRowDataConverters.java
(100%)
copy flink/{v2.1 =>
v1.20}/flink/src/main/java/org/apache/iceberg/flink/formats/avro/JodaConverter.java
(100%)
copy flink/{v2.1 =>
v1.20}/flink/src/main/java/org/apache/iceberg/flink/formats/avro/RowDataToAvroConverters.java
(100%)
copy flink/{v2.1 =>
v1.20}/flink/src/main/java/org/apache/iceberg/flink/formats/avro/typeutils/AvroSchemaConverter.java
(99%)
copy flink/{v2.1 =>
v2.0}/flink/src/main/java/org/apache/iceberg/flink/formats/avro/AvroToRowDataConverters.java
(100%)
copy flink/{v2.1 =>
v2.0}/flink/src/main/java/org/apache/iceberg/flink/formats/avro/JodaConverter.java
(100%)
copy flink/{v2.1 =>
v2.0}/flink/src/main/java/org/apache/iceberg/flink/formats/avro/RowDataToAvroConverters.java
(100%)
copy flink/{v2.1 =>
v2.0}/flink/src/main/java/org/apache/iceberg/flink/formats/avro/typeutils/AvroSchemaConverter.java
(100%)
copy
core/src/main/java/org/apache/iceberg/encryption/NativeEncryptionInputFile.java
=> orc/src/test/java/org/apache/iceberg/orc/OrcWritingTestUtils.java (66%)
create mode 100644
parquet/src/main/java/org/apache/iceberg/parquet/VariantShreddingAnalyzer.java
create mode 100644
parquet/src/test/java/org/apache/iceberg/parquet/TestVariantShreddingAnalyzer.java
copy parquet/src/{main/java/org/apache/iceberg/parquet/ParquetValueReader.java
=> testFixtures/java/org/apache/iceberg/parquet/ParquetFileTestUtils.java} (66%)
create mode 100644
spark/v4.0/spark/src/main/java/org/apache/iceberg/spark/source/SparkVariantShreddingAnalyzer.java
create mode 100644
spark/v4.0/spark/src/test/java/org/apache/iceberg/spark/variant/TestVariantShredding.java
create mode 100644
spark/v4.1/spark/src/main/java/org/apache/iceberg/spark/source/SparkVariantShreddingAnalyzer.java
create mode 100644
spark/v4.1/spark/src/test/java/org/apache/iceberg/spark/variant/TestVariantShredding.java
