This is an automated email from the ASF dual-hosted git repository.
dependabot[bot] pushed a change to branch
dependabot/github_actions/codeql-action-9d88a12d2b
in repository https://gitbox.apache.org/repos/asf/iceberg.git
discard 839ef065b0 Build: Bump the codeql-action group across 1 directory with
3 updates
add f686b5f811 Build: Bump com.github.ben-manes.caffeine:caffeine from
3.3.0 to 3.3.1 (#18643)
add 81bb55deaa Build: Bump jackson-bom from 2.22.3 to 2.22.4 (#18640)
add 5f1ca1817f Build: Bump actions/setup-java from 6.0.1 to 6.1.0 (#18639)
add e146cbfd39 Build: Bump datamodel-code-generator from 0.82.0 to 0.85.0
(#18638)
add 3c69c30b24 Build: Bump pymarkdownlnt from 0.9.40 to 0.9.41 (#18637)
add 97659351d4 Build: Bump com.aliyun:kms20160120 from 2.3.0 to 2.3.1
(#18636)
add 75129efe3b Build: Bump com.azure:azure-sdk-bom from 1.3.8 to 1.3.9
(#18649)
add 47677abf35 Build: Bump io.grpc:grpc-netty-shaded from 1.84.2 to 1.85.0
(#18651)
add feca1ca654 Build: Bump software.amazon.awssdk:bom from 2.55.14 to
2.56.0 (#18650)
add e5f8ab19c8 Spark 3.5: Use snapshot schema for CBO column statistics
(#18459)
add ea47af380c Core: Read geometry and geography bounds as GeospatialBound
(#18394)
add 34927ff68e Core: Include attempt and maxAttempts in Tasks retry log
(#18664)
add 6275107e38 Spec: Replace per-column tight_bounds with file-level
tight_stats in v4 (#18585)
add e5998eb8c1 Spark: Upgrade to 4.1.4 (#18667)
add b61ef96a34 Flink: Fix dynamic sink HASH keying of records sent to the
table updater (#18602)
add e6191b9eda Spark 4.0, 4.2: Port MergingSortedRowDataReader to 4.0 and
4.2 (#18492)
add d5d6bc0faa Spark: Emit geometry bounds in Parquet writers (#18501)
add 9b9be7e629 Spark: Upgrade to 4.0.5 (#18670)
add c759fb82db Spark: Upgrade to 4.2.1 (#18666)
add 339be73d22 Core: Reduce DeleteFileIndex memory for file-scoped
position deletes (#18359)
add 07454273f1 INFRA: Add labeler configuration for blog files (#18345)
add 514387a484 Spark 3.5, 4.0: Fix rewrite failure on tables created with
a sort order (#18510)
add a6461374fd Spec: v4 constraints (#17822)
add e17f482445 Build: Fix Guava CVE scan failures in GCP and Kafka (#18679)
add f8f4b7476c Spark 4.2: Test legacy position deletes when upgrading to
v3 tables (#18214)
add 29d21c2b73 Core: Handle null snapshot summary during incremental
cleanup (#18624)
add d293148e4a Spark: Route `defaultNamespace` call to wrapped catalog in
`SparkSessionCatalog` (#17029)
add 058898c7b5 Flink: Fix ConvertEqualityDeletes key serialization for
temporal equality fields (#18610)
add 1fbd13e42b Core: Block on unfinished futures in Tasks.waitFor instead
of polling (#18540)
add 2ebe838e31 AWS: Fix zero-length S3 tail reads (#18329)
add 1498feeebe Spark: Compare filtered scan results by their unique record
IDs so tests do not depend on Spark task or row ordering (#18645)
add 6955fcd1f3 API: Fix failed scans and wrong results for IN/NOT IN on
timestamp_ns partitions (#18478)
add d8198f7370 Build: Upgrade Arrow to 19.0.0 (#18426)
add 4ad4023bd7 REST: Add none to X-Iceberg-Access-Delegation header values
(#18480)
add b9e84f0e26 Spark 4.2: Forward parseRoutineParam and parseQuery to the
delegate parser (#18702)
add ab3f756b48 Flink: Backport: Forward watermarks in
EqualityConvertCommitter with no active cycle (#18439) (#18697)
add c71e7dfca1 Flink: Backport: Close the Sink V2 aggregator's table
loader (#18496) (#18698)
add dfd7ef3b71 Spark 3.5, 4.0, 4.1, 4.2: Use scan schema for CBO column
statistics (#18655)
add be2528185a Spark 4.0, 4.1: Backport: Forward parseRoutineParam and
parseQuery to the delegate parser (#18702) (#18718)
add 4d9ea86f0f Build: Bump the codeql-action group across 1 directory with
3 updates
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (839ef065b0)
\
N -- N -- N
refs/heads/dependabot/github_actions/codeql-action-9d88a12d2b (4d9ea86f0f)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/labeler.yml | 5 +
...nore => kafka-connect-runtime.trivyignore.yaml} | 14 +-
.github/workflows/api-binary-compatibility.yml | 2 +-
.github/workflows/codeql.yml | 4 +-
.github/workflows/cve-scan.yml | 6 +-
.github/workflows/delta-conversion-ci.yml | 4 +-
.github/workflows/flink-ci.yml | 2 +-
.github/workflows/hive-ci.yml | 2 +-
.github/workflows/java-ci.yml | 8 +-
.github/workflows/jmh-benchmarks.yml | 2 +-
.github/workflows/kafka-connect-ci.yml | 2 +-
.../publish-iceberg-rest-fixture-docker.yml | 2 +-
.github/workflows/publish-snapshot.yml | 2 +-
.github/workflows/recurring-jmh-benchmarks.yml | 2 +-
.github/workflows/source-release-ci.yml | 2 +-
.github/workflows/spark-ci.yml | 2 +-
.../apache/iceberg/geospatial/GeospatialBound.java | 37 ++++-
.../org/apache/iceberg/transforms/Identity.java | 13 +-
.../iceberg/geospatial/TestGeospatialBound.java | 68 +++++++-
.../apache/iceberg/transforms/TestProjection.java | 31 ++++
aws-bundle/runtime-deps.txt | 88 +++++------
.../apache/iceberg/aws/s3/TestS3InputStream.java | 29 ++++
.../org/apache/iceberg/aws/s3/S3InputStream.java | 4 +
.../apache/iceberg/aws/s3/TestS3InputStream.java | 20 ++-
azure-bundle/runtime-deps.txt | 12 +-
.../src/main/java/org/apache/iceberg/BaseFile.java | 10 +-
.../java/org/apache/iceberg/DeleteFileIndex.java | 37 ++++-
.../java/org/apache/iceberg/FieldStatsStruct.java | 7 +-
.../java/org/apache/iceberg/GenericDeleteFile.java | 8 +
.../org/apache/iceberg/IncrementalFileCleanup.java | 20 ++-
.../java/org/apache/iceberg/V4ManifestReader.java | 52 ++++++-
.../main/java/org/apache/iceberg/util/Tasks.java | 97 ++++++------
.../apache/iceberg/DeleteFileIndexTestBase.java | 45 +-----
.../org/apache/iceberg/TestFieldStatsStruct.java | 54 +++++--
.../apache/iceberg/TestLocalDeleteFileIndex.java | 104 +++++++++++++
.../org/apache/iceberg/TestRemoveSnapshots.java | 12 +-
.../org/apache/iceberg/TestV4ManifestReader.java | 129 +++++++++++++++-
.../java/org/apache/iceberg/util/TestTasks.java | 140 +++++++++++++++++
docs/docs/spark-configuration.md | 3 +-
.../operator/EqualityConvertCommitter.java | 11 +-
.../maintenance/operator/EqualityConvertPlan.java | 11 ++
.../operator/EqualityConvertPlanner.java | 11 +-
.../iceberg/flink/sink/IcebergWriteAggregator.java | 9 ++
.../api/TestConvertEqualityDeletesE2E.java | 116 ++++++++++++++
.../operator/TestEqualityConvertCommitter.java | 61 ++++++++
.../operator/TestEqualityConvertDVWriter.java | 31 ++++
.../operator/TestEqualityConvertPlanner.java | 19 ++-
.../iceberg/flink/sink/TestIcebergCommitter.java | 27 ++++
.../operator/EqualityConvertCommitter.java | 11 +-
.../maintenance/operator/EqualityConvertPlan.java | 11 ++
.../operator/EqualityConvertPlanner.java | 11 +-
.../iceberg/flink/sink/IcebergWriteAggregator.java | 9 ++
.../api/TestConvertEqualityDeletesE2E.java | 116 ++++++++++++++
.../operator/TestEqualityConvertCommitter.java | 61 ++++++++
.../operator/TestEqualityConvertDVWriter.java | 31 ++++
.../operator/TestEqualityConvertPlanner.java | 19 ++-
.../iceberg/flink/sink/TestIcebergCommitter.java | 27 ++++
.../operator/EqualityConvertReader.java | 11 +-
.../maintenance/operator/StructLikeSerializer.java | 9 ++
.../flink/sink/dynamic/DynamicRecordProcessor.java | 13 +-
.../flink/sink/dynamic/HashKeyGenerator.java | 10 +-
.../maintenance/operator/OperatorTestBase.java | 10 +-
.../operator/TestEqualityConvertReader.java | 64 ++++++++
.../flink/sink/dynamic/TestDynamicIcebergSink.java | 151 ++++++++++++++++++
.../flink/sink/dynamic/TestHashKeyGenerator.java | 46 ++++++
format/spec.md | 172 ++++++++++++++++++---
gcp-bundle/build.gradle | 3 +
gcp-bundle/runtime-deps.txt | 2 +-
gradle/libs.versions.toml | 18 +--
kafka-connect/build.gradle | 4 +-
.../kafka-connect-runtime/runtime-deps.txt | 104 ++++++-------
open-api/requirements.txt | 2 +-
open-api/rest-catalog-open-api.yaml | 5 +
site/requirements.txt | 2 +-
spark/v3.5/spark-runtime/LICENSE | 37 -----
spark/v3.5/spark-runtime/runtime-deps.txt | 13 +-
.../apache/iceberg/spark/SparkSessionCatalog.java | 3 +-
.../org/apache/iceberg/spark/SparkWriteConf.java | 5 +-
.../org/apache/iceberg/spark/source/SparkScan.java | 7 +-
.../apache/iceberg/spark/TestSparkWriteConf.java | 25 +++
.../spark/actions/TestRewriteDataFilesAction.java | 31 ++++
.../iceberg/spark/source/TestFilteredScan.java | 26 +---
.../apache/iceberg/spark/source/TestSparkScan.java | 80 ++++++++++
.../IcebergSparkSqlExtensionsParser.scala | 7 +-
.../apache/iceberg/spark/TestExtendedParser.java | 28 ++++
spark/v4.0/spark-runtime/LICENSE | 37 -----
spark/v4.0/spark-runtime/runtime-deps.txt | 13 +-
.../apache/iceberg/spark/SparkSessionCatalog.java | 3 +-
.../org/apache/iceberg/spark/SparkWriteConf.java | 5 +-
.../spark/source/MergingSortedRowDataReader.java | 6 +-
.../org/apache/iceberg/spark/source/SparkScan.java | 7 +-
.../apache/iceberg/spark/TestSparkWriteConf.java | 26 ++++
.../spark/actions/TestRewriteDataFilesAction.java | 31 ++++
.../iceberg/spark/source/TestFilteredScan.java | 26 +---
.../source/TestMergingSortedRowDataReader.java | 46 ++++--
.../apache/iceberg/spark/source/TestSparkScan.java | 80 ++++++++++
.../IcebergSparkSqlExtensionsParser.scala | 7 +-
.../apache/iceberg/spark/TestExtendedParser.java | 27 ++++
spark/v4.1/spark-runtime/LICENSE | 37 -----
spark/v4.1/spark-runtime/runtime-deps.txt | 13 +-
.../apache/iceberg/spark/SparkSessionCatalog.java | 3 +-
.../iceberg/spark/data/SparkParquetWriters.java | 48 ++++--
.../org/apache/iceberg/spark/source/SparkScan.java | 7 +-
.../iceberg/spark/data/TestSparkParquetWriter.java | 110 ++++++++++++-
.../iceberg/spark/source/TestFilteredScan.java | 26 +---
.../apache/iceberg/spark/source/TestSparkScan.java | 80 ++++++++++
.../IcebergSparkSqlExtensionsParser.scala | 7 +-
.../apache/iceberg/spark/TestExtendedParser.java | 27 ++++
spark/v4.2/spark-runtime/LICENSE | 37 -----
spark/v4.2/spark-runtime/runtime-deps.txt | 13 +-
.../apache/iceberg/spark/SparkSessionCatalog.java | 3 +-
.../iceberg/spark/data/SparkParquetWriters.java | 48 ++++--
.../spark/source/MergingSortedRowDataReader.java | 0
.../org/apache/iceberg/spark/source/SparkScan.java | 7 +-
.../TestRewritePositionDeleteFilesAction.java | 37 +++++
.../iceberg/spark/data/TestSparkParquetWriter.java | 84 +++++++++-
.../iceberg/spark/source/TestFilteredScan.java | 26 +---
.../source/TestMergingSortedRowDataReader.java | 0
.../spark/source/TestSparkReaderDeletes.java | 143 +++++++++++++----
.../apache/iceberg/spark/source/TestSparkScan.java | 80 ++++++++++
120 files changed, 3018 insertions(+), 693 deletions(-)
rename .github/trivyignore/{kafka-connect-runtime.trivyignore =>
kafka-connect-runtime.trivyignore.yaml} (82%)
copy spark/{v4.1 =>
v4.0}/spark/src/main/java/org/apache/iceberg/spark/source/MergingSortedRowDataReader.java
(98%)
copy spark/{v4.1 =>
v4.0}/spark/src/test/java/org/apache/iceberg/spark/source/TestMergingSortedRowDataReader.java
(96%)
copy spark/{v4.1 =>
v4.2}/spark/src/main/java/org/apache/iceberg/spark/source/MergingSortedRowDataReader.java
(100%)
copy spark/{v4.1 =>
v4.2}/spark/src/test/java/org/apache/iceberg/spark/source/TestMergingSortedRowDataReader.java
(100%)
