This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/gradle/com.fasterxml.jackson.core-jackson-annotations-2.16.1
in repository https://gitbox.apache.org/repos/asf/iceberg.git
omit bafa7d5776 Build: Bump com.fasterxml.jackson.core:jackson-annotations
add 23fc3a36eb Build: Bump datamodel-code-generator from 0.25.1 to 0.25.2
(#9377)
add 1fb47316fe Build: Bump mkdocs-material from 9.5.1 to 9.5.3 (#9376)
add c83308c118 Build: Bump guava from 32.1.3-jre to 33.0.0-jre (#9373)
add c8fc591cba Build: Bump arrow from 14.0.1 to 14.0.2 (#9372)
add 226a23f516 Spark 3.5: Remove constructor from parameterized base class
(#9368)
add 6f4e33ec22 Core: Use CharSequenceMap for writing unordered deletes
(#9365)
add 197b61e756 Core: Optimize manifest evaluation for super wide tables
(#9147)
add cbb50bfa5a Core: Remove unused sourceTransform in private method
(#9379)
add 6c344dbbbe Flink: Create CatalogTestBase for migration to JUnit5
(#9364)
add 22d4e7836a Spark 3.5: Parallelize reading files in add_files procedure
(#9274)
add a8f468d6dd Spark 3.5: Migrate tests to JUnit5 in actions directory
(#9367)
add 604422b056 Core: Refactor internal Avro reader to resolve schemas
directly (#9366)
add 7ebb241232 Core, Spark: Correct the delete record count for
PartitionTable (#9389)
add 580e7021ab Spark 3.5: Fix clobbering of files across streaming epochs
when query ID is reused (#9255)
add ad423142c4 Spark 3.3, 3.4: Fix file clobbering when Spark reuses query
IDs (#9255) (#9399)
add e7999a194d Core, Data, Spark 3.5: Support file and partition delete
granularity (#9384)
add 38eb1b18b0 Build: Bump Nessie to 0.76.0 (#9398)
add 8c7001eb46 Flink: Backport #9308 to v1.17 and the relevant parts to
v1.16 (#9403)
add c19318e686 API: Fix Javadoc on UpdateSchema#updateColumnDoc (#9405)
add 3aa0fcd7cd Core: Remove statistics files in CatalogUtil:dropTableData
(#9305)
add be4e7d2087 JMH: Improvements to `jmh.gradle` (#9390)
add 27e8c42135 Docs: CREATE TABLE LIKE is not supported in Spark DDL
(#9358)
add 4ccc29bc2f Build: Bump actions/labeler from 4 to 5 (#9331)
add 6d75e7a76a Flink: Disable classloader check in
TestIcebergSourceWithWatermarkExtractor to fix flakiness (#9408)
add 1a9c3f78f5 Spark: Add support for reading Iceberg views (#9340)
add 1288eb8e33 Core, Spark, Flink, Data: Deliver key metadata for
encryption of data files (#9359)
add 996cd5b53a AWS: Add S3 Access Grants Integration (#9385)
add b7e3e21bbb Core: Remove partition statistics files during purge table
(#9409)
add 12b3ccdd00 Build: Bump com.google.errorprone:error_prone_annotations
(#9369)
add 0bf2602a7a Flink 1.17: Create JUnit5 version of TestFlinkScan (#9185)
add c416c29894 Nessie: Strip trailing slash for warehouse location (#9415)
add 4602824337 Spark 3.5: Migrate tests to JUnit5 (#9417)
add 2101ac2e55 Spark 3.4: Add support for reading Iceberg views (#9422)
add 12f6d0d0a3 Build: Bump org.assertj:assertj-core from 3.24.2 to 3.25.1
(#9427)
add 4a99678369 Parquet: Support reading INT96 column in row group filter
(#8988)
add c87a53aab9 Build: Bump mkdocs-monorepo-plugin from 1.0.5 to 1.1.0
(#9430)
add be155d70ce Build: Bump com.google.errorprone:error_prone_annotations
(#9429)
add 13e1965af4 Parquet: Move to ValueReader generation to a visitor (#9063)
add e16bfcffc9 Core: Add JUnit5 version of TableTestBase (#9424)
add 3e47855c2a Build: Bump software.amazon.awssdk:bom from 2.21.42 to
2.22.12 (#9426)
add bc6b6e65ee Build: Bump
com.fasterxml.jackson.dataformat:jackson-dataformat-xml (#9395)
add 11121a0df9 Build: Bump com.fasterxml.jackson.core:jackson-annotations
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (bafa7d5776)
\
N -- N -- N
refs/heads/dependabot/gradle/com.fasterxml.jackson.core-jackson-annotations-2.16.1
(11121a0df9)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/labeler.yml | 186 ++++--
.github/workflows/labeler.yml | 2 +-
.../main/java/org/apache/iceberg/UpdateSchema.java | 11 +-
.../iceberg/encryption/EncryptedOutputFile.java | 5 -
.../apache/iceberg/expressions/NamedReference.java | 2 +-
.../main/java/org/apache/iceberg/types/Types.java | 16 +
.../util/{NaNUtil.java => CharSequenceUtil.java} | 27 +-
.../org/apache/iceberg/aws/AwsClientFactories.java | 1 +
.../aws/s3/DefaultS3FileIOAwsClientFactory.java | 1 +
.../aws/s3/S3AccessGrantsPluginConfigurations.java | 50 ++
.../apache/iceberg/aws/s3/S3FileIOProperties.java | 90 +++
.../apache/iceberg/aws/TestS3FileIOProperties.java | 32 +
build.gradle | 7 +-
.../apache/iceberg/BaseUpdatePartitionSpec.java | 5 +-
.../main/java/org/apache/iceberg/CatalogUtil.java | 10 +
.../java/org/apache/iceberg/PartitionsTable.java | 4 +-
.../java/org/apache/iceberg/TableProperties.java | 4 +
.../main/java/org/apache/iceberg/avro/Avro.java | 74 ++-
.../java/org/apache/iceberg/avro/AvroIterable.java | 4 +-
.../iceberg/avro/AvroWithPartnerVisitor.java | 211 +++++++
.../org/apache/iceberg/avro/GenericAvroReader.java | 166 ++++--
.../iceberg/avro/NameMappingDatumReader.java | 66 +++
...ValueReader.java => SupportsCustomRecords.java} | 10 +-
.../java/org/apache/iceberg/avro/ValueReader.java | 4 +
.../java/org/apache/iceberg/avro/ValueReaders.java | 369 +++++++++++-
.../apache/iceberg/deletes/DeleteGranularity.java | 71 +++
.../deletes/FileScopedPositionDeleteWriter.java | 113 ++++
.../deletes/SortingPositionOnlyDeleteWriter.java | 89 ++-
.../apache/iceberg/encryption/EncryptionUtil.java | 17 +-
.../encryption/NativeEncryptionInputFile.java} | 11 +-
...datas.java => NativeEncryptionKeyMetadata.java} | 16 +-
...adatas.java => NativeEncryptionOutputFile.java} | 18 +-
.../encryption/StandardEncryptionManager.java | 17 +-
.../iceberg/encryption/StandardKeyMetadata.java | 8 +-
.../iceberg/io/ClusteredPositionDeleteWriter.java | 25 +
.../iceberg/io/FanoutPositionOnlyDeleteWriter.java | 21 +-
.../org/apache/iceberg/io/FileAppenderFactory.java | 11 +
.../iceberg/{TableTestBase.java => TestBase.java} | 141 ++---
.../apache/iceberg/TestCreateSnapshotEvent.java | 105 ++--
.../org/apache/iceberg/TestManifestReader.java | 88 ++-
.../apache/iceberg/avro/TestAvroNameMapping.java | 23 +-
.../iceberg/hadoop/TestCatalogUtilDropTable.java | 115 +++-
.../apache/iceberg/data/BaseFileWriterFactory.java | 22 +-
.../iceberg/data/GenericAppenderFactory.java | 29 +-
.../apache/iceberg/data/TableMigrationUtil.java | 4 +-
.../apache/iceberg/data/GenericAppenderHelper.java | 27 +-
.../io/TestGenericSortedPosDeleteWriter.java | 89 ++-
.../apache/iceberg/io/TestPartitioningWriters.java | 188 +++++-
docs/spark-ddl.md | 2 +
docs/spark-procedures.md | 1 +
.../source/reader/IcebergSourceSplitReader.java | 13 +-
.../TestIcebergSourceWithWatermarkExtractor.java | 6 +-
.../iceberg/flink/sink/FlinkAppenderFactory.java | 20 +-
.../source/reader/IcebergSourceSplitReader.java | 24 +-
.../java/org/apache/iceberg/flink/TestHelpers.java | 361 ++++++------
.../iceberg/flink/source/TestFlinkInputFormat.java | 30 +-
.../apache/iceberg/flink/source/TestFlinkScan.java | 152 +++--
.../iceberg/flink/source/TestFlinkScanSql.java | 11 +-
.../iceberg/flink/source/TestFlinkSource.java | 6 +-
.../flink/source/TestIcebergSourceBounded.java | 9 +-
.../flink/source/TestIcebergSourceBoundedSql.java | 10 +-
.../TestIcebergSourceWithWatermarkExtractor.java | 9 +-
...nkCatalogTestBase.java => CatalogTestBase.java} | 86 ++-
.../iceberg/flink/TestFlinkCatalogDatabase.java | 267 ++++-----
.../flink/TestFlinkCatalogTablePartitions.java | 46 +-
.../TestIcebergSourceWithWatermarkExtractor.java | 4 +-
.../source/TestMetadataTableReadableMetrics.java | 48 +-
gradle/libs.versions.toml | 16 +-
jmh.gradle | 8 +-
.../org/apache/iceberg/nessie/NessieCatalog.java | 8 +-
.../apache/iceberg/nessie/TestNessieCatalog.java | 13 +
open-api/requirements.txt | 2 +-
orc/src/main/java/org/apache/iceberg/orc/ORC.java | 24 +
.../iceberg/data/parquet/BaseParquetReaders.java | 172 ++++--
.../java/org/apache/iceberg/parquet/Parquet.java | 45 +-
.../apache/iceberg/parquet/ParquetConversions.java | 5 +
.../parquet/ParquetDictionaryRowGroupFilter.java | 3 +
site/requirements.txt | 4 +-
.../apache/iceberg/spark/source/SparkWrite.java | 4 +-
.../spark/source/TestIcebergSourceTablesBase.java | 79 ++-
.../extensions/IcebergSparkSessionExtensions.scala | 2 +
.../spark/sql/catalyst/analysis/ResolveViews.scala | 146 +++++
.../apache/iceberg/spark/extensions/TestViews.java | 647 +++++++++++++++++++++
.../org/apache/iceberg/spark/SparkCatalog.java | 70 ++-
.../iceberg/spark/source/SparkAppenderFactory.java | 20 +-
.../org/apache/iceberg/spark/source/SparkView.java | 148 +++++
.../apache/iceberg/spark/source/SparkWrite.java | 4 +-
.../apache/iceberg/spark/SparkCatalogConfig.java | 14 +-
.../iceberg/spark/SparkTestBaseWithCatalog.java | 2 +-
.../spark/source/TestIcebergSourceTablesBase.java | 78 ++-
.../iceberg/spark/source/TestSparkCatalog.java | 4 +-
.../extensions/IcebergSparkSessionExtensions.scala | 2 +
.../spark/sql/catalyst/analysis/ResolveViews.scala | 146 +++++
.../spark/extensions/TestAddFilesProcedure.java | 22 +
.../spark/extensions/TestMergeOnReadDelete.java | 45 ++
.../spark/extensions/TestMergeOnReadMerge.java | 57 ++
.../spark/extensions/TestMergeOnReadUpdate.java | 55 ++
.../apache/iceberg/spark/extensions/TestViews.java | 647 +++++++++++++++++++++
.../iceberg/spark/source/WritersBenchmark.java | 52 +-
.../org/apache/iceberg/spark/SparkCatalog.java | 70 ++-
.../org/apache/iceberg/spark/SparkTableUtil.java | 89 ++-
.../org/apache/iceberg/spark/SparkWriteConf.java | 12 +
.../apache/iceberg/spark/SparkWriteOptions.java | 3 +
.../spark/procedures/AddFilesProcedure.java | 54 +-
.../iceberg/spark/procedures/ProcedureInput.java | 12 +
.../spark/source/SparkPositionDeletesRewrite.java | 15 +-
.../spark/source/SparkPositionDeltaWrite.java | 14 +-
.../org/apache/iceberg/spark/source/SparkView.java | 148 +++++
.../apache/iceberg/spark/source/SparkWrite.java | 4 +-
.../java/org/apache/iceberg/TaskCheckHelper.java | 99 ++--
.../apache/iceberg/TestDataFileSerialization.java | 23 +-
.../apache/iceberg/TestFileIOSerialization.java | 31 +-
.../TestHadoopMetricsContextSerialization.java | 2 +-
.../iceberg/TestManifestFileSerialization.java | 108 ++--
.../apache/iceberg/TestScanTaskSerialization.java | 45 +-
.../org/apache/iceberg/TestTableSerialization.java | 49 +-
.../java/org/apache/iceberg/ValidationHelpers.java | 5 +-
.../org/apache/iceberg/spark/CatalogTestBase.java | 11 +-
.../apache/iceberg/spark/SparkCatalogConfig.java | 14 +-
.../iceberg/spark/SparkTestBaseWithCatalog.java | 2 +-
.../java/org/apache/iceberg/spark/TestBase.java | 6 +-
.../apache/iceberg/spark/TestBaseWithCatalog.java | 59 +-
.../iceberg/spark/TestChangelogIterator.java | 16 +-
.../iceberg/spark/TestFileRewriteCoordinator.java | 53 +-
.../apache/iceberg/spark/TestFunctionCatalog.java | 84 ++-
.../org/apache/iceberg/spark/TestSpark3Util.java | 109 ++--
.../iceberg/spark/TestSparkCachedTableCatalog.java | 26 +-
.../iceberg/spark/TestSparkCatalogOperations.java | 44 +-
.../iceberg/spark/TestSparkCompressionUtil.java | 6 +-
.../TestSparkDistributionAndOrderingUtil.java | 222 +++----
.../org/apache/iceberg/spark/TestSparkFilters.java | 84 +--
.../apache/iceberg/spark/TestSparkSchemaUtil.java | 27 +-
.../iceberg/spark/TestSparkSessionCatalog.java | 66 +--
.../apache/iceberg/spark/TestSparkTableUtil.java | 36 +-
.../apache/iceberg/spark/TestSparkV2Filters.java | 150 ++---
.../iceberg/spark/TestSparkValueConverter.java | 12 +-
.../apache/iceberg/spark/TestSparkWriteConf.java | 111 +++-
.../iceberg/spark/actions/TestCreateActions.java | 383 ++++++------
.../actions/TestDeleteReachableFilesAction.java | 105 ++--
.../spark/actions/TestExpireSnapshotsAction.java | 454 +++++++--------
.../spark/actions/TestRemoveOrphanFilesAction.java | 200 ++++---
.../actions/TestRemoveOrphanFilesAction3.java | 45 +-
.../spark/actions/TestRewriteDataFilesAction.java | 295 +++++-----
.../spark/actions/TestRewriteManifestsAction.java | 235 ++++----
.../TestRewritePositionDeleteFilesAction.java | 347 ++++++-----
.../spark/source/TestDataFrameWriterV2.java | 12 +-
.../spark/source/TestDataSourceOptions.java | 22 +-
.../spark/source/TestIcebergSourceTablesBase.java | 74 ++-
.../source/TestMetadataTableReadableMetrics.java | 24 +-
.../iceberg/spark/source/TestSparkCatalog.java | 4 +-
.../source/TestSparkCatalogCacheExpiration.java | 22 +-
.../iceberg/spark/source/TestSparkReadMetrics.java | 8 +-
.../iceberg/spark/source/TestSparkStagedScan.java | 6 -
.../iceberg/spark/source/TestSparkTable.java | 5 -
154 files changed, 7339 insertions(+), 3077 deletions(-)
copy api/src/main/java/org/apache/iceberg/util/{NaNUtil.java =>
CharSequenceUtil.java} (66%)
create mode 100644
aws/src/main/java/org/apache/iceberg/aws/s3/S3AccessGrantsPluginConfigurations.java
create mode 100644
core/src/main/java/org/apache/iceberg/avro/AvroWithPartnerVisitor.java
create mode 100644
core/src/main/java/org/apache/iceberg/avro/NameMappingDatumReader.java
copy core/src/main/java/org/apache/iceberg/avro/{ValueReader.java =>
SupportsCustomRecords.java} (79%)
create mode 100644
core/src/main/java/org/apache/iceberg/deletes/DeleteGranularity.java
create mode 100644
core/src/main/java/org/apache/iceberg/deletes/FileScopedPositionDeleteWriter.java
copy core/src/{test/java/org/apache/iceberg/TestLocalDeleteFileIndex.java =>
main/java/org/apache/iceberg/encryption/NativeEncryptionInputFile.java} (73%)
copy
core/src/main/java/org/apache/iceberg/encryption/{EncryptionKeyMetadatas.java
=> NativeEncryptionKeyMetadata.java} (71%)
copy
core/src/main/java/org/apache/iceberg/encryption/{EncryptionKeyMetadatas.java
=> NativeEncryptionOutputFile.java} (69%)
copy core/src/test/java/org/apache/iceberg/{TableTestBase.java =>
TestBase.java} (86%)
copy
flink/v1.18/flink/src/test/java/org/apache/iceberg/flink/{FlinkCatalogTestBase.java
=> CatalogTestBase.java} (70%)
create mode 100644
spark/v3.4/spark-extensions/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveViews.scala
create mode 100644
spark/v3.4/spark-extensions/src/test/java/org/apache/iceberg/spark/extensions/TestViews.java
create mode 100644
spark/v3.4/spark/src/main/java/org/apache/iceberg/spark/source/SparkView.java
create mode 100644
spark/v3.5/spark-extensions/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveViews.scala
create mode 100644
spark/v3.5/spark-extensions/src/test/java/org/apache/iceberg/spark/extensions/TestViews.java
create mode 100644
spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/source/SparkView.java
