This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/gradle/com.azure-azure-sdk-bom-1.2.28
in repository https://gitbox.apache.org/repos/asf/iceberg.git
omit b802f2682e Build: Bump com.azure:azure-sdk-bom from 1.2.25 to 1.2.28
add ce75f52719 Build: Bump com.google.cloud:libraries-bom from 26.48.0 to
26.49.0 (#11363)
add c16cefa501 Core: Move deleteRemovedMetadataFiles(..) to CatalogUtil
(#11352)
add d0a7ff915e Arrow: Fix indexing in Parquet dictionary encoded values
readers (#11247)
add a19896658c Spark 3.5: Update Spark to use planned Avro reads (#11299)
add a8ec43d975 Core, Spark 3.5: Remove dangling deletes as part of
RewriteDataFilesAction (#9724)
add 97946088a8 Spark: Randomize view/function names in testing (#11381)
add 60181f9a76 Spark 3.4: Randomize view/function names in testing (#11382)
add 9c0a806846 Spark 3.4: Action to remove dangling deletes (#11377)
add 043757c0a1 Spark 3.5: Reset Spark Conf for each test in
TestCompressionSettings (#11333)
add 02a988b09a Spec: Adds Row Lineage (#11130)
add 4850b622c7 AWS: Support S3 directory bucket listing (#11021)
add 1cb88a64f8 Core: Add LoadCredentialsResponse class/parser (#11339)
add 35a02d035e OpenAPI: Add endpoint for refreshing vended credentials
(#11281)
add 6ba1a1f578 AWS: Use testcontainers-minio instead of S3Mock (#11349)
add 12ac3ee5d3 Kafka Connect: Include third party licenses and notices in
distribution (#10829)
add fdc2c223ef Deprecate iceberg-pig (#11379)
add 6b04a6d000 Core: Track data files by spec id instead of full
PartitionSpec (#11323)
add 32e9f40468 Spark 3.5: Don't change table distribution when only
altering local order (#10774)
add 7738e1d722 Spec: Fix table of content generation (#11067)
add 9ecd97bf45 [KafkaConnect] Fix RecordConverter for UUID and Fixed Types
(#11346)
add 7ad11b2df1 Core: Snapshot `summary` map must have `operation` key
(#11354)
add 2b55fef7cc Core: Update TableMetadataParser to ensure all streams
closed (#11220)
add e3bbcac852 Build: Bump Spark 3.4 to 3.4.4 (#11366)
add b4d178fa05 Build: Bump junit from 5.11.1 to 5.11.3 (#11401)
add 9565b9c401 Build: Bump software.amazon.awssdk:bom from 2.28.26 to
2.29.1 (#11400)
add 85ed870175 Build: Bump com.azure:azure-sdk-bom from 1.2.25 to 1.2.28
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (b802f2682e)
\
N -- N -- N
refs/heads/dependabot/gradle/com.azure-azure-sdk-bom-1.2.28 (85ed870175)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../apache/iceberg/actions/ActionsProvider.java | 6 +
.../iceberg/actions/RemoveDanglingDeleteFiles.java | 20 +-
.../apache/iceberg/actions/RewriteDataFiles.java | 16 +
...orizedDictionaryEncodedParquetValuesReader.java | 22 +-
.../org/apache/iceberg/aws/AwsIntegTestUtil.java | 47 +-
.../org/apache/iceberg/aws/glue/GlueTestBase.java | 2 +-
.../iceberg/aws/s3/TestS3FileIOIntegration.java | 73 +-
.../iceberg/aws/s3/TestS3MultipartUpload.java | 2 +-
.../java/org/apache/iceberg/aws/s3/S3FileIO.java | 8 +-
.../apache/iceberg/aws/s3/S3FileIOProperties.java | 37 +
.../main/java/org/apache/iceberg/aws/s3/S3URI.java | 33 +
.../apache/iceberg/aws/TestS3FileIOProperties.java | 8 +
.../org/apache/iceberg/aws/s3/MinioContainer.java | 68 -
.../java/org/apache/iceberg/aws/s3/MinioUtil.java | 65 +
.../org/apache/iceberg/aws/s3/TestMinioUtil.java | 75 +
.../org/apache/iceberg/aws/s3/TestS3FileIO.java | 116 +-
.../apache/iceberg/aws/s3/TestS3InputStream.java | 13 +-
.../apache/iceberg/aws/s3/TestS3OutputStream.java | 13 +-
.../java/org/apache/iceberg/aws/s3/TestS3URI.java | 43 +
.../iceberg/aws/s3/signer/S3SignerServlet.java | 6 +-
.../iceberg/aws/s3/signer/TestS3RestSigner.java | 18 +-
build.gradle | 8 +-
.../iceberg/BaseMetastoreTableOperations.java | 49 +-
.../main/java/org/apache/iceberg/CatalogUtil.java | 45 +
.../apache/iceberg/MergingSnapshotProducer.java | 23 +-
.../java/org/apache/iceberg/SnapshotParser.java | 5 +-
.../org/apache/iceberg/TableMetadataParser.java | 12 +-
...ble.java => BaseRemoveDanglingDeleteFiles.java} | 6 +-
.../iceberg/actions/BaseRewriteDataFiles.java | 6 +
.../iceberg/avro/AvroWithPartnerVisitor.java | 2 +-
.../java/org/apache/iceberg/avro/ValueReaders.java | 4 +-
.../iceberg/hadoop/HadoopTableOperations.java | 40 +-
.../org/apache/iceberg/rest/RESTSerializers.java | 29 +-
.../rest/responses/LoadCredentialsResponse.java | 15 +-
.../responses/LoadCredentialsResponseParser.java | 77 +
.../rest/responses/LoadTableResponseParser.java | 8 +-
.../rest/responses/LoadViewResponseParser.java | 8 +-
.../java/org/apache/iceberg/TestSnapshotJson.java | 77 +
.../TestLoadCredentialsResponseParser.java | 112 ++
format/spec.md | 371 ++--
gradle/libs.versions.toml | 12 +-
kafka-connect/build.gradle | 6 +-
kafka-connect/kafka-connect-runtime/LICENSE | 1970 ++++++++++++++++++++
kafka-connect/kafka-connect-runtime/NOTICE | 1723 +++++++++++++++++
.../iceberg/connect/data/RecordConverter.java | 25 +-
.../iceberg/connect/data/RecordConverterTest.java | 32 +-
open-api/rest-catalog-open-api.py | 6 +
open-api/rest-catalog-open-api.yaml | 55 +
.../apache/iceberg/pig/IcebergPigInputFormat.java | 5 +
.../org/apache/iceberg/pig/IcebergStorage.java | 8 +
.../org/apache/iceberg/pig/PigParquetReader.java | 13 +-
.../java/org/apache/iceberg/pig/SchemaUtil.java | 4 +
.../apache/iceberg/spark/extensions/TestViews.java | 169 +-
.../org/apache/iceberg/spark/SparkContentFile.java | 7 +-
.../actions/RemoveDanglingDeletesSparkAction.java | 171 ++
.../spark/actions/RewriteDataFilesSparkAction.java | 33 +-
.../apache/iceberg/spark/actions/SparkActions.java | 6 +
.../actions/TestRemoveDanglingDeleteAction.java | 426 +++++
.../spark/actions/TestRewriteDataFilesAction.java | 193 +-
.../IcebergSqlExtensionsAstBuilder.scala | 10 +-
.../v2/SetWriteDistributionAndOrderingExec.scala | 10 +-
.../TestSetWriteDistributionAndOrdering.java | 29 +-
.../apache/iceberg/spark/extensions/TestViews.java | 169 +-
.../org/apache/iceberg/spark/SparkContentFile.java | 7 +-
.../actions/RemoveDanglingDeletesSparkAction.java | 179 ++
.../spark/actions/RewriteDataFilesSparkAction.java | 34 +-
.../apache/iceberg/spark/actions/SparkActions.java | 6 +
.../apache/iceberg/spark/data/SparkAvroReader.java | 12 +
.../spark/data/SparkPlannedAvroReader.java} | 80 +-
.../iceberg/spark/data/SparkValueReaders.java | 38 +
.../apache/iceberg/spark/source/BaseRowReader.java | 4 +-
.../logical/SetWriteDistributionAndOrdering.scala | 2 +-
.../actions/TestRemoveDanglingDeleteAction.java | 447 +++++
.../spark/actions/TestRewriteDataFilesAction.java | 215 ++-
.../TestRewritePositionDeleteFilesAction.java | 3 +-
.../org/apache/iceberg/spark/data/TestHelpers.java | 15 +
.../iceberg/spark/data/TestSparkAvroEnums.java | 2 +-
.../iceberg/spark/data/TestSparkAvroReader.java | 2 +-
...estParquetDictionaryEncodedVectorizedReads.java | 92 +
.../spark/source/TestCompressionSettings.java | 19 +
.../iceberg/spark/source/TestDataFrameWrites.java | 4 +-
.../decimal_dict_and_plain_encoding.parquet | Bin 0 -> 3685 bytes
82 files changed, 7166 insertions(+), 665 deletions(-)
copy
spark/v3.3/spark/src/main/java/org/apache/iceberg/spark/PositionDeletesRewriteCoordinator.java
=> api/src/main/java/org/apache/iceberg/actions/RemoveDanglingDeleteFiles.java
(63%)
delete mode 100644
aws/src/test/java/org/apache/iceberg/aws/s3/MinioContainer.java
create mode 100644 aws/src/test/java/org/apache/iceberg/aws/s3/MinioUtil.java
create mode 100644
aws/src/test/java/org/apache/iceberg/aws/s3/TestMinioUtil.java
copy core/src/main/java/org/apache/iceberg/actions/{BaseMigrateTable.java =>
BaseRemoveDanglingDeleteFiles.java} (83%)
copy aws/src/main/java/org/apache/iceberg/aws/s3/signer/S3SignResponse.java =>
core/src/main/java/org/apache/iceberg/rest/responses/LoadCredentialsResponse.java
(78%)
create mode 100644
core/src/main/java/org/apache/iceberg/rest/responses/LoadCredentialsResponseParser.java
create mode 100644
core/src/test/java/org/apache/iceberg/rest/responses/TestLoadCredentialsResponseParser.java
create mode 100644 kafka-connect/kafka-connect-runtime/LICENSE
create mode 100644 kafka-connect/kafka-connect-runtime/NOTICE
create mode 100644
spark/v3.4/spark/src/main/java/org/apache/iceberg/spark/actions/RemoveDanglingDeletesSparkAction.java
create mode 100644
spark/v3.4/spark/src/test/java/org/apache/iceberg/spark/actions/TestRemoveDanglingDeleteAction.java
create mode 100644
spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/actions/RemoveDanglingDeletesSparkAction.java
copy
spark/{v3.3/spark/src/main/java/org/apache/iceberg/spark/data/SparkAvroReader.java
=>
v3.5/spark/src/main/java/org/apache/iceberg/spark/data/SparkPlannedAvroReader.java}
(62%)
create mode 100644
spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestRemoveDanglingDeleteAction.java
create mode 100644
spark/v3.5/spark/src/test/resources/decimal_dict_and_plain_encoding.parquet
