This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/gradle/io.delta-delta-standalone_2.12-3.2.0
in repository https://gitbox.apache.org/repos/asf/iceberg.git
discard b24c6cf965 Build: Bump io.delta:delta-standalone_2.12 from 3.1.0 to
3.2.0
add fcd07d91aa Build: Bump mkdocs-material from 9.5.21 to 9.5.23 (#10353)
add f1a548f972 Build: Bump org.springframework:spring-web from 5.3.34 to
5.3.35 (#10354)
add b3c25fb760 Build: Bump software.amazon.awssdk:bom from 2.25.50 to
2.25.57 (#10367)
add 9114cc87ac Hive: Use base table metadata to create HiveLock (#10016)
add dd2197f835 API: Fix aggregate pushdown when optional DataFile stats
are null (#10273)
add d4c2ef8950 Spark 3.5: Support camel case session configs and options
(#10310)
add 311dbbb10d AWS: Support S3 DSSE-KMS encryption (#8370)
add af9b9ee8a5 Docs: add metrics-reporting back (#10377)
add 2a35e23960 Build: Bump software.amazon.awssdk:bom from 2.25.57 to
2.25.60 (#10385)
add 9a3db37d39 Build: Bump io.netty:netty-buffer from 4.1.109.Final to
4.1.110.Final (#10384)
add ca8af31f7d Build: Bump io.airlift:aircompressor from 0.26 to 0.27
(#10383)
add 957cb0d67f Build: Bump org.springframework:spring-web from 5.3.35 to
5.3.36 (#10382)
add 6f4b19516b Prevent deadlock in Jackson (#10379)
add 580df62d4b Build: Bump nessie from 0.82.0 to 0.83.2 (#10381)
add 795fea9446 Url encode field names for partition paths (#10329)
add f9cdde2516 Build: Bump net.snowflake:snowflake-jdbc from 3.15.1 to
3.16.0 (#10269)
add d723f9fc63 Spark 3.5: Only traverse ancestors of current snapshot when
building changelog scan (#10252)
add 2843f32332 docs: Add archive for documentations older than 1.4.0
(#10374)
add 46732b876a Flink 1.19: Fix flaky TestIcebergSourceFailover >
testBoundedWithSavepoint (#10393)
add 2722290a77 docs: deploy on changes in `docs/` (#10394)
add 6a594546b0 Spark 3.4: Only traverse ancestors of current snapshot when
building changelog scan (#10405)
add 23eb5941cd Bump Azurite test-container to `3.30.0`
add b4ffbf4f18 Build: Bump mkdocs-material from 9.5.23 to 9.5.25 (#10413)
add 1837c81758 Build: Bump org.assertj:assertj-core from 3.25.3 to 3.26.0
(#10416)
add ee11de91c9 Build: Bump guava from 33.2.0-jre to 33.2.1-jre (#10414)
add 2dfc0c66fa Build: Bump org.xerial:sqlite-jdbc from 3.45.3.0 to
3.46.0.0 (#10415)
add 252168419f Docs: Refer to the README.md in `site/` for the docs
(#10402)
add 7d75f823ac Build: Require approving review (#10424)
add 134345dd20 Parquet: Remove TestHelpers in parquet module (#10428)
add 67e181ea9b Core: Introduce AuthConfig (#10161)
add 45bdf3fd43 Build: Bump software.amazon.awssdk:bom from 2.25.60 to
2.25.64 (#10421)
add ab476abfdb Build: Bump com.google.errorprone:error_prone_annotations
(#10418)
add 40da6f1e43 Core: Use TestTemplate instead of Test annotation in
TestPartitionSpecParser/Info (#10435)
add 0a26f02876 Docs: Point links in metrics-reporting.md to GitHub Java
source (#10397)
add a642a9350e Build: Clean up Jackson dependency usages (#10448)
add cbe391d1fa Flink: refactor sink shuffling statistics collection
(#10331)
add 80fa5ab29d Build: Bump io.delta:delta-standalone_2.12 from 3.1.0 to
3.2.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (b24c6cf965)
\
N -- N -- N
refs/heads/dependabot/gradle/io.delta-delta-standalone_2.12-3.2.0 (80fa5ab29d)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 3 +
.github/workflows/site-ci.yml | 1 +
.../java/org/apache/iceberg/PartitionSpec.java | 2 +-
.../apache/iceberg/expressions/BoundAggregate.java | 7 +
.../apache/iceberg/expressions/CountNonNull.java | 3 +-
.../apache/iceberg/expressions/MaxAggregate.java | 2 +-
.../apache/iceberg/expressions/MinAggregate.java | 2 +-
.../org/apache/iceberg/TestPartitionPaths.java | 12 +-
.../expressions/TestAggregateEvaluator.java | 52 ++
.../iceberg/aws/s3/TestS3FileIOIntegration.java | 15 +
.../apache/iceberg/aws/s3/S3FileIOProperties.java | 14 +-
.../org/apache/iceberg/aws/s3/S3RequestUtil.java | 5 +
.../iceberg/aws/s3/signer/S3ObjectMapper.java | 4 +-
.../aws/s3/signer/S3V4RestSignerClient.java | 26 +-
.../apache/iceberg/aws/s3/TestS3RequestUtil.java | 19 +
.../iceberg/azure/adlsv2/AzuriteContainer.java | 2 +-
build.gradle | 18 +-
.../apache/iceberg/rest/RESTMetricsReporter.java | 4 +
.../org/apache/iceberg/rest/RESTObjectMapper.java | 4 +-
.../apache/iceberg/rest/RESTSessionCatalog.java | 9 +-
.../auth/AuthConfig.java} | 58 ++-
.../org/apache/iceberg/rest/auth/OAuth2Util.java | 151 +++---
.../org/apache/iceberg/TestLocationProvider.java | 19 +
.../org/apache/iceberg/TestPartitionSpecInfo.java | 12 +-
.../apache/iceberg/TestPartitionSpecParser.java | 10 +-
docs/docs/aws.md | 5 +-
docs/docs/metrics-reporting.md | 18 +-
docs/mkdocs.yml | 1 +
.../flink/source/TestIcebergSourceFailover.java | 36 +-
...cebergSourceFailoverWithWatermarkExtractor.java | 13 +-
.../flink/source/TestIcebergSourceFailover.java | 36 +-
...cebergSourceFailoverWithWatermarkExtractor.java | 13 +-
flink/v1.19/build.gradle | 2 +
.../flink/sink/shuffle/AggregatedStatistics.java | 93 ++--
.../shuffle/AggregatedStatisticsSerializer.java | 175 +++++++
.../sink/shuffle/AggregatedStatisticsTracker.java | 271 ++++++++---
.../iceberg/flink/sink/shuffle/DataStatistics.java | 25 +-
.../sink/shuffle/DataStatisticsCoordinator.java | 110 +++--
.../shuffle/DataStatisticsCoordinatorProvider.java | 24 +-
.../flink/sink/shuffle/DataStatisticsOperator.java | 150 +++---
.../sink/shuffle/DataStatisticsSerializer.java | 204 ++++++++
.../flink/sink/shuffle/DataStatisticsUtil.java | 96 ----
.../flink/sink/shuffle/MapDataStatistics.java | 52 +-
.../sink/shuffle/MapDataStatisticsSerializer.java | 187 -------
.../flink/sink/shuffle/MapRangePartitioner.java | 22 +-
.../flink/sink/shuffle/SketchDataStatistics.java | 87 ++++
.../iceberg/flink/sink/shuffle/SketchUtil.java | 148 ++++++
.../flink/sink/shuffle/SortKeySerializer.java | 17 +-
.../sink/shuffle/SortKeySketchSerializer.java | 143 ++++++
...taStatisticsEvent.java => StatisticsEvent.java} | 22 +-
...isticsOrRecord.java => StatisticsOrRecord.java} | 43 +-
...izer.java => StatisticsOrRecordSerializer.java} | 102 ++--
.../iceberg/flink/sink/shuffle/StatisticsType.java | 55 +++
.../iceberg/flink/sink/shuffle/StatisticsUtil.java | 97 ++++
.../iceberg/flink/sink/shuffle/Fixtures.java | 98 ++++
.../sink/shuffle/TestAggregatedStatistics.java | 63 ---
...ava => TestAggregatedStatisticsSerializer.java} | 41 +-
.../shuffle/TestAggregatedStatisticsTracker.java | 535 +++++++++++++++------
.../shuffle/TestDataStatisticsCoordinator.java | 195 ++++----
.../TestDataStatisticsCoordinatorProvider.java | 182 ++++---
.../sink/shuffle/TestDataStatisticsOperator.java | 332 +++++++------
.../shuffle/TestDataStatisticsSerializer.java} | 44 +-
.../flink/sink/shuffle/TestMapDataStatistics.java | 63 +--
.../sink/shuffle/TestMapRangePartitioner.java | 53 +-
.../sink/shuffle/TestSketchDataStatistics.java | 60 +++
.../iceberg/flink/sink/shuffle/TestSketchUtil.java | 133 +++++
.../shuffle/TestSortKeySerializerPrimitives.java | 33 ++
.../flink/source/TestIcebergSourceFailover.java | 36 +-
...cebergSourceFailoverWithWatermarkExtractor.java | 13 +-
gradle/libs.versions.toml | 29 +-
.../apache/iceberg/hive/HiveTableOperations.java | 6 +-
.../org/apache/iceberg/hive/TestHiveCommits.java | 39 +-
kafka-connect/build.gradle | 4 +-
mr/build.gradle | 2 +-
.../test/java/org/apache/iceberg/TestHelpers.java | 85 ----
.../iceberg/parquet/TestBloomRowGroupFilter.java | 36 +-
.../iceberg/parquet/TestParquetEncryption.java | 37 +-
site/README.md | 18 +-
site/docs/archive.md | 34 ++
site/docs/how-to-release.md | 70 +--
site/nav.yml | 1 +
site/requirements.txt | 2 +-
.../spark/extensions/TestChangelogTable.java | 63 +++
.../iceberg/spark/source/SparkScanBuilder.java | 13 +-
.../spark/extensions/TestChangelogTable.java | 63 +++
.../org/apache/iceberg/spark/SparkConfParser.java | 28 ++
.../iceberg/spark/source/SparkScanBuilder.java | 13 +-
.../apache/iceberg/spark/TestSparkWriteConf.java | 26 +
88 files changed, 3452 insertions(+), 1699 deletions(-)
copy core/src/main/java/org/apache/iceberg/{view/BaseViewVersion.java =>
rest/auth/AuthConfig.java} (51%)
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/shuffle/AggregatedStatisticsSerializer.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/shuffle/DataStatisticsSerializer.java
delete mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/shuffle/DataStatisticsUtil.java
delete mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/shuffle/MapDataStatisticsSerializer.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/shuffle/SketchDataStatistics.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/shuffle/SketchUtil.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/shuffle/SortKeySketchSerializer.java
rename
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/shuffle/{DataStatisticsEvent.java
=> StatisticsEvent.java} (68%)
rename
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/shuffle/{DataStatisticsOrRecord.java
=> StatisticsOrRecord.java} (66%)
rename
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/shuffle/{DataStatisticsOrRecordSerializer.java
=> StatisticsOrRecordSerializer.java} (54%)
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/shuffle/StatisticsType.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/shuffle/StatisticsUtil.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/shuffle/Fixtures.java
delete mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/shuffle/TestAggregatedStatistics.java
copy
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/shuffle/{TestSortKeySerializerBase.java
=> TestAggregatedStatisticsSerializer.java} (53%)
copy
flink/{v1.17/flink/src/test/java/org/apache/iceberg/flink/sink/shuffle/TestSortKeySerializerBase.java
=>
v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/shuffle/TestDataStatisticsSerializer.java}
(51%)
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/shuffle/TestSketchDataStatistics.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/shuffle/TestSketchUtil.java
delete mode 100644 parquet/src/test/java/org/apache/iceberg/TestHelpers.java
create mode 100644 site/docs/archive.md
