This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/gradle/junit-5.11.0
in repository https://gitbox.apache.org/repos/asf/iceberg.git
discard ea4d904b7a Build: Bump junit from 5.10.1 to 5.11.0
add 65e7cae512 Build: Bump guava from 33.2.1-jre to 33.3.0-jre (#10960)
add d4e0b3f207 Build: Bump org.springframework:spring-web from 5.3.37 to
5.3.39 (#10959)
add b53595b738 Build: Bump software.amazon.awssdk:bom from 2.27.2 to
2.27.7 (#10961)
add 9ddde5077b Docs: Update MRAP endpoint and add notebook link (#9362)
add ed07fd1cd7 Flink: put everything together for range distribution in
Flink sink (#10859)
add 43bbf08adc Flink: FLIP-27 IcebergSource builder missed a couple of
configs compared to old FlinkSource: expose locality and plan parallelism
(#10957)
add 3028552b41 Prevent implicit default locale/charset usage (#10969)
add 2f2c367b35 Core: Add ManifestWrite benchmark (#8637)
add b76d81acf0 S3OutputStream: Don't complete multipart upload on finalize
(#10874)
add ce33890314 Enable UnusedMethod error-prone check (#10968)
add 24afc1f980 Build: Upgrade to Gradle 8.10 (#10976)
add 40d5204fb7 Core: Support case-insensitivity for column names in
PartitionSpec (#10678)
add f17c225f67 Core: Remove unused throws declarations (#10974)
add 85cf79de01 Flink: deprecate ReaderFunction with a new Converter
interface to simplify user experience (#10956)
add bcb32818da Drop ParallelIterable's queue low water mark (#10978)
add f1076494c8 Check for minimal queue size in ParallelIterable (#10977)
add 2f6e7e6371 API, Spark 3.5: Action to compute table stats (#10288)
add cbd71ebd12 Core,AWS: Fix NPE in ResolvingFileIO when HadoopConf is not
set (#10872)
add 04461781c7 Spark 3.5: Fix incorrect catalog loaded in
TestCreateActions (#10952)
add b2cd6f38ed Flink: Maintenance - TriggerManager (#10484)
add 7fec19f3fd Flink: backport PR #10956 for converter interface that
deprecates ReaderFunction (#10985)
add bf459eed48 Flink: backport PR #10777 from 1.19 to 1.18 for sink test
refactoring. (#10965)
add ac0d206359 Spec: Minor modifications for v3 (#10948)
add ce772a6ecd Flink: backport PR #10859 for range distribution (#10990)
add f2d62757e2 Flink: Port #10484 to v1.20 (#10989)
add aa1ecc817b Flink: Maintenance - TableChange refactor (#10992)
add 2424e2c31d Flink: Port #10992 to v1.19 (#10994)
add e0596fbba2 OpenAPI: Add endpoint field to CatalogConfig (#10928)
add 5864850083 Spark 3.5: Add utility to load table state reliably (#10984)
add b9a6645a53 AWS: Include http-auth-aws-crt module into
iceberg-aws-bundle (#10972)
add 5958065b05 Build: Bump software.amazon.awssdk:bom from 2.27.7 to
2.27.12 (#11006)
add 9aa354d222 Build: Bump org.apache.commons:commons-compress from 1.27.0
to 1.27.1 (#11005)
add 4af2b9e7ae Build: Bump jetty from 11.0.22 to 11.0.23 (#11003)
add 244eb1e8d4 Build: Bump mkdocs-material from 9.5.31 to 9.5.33 (#11002)
add eb53685f2d Build: Bump junit from 5.10.1 to 5.11.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (ea4d904b7a)
\
N -- N -- N refs/heads/dependabot/gradle/junit-5.11.0
(eb53685f2d)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../java/org/apache/iceberg/PartitionSpec.java | 85 +-
.../apache/iceberg/actions/ActionsProvider.java | 6 +
.../apache/iceberg/actions/ComputeTableStats.java | 47 ++
.../java/org/apache/iceberg/types/TypeUtil.java | 28 +-
.../apache/iceberg/TestSchemaCaseSensitivity.java | 65 ++
aws-bundle/LICENSE | 140 +++-
aws-bundle/NOTICE | 67 +-
aws-bundle/build.gradle | 1 +
.../org/apache/iceberg/aws/AwsIntegTestUtil.java | 11 +
.../iceberg/aws/s3/TestS3FileIOIntegration.java | 90 ++-
.../org/apache/iceberg/aws/s3/S3OutputStream.java | 10 +-
.../org/apache/iceberg/aws/s3/TestS3FileIO.java | 12 +
baseline.gradle | 3 +
build.gradle | 1 +
.../org/apache/iceberg/ManifestReadBenchmark.java | 7 +-
...dBenchmark.java => ManifestWriteBenchmark.java} | 107 +--
.../org/apache/iceberg/GenericBlobMetadata.java | 8 +
.../iceberg/actions/BaseComputeTableStats.java | 39 +
.../org/apache/iceberg/io/ResolvingFileIO.java | 10 +-
.../org/apache/iceberg/util/ParallelIterable.java | 10 +-
.../TestPartitionSpecBuilderCaseSensitivity.java | 873 +++++++++++++++++++++
.../org/apache/iceberg/TestPartitionSpecInfo.java | 25 +
.../java/org/apache/iceberg/TestPartitioning.java | 36 +
.../apache/iceberg/util/TestParallelIterable.java | 45 +-
docs/docs/aws.md | 8 +-
docs/docs/flink-configuration.md | 64 +-
docs/docs/flink-writes.md | 101 +++
.../apache/iceberg/flink/FlinkCatalogFactory.java | 1 +
.../org/apache/iceberg/flink/FlinkConfParser.java | 27 +
.../org/apache/iceberg/flink/FlinkWriteConf.java | 21 +
.../apache/iceberg/flink/FlinkWriteOptions.java | 14 +
.../org/apache/iceberg/flink/sink/FlinkSink.java | 155 +++-
.../shuffle/DataStatisticsOperatorFactory.java | 98 +++
.../apache/iceberg/flink/source/IcebergSource.java | 98 ++-
.../source/reader/AvroGenericRecordConverter.java | 69 ++
.../reader/AvroGenericRecordReaderFunction.java | 10 +-
.../source/reader/ConverterReaderFunction.java} | 101 ++-
.../source/reader/IcebergSourceSplitReader.java | 2 +-
.../flink/source/reader/RowDataConverter.java | 32 +
.../org/apache/iceberg/flink/CatalogTestBase.java | 22 -
.../java/org/apache/iceberg/flink/SqlBase.java | 0
.../java/org/apache/iceberg/flink/TestBase.java | 23 +-
.../apache/iceberg/flink/TestFlinkTableSink.java | 116 +--
.../iceberg/flink/TestFlinkTableSinkExtended.java | 92 +++
.../apache/iceberg/flink/TestIcebergConnector.java | 24 +-
.../iceberg/flink/sink/TestFlinkIcebergSink.java | 270 +------
.../flink/sink/TestFlinkIcebergSinkBase.java | 51 +-
.../sink/TestFlinkIcebergSinkDistributionMode.java | 494 ++++++++++++
.../flink/sink/TestFlinkIcebergSinkExtended.java | 0
.../iceberg/flink/sink/TestFlinkIcebergSinkV2.java | 21 +-
.../TestIcebergSourceBoundedGenericRecord.java | 70 +-
.../TestIcebergSpeculativeExecutionSupport.java | 2 +-
flink/v1.19/build.gradle | 1 +
.../sink/shuffle/MapRangePartitionerBenchmark.java | 3 +-
.../org/apache/iceberg/flink/FlinkConfParser.java | 27 +
.../org/apache/iceberg/flink/FlinkWriteConf.java | 21 +
.../apache/iceberg/flink/FlinkWriteOptions.java | 14 +
.../maintenance/operator/JdbcLockFactory.java | 319 ++++++++
.../flink/maintenance/operator/MonitorSource.java | 4 +-
.../flink/maintenance/operator/TableChange.java | 196 +++--
.../operator/TableMaintenanceMetrics.java | 34 +
.../flink/maintenance/operator/Trigger.java | 72 ++
.../maintenance/operator/TriggerEvaluator.java | 151 ++++
.../maintenance/operator/TriggerLockFactory.java | 63 ++
.../flink/maintenance/operator/TriggerManager.java | 339 ++++++++
.../org/apache/iceberg/flink/sink/FlinkSink.java | 155 +++-
.../shuffle/DataStatisticsOperatorFactory.java | 98 +++
.../apache/iceberg/flink/source/IcebergSource.java | 98 ++-
.../source/reader/AvroGenericRecordConverter.java | 69 ++
.../reader/AvroGenericRecordReaderFunction.java | 10 +-
...rFunction.java => ConverterReaderFunction.java} | 101 ++-
.../source/reader/IcebergSourceSplitReader.java | 2 +-
.../flink/source/reader/RowDataConverter.java | 32 +
.../iceberg/flink/TestFlinkTableSinkExtended.java | 92 +++
.../maintenance/operator/ConstantsForTests.java | 29 +
.../operator/MetricsReporterFactoryForTests.java | 153 ++++
.../maintenance/operator/OperatorTestBase.java | 107 ++-
.../maintenance/operator/TestJdbcLockFactory.java | 57 ++
.../maintenance/operator/TestLockFactoryBase.java | 80 ++
.../maintenance/operator/TestMonitorSource.java | 41 +-
.../maintenance/operator/TestTriggerManager.java | 686 ++++++++++++++++
.../sink/TestFlinkIcebergSinkDistributionMode.java | 314 ++++++++
.../iceberg/flink/sink/TestFlinkIcebergSinkV2.java | 21 +-
.../TestIcebergSourceBoundedGenericRecord.java | 70 +-
...he.flink.metrics.reporter.MetricReporterFactory | 16 +
flink/v1.20/build.gradle | 1 +
.../org/apache/iceberg/flink/FlinkConfParser.java | 27 +
.../org/apache/iceberg/flink/FlinkWriteConf.java | 21 +
.../apache/iceberg/flink/FlinkWriteOptions.java | 14 +
.../maintenance/operator/JdbcLockFactory.java | 319 ++++++++
.../flink/maintenance/operator/MonitorSource.java | 4 +-
.../flink/maintenance/operator/TableChange.java | 196 +++--
.../operator/TableMaintenanceMetrics.java | 34 +
.../flink/maintenance/operator/Trigger.java | 72 ++
.../maintenance/operator/TriggerEvaluator.java | 151 ++++
.../maintenance/operator/TriggerLockFactory.java | 63 ++
.../flink/maintenance/operator/TriggerManager.java | 339 ++++++++
.../org/apache/iceberg/flink/sink/FlinkSink.java | 155 +++-
.../shuffle/DataStatisticsOperatorFactory.java | 98 +++
.../apache/iceberg/flink/source/IcebergSource.java | 98 ++-
.../source/reader/AvroGenericRecordConverter.java | 69 ++
.../reader/AvroGenericRecordReaderFunction.java | 10 +-
.../source/reader/ConverterReaderFunction.java} | 101 ++-
.../source/reader/IcebergSourceSplitReader.java | 2 +-
.../flink/source/reader/RowDataConverter.java | 32 +
.../iceberg/flink/TestFlinkTableSinkExtended.java | 92 +++
.../maintenance/operator/ConstantsForTests.java | 29 +
.../operator/MetricsReporterFactoryForTests.java | 153 ++++
.../maintenance/operator/OperatorTestBase.java | 107 ++-
.../maintenance/operator/TestJdbcLockFactory.java | 57 ++
.../maintenance/operator/TestLockFactoryBase.java | 80 ++
.../maintenance/operator/TestMonitorSource.java | 41 +-
.../maintenance/operator/TestTriggerManager.java | 686 ++++++++++++++++
.../sink/TestFlinkIcebergSinkDistributionMode.java | 314 ++++++++
.../iceberg/flink/sink/TestFlinkIcebergSinkV2.java | 21 +-
.../TestIcebergSourceBoundedGenericRecord.java | 70 +-
...he.flink.metrics.reporter.MetricReporterFactory | 16 +
format/spec.md | 119 +--
gradle/libs.versions.toml | 8 +-
gradle/wrapper/gradle-wrapper.properties | 4 +-
gradlew | 2 +-
kafka-connect/build.gradle | 3 +-
.../apache/iceberg/connect/data/SinkWriter.java | 3 +-
open-api/rest-catalog-open-api.py | 11 +
open-api/rest-catalog-open-api.yaml | 54 +-
site/requirements.txt | 2 +-
spark/v3.5/build.gradle | 2 +
.../org/apache/iceberg/spark/SparkTableUtil.java | 19 +-
.../actions/ComputeTableStatsSparkAction.java | 179 +++++
.../iceberg/spark/actions/NDVSketchUtil.java | 89 +++
.../apache/iceberg/spark/actions/SparkActions.java | 6 +
.../apache/spark/sql/stats/ThetaSketchAgg.scala | 121 +++
.../spark/actions/TestComputeTableStatsAction.java | 431 ++++++++++
.../iceberg/spark/actions/TestCreateActions.java | 15 +
134 files changed, 10536 insertions(+), 1191 deletions(-)
create mode 100644
api/src/main/java/org/apache/iceberg/actions/ComputeTableStats.java
create mode 100644
api/src/test/java/org/apache/iceberg/TestSchemaCaseSensitivity.java
copy core/src/jmh/java/org/apache/iceberg/{ManifestReadBenchmark.java =>
ManifestWriteBenchmark.java} (70%)
create mode 100644
core/src/main/java/org/apache/iceberg/actions/BaseComputeTableStats.java
create mode 100644
core/src/test/java/org/apache/iceberg/TestPartitionSpecBuilderCaseSensitivity.java
create mode 100644
flink/v1.18/flink/src/main/java/org/apache/iceberg/flink/sink/shuffle/DataStatisticsOperatorFactory.java
create mode 100644
flink/v1.18/flink/src/main/java/org/apache/iceberg/flink/source/reader/AvroGenericRecordConverter.java
copy
flink/{v1.19/flink/src/main/java/org/apache/iceberg/flink/source/reader/AvroGenericRecordReaderFunction.java
=>
v1.18/flink/src/main/java/org/apache/iceberg/flink/source/reader/ConverterReaderFunction.java}
(51%)
create mode 100644
flink/v1.18/flink/src/main/java/org/apache/iceberg/flink/source/reader/RowDataConverter.java
copy flink/{v1.19 =>
v1.18}/flink/src/test/java/org/apache/iceberg/flink/SqlBase.java (100%)
copy flink/{v1.19 =>
v1.18}/flink/src/test/java/org/apache/iceberg/flink/TestFlinkTableSinkExtended.java
(70%)
create mode 100644
flink/v1.18/flink/src/test/java/org/apache/iceberg/flink/sink/TestFlinkIcebergSinkDistributionMode.java
copy flink/{v1.19 =>
v1.18}/flink/src/test/java/org/apache/iceberg/flink/sink/TestFlinkIcebergSinkExtended.java
(100%)
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/maintenance/operator/JdbcLockFactory.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/maintenance/operator/TableMaintenanceMetrics.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/maintenance/operator/Trigger.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/maintenance/operator/TriggerEvaluator.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/maintenance/operator/TriggerLockFactory.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/maintenance/operator/TriggerManager.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/shuffle/DataStatisticsOperatorFactory.java
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/source/reader/AvroGenericRecordConverter.java
copy
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/source/reader/{AvroGenericRecordReaderFunction.java
=> ConverterReaderFunction.java} (51%)
create mode 100644
flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/source/reader/RowDataConverter.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/ConstantsForTests.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/MetricsReporterFactoryForTests.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/TestJdbcLockFactory.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/TestLockFactoryBase.java
create mode 100644
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/TestTriggerManager.java
create mode 100644
flink/v1.19/flink/src/test/resources/META-INF/services/org.apache.flink.metrics.reporter.MetricReporterFactory
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/maintenance/operator/JdbcLockFactory.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/maintenance/operator/TableMaintenanceMetrics.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/maintenance/operator/Trigger.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/maintenance/operator/TriggerEvaluator.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/maintenance/operator/TriggerLockFactory.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/maintenance/operator/TriggerManager.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/shuffle/DataStatisticsOperatorFactory.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/source/reader/AvroGenericRecordConverter.java
copy
flink/{v1.19/flink/src/main/java/org/apache/iceberg/flink/source/reader/AvroGenericRecordReaderFunction.java
=>
v1.20/flink/src/main/java/org/apache/iceberg/flink/source/reader/ConverterReaderFunction.java}
(51%)
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/source/reader/RowDataConverter.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/ConstantsForTests.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/MetricsReporterFactoryForTests.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/TestJdbcLockFactory.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/TestLockFactoryBase.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/maintenance/operator/TestTriggerManager.java
create mode 100644
flink/v1.20/flink/src/test/resources/META-INF/services/org.apache.flink.metrics.reporter.MetricReporterFactory
create mode 100644
spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/actions/ComputeTableStatsSparkAction.java
create mode 100644
spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/actions/NDVSketchUtil.java
create mode 100644
spark/v3.5/spark/src/main/scala/org/apache/spark/sql/stats/ThetaSketchAgg.scala
create mode 100644
spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestComputeTableStatsAction.java
