This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a change to branch bot/trino-pin
in repository https://gitbox.apache.org/repos/asf/hudi.git
discard 7ee273bdf134 chore(trino): advance trino master pin to e7f009a140e9
add 39c510d682e9 fix: ensure AmazonDynamoDBLockClient is always closed in
DynamoDBBasedLockProviderBase.close() (#19742)
add 29b7a52564f4 fix(trino): skip predicate pushdown on type-evolved
parquet columns (#19467)
add a27828d8de75 test(io): drive the HFile writer tests through byte
arrays instead of a file (#19618)
add bcaf2d48e6b7 chore(docker): address PR #18520 review comments for
Spark 4.0.1 stack (#18524)
add c28a87d8987c fix(storage): resolve HoodieStorage from a path instead
of a default local URI (#19737)
add 34b4850421eb fix(streamer): route configured write table version into
sample-writes flow (#19746)
add ad221c449ecf fix(common): escape dots in single-level hive-style
partition column names (#19751)
add b5263e1a2e63 fix(client): create a new log file version instead of
reopening the latest on pre-v8 writes (#19755)
add 3ddf6285d52e fix(timeline-service): support response charset for
Timeline Server interaction (#19753)
add 18ae8c349058 feat(flink): Extend RocksDBDAO with generic column-family
lifecycle operations (#19744)
new b932ede57fef chore(trino): advance trino master pin to 92757c4365a1
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (7ee273bdf134)
\
N -- N -- N refs/heads/bot/trino-pin (b932ede57fef)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
docker/README.md | 7 +
docker/build_docker_images.sh | 93 +++--
...er-compose_hadoop340_hive313_spark401_amd64.yml | 31 +-
...er-compose_hadoop340_hive313_spark401_arm64.yml | 17 +-
docker/hoodie/hadoop/base_java11/Dockerfile | 3 +-
docker/hoodie/hadoop/spark_base/Dockerfile | 14 +-
.../lock/DynamoDBBasedLockProviderBase.java | 7 +-
.../hudi/cli/commands/TestCommitsCommand.java | 3 +-
.../client/HoodieTableServiceManagerClient.java | 7 +-
.../client/embedded/EmbeddedTimelineService.java | 1 +
.../java/org/apache/hudi/io/HoodieWriteHandle.java | 7 +-
.../table/action/rollback/RollbackHelperV1.java | 3 -
.../org/apache/hudi/io/TestHoodieAppendHandle.java | 142 ++++++++
.../action/rollback/TestRollbackHelperV1.java | 63 +---
.../upgrade/TestEightToSevenDowngradeHandler.java | 5 +-
.../table/functional/TestCleanActionExecutor.java | 3 +-
.../table/timeline/TimelineServiceClient.java | 7 +-
.../table/view/FileSystemViewStorageConfig.java | 19 +
.../hudi/common/util/HoodieStorageUtils.java | 12 +-
.../hudi/common/util/PartitionPathEncodeUtils.java | 20 ++
.../hudi/common/util/collection/RocksDBDAO.java | 16 +
.../hudi/common/testutils/HoodieTestUtils.java | 16 +-
.../common/util/TestPartitionPathEncodeUtils.java | 83 +++++
.../common/util/collection/TestRocksDBDAO.java | 33 ++
.../hadoop/fs/NonLocalSchemeLocalFileSystem.java | 88 +++++
.../hudi/io/hadoop/TestHoodieHadoopIOFactory.java | 2 +-
.../org/apache/hudi/io/hfile/TestHFileWriter.java | 179 ++++------
.../spark/sql/hudi/blob/BatchedBlobReader.scala | 45 ++-
.../TestIncrementalQueryWithArchivedInstants.scala | 4 +-
.../org/apache/hudi/TestHoodieSparkSqlWriter.scala | 51 +++
.../org/apache/hudi/blob/BlobTestHelpers.scala | 35 ++
.../apache/hudi/blob/CountingHoodieStorage.scala | 55 +++
.../apache/hudi/blob/TestBatchedBlobReader.scala | 150 ++++++++
.../org/apache/hudi/blob/TestReadBlobSQL.scala | 55 +++
.../sql/hudi/blob/TestBatchedBlobReaderMerge.scala | 4 +-
.../trino/plugin/hudi/HudiPageSourceProvider.java | 6 +-
.../plugin/hudi/util/ParquetStatisticsDomains.java | 207 +++++++++++
.../TestHudiConnectorParquetColumnNamesTest.java | 7 +-
.../hudi/TestHudiEvolvedColumnPredicates.java | 387 ++++++++++++++++++++
.../hudi/TestHudiPageSourceProviderTest.java | 144 +-------
.../io/trino/plugin/hudi/TestHudiSmokeTest.java | 98 ++++--
.../plugin/hudi/TestingBaseFilePageSource.java | 201 +++++++++++
.../SchemaEvolutionHudiTablesInitializer.java | 174 +++++++++
.../hudi/util/TestParquetStatisticsDomains.java | 390 +++++++++++++++++++++
.../utilities/streamer/SparkSampleWritesUtils.java | 5 +
.../org/apache/hudi/utilities/TestUtilHelpers.java | 7 +-
.../deltastreamer/TestSparkSampleWritesUtils.java | 33 +-
.../utilities/sources/TestHoodieIncrSource.java | 5 +-
.../streamer/TestHoodieStreamerMetrics.java | 17 +-
pom.xml | 2 +-
50 files changed, 2549 insertions(+), 414 deletions(-)
create mode 100644
hudi-client/hudi-client-common/src/test/java/org/apache/hudi/io/TestHoodieAppendHandle.java
create mode 100644
hudi-common/src/test/java/org/apache/hudi/common/util/TestPartitionPathEncodeUtils.java
create mode 100644
hudi-hadoop-common/src/test/java/org/apache/hudi/hadoop/fs/NonLocalSchemeLocalFileSystem.java
create mode 100644
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/blob/CountingHoodieStorage.scala
create mode 100644
hudi-trino/src/main/java/io/trino/plugin/hudi/util/ParquetStatisticsDomains.java
create mode 100644
hudi-trino/src/test/java/io/trino/plugin/hudi/TestHudiEvolvedColumnPredicates.java
create mode 100644
hudi-trino/src/test/java/io/trino/plugin/hudi/TestingBaseFilePageSource.java
create mode 100644
hudi-trino/src/test/java/io/trino/plugin/hudi/testing/SchemaEvolutionHudiTablesInitializer.java
create mode 100644
hudi-trino/src/test/java/io/trino/plugin/hudi/util/TestParquetStatisticsDomains.java
