This is an automated email from the ASF dual-hosted git repository.
lzljs3620320 pushed a change to branch release-1.3
in repository https://gitbox.apache.org/repos/asf/paimon.git
from 4f9bfd85fc [Python] Move __version__ to setup.py (#6491)
new 3c213dc7ee [doc] fix MarkPartitionDoneProcedure doc. (#6473)
new d3a7451c16 [doc] add view doc (#6469)
new f170713ac8 [doc] Fix typo in flink/sql-ddl.md (#6476)
new b856f28363 [typo] fix typo in distinct (#6475)
new 5c90f445a0 [doc] Update batch partition mark done doc (#6478)
new de1f9c26b5 [core] support automatically clustering historical
partition (#6472)
new 718f124d37 [core] Refactor HistoryPartitionCluster to load less
history partitions
new 5625e47e48 [spark] Fix write non-pk dv table with external paths
(#6487)
new d495257d4c [core] Fix endian spec for BloomFilter index reader (#6493)
The 9 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
docs/content/concepts/spec/_index.md | 2 +-
docs/content/concepts/views.md | 107 ++++++++++++
docs/content/flink/sql-ddl.md | 2 +-
docs/content/maintenance/manage-partitions.md | 4 +-
docs/content/spark/procedures.md | 4 +-
.../shortcodes/generated/core_configuration.html | 12 ++
.../main/java/org/apache/paimon/CoreOptions.java | 24 +++
.../bloomfilter/BloomFilterFileIndex.java | 2 +-
.../append/cluster/HistoryPartitionCluster.java | 184 +++++++++++++++++++++
.../append/cluster/IncrementalClusterManager.java | 124 +++++++-------
.../compact/aggregate/FieldCollectAgg.java | 2 +-
.../paimon/operation/AbstractFileStoreScan.java | 6 +
.../org/apache/paimon/operation/FileStoreScan.java | 2 +
.../apache/paimon/operation/ManifestsReader.java | 10 ++
.../table/source/snapshot/SnapshotReader.java | 3 +
.../table/source/snapshot/SnapshotReaderImpl.java | 7 +
.../apache/paimon/table/system/AuditLogTable.java | 7 +
.../cluster/HistoryPartitionClusterTest.java | 135 +++++++++++++++
.../cluster/IncrementalClusterManagerTest.java | 90 +++++++++-
.../cluster/IncrementalClusterStrategyTest.java | 2 +-
.../action/IncrementalClusterActionITCase.java | 173 ++++++++++++++++++-
.../spark/commands/PaimonRowLevelCommand.scala | 31 +---
.../paimon/spark/commands/PaimonSparkWriter.scala | 5 +-
.../paimon/spark/commands/SparkDataFileMeta.scala | 13 +-
.../spark/commands/SparkDeletionVector.scala | 23 +--
.../spark/commands/UpdatePaimonTableCommand.scala | 7 +-
.../paimon/spark/sql/DeletionVectorTest.scala | 33 +++-
27 files changed, 887 insertions(+), 127 deletions(-)
create mode 100644 docs/content/concepts/views.md
create mode 100644
paimon-core/src/main/java/org/apache/paimon/append/cluster/HistoryPartitionCluster.java
create mode 100644
paimon-core/src/test/java/org/apache/paimon/append/cluster/HistoryPartitionClusterTest.java
