This is an automated email from the ASF dual-hosted git repository.
lzljs3620320 pushed a change to branch release-0.6
in repository https://gitbox.apache.org/repos/asf/incubator-paimon.git
from 1cca5947e [doc] Trino Presto use snapshot for stable version
new d8faef649 [doc] Recommend to use 200MB bucket size
new 9a196e0fa [flink] supports writing to multiple partitions of kafka in
unaware bucket mode. (#2459)
new 1e96efdb9 [spark] Show create table display using paimon (#2460)
new 624a553fb [flink] Disable compaction topology when streaming with
bounded input stream (#2463)
new b6789b490 [doc]Add doc for Trino time travel query (#2467)
new 927a668c3 [spark] Optimize compact procedure in non-sort scenario
(#2457)
new c54d3b2d0 [flink] Support source reader metrics when consumer-id is
set (#2470)
new abf3fe3ec [core] Introduce 'rowkind.field' to define rowkind from data
(#2476)
The 8 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
docs/content/concepts/basic-concepts.md | 2 +-
docs/content/concepts/primary-key-table.md | 7 +
docs/content/engines/trino.md | 22 ++-
docs/content/how-to/querying-tables.md | 12 ++
docs/content/maintenance/dedicated-compaction.md | 4 +-
docs/content/maintenance/metrics.md | 4 +
.../shortcodes/generated/core_configuration.html | 6 +
.../main/java/org/apache/paimon/CoreOptions.java | 13 ++
.../apache/paimon/predicate/PredicateBuilder.java | 7 +
.../main/java/org/apache/paimon/types/RowKind.java | 21 +++
.../AppendOnlyTableCompactionCoordinator.java | 4 +-
.../org/apache/paimon/schema/SchemaValidation.java | 9 +
.../paimon/table/PrimaryKeyFileStoreTable.java | 21 ++-
.../apache/paimon/table/sink/RowKindGenerator.java | 65 +++++++
.../paimon/table/sink/SequenceGenerator.java | 1 +
.../apache/paimon/table/sink/TableWriteImpl.java | 9 +-
.../AppendOnlyTableCompactionCoordinatorTest.java | 2 +-
.../flink/kafka/KafkaLogSerializationSchema.java | 3 +-
.../flink/kafka/KafkaLogSerializationTest.java | 15 +-
.../apache/paimon/flink/kafka/LogSystemITCase.java | 52 ++++++
.../UnawareBucketCompactionTopoBuilder.java | 20 +--
.../apache/paimon/flink/sink/FlinkSinkBuilder.java | 9 +-
.../paimon/flink/sink/FlinkTableSinkBase.java | 1 +
.../paimon/flink/sink/LocalMergeOperator.java | 6 +-
.../paimon/flink/sink/StoreSinkWriteImpl.java | 3 +-
.../paimon/flink/sink/UnawareBucketWriteSink.java | 8 +-
.../paimon/flink/source/operator/ReadOperator.java | 14 +-
.../apache/paimon/flink/BatchFileStoreITCase.java | 11 ++
.../flink/source/operator/OperatorSourceTest.java | 30 ++++
.../apache/paimon/spark/SparkGenericCatalog.java | 4 +-
.../java/org/apache/paimon/spark/SparkTable.java | 4 +-
.../paimon/spark/procedure/CompactProcedure.java | 200 +++++++++++++++++++--
.../org/apache/paimon/spark/sort/TableSorter.java | 6 +-
.../org/apache/paimon/spark/SparkReadITCase.java | 1 -
.../org/apache/paimon/spark/SparkReadTestBase.java | 2 +-
.../spark/procedure/CompactProcedureTest.scala | 130 +++++++++++++-
.../paimon/spark/sql/PaimonPushDownTest.scala | 3 +-
37 files changed, 662 insertions(+), 69 deletions(-)
create mode 100644
paimon-core/src/main/java/org/apache/paimon/table/sink/RowKindGenerator.java
