This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch branch-catalog-spi
in repository https://gitbox.apache.org/repos/asf/doris.git
from 777a61671ab [perf](catalog) fe-connector-iceberg hot-path caching +
fe-core per-statement metadata funnel, with session=user cache isolation
add 568c4bb4571 [perf](catalog) two-level cross-query cache for external
partition derived views (#65829)
No new revisions were added by this update.
Summary of changes:
.gitleaks.toml | 6 +
.../cache/ConnectorPartitionViewCache.java | 110 ++++
.../connector/cache/PartitionViewCacheKey.java | 100 ++++
.../cache/ConnectorPartitionViewCacheTest.java | 278 ++++++++++
.../apache/doris/connector/hive/HiveConnector.java | 33 +-
.../connector/hive/HiveConnectorMetadata.java | 48 ++
...iveConnectorMetadataPartitionViewCacheTest.java | 251 +++++++++
.../hive/HiveConnectorPartitionViewCacheTest.java | 144 +++++
.../doris/connector/iceberg/IcebergConnector.java | 59 ++-
.../iceberg/IcebergConnectorMetadata.java | 99 +++-
.../iceberg/IcebergConnectorTransaction.java | 8 +-
.../iceberg/IcebergConnectorCacheTest.java | 99 ++++
...ergConnectorMetadataPartitionViewCacheTest.java | 260 +++++++++
.../doris/connector/paimon/PaimonConnector.java | 31 +-
.../connector/paimon/PaimonConnectorMetadata.java | 74 ++-
.../connector/paimon/PaimonConnectorCacheTest.java | 66 +++
...monConnectorMetadataPartitionViewCacheTest.java | 262 ++++++++++
.../doris/datasource/ExternalMetaCacheMgr.java | 33 ++
.../org/apache/doris/datasource/ExternalTable.java | 17 +-
.../mvcc/PluginDrivenMvccExternalTable.java | 58 +-
.../rules/rewrite/PruneFileScanPartition.java | 10 +-
...dsSortedPartitionsCacheManagerExternalTest.java | 581 +++++++++++++++++++++
.../physical/PhysicalIcebergMergeSinkTest.java | 4 +
...7-20-external-partition-derived-cache-design.md | 179 +++++++
...7-21-partition-ranges-cache-B-iceberg-paimon.md | 419 +++++++++++++++
...est_iceberg_v3_row_lineage_complex_query.groovy | 4 +-
26 files changed, 3205 insertions(+), 28 deletions(-)
create mode 100644
fe/fe-connector/fe-connector-cache/src/main/java/org/apache/doris/connector/cache/ConnectorPartitionViewCache.java
create mode 100644
fe/fe-connector/fe-connector-cache/src/main/java/org/apache/doris/connector/cache/PartitionViewCacheKey.java
create mode 100644
fe/fe-connector/fe-connector-cache/src/test/java/org/apache/doris/connector/cache/ConnectorPartitionViewCacheTest.java
create mode 100644
fe/fe-connector/fe-connector-hive/src/test/java/org/apache/doris/connector/hive/HiveConnectorMetadataPartitionViewCacheTest.java
create mode 100644
fe/fe-connector/fe-connector-hive/src/test/java/org/apache/doris/connector/hive/HiveConnectorPartitionViewCacheTest.java
create mode 100644
fe/fe-connector/fe-connector-iceberg/src/test/java/org/apache/doris/connector/iceberg/IcebergConnectorMetadataPartitionViewCacheTest.java
create mode 100644
fe/fe-connector/fe-connector-paimon/src/test/java/org/apache/doris/connector/paimon/PaimonConnectorMetadataPartitionViewCacheTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/common/cache/NereidsSortedPartitionsCacheManagerExternalTest.java
create mode 100644
plan-doc/designs/2026-07-20-external-partition-derived-cache-design.md
create mode 100644
plan-doc/plans/2026-07-21-partition-ranges-cache-B-iceberg-paimon.md
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
