This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch branch-catalog-spi
in repository https://gitbox.apache.org/repos/asf/doris.git
discard e717b560da7 [test](nereids) rebase-adapt PullUpJoinFromUnionAllTest to
the connector-migrated Hudi scan path
discard 91b157990ce [test](paimon) align stale schema-evolution matrix tests
to shipped behavior
discard c7b10e61ffc [fix](paimon) read a branch's independent schema via its
own schema dir on the scan path
discard 2e14fcf5202 [fix](iceberg) scan same-table multi-version references
against each reference's pinned snapshot schema
discard d76d939ad36 [refactor](catalog) drop generic-S3 minio.* folding
superseded by upstream #65834's dedicated fe-filesystem-minio
discard 33b2b49bd4f [fix](be) fail the query instead of aborting BE on a
missing projected column
discard 1976332dd24 [fix](paimon) read latest schema in getColumnHandles so a
renamed column is not dropped
discard f00a2e5fe10 [fix](catalog) preserve nested STRUCT field comment on
omitted COMMENT in complex MODIFY (build 1004182)
discard 9582857c790 [fix](catalog) catalog-SPI abstraction-mismatch review:
paimon time-travel crash, partition/schema fidelity, SPI convergence &
dead-code cleanup (#65970)
discard fcf003f4856 [feat](catalog) port upstream #65329 iceberg nested column
schema change to the connector SPI (Tier 2)
discard 76b6068624b [fix](catalog) reconcile upstream #65329 iceberg nested
column schema change with connector SPI (Tier 1: compile + flat DDL routing)
discard 15e613e4656 [fix](catalog) port #65904 paimon special-char partition
names into fe-connector
discard d862f77bdfe [fix](catalog) bundle fastutil-core into BE
java-extensions that eager-load ConcurrentLong2LongHashMap
discard afec33703d6 [fix](catalog) migrate rebased-in
PhysicalStorageLayerAggregateTest to PluginDrivenExternalTable
discard a0679eba473 [refactor](catalog) extract fe-trino-connector-common so
fe-common no longer depends on Trino
discard d17544385e8 [refactor](catalog) fe-core: strip residual
iceberg/hive/hudi deps & dead code, delegate DDL validation to connectors,
remove hudi_meta TVF (#65893)
discard 4c477d59b26 [fix](catalog) port #65784 authoritative iceberg name
mapping to the connector scan path
discard 19f349faa40 [fix](catalog) port #65782 collect_column_stats sink flag
+ write-metrics tests to the iceberg connector
discard 21befabae13 [perf](catalog) two-level cross-query cache for external
partition derived views (#65829)
discard 3cbfedab461 [perf](catalog) fe-connector-iceberg hot-path caching +
fe-core per-statement metadata funnel, with session=user cache isolation
discard db7537bed55 [fix](catalog) port #65676 iceberg deletion-vector
metadata validation to the connector scan path
discard 484186e887f [fix](catalog) port #65548 external COUNT(*)/COUNT(col)
semantics to the connector scan path
discard 29d16fb7976 [fix](catalog) iceberg system-table scan: restore #65262
positional JNI read + order-preserving projection
discard 21347cf0a92 [fix](catalog) restore jfs hive-write hadoop config +
iceberg system-table scan projection
discard 31f9423c24c [feat](catalog) fe-connector-iceberg: port #64966 REST 401
re-auth to the connector
discard 1e0ec56b0cc [refactor](catalog) drop
ReauthenticatingRestSessionCatalog test orphaned by master rebase
discard ea1c4371b69 [refactor](catalog) fe-core: remove 6 dead datasource
classes orphaned by the SPI migration (#65740)
discard f7c428ec597 [refactor](catalog) fe-core: remove dead
ExternalMetadataOps layer, deprecated LakeSoul catalog, and odbc/statistics
stubs (#65736)
discard 3c1b272f540 [refactor](catalog) fe-core: remove dead Trino-ported
DirectoryListercache cluster (#65734)
discard e0e93a59601 [refactor](catalog) fe-connector: replace fat
hive-catalog-shade with a slim HMS metastore-client shade (#65721)
discard b552c2a8083 [refactor](catalog) Catalog spi 11 hive (#65473)
discard f3665d78361 [doc](catalog) HANDOFF: $position_deletes port done; e2e
is the only remaining flip gate
discard 823450a104d [feat](catalog) P6.6: support the iceberg
$position_deletes system table on the connector SPI
discard 5c77077d593 [doc](catalog) HANDOFF: point next step at the
$position_deletes port design (T0 evidence in)
discard f8586e9671b [doc](catalog) P6.6 $position_deletes connector port:
research notes + design (T0 evidence in, ready to implement)
discard 93fa0d6fbf2 [doc](catalog) HANDOFF: rebase to upstream 30a44d61a8a +
register $position_deletes connector gap as flip blocker
discard d0edf25ca38 [fix](build) fix parallel -T shade race in
fe-connector-paimon-hive-shade
discard 48ad870404a [fix](catalog) reconcile upstream #65365 with connector
SPI after rebase to 4f48ccfaa7d
discard 95d5623c993 [doc](catalog) P6.6-C6 #63068 HANDOFF: record
cache-leakage data-flow test + Task 0 retained-base verify
discard 72bcb5b8fef [feat](catalog) P6.6-C6 #63068 FE: re-migrate
ExternalDatabaseSessionContextTest (cross-user cache-leakage data-flow)
discard b8524b4d063 [doc](catalog) P6.6-C6 #63068 OIDC session migration:
design + research notes + HANDOFF (Tasks 0-7 DONE)
discard 2304b5672dc [feat](catalog) P6.6-C6 #63068 iceberg: per-user REST
session routing (metadata + scan/write/procedure)
discard 1cbd3963bb0 [feat](catalog) P6.6-C6 #63068 FE: capability-gated
credential injection + per-user cache bypass
discard 4e9443243fa [feat](catalog) P6.6-C6 #63068 SPI: neutral
delegated-credential DTO + user-session capability
discard d7daa3c6cdb [fix](catalog) tier3 #65094: preserve external-table
top-level column-name case on the read path
discard 341e0533723 [fix](catalog) port upstream #65332/#65094 datasource
fixes into SPI connectors
discard 92ac46673c5 [fix](catalog) P4 maxcompute: drop dangling legacy
MaxComputeExternalTableTest after rebase
discard f5d43da45fc [fix](catalog) jdbc: keep driver classloaders alive per
URL to stop Metaspace leak
discard 91e3694feee [refactor](catalog) P6 iceberg: migrate to catalog SPI +
cutover + remove legacy fe-core subsystem (#64688)
discard 9e9f7c3f90d [refactor](catalog) P3b: consolidate kerberos
authentication into fe-kerberos (#64655)
discard f03770fb8d2 [refactor](catalog) P5 paimon: remove legacy subsystem
from fe-core + make fe-core paimon-SDK-free (T29) (#64653)
discard b75ebb5d028 [refactor](catalog) P5 paimon: migrate to catalog SPI +
cutover (#64446) (#64446)
discard 2ddf31716e5 update P5 handoff and fix compile issue
discard f1d28dd0867 [refactor](connector) P4 maxcompute: remove legacy
subsystem from fe-core + make fe-core odps-free (T07-T09) (#64300)
discard 5a8f496eef1 [feat](connector) P3 hudi connector hardening + test
baseline + dispatch design (hybrid, T02-T08) (#64143)
discard 1e88f04386d [feat](connector) P2 migrate trino-connector to catalog
SPI (T01-T13) (#64096)
discard 234d3e47160 [P1-T03-T05] route plugin-driven scans first in nereids
translator (#63641)
discard 6cec4ec6bb4 [feat](connector) P0 SPI baseline + DDL/Partition + import
gate (T03-T27) (#63582)
discard 2dbb35ed137 [doc](connector) add project tracking system for catalog
SPI migration
add 22327842e8f [test](regression) Add external correctness P0 coverage
(#66002)
add 7809a73814e [regression](test) expand Iceberg and Paimon partition
evolution coverage (#65992)
add b7aaf5f2a2e [doc](connector) add project tracking system for catalog
SPI migration
add dee5e4c668f [feat](connector) P0 SPI baseline + DDL/Partition + import
gate (T03-T27) (#63582)
add 36c841e1306 [P1-T03-T05] route plugin-driven scans first in nereids
translator (#63641)
add c8071898889 [feat](connector) P2 migrate trino-connector to catalog
SPI (T01-T13) (#64096)
add e55733f8f81 [feat](connector) P3 hudi connector hardening + test
baseline + dispatch design (hybrid, T02-T08) (#64143)
add 8c01c120851 [refactor](connector) P4 maxcompute: remove legacy
subsystem from fe-core + make fe-core odps-free (T07-T09) (#64300)
add 4a9b24e1192 update P5 handoff and fix compile issue
add 19b84185536 [refactor](catalog) P5 paimon: migrate to catalog SPI +
cutover (#64446) (#64446)
add 29855c1686a [refactor](catalog) P5 paimon: remove legacy subsystem
from fe-core + make fe-core paimon-SDK-free (T29) (#64653)
add 6003a3f5ad7 [refactor](catalog) P3b: consolidate kerberos
authentication into fe-kerberos (#64655)
add 289df814266 [refactor](catalog) P6 iceberg: migrate to catalog SPI +
cutover + remove legacy fe-core subsystem (#64688)
add 6911bbc39ea [fix](catalog) jdbc: keep driver classloaders alive per
URL to stop Metaspace leak
add 06d9f7c456c [fix](catalog) P4 maxcompute: drop dangling legacy
MaxComputeExternalTableTest after rebase
add e35c06b7ef3 [fix](catalog) port upstream #65332/#65094 datasource
fixes into SPI connectors
add 360d10df791 [fix](catalog) tier3 #65094: preserve external-table
top-level column-name case on the read path
add e92108d526d [feat](catalog) P6.6-C6 #63068 SPI: neutral
delegated-credential DTO + user-session capability
add e5a367e8c02 [feat](catalog) P6.6-C6 #63068 FE: capability-gated
credential injection + per-user cache bypass
add 5d611f4aa0a [feat](catalog) P6.6-C6 #63068 iceberg: per-user REST
session routing (metadata + scan/write/procedure)
add ac30fd1f14b [doc](catalog) P6.6-C6 #63068 OIDC session migration:
design + research notes + HANDOFF (Tasks 0-7 DONE)
add 0d77f22be39 [feat](catalog) P6.6-C6 #63068 FE: re-migrate
ExternalDatabaseSessionContextTest (cross-user cache-leakage data-flow)
add 013c1a0be92 [doc](catalog) P6.6-C6 #63068 HANDOFF: record
cache-leakage data-flow test + Task 0 retained-base verify
add bd255043407 [fix](catalog) reconcile upstream #65365 with connector
SPI after rebase to 4f48ccfaa7d
add 1f78eb4684c [fix](build) fix parallel -T shade race in
fe-connector-paimon-hive-shade
add 7ed1ca02a22 [doc](catalog) HANDOFF: rebase to upstream 30a44d61a8a +
register $position_deletes connector gap as flip blocker
add 03e9f460236 [doc](catalog) P6.6 $position_deletes connector port:
research notes + design (T0 evidence in, ready to implement)
add 24a92821956 [doc](catalog) HANDOFF: point next step at the
$position_deletes port design (T0 evidence in)
add 25ff99029d6 [feat](catalog) P6.6: support the iceberg
$position_deletes system table on the connector SPI
add 8821649c7c8 [doc](catalog) HANDOFF: $position_deletes port done; e2e
is the only remaining flip gate
add ab61c37ba07 [refactor](catalog) Catalog spi 11 hive (#65473)
add ef031a422fc [refactor](catalog) fe-connector: replace fat
hive-catalog-shade with a slim HMS metastore-client shade (#65721)
add 4dc56d572fa [refactor](catalog) fe-core: remove dead Trino-ported
DirectoryListercache cluster (#65734)
add 9ddda435248 [refactor](catalog) fe-core: remove dead
ExternalMetadataOps layer, deprecated LakeSoul catalog, and odbc/statistics
stubs (#65736)
add 3f7e17904c5 [refactor](catalog) fe-core: remove 6 dead datasource
classes orphaned by the SPI migration (#65740)
add 182f992bdef [refactor](catalog) drop
ReauthenticatingRestSessionCatalog test orphaned by master rebase
add 6418fc7761a [feat](catalog) fe-connector-iceberg: port #64966 REST 401
re-auth to the connector
add 664b611d04d [fix](catalog) restore jfs hive-write hadoop config +
iceberg system-table scan projection
add 5fc7e8e8ab0 [fix](catalog) iceberg system-table scan: restore #65262
positional JNI read + order-preserving projection
add bcba3f12cf4 [fix](catalog) port #65548 external COUNT(*)/COUNT(col)
semantics to the connector scan path
add 6eb392adc9f [fix](catalog) port #65676 iceberg deletion-vector
metadata validation to the connector scan path
add 1a58dd40403 [perf](catalog) fe-connector-iceberg hot-path caching +
fe-core per-statement metadata funnel, with session=user cache isolation
add f972836dd25 [perf](catalog) two-level cross-query cache for external
partition derived views (#65829)
add e74f003a705 [fix](catalog) port #65782 collect_column_stats sink flag
+ write-metrics tests to the iceberg connector
add ef4295026d4 [fix](catalog) port #65784 authoritative iceberg name
mapping to the connector scan path
add 930e13a30a6 [refactor](catalog) fe-core: strip residual
iceberg/hive/hudi deps & dead code, delegate DDL validation to connectors,
remove hudi_meta TVF (#65893)
add fcad8fd1f38 [refactor](catalog) extract fe-trino-connector-common so
fe-common no longer depends on Trino
add 52a7608f73c [fix](catalog) migrate rebased-in
PhysicalStorageLayerAggregateTest to PluginDrivenExternalTable
add e6d1bb1056d [fix](catalog) bundle fastutil-core into BE
java-extensions that eager-load ConcurrentLong2LongHashMap
add ea03b712e75 [fix](catalog) port #65904 paimon special-char partition
names into fe-connector
add c828a219965 [fix](catalog) reconcile upstream #65329 iceberg nested
column schema change with connector SPI (Tier 1: compile + flat DDL routing)
add 2ed3c79b257 [feat](catalog) port upstream #65329 iceberg nested column
schema change to the connector SPI (Tier 2)
add 509fe68acfe [fix](catalog) catalog-SPI abstraction-mismatch review:
paimon time-travel crash, partition/schema fidelity, SPI convergence &
dead-code cleanup (#65970)
add a04a0c093fb [fix](catalog) preserve nested STRUCT field comment on
omitted COMMENT in complex MODIFY (build 1004182)
add 799455ab127 [fix](paimon) read latest schema in getColumnHandles so a
renamed column is not dropped
add 1afa210221d [fix](be) fail the query instead of aborting BE on a
missing projected column
add 1efd6ce82c6 [refactor](catalog) drop generic-S3 minio.* folding
superseded by upstream #65834's dedicated fe-filesystem-minio
add d22d6bbe384 [fix](iceberg) scan same-table multi-version references
against each reference's pinned snapshot schema
add 4d80e3b7273 [fix](paimon) read a branch's independent schema via its
own schema dir on the scan path
add 08d1c128125 [test](paimon) align stale schema-evolution matrix tests
to shipped behavior
add bfc5f1437a4 [test](nereids) rebase-adapt PullUpJoinFromUnionAllTest to
the connector-migrated Hudi scan path
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (e717b560da7)
\
N -- N -- N refs/heads/branch-catalog-spi (bfc5f1437a4)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../test_iceberg_multi_spec_filter_aggregate.out | 35 ++
...iceberg_partition_evolution_equality_delete.out | 36 ++
...est_iceberg_partition_evolution_filter_refs.out | 71 ++++
..._iceberg_partition_evolution_format_scanner.out | 153 +++++++++
...est_iceberg_partition_evolution_position_dv.out | 201 +++++++++++
..._iceberg_partition_evolution_runtime_filter.out | 44 +++
...est_iceberg_schema_evolution_filter_binding.out | 21 ++
.../test_iceberg_failed_write_atomicity_retry.out | 9 +
.../test_paimon_partition_mutation_atomicity.out | 14 +
.../test_paimon_partition_pk_delete_refs.out | 109 ++++++
.../test_paimon_partition_schema_filter_refs.out | 145 ++++++++
...test_external_catalog_credential_masking.groovy | 99 ++++++
...test_iceberg_multi_spec_filter_aggregate.groovy | 120 +++++++
...berg_partition_evolution_equality_delete.groovy | 302 +++++++++++++++++
..._iceberg_partition_evolution_filter_refs.groovy | 275 ++++++++++++++++
...eberg_partition_evolution_format_scanner.groovy | 211 ++++++++++++
..._iceberg_partition_evolution_position_dv.groovy | 318 ++++++++++++++++++
...eberg_partition_evolution_runtime_filter.groovy | 277 ++++++++++++++++
..._iceberg_schema_evolution_filter_binding.groovy | 119 +++++++
...est_iceberg_failed_write_atomicity_retry.groovy | 107 ++++++
.../iceberg_paimon_schema_time_travel_coverage.md | 85 ++++-
...test_paimon_partition_mutation_atomicity.groovy | 148 +++++++++
.../test_paimon_partition_pk_delete_refs.groovy | 346 +++++++++++++++++++
...test_paimon_partition_schema_filter_refs.groovy | 366 +++++++++++++++++++++
24 files changed, 3599 insertions(+), 12 deletions(-)
create mode 100644
regression-test/data/external_table_p0/iceberg/test_iceberg_multi_spec_filter_aggregate.out
create mode 100644
regression-test/data/external_table_p0/iceberg/test_iceberg_partition_evolution_equality_delete.out
create mode 100644
regression-test/data/external_table_p0/iceberg/test_iceberg_partition_evolution_filter_refs.out
create mode 100644
regression-test/data/external_table_p0/iceberg/test_iceberg_partition_evolution_format_scanner.out
create mode 100644
regression-test/data/external_table_p0/iceberg/test_iceberg_partition_evolution_position_dv.out
create mode 100644
regression-test/data/external_table_p0/iceberg/test_iceberg_partition_evolution_runtime_filter.out
create mode 100644
regression-test/data/external_table_p0/iceberg/test_iceberg_schema_evolution_filter_binding.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_failed_write_atomicity_retry.out
create mode 100644
regression-test/data/external_table_p0/paimon/test_paimon_partition_mutation_atomicity.out
create mode 100644
regression-test/data/external_table_p0/paimon/test_paimon_partition_pk_delete_refs.out
create mode 100644
regression-test/data/external_table_p0/paimon/test_paimon_partition_schema_filter_refs.out
create mode 100644
regression-test/suites/audit/test_external_catalog_credential_masking.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_multi_spec_filter_aggregate.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_partition_evolution_equality_delete.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_partition_evolution_filter_refs.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_partition_evolution_format_scanner.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_partition_evolution_position_dv.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_partition_evolution_runtime_filter.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_schema_evolution_filter_binding.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_failed_write_atomicity_retry.groovy
create mode 100644
regression-test/suites/external_table_p0/paimon/test_paimon_partition_mutation_atomicity.groovy
create mode 100644
regression-test/suites/external_table_p0/paimon/test_paimon_partition_pk_delete_refs.groovy
create mode 100644
regression-test/suites/external_table_p0/paimon/test_paimon_partition_schema_filter_refs.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
