This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch branch-catalog-spi
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 0c082d67e52 [opt](catalog) fe-connector: unify the connector cache
foundation, memoize per-statement hot paths, fix iceberg case-insensitive
column DDL (#66029)
omit 420483b0c84 [test](nereids) rebase-adapt PullUpJoinFromUnionAllTest to
the connector-migrated Hudi scan path
omit 08d1c128125 [test](paimon) align stale schema-evolution matrix tests
to shipped behavior
omit 4d80e3b7273 [fix](paimon) read a branch's independent schema via its
own schema dir on the scan path
omit d22d6bbe384 [fix](iceberg) scan same-table multi-version references
against each reference's pinned snapshot schema
omit 1efd6ce82c6 [refactor](catalog) drop generic-S3 minio.* folding
superseded by upstream #65834's dedicated fe-filesystem-minio
omit 1afa210221d [fix](be) fail the query instead of aborting BE on a
missing projected column
omit 799455ab127 [fix](paimon) read latest schema in getColumnHandles so a
renamed column is not dropped
omit a04a0c093fb [fix](catalog) preserve nested STRUCT field comment on
omitted COMMENT in complex MODIFY (build 1004182)
omit 509fe68acfe [fix](catalog) catalog-SPI abstraction-mismatch review:
paimon time-travel crash, partition/schema fidelity, SPI convergence &
dead-code cleanup (#65970)
omit 2ed3c79b257 [feat](catalog) port upstream #65329 iceberg nested column
schema change to the connector SPI (Tier 2)
omit c828a219965 [fix](catalog) reconcile upstream #65329 iceberg nested
column schema change with connector SPI (Tier 1: compile + flat DDL routing)
omit ea03b712e75 [fix](catalog) port #65904 paimon special-char partition
names into fe-connector
omit e6d1bb1056d [fix](catalog) bundle fastutil-core into BE
java-extensions that eager-load ConcurrentLong2LongHashMap
omit 52a7608f73c [fix](catalog) migrate rebased-in
PhysicalStorageLayerAggregateTest to PluginDrivenExternalTable
omit fcad8fd1f38 [refactor](catalog) extract fe-trino-connector-common so
fe-common no longer depends on Trino
omit 930e13a30a6 [refactor](catalog) fe-core: strip residual
iceberg/hive/hudi deps & dead code, delegate DDL validation to connectors,
remove hudi_meta TVF (#65893)
omit ef4295026d4 [fix](catalog) port #65784 authoritative iceberg name
mapping to the connector scan path
omit e74f003a705 [fix](catalog) port #65782 collect_column_stats sink flag
+ write-metrics tests to the iceberg connector
omit f972836dd25 [perf](catalog) two-level cross-query cache for external
partition derived views (#65829)
omit 1a58dd40403 [perf](catalog) fe-connector-iceberg hot-path caching +
fe-core per-statement metadata funnel, with session=user cache isolation
omit 6eb392adc9f [fix](catalog) port #65676 iceberg deletion-vector
metadata validation to the connector scan path
omit bcba3f12cf4 [fix](catalog) port #65548 external COUNT(*)/COUNT(col)
semantics to the connector scan path
omit 5fc7e8e8ab0 [fix](catalog) iceberg system-table scan: restore #65262
positional JNI read + order-preserving projection
omit 664b611d04d [fix](catalog) restore jfs hive-write hadoop config +
iceberg system-table scan projection
omit 6418fc7761a [feat](catalog) fe-connector-iceberg: port #64966 REST 401
re-auth to the connector
omit 182f992bdef [refactor](catalog) drop
ReauthenticatingRestSessionCatalog test orphaned by master rebase
omit 3f7e17904c5 [refactor](catalog) fe-core: remove 6 dead datasource
classes orphaned by the SPI migration (#65740)
omit 9ddda435248 [refactor](catalog) fe-core: remove dead
ExternalMetadataOps layer, deprecated LakeSoul catalog, and odbc/statistics
stubs (#65736)
omit 4dc56d572fa [refactor](catalog) fe-core: remove dead Trino-ported
DirectoryListercache cluster (#65734)
omit ef031a422fc [refactor](catalog) fe-connector: replace fat
hive-catalog-shade with a slim HMS metastore-client shade (#65721)
omit ab61c37ba07 [refactor](catalog) Catalog spi 11 hive (#65473)
omit 8821649c7c8 [doc](catalog) HANDOFF: $position_deletes port done; e2e
is the only remaining flip gate
omit 25ff99029d6 [feat](catalog) P6.6: support the iceberg
$position_deletes system table on the connector SPI
omit 24a92821956 [doc](catalog) HANDOFF: point next step at the
$position_deletes port design (T0 evidence in)
omit 03e9f460236 [doc](catalog) P6.6 $position_deletes connector port:
research notes + design (T0 evidence in, ready to implement)
omit 7ed1ca02a22 [doc](catalog) HANDOFF: rebase to upstream 30a44d61a8a +
register $position_deletes connector gap as flip blocker
omit 1f78eb4684c [fix](build) fix parallel -T shade race in
fe-connector-paimon-hive-shade
omit bd255043407 [fix](catalog) reconcile upstream #65365 with connector
SPI after rebase to 4f48ccfaa7d
omit 013c1a0be92 [doc](catalog) P6.6-C6 #63068 HANDOFF: record
cache-leakage data-flow test + Task 0 retained-base verify
omit 0d77f22be39 [feat](catalog) P6.6-C6 #63068 FE: re-migrate
ExternalDatabaseSessionContextTest (cross-user cache-leakage data-flow)
omit ac30fd1f14b [doc](catalog) P6.6-C6 #63068 OIDC session migration:
design + research notes + HANDOFF (Tasks 0-7 DONE)
omit 5d611f4aa0a [feat](catalog) P6.6-C6 #63068 iceberg: per-user REST
session routing (metadata + scan/write/procedure)
omit e5a367e8c02 [feat](catalog) P6.6-C6 #63068 FE: capability-gated
credential injection + per-user cache bypass
omit e92108d526d [feat](catalog) P6.6-C6 #63068 SPI: neutral
delegated-credential DTO + user-session capability
omit 360d10df791 [fix](catalog) tier3 #65094: preserve external-table
top-level column-name case on the read path
omit e35c06b7ef3 [fix](catalog) port upstream #65332/#65094 datasource
fixes into SPI connectors
omit 06d9f7c456c [fix](catalog) P4 maxcompute: drop dangling legacy
MaxComputeExternalTableTest after rebase
omit 6911bbc39ea [fix](catalog) jdbc: keep driver classloaders alive per
URL to stop Metaspace leak
omit 289df814266 [refactor](catalog) P6 iceberg: migrate to catalog SPI +
cutover + remove legacy fe-core subsystem (#64688)
omit 6003a3f5ad7 [refactor](catalog) P3b: consolidate kerberos
authentication into fe-kerberos (#64655)
omit 29855c1686a [refactor](catalog) P5 paimon: remove legacy subsystem
from fe-core + make fe-core paimon-SDK-free (T29) (#64653)
omit 19b84185536 [refactor](catalog) P5 paimon: migrate to catalog SPI +
cutover (#64446) (#64446)
omit 4a9b24e1192 update P5 handoff and fix compile issue
omit 8c01c120851 [refactor](connector) P4 maxcompute: remove legacy
subsystem from fe-core + make fe-core odps-free (T07-T09) (#64300)
omit e55733f8f81 [feat](connector) P3 hudi connector hardening + test
baseline + dispatch design (hybrid, T02-T08) (#64143)
omit c8071898889 [feat](connector) P2 migrate trino-connector to catalog
SPI (T01-T13) (#64096)
omit 36c841e1306 [P1-T03-T05] route plugin-driven scans first in nereids
translator (#63641)
omit dee5e4c668f [feat](connector) P0 SPI baseline + DDL/Partition + import
gate (T03-T27) (#63582)
omit b7aaf5f2a2e [doc](connector) add project tracking system for catalog
SPI migration
add b9c561a0384 [test](regression) Expand Iceberg write evolution coverage
(#66021)
add e068ced0f80 [doc](connector) add project tracking system for catalog
SPI migration
add 53becdd76b8 [feat](connector) P0 SPI baseline + DDL/Partition + import
gate (T03-T27) (#63582)
add 61e7f4e66cb [P1-T03-T05] route plugin-driven scans first in nereids
translator (#63641)
add e3a23fed8ef [feat](connector) P2 migrate trino-connector to catalog
SPI (T01-T13) (#64096)
add da1dc51652d [feat](connector) P3 hudi connector hardening + test
baseline + dispatch design (hybrid, T02-T08) (#64143)
add 76d15eb8a4e [refactor](connector) P4 maxcompute: remove legacy
subsystem from fe-core + make fe-core odps-free (T07-T09) (#64300)
add 7c4ae8d9d38 update P5 handoff and fix compile issue
add ed56bff25f1 [refactor](catalog) P5 paimon: migrate to catalog SPI +
cutover (#64446) (#64446)
add 1ee79930faf [refactor](catalog) P5 paimon: remove legacy subsystem
from fe-core + make fe-core paimon-SDK-free (T29) (#64653)
add ca853d78d24 [refactor](catalog) P3b: consolidate kerberos
authentication into fe-kerberos (#64655)
add 57e1ce46b7c [refactor](catalog) P6 iceberg: migrate to catalog SPI +
cutover + remove legacy fe-core subsystem (#64688)
add bd433112564 [fix](catalog) jdbc: keep driver classloaders alive per
URL to stop Metaspace leak
add 0b42d96e1a8 [fix](catalog) P4 maxcompute: drop dangling legacy
MaxComputeExternalTableTest after rebase
add 9d48b21cc8b [fix](catalog) port upstream #65332/#65094 datasource
fixes into SPI connectors
add 3fe9fe8aa9f [fix](catalog) tier3 #65094: preserve external-table
top-level column-name case on the read path
add 3b9092bcc42 [feat](catalog) P6.6-C6 #63068 SPI: neutral
delegated-credential DTO + user-session capability
add 4dfad2a30c7 [feat](catalog) P6.6-C6 #63068 FE: capability-gated
credential injection + per-user cache bypass
add f04b54371eb [feat](catalog) P6.6-C6 #63068 iceberg: per-user REST
session routing (metadata + scan/write/procedure)
add 11e040a0fac [doc](catalog) P6.6-C6 #63068 OIDC session migration:
design + research notes + HANDOFF (Tasks 0-7 DONE)
add aabba45fc15 [feat](catalog) P6.6-C6 #63068 FE: re-migrate
ExternalDatabaseSessionContextTest (cross-user cache-leakage data-flow)
add 7b4cccce6cd [doc](catalog) P6.6-C6 #63068 HANDOFF: record
cache-leakage data-flow test + Task 0 retained-base verify
add 8206bc5b4b7 [fix](catalog) reconcile upstream #65365 with connector
SPI after rebase to 4f48ccfaa7d
add db68d14b210 [fix](build) fix parallel -T shade race in
fe-connector-paimon-hive-shade
add b68b7ca51dd [doc](catalog) HANDOFF: rebase to upstream 30a44d61a8a +
register $position_deletes connector gap as flip blocker
add b68a583530e [doc](catalog) P6.6 $position_deletes connector port:
research notes + design (T0 evidence in, ready to implement)
add e801a8ff0ac [doc](catalog) HANDOFF: point next step at the
$position_deletes port design (T0 evidence in)
add 772991ebc13 [feat](catalog) P6.6: support the iceberg
$position_deletes system table on the connector SPI
add caca4c90e46 [doc](catalog) HANDOFF: $position_deletes port done; e2e
is the only remaining flip gate
add a7b45c6e2fc [refactor](catalog) Catalog spi 11 hive (#65473)
add 5ecafcbeb0f [refactor](catalog) fe-connector: replace fat
hive-catalog-shade with a slim HMS metastore-client shade (#65721)
add e7812791026 [refactor](catalog) fe-core: remove dead Trino-ported
DirectoryListercache cluster (#65734)
add 91f874f2a65 [refactor](catalog) fe-core: remove dead
ExternalMetadataOps layer, deprecated LakeSoul catalog, and odbc/statistics
stubs (#65736)
add 5c2ff1d996d [refactor](catalog) fe-core: remove 6 dead datasource
classes orphaned by the SPI migration (#65740)
add a39b4f89c1f [refactor](catalog) drop
ReauthenticatingRestSessionCatalog test orphaned by master rebase
add 06ab813ab39 [feat](catalog) fe-connector-iceberg: port #64966 REST 401
re-auth to the connector
add 21f6821241f [fix](catalog) restore jfs hive-write hadoop config +
iceberg system-table scan projection
add d42868bd9a7 [fix](catalog) iceberg system-table scan: restore #65262
positional JNI read + order-preserving projection
add 907894ea410 [fix](catalog) port #65548 external COUNT(*)/COUNT(col)
semantics to the connector scan path
add bb27ae9f951 [fix](catalog) port #65676 iceberg deletion-vector
metadata validation to the connector scan path
add 7ac3ca7e1e4 [perf](catalog) fe-connector-iceberg hot-path caching +
fe-core per-statement metadata funnel, with session=user cache isolation
add 0944b636339 [perf](catalog) two-level cross-query cache for external
partition derived views (#65829)
add 4867144b30d [fix](catalog) port #65782 collect_column_stats sink flag
+ write-metrics tests to the iceberg connector
add f82809a5b31 [fix](catalog) port #65784 authoritative iceberg name
mapping to the connector scan path
add f9c298b102b [refactor](catalog) fe-core: strip residual
iceberg/hive/hudi deps & dead code, delegate DDL validation to connectors,
remove hudi_meta TVF (#65893)
add 3f010fea648 [refactor](catalog) extract fe-trino-connector-common so
fe-common no longer depends on Trino
add c28691a9d0e [fix](catalog) migrate rebased-in
PhysicalStorageLayerAggregateTest to PluginDrivenExternalTable
add 924793f9ee9 [fix](catalog) bundle fastutil-core into BE
java-extensions that eager-load ConcurrentLong2LongHashMap
add 1e4ade63c71 [fix](catalog) port #65904 paimon special-char partition
names into fe-connector
add 7309efcf48c [fix](catalog) reconcile upstream #65329 iceberg nested
column schema change with connector SPI (Tier 1: compile + flat DDL routing)
add 1b330930cc2 [feat](catalog) port upstream #65329 iceberg nested column
schema change to the connector SPI (Tier 2)
add 595d93b2f17 [fix](catalog) catalog-SPI abstraction-mismatch review:
paimon time-travel crash, partition/schema fidelity, SPI convergence &
dead-code cleanup (#65970)
add cbdab97ba74 [fix](catalog) preserve nested STRUCT field comment on
omitted COMMENT in complex MODIFY (build 1004182)
add aa2098ad1fd [fix](paimon) read latest schema in getColumnHandles so a
renamed column is not dropped
add 5429366e9f7 [fix](be) fail the query instead of aborting BE on a
missing projected column
add adb77ec5e74 [refactor](catalog) drop generic-S3 minio.* folding
superseded by upstream #65834's dedicated fe-filesystem-minio
add 16004bace48 [fix](iceberg) scan same-table multi-version references
against each reference's pinned snapshot schema
add 609adeb6261 [fix](paimon) read a branch's independent schema via its
own schema dir on the scan path
add 3b7efafceeb [test](paimon) align stale schema-evolution matrix tests
to shipped behavior
add 565d31eb0ce [test](nereids) rebase-adapt PullUpJoinFromUnionAllTest to
the connector-migrated Hudi scan path
add c9540902dd1 [opt](catalog) fe-connector: unify the connector cache
foundation, memoize per-statement hot paths, fix iceberg case-insensitive
column DDL (#66029)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (0c082d67e52)
\
N -- N -- N refs/heads/branch-catalog-spi (c9540902dd1)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../test_iceberg_write_branch_dml_boundary.out | 12 +
.../write/test_iceberg_write_complex_evolution.out | 30 +++
...t_iceberg_write_concurrent_merge_invariants.out | 4 +
.../test_iceberg_write_ctas_format_boundary.out | 16 ++
.../test_iceberg_write_dml_modes_evolution.out | 32 +++
.../write/test_iceberg_write_evolution_refs.out | 75 ++++++
...eberg_write_merge_duplicate_source_negative.out | 3 +
.../write/test_iceberg_write_merge_semantics.out | 13 +
.../test_iceberg_write_merge_truncate_negative.out | 9 +
.../test_iceberg_write_nullability_atomicity.out | 7 +
...st_iceberg_write_nullable_truncate_negative.out | 13 +
...iceberg_write_order_distribution_properties.out | 14 +
.../test_iceberg_write_overwrite_atomicity.out | 23 ++
.../test_iceberg_write_overwrite_delete_files.out | 40 +++
.../test_iceberg_write_overwrite_evolution.out | 45 ++++
.../test_iceberg_write_partition_types_null.out | 64 +++++
.../write/test_iceberg_write_source_models.out | 26 ++
...est_iceberg_write_string_transform_metadata.out | 40 +++
.../iceberg/write/ICEBERG_WRITE_P0_COVERAGE.md | 120 +++++++++
.../test_iceberg_write_branch_dml_boundary.groovy | 169 ++++++++++++
.../test_iceberg_write_complex_evolution.groovy | 178 +++++++++++++
...ceberg_write_concurrent_merge_invariants.groovy | 209 +++++++++++++++
.../test_iceberg_write_ctas_format_boundary.groovy | 180 +++++++++++++
.../test_iceberg_write_dml_modes_evolution.groovy | 269 +++++++++++++++++++
.../write/test_iceberg_write_evolution_refs.groovy | 253 ++++++++++++++++++
...rg_write_merge_duplicate_source_negative.groovy | 102 ++++++++
.../test_iceberg_write_merge_semantics.groovy | 207 +++++++++++++++
...st_iceberg_write_merge_truncate_negative.groovy | 100 +++++++
...test_iceberg_write_nullability_atomicity.groovy | 133 ++++++++++
...iceberg_write_nullable_truncate_negative.groovy | 97 +++++++
...berg_write_order_distribution_properties.groovy | 215 +++++++++++++++
.../test_iceberg_write_overwrite_atomicity.groovy | 163 ++++++++++++
...est_iceberg_write_overwrite_delete_files.groovy | 197 ++++++++++++++
.../test_iceberg_write_overwrite_evolution.groovy | 180 +++++++++++++
.../test_iceberg_write_partition_types_null.groovy | 287 +++++++++++++++++++++
...berg_write_required_null_select_negative.groovy | 103 ++++++++
...berg_write_required_null_values_negative.groovy | 81 ++++++
.../write/test_iceberg_write_source_models.groovy | 220 ++++++++++++++++
..._iceberg_write_string_transform_metadata.groovy | 212 +++++++++++++++
39 files changed, 4141 insertions(+)
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_branch_dml_boundary.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_complex_evolution.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_concurrent_merge_invariants.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_ctas_format_boundary.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_dml_modes_evolution.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_evolution_refs.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_merge_duplicate_source_negative.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_merge_semantics.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_merge_truncate_negative.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_nullability_atomicity.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_nullable_truncate_negative.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_order_distribution_properties.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_overwrite_atomicity.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_overwrite_delete_files.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_overwrite_evolution.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_partition_types_null.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_source_models.out
create mode 100644
regression-test/data/external_table_p0/iceberg/write/test_iceberg_write_string_transform_metadata.out
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/ICEBERG_WRITE_P0_COVERAGE.md
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_branch_dml_boundary.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_complex_evolution.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_concurrent_merge_invariants.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_ctas_format_boundary.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_dml_modes_evolution.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_evolution_refs.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_merge_duplicate_source_negative.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_merge_semantics.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_merge_truncate_negative.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_nullability_atomicity.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_nullable_truncate_negative.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_order_distribution_properties.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_overwrite_atomicity.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_overwrite_delete_files.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_overwrite_evolution.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_partition_types_null.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_required_null_select_negative.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_required_null_values_negative.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_source_models.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_string_transform_metadata.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
