This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch branch-catalog-spi
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 3fb9cae390f [fix](catalog) port #65548 external COUNT(*)/COUNT(col)
semantics to the connector scan path
discard d73cfdb08ab [fix](catalog) iceberg system-table scan: restore #65262
positional JNI read + order-preserving projection
discard 1586b7608a6 [fix](catalog) restore jfs hive-write hadoop config +
iceberg system-table scan projection
discard d0093c680c6 [feat](catalog) fe-connector-iceberg: port #64966 REST 401
re-auth to the connector
discard efe7cbb311a [refactor](catalog) drop
ReauthenticatingRestSessionCatalog test orphaned by master rebase
discard f88027e75ca [refactor](catalog) fe-core: remove 6 dead datasource
classes orphaned by the SPI migration (#65740)
discard 14b35d647c2 [refactor](catalog) fe-core: remove dead
ExternalMetadataOps layer, deprecated LakeSoul catalog, and odbc/statistics
stubs (#65736)
discard e5af2dbcaa1 [refactor](catalog) fe-core: remove dead Trino-ported
DirectoryListercache cluster (#65734)
discard d3f98a787b1 [refactor](catalog) fe-connector: replace fat
hive-catalog-shade with a slim HMS metastore-client shade (#65721)
discard 92a53a0aac5 [refactor](catalog) Catalog spi 11 hive (#65473)
discard 16fdb1808b5 [doc](catalog) HANDOFF: $position_deletes port done; e2e
is the only remaining flip gate
discard a1c945e88d9 [feat](catalog) P6.6: support the iceberg
$position_deletes system table on the connector SPI
discard fdc15137538 [doc](catalog) HANDOFF: point next step at the
$position_deletes port design (T0 evidence in)
discard 0592a16110c [doc](catalog) P6.6 $position_deletes connector port:
research notes + design (T0 evidence in, ready to implement)
discard c9579dc1a72 [doc](catalog) HANDOFF: rebase to upstream 30a44d61a8a +
register $position_deletes connector gap as flip blocker
discard d29810c29d8 [fix](build) fix parallel -T shade race in
fe-connector-paimon-hive-shade
discard 4302d1e3525 [fix](catalog) reconcile upstream #65365 with connector
SPI after rebase to 4f48ccfaa7d
discard b6f9ed5d1cd [doc](catalog) P6.6-C6 #63068 HANDOFF: record
cache-leakage data-flow test + Task 0 retained-base verify
discard 7e55cb8a1b0 [feat](catalog) P6.6-C6 #63068 FE: re-migrate
ExternalDatabaseSessionContextTest (cross-user cache-leakage data-flow)
discard 606cea86f07 [doc](catalog) P6.6-C6 #63068 OIDC session migration:
design + research notes + HANDOFF (Tasks 0-7 DONE)
discard b25082a5d33 [feat](catalog) P6.6-C6 #63068 iceberg: per-user REST
session routing (metadata + scan/write/procedure)
discard 0657f800a56 [feat](catalog) P6.6-C6 #63068 FE: capability-gated
credential injection + per-user cache bypass
discard fdc2986dca3 [feat](catalog) P6.6-C6 #63068 SPI: neutral
delegated-credential DTO + user-session capability
discard 1283fbd255e [fix](catalog) tier3 #65094: preserve external-table
top-level column-name case on the read path
discard 3af05086513 [fix](catalog) port upstream #65332/#65094 datasource
fixes into SPI connectors
discard 2693b19324e [fix](catalog) P4 maxcompute: drop dangling legacy
MaxComputeExternalTableTest after rebase
discard 3e3442c8011 [fix](catalog) jdbc: keep driver classloaders alive per
URL to stop Metaspace leak
discard c7cda5c1147 [refactor](catalog) P6 iceberg: migrate to catalog SPI +
cutover + remove legacy fe-core subsystem (#64688)
discard d1c3db89c4b [refactor](catalog) P3b: consolidate kerberos
authentication into fe-kerberos (#64655)
discard adf258f4a1d [refactor](catalog) P5 paimon: remove legacy subsystem
from fe-core + make fe-core paimon-SDK-free (T29) (#64653)
discard 0b4e497fa03 [refactor](catalog) P5 paimon: migrate to catalog SPI +
cutover (#64446) (#64446)
discard 73394ebd8c5 update P5 handoff and fix compile issue
discard 30625653cfa [refactor](connector) P4 maxcompute: remove legacy
subsystem from fe-core + make fe-core odps-free (T07-T09) (#64300)
discard 5771264af95 [feat](connector) P3 hudi connector hardening + test
baseline + dispatch design (hybrid, T02-T08) (#64143)
discard 52d3886bb66 [feat](connector) P2 migrate trino-connector to catalog
SPI (T01-T13) (#64096)
discard 538d21a47eb [P1-T03-T05] route plugin-driven scans first in nereids
translator (#63641)
discard d66c2023cfa [feat](connector) P0 SPI baseline + DDL/Partition + import
gate (T03-T27) (#63582)
discard 6ab33331cb7 [doc](connector) add project tracking system for catalog
SPI migration
add dfa3b018a4e [fix](iceberg) make iceberg deletion vector stable.
(#65676)
add fe24eb46847 [fix](brpc) Make secondary package aliases non-owning
(#65777)
add b5cb4514c5b [doc](connector) add project tracking system for catalog
SPI migration
add 8983df1a84c [feat](connector) P0 SPI baseline + DDL/Partition + import
gate (T03-T27) (#63582)
add a2c82578337 [P1-T03-T05] route plugin-driven scans first in nereids
translator (#63641)
add 7115bdcdd65 [feat](connector) P2 migrate trino-connector to catalog
SPI (T01-T13) (#64096)
add 526e5dc3fb2 [feat](connector) P3 hudi connector hardening + test
baseline + dispatch design (hybrid, T02-T08) (#64143)
add fdaf1631cc4 [refactor](connector) P4 maxcompute: remove legacy
subsystem from fe-core + make fe-core odps-free (T07-T09) (#64300)
add 097d8780c6d update P5 handoff and fix compile issue
add 1de7c82d38f [refactor](catalog) P5 paimon: migrate to catalog SPI +
cutover (#64446) (#64446)
add 5f168f3cb5a [refactor](catalog) P5 paimon: remove legacy subsystem
from fe-core + make fe-core paimon-SDK-free (T29) (#64653)
add 93737971747 [refactor](catalog) P3b: consolidate kerberos
authentication into fe-kerberos (#64655)
add c23f9fcd088 [refactor](catalog) P6 iceberg: migrate to catalog SPI +
cutover + remove legacy fe-core subsystem (#64688)
add 9b1ea31ddd9 [fix](catalog) jdbc: keep driver classloaders alive per
URL to stop Metaspace leak
add baec46b172f [fix](catalog) P4 maxcompute: drop dangling legacy
MaxComputeExternalTableTest after rebase
add 3927b4496bd [fix](catalog) port upstream #65332/#65094 datasource
fixes into SPI connectors
add 2ea7c93db13 [fix](catalog) tier3 #65094: preserve external-table
top-level column-name case on the read path
add 696c29b713b [feat](catalog) P6.6-C6 #63068 SPI: neutral
delegated-credential DTO + user-session capability
add 34f8e8e5850 [feat](catalog) P6.6-C6 #63068 FE: capability-gated
credential injection + per-user cache bypass
add a0c920b5ee0 [feat](catalog) P6.6-C6 #63068 iceberg: per-user REST
session routing (metadata + scan/write/procedure)
add e2045845454 [doc](catalog) P6.6-C6 #63068 OIDC session migration:
design + research notes + HANDOFF (Tasks 0-7 DONE)
add 4367f526c97 [feat](catalog) P6.6-C6 #63068 FE: re-migrate
ExternalDatabaseSessionContextTest (cross-user cache-leakage data-flow)
add 88edc39ad68 [doc](catalog) P6.6-C6 #63068 HANDOFF: record
cache-leakage data-flow test + Task 0 retained-base verify
add 9203e048913 [fix](catalog) reconcile upstream #65365 with connector
SPI after rebase to 4f48ccfaa7d
add d772fc57b5a [fix](build) fix parallel -T shade race in
fe-connector-paimon-hive-shade
add aa97017f6fe [doc](catalog) HANDOFF: rebase to upstream 30a44d61a8a +
register $position_deletes connector gap as flip blocker
add 2ab2297d8ac [doc](catalog) P6.6 $position_deletes connector port:
research notes + design (T0 evidence in, ready to implement)
add 3d58a1cc6af [doc](catalog) HANDOFF: point next step at the
$position_deletes port design (T0 evidence in)
add 8c2caf26da2 [feat](catalog) P6.6: support the iceberg
$position_deletes system table on the connector SPI
add 447abcc1a51 [doc](catalog) HANDOFF: $position_deletes port done; e2e
is the only remaining flip gate
add 6229e17e64c [refactor](catalog) Catalog spi 11 hive (#65473)
add 2eacfd426a3 [refactor](catalog) fe-connector: replace fat
hive-catalog-shade with a slim HMS metastore-client shade (#65721)
add 61ab7a11dcf [refactor](catalog) fe-core: remove dead Trino-ported
DirectoryListercache cluster (#65734)
add b7409f5ca9d [refactor](catalog) fe-core: remove dead
ExternalMetadataOps layer, deprecated LakeSoul catalog, and odbc/statistics
stubs (#65736)
add e0bcd0633ee [refactor](catalog) fe-core: remove 6 dead datasource
classes orphaned by the SPI migration (#65740)
add 0cf940a36e8 [refactor](catalog) drop
ReauthenticatingRestSessionCatalog test orphaned by master rebase
add a4858fb7bad [feat](catalog) fe-connector-iceberg: port #64966 REST 401
re-auth to the connector
add ebf1846a970 [fix](catalog) restore jfs hive-write hadoop config +
iceberg system-table scan projection
add c5aca7ed934 [fix](catalog) iceberg system-table scan: restore #65262
positional JNI read + order-preserving projection
add 0cebd657187 [fix](catalog) port #65548 external COUNT(*)/COUNT(col)
semantics to the connector scan path
add eb0921d56a2 [fix](catalog) port #65676 iceberg deletion-vector
metadata validation to the connector scan path
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (3fb9cae390f)
\
N -- N -- N refs/heads/branch-catalog-spi (eb0921d56a2)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/src/exec/sink/viceberg_delete_sink.cpp | 20 +++-
be/src/exec/sink/viceberg_delete_sink.h | 4 +
be/src/format/table/deletion_vector.h | 12 +++
be/src/format/table/deletion_vector_reader.cpp | 82 +++++++++++++++-
be/src/format/table/deletion_vector_reader.h | 8 +-
.../table/iceberg_delete_file_reader_helper.cpp | 47 ++++++---
.../table/iceberg_delete_file_reader_helper.h | 3 +
be/src/format/table/iceberg_reader_mixin.h | 3 +
be/src/format/table/paimon_reader.cpp | 41 +++++---
be/src/format/table/paimon_reader.h | 4 +
be/src/format_v2/table/iceberg_reader.cpp | 8 +-
be/src/format_v2/table/paimon_reader.cpp | 4 +-
be/test/exec/sink/viceberg_delete_sink_test.cpp | 14 +++
.../iceberg_delete_file_reader_helper_test.cpp | 109 +++++++++++++++++++--
be/test/format/table/paimon_cpp_reader_test.cpp | 52 +++++++++-
be/test/format_v2/table/iceberg_reader_test.cpp | 25 ++++-
be/test/format_v2/table/paimon_reader_test.cpp | 14 +++
.../connector/iceberg/IcebergScanPlanProvider.java | 47 ++++++++-
.../iceberg/IcebergScanPlanProviderTest.java | 61 ++++++++++++
thirdparty/build-thirdparty.sh | 23 ++---
.../brpc-1.4.0-secondary-package-name.patch | 12 ++-
21 files changed, 525 insertions(+), 68 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
