This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-4.2
in repository https://gitbox.apache.org/repos/asf/doris.git
from 9d671369d5f branch-4.1: [fix](arrow-flight) Do not take the
point-query short circuit on an Arrow Flight connection #67487 (#67557)
new 39892d33393 branch-4.1: [fix](sqlcache) Do not replay the MySQL sql
cache on an Arrow Flight connection #67381 (#67556)
new c4d5234ce27 [opt](lance) support rf push down to lance scan (#67268)
new 4c480530d7a [fix](iceberg) Fix historical scans after schema evolution
(#67479)
new ad9a7c48910 [improvement](fe) Release cloud tablet scheduling indexes
after balance (#66451) (#67290)
new 4c5668c3356 branch-4.1: [fix](http) Clamp range reads to file size
#67634 (#67683)
new e8f53325ce7 [feature](lance) support full_text_search in lance catalog
(#67289)
new 615f6c0563e branch-4.1: [feature](lance) Add statically validated
Lance index DDL surface (#67201)
new 8be3f93848d branch-4.1: [fix](test) Isolate cloud mode in colocation
proc test #65515 (#67658)
new f09b6c1137b branch-4.1: [fix](profile) Nereids Optimize Time shows N/A
when MV pre-rewrite is skipped #67532 (#67626)
new e5cc38545bb [bugfix](glibc) fix glibc compatible bugs (#67694)
new 092fe5ccb9c branch-4.1: [improvement](pk lookup) Avoid copying segment
key bounds #67618 (#67698)
new 959b55cd77b branch-4.1: [fix](subquery)show user friendly message when
meet unsupported subquery #64778 (#67693)
new e4bfd540c4b branch-4.1: [fix](regression) Stabilize compaction
regression cases #67613 (#67691)
new 3373684feb2 branch-4.1: [fix](be) Fix array_range overflow and batch
integer output #67584 (#67689)
new e054f5b9aa7 branch-4.1: [fix](build) Update Doris compose to Debian 12
with Liberica JDK 17 #67664 (#67688)
new 5dca58c9fde branch-4.1: [improvement](streaming-job) Adjust CDC
request timeout and split batch defaults #67559 (#67684)
new bc6d21bce6f branch-4.1: [fix](test) Deflake insert overwrite auto
detect failure #67571 (#67707)
new bf8a9f56feb branch-4.1: [fix](compaction): avoid decrementing
uncounted cumulative compaction threads #66752 (#67662)
new ad9524546a9 branch-4.1: [improvement](compaction) split time series
compaction score metric #63900 (#67607)
new 1837ae5691e branch-4.1: [fix](compaction) Keep latest 10 versions
unmerged during schema change #66337 (#67589)
new 950c820734f branch-4.1: [Improve](cloud) Only register watershed txn
id once when BE enters decommissioning state #67322 (#67632)
new 0cfae6906e0 branch-4.1: [chore](thirdparty) Add Google Cloud C++
OAuth2 dependency (#67651)
new 53c5c530546 branch-4.1: [fix](test) Isolate TPC-H MOR-as-DUP tables
from compaction #67566 (#67654)
new c2ac736ec41 branch-4.1: [fix](arrow-flight) Release a finished Flight
query's coordinator instead of holding it until wait_timeout #67504 (#67558)
new efe2f9d3edf branch-4.1: [fix](mv) Prevent snapshot reads from using
current MVs #67700 (#67729)
new d7cb6d11243 branch-4.1: [fix](window) Respect frames when simplifying
window functions #67706 (#67743)
new 556ba3027f9 branch-4.1: [fix](rbo) Preserve nullability in distinct
window rewrites #67666 (#67721)
new 6f25c754627 branch-4.1: [fix](be) Avoid repeated peer connect failures
#67464 (#67647)
new 00894a20303 branch-4.1: [fix](cloud) prevent warm-up job scheduling
starvation (#67643)
new 5df8e4ee6f6 branch-4.1: [fix](cloud) Set file cache TTL on cloud
schema change output #67454 (#67686)
new 6accacc3929 branch-4.1 [fix](fd) Propagate constants out of one row
relation to enable partition pruning (#67400)
new 81690a0c61f branch-4.1 [fix](view) Quote view column names in SHOW
CREATE VIEW output (#67398)
new 2416c870415 branch-4.1:[opt](merge into) Put MERGE INTO target on the
probe side - #66565 (#67279)
new bc2f21d30cd branch-4.1: [fix](compaction) Release exhausted segment
contexts during vertical compaction #65963 (#67599)
new e98200a945f Update github host from macos-13 to macos-15 (#67746)
new 47487e1ddd7 branch-4.1: [perf](load) Optimize write performance with
improved backpressure control (#67728)
new 8ca8dc9c725 branch-4.1: [fix](be) Initialize bthread context key
before first use (#67722)
new abb49c4536f branch-4.1: [fix](cloud) Return existing rowset for
concurrent commits #67637 (#67660)
new a701e06b108 branch-4.1: [fix](regression) Deflake the sql cache
regression suites #67734 (#67735)
The 39 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/build-thirdparty.yml | 2 +-
be/CMakeLists.txt | 10 +
be/benchmark/benchmark_array_range.hpp | 97 +
be/benchmark/benchmark_main.cpp | 1 +
be/cmake/check_glibc_compatibility.cmake | 70 +
.../cloud/cloud_cumulative_compaction_policy.cpp | 2 +-
be/src/cloud/cloud_delta_writer.cpp | 16 +-
be/src/cloud/cloud_rowset_builder.cpp | 8 +
be/src/cloud/cloud_rowset_builder.h | 2 +
be/src/cloud/cloud_schema_change_job.cpp | 5 +
be/src/cloud/cloud_storage_engine.cpp | 42 +-
be/src/cloud/cloud_storage_engine.h | 5 +
be/src/cloud/cloud_tablet_mgr.cpp | 21 +-
be/src/cloud/cloud_tablet_mgr.h | 4 +-
be/src/cloud/config.cpp | 4 +
be/src/cloud/config.h | 3 +
be/src/common/config.cpp | 2 +-
be/src/common/metrics/doris_metrics.cpp | 4 +
be/src/common/metrics/doris_metrics.h | 6 +-
.../exprs/function/array/function_array_range.cpp | 36 +-
be/src/exprs/runtime_filter_expr.h | 1 +
be/src/format_v2/lance/lance_reader_helper.cpp | 321 +++
be/src/format_v2/lance/lance_reader_helper.h | 81 +
.../lance/lance_runtime_filter_helper.cpp | 531 +++++
.../format_v2/lance/lance_runtime_filter_helper.h | 55 +
be/src/format_v2/table/lance_reader.cpp | 868 ++++----
be/src/format_v2/table/lance_reader.h | 32 +-
be/src/glibc-compatibility/lance_symbol_versions.c | 115 +-
be/src/glibc-compatibility/musl/expf.c | 80 +
be/src/io/cache/peer_file_cache_reader.cpp | 63 +-
be/src/io/fs/http_file_reader.cpp | 5 +
be/src/runtime/thread_context.cpp | 18 +
be/src/runtime/thread_context.h | 5 +
be/src/service/CMakeLists.txt | 22 +-
be/src/service/internal_service.cpp | 8 -
.../compaction/cumulative_compaction_policy.cpp | 2 +-
be/src/storage/data_dir.h | 7 +
be/src/storage/iterator/vertical_block_reader.cpp | 9 +-
be/src/storage/iterator/vertical_block_reader.h | 7 +-
.../storage/iterator/vertical_merge_iterator.cpp | 109 +-
be/src/storage/iterator/vertical_merge_iterator.h | 53 +-
be/src/storage/merger.cpp | 16 +-
be/src/storage/merger.h | 3 +-
be/src/storage/olap_common.h | 7 +
be/src/storage/olap_server.cpp | 80 +-
be/src/storage/storage_engine.h | 14 +-
be/src/storage/tablet/base_tablet.cpp | 3 +-
be/src/storage/tablet/tablet_manager.cpp | 41 +-
be/src/storage/tablet/tablet_manager.h | 3 +-
be/src/util/brpc_client_cache.h | 7 +-
be/test/cloud/cloud_compaction_test.cpp | 179 +-
.../cloud_cumulative_compaction_policy_test.cpp | 34 +
.../exprs/function/function_array_range_test.cpp | 197 ++
.../lance/lance_runtime_filter_helper_test.cpp | 311 +++
.../metadata.lance | Bin 0 -> 734 bytes
.../part_0_docs.lance | Bin 0 -> 701 bytes
.../part_0_invert.lance | Bin 0 -> 2565 bytes
.../part_0_tokens.lance | Bin 0 -> 1155 bytes
.../0-4a942168-96d8-4f07-bce0-e3049c8ea6c5.txn | Bin 0 -> 253 bytes
.../1-b311fe36-9353-4f41-ae19-5054d4a73009.txn | Bin 0 -> 126 bytes
.../2-76e69d8c-04b7-402e-8620-7f9a772a2224.txn | Bin 0 -> 278 bytes
.../_versions/18446744073709551612.manifest | Bin 0 -> 934 bytes
.../_versions/18446744073709551613.manifest | Bin 0 -> 541 bytes
.../_versions/18446744073709551614.manifest | Bin 0 -> 583 bytes
.../_versions/latest_version_hint.json | 0
...001100000000001ee52754ad1a1da89dd0efa4379.lance | Bin 0 -> 1412 bytes
...010010100010000fd779442f589c03379a2858ea8.lance | Bin 0 -> 1348 bytes
be/test/format_v2/table/lance_reader_test.cpp | 772 ++++++-
.../cache/cached_remote_file_reader_peer_test.cpp | 23 +
be/test/io/fs/http_file_reader_test.cpp | 84 +
.../cumulative_compaction_policy_test.cpp | 47 +
.../compaction/vertical_compaction_test.cpp | 285 +++
be/test/storage/tablet/tablet_mgr_test.cpp | 288 ++-
be/test/util/doris_metrics_test.cpp | 12 +
cloud/src/meta-service/meta_service.cpp | 40 +-
cloud/test/meta_service_test.cpp | 45 +
docker/runtime/doris-compose/Dockerfile | 7 +-
docker/runtime/doris-compose/Readme.md | 2 +-
.../scripts/lance_build_preinstalled_catalog.py | 177 +-
.../metadata.lance | Bin 0 -> 734 bytes
.../part_0_docs.lance | Bin 0 -> 701 bytes
.../part_0_invert.lance | Bin 0 -> 2565 bytes
.../part_0_tokens.lance | Bin 0 -> 1155 bytes
.../0-4a942168-96d8-4f07-bce0-e3049c8ea6c5.txn | Bin 0 -> 253 bytes
.../1-b311fe36-9353-4f41-ae19-5054d4a73009.txn | Bin 0 -> 126 bytes
.../2-76e69d8c-04b7-402e-8620-7f9a772a2224.txn | Bin 0 -> 278 bytes
.../_versions/18446744073709551612.manifest | Bin 0 -> 934 bytes
.../_versions/18446744073709551613.manifest | Bin 0 -> 541 bytes
.../_versions/18446744073709551614.manifest | Bin 0 -> 583 bytes
.../_versions/latest_version_hint.json | 0
...001100000000001ee52754ad1a1da89dd0efa4379.lance | Bin 0 -> 1412 bytes
...010010100010000fd779442f589c03379a2858ea8.lance | Bin 0 -> 1348 bytes
.../bitmap_page_lookup.lance | Bin 812 -> 812 bytes
.../page_data.lance | Bin 0 -> 1213 bytes
.../page_lookup.lance | Bin
.../page_data.lance | Bin 1149 -> 0 bytes
.../bitmap_page_lookup.lance | Bin 0 -> 457 bytes
.../bitmap_page_lookup.lance | Bin 457 -> 0 bytes
.../28-39e6dfbf-f1c5-4b1e-808a-ee342f74383f.txn | Bin 946 -> 0 bytes
.../33-54b88aa6-136b-41a5-9652-3a7132712a1a.txn | Bin 0 -> 946 bytes
.../_versions/18446744073709551581.manifest | Bin 0 -> 1968 bytes
.../_versions/18446744073709551586.manifest | Bin 1968 -> 0 bytes
.../__manifest/_versions/latest_version_hint.json | 2 +-
...00000010010101183fee04e8eb3b452a26bcf00a5.lance | Bin 0 -> 2489 bytes
...010100110110006d24fe4da58277b24ffe1d6a0e.lance} | Bin 1520 -> 1584 bytes
...111011100000100d7d3884108b45243313e881513.lance | Bin 2361 -> 0 bytes
.../metadata.lance | Bin 0 -> 734 bytes
.../part_0_docs.lance | Bin 0 -> 637 bytes
.../part_0_invert.lance | Bin 0 -> 1851 bytes
.../part_0_tokens.lance | Bin 0 -> 1026 bytes
.../0-1bba5bff-2ab6-434b-8eaa-822470b46ed7.txn | Bin 0 -> 219 bytes
.../1-0a6db125-38e9-4ae5-94d5-5972747763df.txn | Bin 0 -> 284 bytes
.../2-315f4e75-d073-4bd2-a75d-f04c8347628b.txn | Bin 0 -> 124 bytes
.../_versions/18446744073709551612.manifest | Bin 0 -> 750 bytes
.../_versions/18446744073709551613.manifest | Bin 0 -> 827 bytes
.../_versions/18446744073709551614.manifest | Bin 0 -> 515 bytes
.../_versions/latest_version_hint.json | 0
...11000100000100086dae842f7bee179e75e92939e.lance | Bin 0 -> 991 bytes
...100101101000001aafd3f464c855149c5211be544.lance | Bin 0 -> 991 bytes
.../main/java/org/apache/doris/common/Config.java | 28 +-
.../java/org/apache/doris/common/ConfigTest.java | 21 +
.../antlr4/org/apache/doris/nereids/DorisLexer.g4 | 1 +
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 5 +-
.../doris/catalog/BuiltinTableValuedFunctions.java | 4 +-
.../main/java/org/apache/doris/catalog/Env.java | 7 +-
.../apache/doris/cloud/CacheHotspotManager.java | 120 +-
.../doris/cloud/catalog/CloudClusterChecker.java | 6 +-
.../doris/cloud/catalog/CloudTabletRebalancer.java | 25 +-
.../java/org/apache/doris/common/ErrorCode.java | 5 +
.../doris/common/profile/SummaryProfile.java | 12 +-
.../datasource/iceberg/dlf/DLFTableOperations.java | 3 +-
.../datasource/lance/LanceExternalCatalog.java | 2 +-
.../doris/datasource/lance/LanceExternalTable.java | 4 +-
.../lance/LanceIndexMutationValidator.java | 230 ++
.../datasource/lance/LanceIndexSegmentInfo.java | 27 +-
.../datasource/lance/LanceMetadataLoader.java | 15 +-
.../lance/source/IndexSegmentSplitPlan.java | 2 +-
.../datasource/lance/source/LanceScanNode.java | 273 ++-
.../org/apache/doris/nereids/NereidsPlanner.java | 114 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 10 +-
.../post/materialize/MaterializeProbeVisitor.java | 11 +-
.../nereids/rules/analysis/BindExpression.java | 39 +-
.../nereids/rules/analysis/SubExprAnalyzer.java | 68 +-
.../exploration/mv/MaterializedViewUtils.java | 6 +-
.../rules/rewrite/DistinctWindowExpression.java | 6 +-
.../PushDownFilterThroughVectorSearchTopN.java | 18 +-
.../rules/rewrite/SimplifyWindowExpression.java | 14 +-
.../functions/table/FullTextSearch.java | 49 +
.../trees/plans/commands/AlterTableCommand.java | 51 +-
.../trees/plans/commands/IcebergMergeCommand.java | 12 +-
.../trees/plans/commands/info/IndexDefinition.java | 49 +-
.../plans/commands/merge/MergeIntoCommand.java | 9 +-
.../trees/plans/commands/merge/MergeUtils.java | 58 +
.../trees/plans/logical/LogicalOneRowRelation.java | 13 +-
.../java/org/apache/doris/planner/ScanNode.java | 11 +
.../java/org/apache/doris/qe/ConnectContext.java | 45 +-
.../java/org/apache/doris/qe/ConnectProcessor.java | 10 +-
.../main/java/org/apache/doris/qe/Coordinator.java | 19 +
.../java/org/apache/doris/qe/SessionVariable.java | 7 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 57 +-
.../arrowflight/FlightSqlConnectProcessor.java | 11 +-
.../FullTextSearchTableValuedFunction.java | 177 ++
...=> LanceExternalSearchTableValuedFunction.java} | 365 ++-
.../doris/tablefunction/TableValuedFunctionIf.java | 2 +
.../VectorSearchTableValuedFunction.java | 287 +--
.../java/org/apache/iceberg/DeleteFileIndex.java | 63 +-
.../cloud/CacheHotspotManagerSchedulerTest.java | 149 ++
.../common/proc/ColocationGroupProcDirTest.java | 30 +-
.../doris/common/profile/SummaryProfileTest.java | 46 +
.../iceberg/IcebergExternalMetaCacheTest.java | 10 +-
.../iceberg/source/IcebergScanNodeTest.java | 57 +
.../lance/LanceIndexMutationValidatorTest.java | 459 ++++
.../datasource/lance/source/LanceScanNodeTest.java | 185 +-
.../nereids/parser/CreateIndexParserTest.java | 187 ++
.../rules/analysis/AnalyzeSubQueryTest.java | 66 +
.../exploration/mv/MaterializedViewUtilsTest.java | 12 +
.../nereids/rules/rewrite/ConstantCteTest.java | 121 +
.../rules/rewrite/PruneNestedColumnTest.java | 9 +-
.../commands/AlterTableCommandLanceIndexTest.java | 375 ++++
.../plans/commands/merge/MergeIntoCommandTest.java | 43 +-
.../doris/qe/ArrowFlightDeferralGateTest.java | 69 +
.../java/org/apache/doris/qe/StmtExecutorTest.java | 33 +
.../FlightSqlDeferredQueryIdleTimeoutTest.java | 156 ++
.../FullTextSearchTableValuedFunctionTest.java | 127 ++
fe/pom.xml | 4 +-
gensrc/thrift/PlanNodes.thrift | 48 +-
.../get_assignment_compatible_type.out | 2 +-
.../test_create_view_nereids.out | 54 +-
.../data/ddl_p0/test_alter_view_nereids.out | 4 +-
.../iceberg_schema_change_ddl_with_branch.out | 5 +
.../iceberg/test_iceberg_sys_table.out | 2 +
.../lance/test_lance_full_text_search.out | 36 +
.../lance/test_lance_runtime_filter_pushdown.out | 18 +
.../nereids_p0/ddl/show_view/show_view_command.out | 16 +-
.../multi_distinct/multi_distinct_window.out | 8 +
.../data/nereids_p0/show/test_show_create_view.out | 4 +-
.../subquery/correlated_scalar_subquery.out | 63 +
.../infer_predicate/pull_up_predicate_literal.out | 4 +-
.../simplify_window_frame.out | 22 +
.../test_show_create_table_and_views_nereids.out | 2 +-
.../create_view_star_except_and_cast_to_sql.out | 4 +-
regression-test/data/view_p0/view_p0.out | 12 +-
.../test_arrow_flight_query_release.groovy | 88 +
.../test_sql_cache_over_arrow_flight.groovy | 183 ++
.../test_schema_change_with_compaction1.groovy | 70 +-
.../test_schema_change_with_compaction10.groovy | 94 +-
.../test_schema_change_with_compaction5.groovy | 152 +-
.../test_schema_change_with_compaction6.groovy | 179 +-
.../test_schema_change_with_compaction7.groovy | 150 +-
.../test_schema_change_with_compaction9.groovy | 151 +-
.../test_create_view_nereids.groovy | 7 +
.../iceberg_schema_change_ddl_with_branch.groovy | 7 +-
.../test_iceberg_arrow_flight_split_source.groovy | 73 +
.../lance/test_lance_full_text_search.groovy | 161 ++
.../lance/test_lance_index_ddl.groovy | 176 ++
.../test_lance_runtime_filter_pushdown.groovy | 158 ++
...cumu_compaction_global_lock_thread_count.groovy | 186 ++
.../test_iot_auto_detect_fail.groovy | 18 +-
...est_cumulative_compaction_with_format_v2.groovy | 55 +-
.../suites/mtmv_p0/test_show_create_mtmv.groovy | 2 +-
.../cte/test_constant_cte_partition_prune.groovy | 80 +
.../multi_distinct/multi_distinct_window.groovy | 38 +
.../subquery/correlated_scalar_subquery.groovy | 219 ++
.../simplify_window_frame.groovy | 78 +
.../query_p0/cache/sql_cache_object_type.groovy | 112 +
.../ddl/customer_mor_as_dup.sql | 18 +
.../ddl/lineitem_mor_as_dup.sql | 26 +
.../ddl/nation_mor_as_dup.sql | 14 +
.../ddl/orders_mor_as_dup.sql | 19 +
.../ddl/part_mor_as_dup.sql | 19 +
.../ddl/partsupp_mor_as_dup.sql | 15 +
.../ddl/region_mor_as_dup.sql | 13 +
.../ddl/supplier_mor_as_dup.sql | 17 +
.../suites/tpch_sf100_unique_mor_p2/load.groovy | 12 +-
.../test_read_mor_as_dup.groovy | 12 +-
thirdparty/build-thirdparty.sh | 23 +
thirdparty/download-thirdparty.sh | 9 +-
thirdparty/patches/lance-c-0.1.7-pr-64.patch | 1522 -------------
thirdparty/patches/lance-c-0.1.9-pr-73.patch | 2317 ++++++++++++++++++++
thirdparty/patches/lance-c-0.1.9-pr-74.patch | 1159 ++++++++++
thirdparty/vars.sh | 17 +-
241 files changed, 14435 insertions(+), 3438 deletions(-)
create mode 100644 be/benchmark/benchmark_array_range.hpp
create mode 100644 be/cmake/check_glibc_compatibility.cmake
create mode 100644 be/src/format_v2/lance/lance_reader_helper.cpp
create mode 100644 be/src/format_v2/lance/lance_reader_helper.h
create mode 100644 be/src/format_v2/lance/lance_runtime_filter_helper.cpp
create mode 100644 be/src/format_v2/lance/lance_runtime_filter_helper.h
create mode 100644 be/src/glibc-compatibility/musl/expf.c
create mode 100644 be/test/exprs/function/function_array_range_test.cpp
create mode 100644 be/test/format_v2/lance/lance_runtime_filter_helper_test.cpp
create mode 100644
be/test/format_v2/table/lance/data/fts_indexed.lance/_indices/59b9c9af-09f0-499a-a888-06036eeec27a/metadata.lance
create mode 100644
be/test/format_v2/table/lance/data/fts_indexed.lance/_indices/59b9c9af-09f0-499a-a888-06036eeec27a/part_0_docs.lance
create mode 100644
be/test/format_v2/table/lance/data/fts_indexed.lance/_indices/59b9c9af-09f0-499a-a888-06036eeec27a/part_0_invert.lance
create mode 100644
be/test/format_v2/table/lance/data/fts_indexed.lance/_indices/59b9c9af-09f0-499a-a888-06036eeec27a/part_0_tokens.lance
create mode 100644
be/test/format_v2/table/lance/data/fts_indexed.lance/_transactions/0-4a942168-96d8-4f07-bce0-e3049c8ea6c5.txn
create mode 100644
be/test/format_v2/table/lance/data/fts_indexed.lance/_transactions/1-b311fe36-9353-4f41-ae19-5054d4a73009.txn
create mode 100644
be/test/format_v2/table/lance/data/fts_indexed.lance/_transactions/2-76e69d8c-04b7-402e-8620-7f9a772a2224.txn
create mode 100644
be/test/format_v2/table/lance/data/fts_indexed.lance/_versions/18446744073709551612.manifest
create mode 100644
be/test/format_v2/table/lance/data/fts_indexed.lance/_versions/18446744073709551613.manifest
create mode 100644
be/test/format_v2/table/lance/data/fts_indexed.lance/_versions/18446744073709551614.manifest
copy be/test/format_v2/table/lance/data/{all_types.lance =>
fts_indexed.lance}/_versions/latest_version_hint.json (100%)
create mode 100644
be/test/format_v2/table/lance/data/fts_indexed.lance/data/000100011001100000000001ee52754ad1a1da89dd0efa4379.lance
create mode 100644
be/test/format_v2/table/lance/data/fts_indexed.lance/data/100101010010010100010000fd779442f589c03379a2858ea8.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/14d4e11d_doris$full_text_search/_indices/59b9c9af-09f0-499a-a888-06036eeec27a/metadata.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/14d4e11d_doris$full_text_search/_indices/59b9c9af-09f0-499a-a888-06036eeec27a/part_0_docs.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/14d4e11d_doris$full_text_search/_indices/59b9c9af-09f0-499a-a888-06036eeec27a/part_0_invert.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/14d4e11d_doris$full_text_search/_indices/59b9c9af-09f0-499a-a888-06036eeec27a/part_0_tokens.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/14d4e11d_doris$full_text_search/_transactions/0-4a942168-96d8-4f07-bce0-e3049c8ea6c5.txn
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/14d4e11d_doris$full_text_search/_transactions/1-b311fe36-9353-4f41-ae19-5054d4a73009.txn
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/14d4e11d_doris$full_text_search/_transactions/2-76e69d8c-04b7-402e-8620-7f9a772a2224.txn
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/14d4e11d_doris$full_text_search/_versions/18446744073709551612.manifest
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/14d4e11d_doris$full_text_search/_versions/18446744073709551613.manifest
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/14d4e11d_doris$full_text_search/_versions/18446744073709551614.manifest
copy {be/test/format_v2/table/lance/data/all_types.lance =>
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/14d4e11d_doris$full_text_search}/_versions/latest_version_hint.json
(100%)
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/14d4e11d_doris$full_text_search/data/000100011001100000000001ee52754ad1a1da89dd0efa4379.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/14d4e11d_doris$full_text_search/data/100101010010010100010000fd779442f589c03379a2858ea8.lance
rename
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/__manifest/_indices/{8831a412-b4a7-4975-950c-8fe62bf16ef7
=> 19cc56b4-0a64-4d27-a659-61c9404f2b4e}/bitmap_page_lookup.lance (75%)
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/__manifest/_indices/3d69787d-d9aa-4cc5-8358-cd34c85bd6f1/page_data.lance
rename
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/__manifest/_indices/{5b68f7cb-d3d6-404d-9fe4-2fab2d4c2c3e
=> 3d69787d-d9aa-4cc5-8358-cd34c85bd6f1}/page_lookup.lance (100%)
delete mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/__manifest/_indices/5b68f7cb-d3d6-404d-9fe4-2fab2d4c2c3e/page_data.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/__manifest/_indices/6cd7ad50-bc0e-484d-87b1-f9b3ac35ce9b/bitmap_page_lookup.lance
delete mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/__manifest/_indices/b2a0b46c-741e-4884-8b1b-15aa5e389eb0/bitmap_page_lookup.lance
delete mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/__manifest/_transactions/28-39e6dfbf-f1c5-4b1e-808a-ee342f74383f.txn
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/__manifest/_transactions/33-54b88aa6-136b-41a5-9652-3a7132712a1a.txn
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/__manifest/_versions/18446744073709551581.manifest
delete mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/__manifest/_versions/18446744073709551586.manifest
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/__manifest/data/10010110000000010010101183fee04e8eb3b452a26bcf00a5.lance
rename
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/__manifest/data/{01101101000001110001101007a96744fd8fa4f4791c8ccd2a.lance
=> 1001111110010100110110006d24fe4da58277b24ffe1d6a0e.lance} (60%)
delete mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/__manifest/data/110001010111011100000100d7d3884108b45243313e881513.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/d9b832a2_doris$full_text_search_partial/_indices/998a5a77-b8d4-4318-abad-3fc2341fc194/metadata.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/d9b832a2_doris$full_text_search_partial/_indices/998a5a77-b8d4-4318-abad-3fc2341fc194/part_0_docs.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/d9b832a2_doris$full_text_search_partial/_indices/998a5a77-b8d4-4318-abad-3fc2341fc194/part_0_invert.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/d9b832a2_doris$full_text_search_partial/_indices/998a5a77-b8d4-4318-abad-3fc2341fc194/part_0_tokens.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/d9b832a2_doris$full_text_search_partial/_transactions/0-1bba5bff-2ab6-434b-8eaa-822470b46ed7.txn
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/d9b832a2_doris$full_text_search_partial/_transactions/1-0a6db125-38e9-4ae5-94d5-5972747763df.txn
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/d9b832a2_doris$full_text_search_partial/_transactions/2-315f4e75-d073-4bd2-a75d-f04c8347628b.txn
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/d9b832a2_doris$full_text_search_partial/_versions/18446744073709551612.manifest
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/d9b832a2_doris$full_text_search_partial/_versions/18446744073709551613.manifest
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/d9b832a2_doris$full_text_search_partial/_versions/18446744073709551614.manifest
copy {be/test/format_v2/table/lance/data/all_types.lance =>
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/d9b832a2_doris$full_text_search_partial}/_versions/latest_version_hint.json
(100%)
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/d9b832a2_doris$full_text_search_partial/data/00101001111000100000100086dae842f7bee179e75e92939e.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/d9b832a2_doris$full_text_search_partial/data/001100101100101101000001aafd3f464c855149c5211be544.lance
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/lance/LanceIndexMutationValidator.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/table/FullTextSearch.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/merge/MergeUtils.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/tablefunction/FullTextSearchTableValuedFunction.java
copy
fe/fe-core/src/main/java/org/apache/doris/tablefunction/{VectorSearchTableValuedFunction.java
=> LanceExternalSearchTableValuedFunction.java} (53%)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/cloud/CacheHotspotManagerSchedulerTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/lance/LanceIndexMutationValidatorTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/parser/CreateIndexParserTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/ConstantCteTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/AlterTableCommandLanceIndexTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/qe/ArrowFlightDeferralGateTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/service/arrowflight/sessions/FlightSqlDeferredQueryIdleTimeoutTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/tablefunction/FullTextSearchTableValuedFunctionTest.java
create mode 100644
regression-test/data/external_table_p0/lance/test_lance_full_text_search.out
create mode 100644
regression-test/data/external_table_p0/lance/test_lance_runtime_filter_pushdown.out
create mode 100644
regression-test/data/nereids_rules_p0/simplify_window_expression/simplify_window_frame.out
create mode 100644
regression-test/suites/arrow_flight_sql_p0/test_arrow_flight_query_release.groovy
create mode 100644
regression-test/suites/arrow_flight_sql_p0/test_sql_cache_over_arrow_flight.groovy
create mode 100644
regression-test/suites/external_table_p0/lance/test_lance_full_text_search.groovy
create mode 100644
regression-test/suites/external_table_p0/lance/test_lance_index_ddl.groovy
create mode 100644
regression-test/suites/external_table_p0/lance/test_lance_runtime_filter_pushdown.groovy
create mode 100644
regression-test/suites/fault_injection_p0/cloud/test_cloud_cumu_compaction_global_lock_thread_count.groovy
create mode 100644
regression-test/suites/nereids_p0/cte/test_constant_cte_partition_prune.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/simplify_window_expression/simplify_window_frame.groovy
create mode 100644
regression-test/suites/query_p0/cache/sql_cache_object_type.groovy
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/customer_mor_as_dup.sql
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/lineitem_mor_as_dup.sql
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/nation_mor_as_dup.sql
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/orders_mor_as_dup.sql
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/part_mor_as_dup.sql
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/partsupp_mor_as_dup.sql
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/region_mor_as_dup.sql
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/supplier_mor_as_dup.sql
delete mode 100644 thirdparty/patches/lance-c-0.1.7-pr-64.patch
create mode 100644 thirdparty/patches/lance-c-0.1.9-pr-73.patch
create mode 100644 thirdparty/patches/lance-c-0.1.9-pr-74.patch
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
