This is an automated email from the ASF dual-hosted git repository.
panxiaolei pushed a change to branch refactor_rf
in repository https://gitbox.apache.org/repos/asf/doris.git
discard e23dd9a4085 refactor of RuntimeFilterSlots
add a21338b9148 [improve](load) print error string in local fs error
messages (#47918)
add ba8584ef1d6 [fix](table) Filter base idx id for get sycned table ddl
(#47970)
add a0243bc8741 [ut](test) Add BE unit tests for agg function
group_array_intersect() (#47983)
add d8ec7797054 [Bug](function) add index check on function like (#47991)
add 0036cca5ed3 [fix](group commit) replay wal failed when enable global
enable_memtable_on_sink_node (#47968)
add 0c30f2c3ba0 [Bug](set) fix find null get wrong result on set operators
(#48001)
add 69ff4f3d793 [fix](icu) Switch to static ICU library (#47984)
add 06f4aafe7c8 [fix](pipeline) The sink operator should not be set to
ready when closing the source operator (#48008)
add 4a040769570 [fix](parquet)Fix data column and null map column not
equal when reading Parquet complex type cross-page data (#47734)
add c7acec48225 Revert "[fix](java) should use JAVA_OPTS_FOR_JDK_17
instead of JAVA_OPTS" (#48017)
add dd0c2d81da5 [Fix](Authenticator)defaultAuthenticator not init (#43057)
add 5cec5691bad [test](scanner) Scanner scheduler unit test (#47783)
add 77bec724630 [BE](ut) add UT about bitmap/hll/quantile_state datatype
(#47845)
add ac772027043 [ut](merger) Add test case for sort merger (#48015)
add 8c7a76acb4d [enhance](function) add more signatures for lag/lead
fucntion (#47940)
add 3477d514673 [fix](test) fix the regression test
`test_trino_hive_serde_prop` (#48012)
add ae86e689594 [fix](case) fix external case user cluster usage_priv when
cloud-mode (#48016)
add e44d839ac63 [Feat](Nereids) support alter system decommission backend
and add/drop follower/observer command (#47982)
add 376d739b8b7 [fix](array index) Correct null bitmap writing for
inverted index (#47846)
add 40d56530787 [test](beut)add beut case for MultiCastDataStreamer
(#47979)
add e7c966c6043 [fix](resource) Fix register ResourceContext to
RuntimeQueryStatisticsMgr (#48004)
add d8234fd9a3d [test](ut) Add `DataTypeSerDeArrowTest` (#48028)
add 4d90ef1abd9 [fix](Export) Fix the issue where the show export status
stays stuck on EXPORTING. (#47974)
add e60ca82d27c [fix](Export) modify some cases of export feature (#47976)
add b000072a905 refactor of RuntimeFilterSlots
add fb926be5cab update
add 9356ef4c28a format
add 157a3553920 update
add a870bcea5a2 fix
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (e23dd9a4085)
\
N -- N -- N refs/heads/refactor_rf (a870bcea5a2)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/CMakeLists.txt | 22 +-
.../common/{env_config.h.in => be_mock_util.cpp} | 17 +-
be/src/common/be_mock_util.h | 15 +
be/src/http/action/http_stream.cpp | 3 +
be/src/io/fs/err_utils.cpp | 28 +-
be/src/io/fs/err_utils.h | 1 +
be/src/olap/rowset/segment_v2/column_writer.cpp | 10 +-
.../rowset/segment_v2/inverted_index_writer.cpp | 52 +-
.../olap/rowset/segment_v2/inverted_index_writer.h | 2 +-
be/src/olap/task/index_builder.cpp | 41 +-
be/src/pipeline/dependency.cpp | 7 +-
be/src/pipeline/dependency.h | 2 +-
.../pipeline/exec/multi_cast_data_stream_sink.cpp | 11 +-
be/src/pipeline/exec/multi_cast_data_stream_sink.h | 10 +-
.../exec/multi_cast_data_stream_source.cpp | 2 +-
.../pipeline/exec/multi_cast_data_stream_source.h | 26 +-
be/src/pipeline/exec/multi_cast_data_streamer.cpp | 11 +-
be/src/pipeline/exec/multi_cast_data_streamer.h | 14 +-
.../exec/nested_loop_join_build_operator.cpp | 9 +-
.../exec/nested_loop_join_build_operator.h | 1 +
be/src/pipeline/exec/operator.cpp | 5 -
be/src/pipeline/pipeline_fragment_context.cpp | 15 +-
be/src/runtime/fragment_mgr.cpp | 2 +-
be/src/runtime/fragment_mgr.h | 2 +-
be/src/runtime/query_context.cpp | 8 +-
be/src/runtime/query_context.h | 2 +-
be/src/runtime/runtime_state.cpp | 2 +-
be/src/runtime/runtime_state.h | 9 +-
be/src/runtime_filter/role/consumer.cpp | 6 +-
be/src/runtime_filter/role/consumer.h | 2 +-
be/src/runtime_filter/role/merger.h | 35 +-
be/src/runtime_filter/role/producer.cpp | 48 +-
be/src/runtime_filter/role/producer.h | 10 +-
be/src/runtime_filter/role/runtime_filter.cpp | 4 +-
be/src/runtime_filter/role/runtime_filter.h | 18 +-
.../runtime_filter_mgr.cpp | 98 +--
.../runtime_filter_mgr.h | 53 +-
be/src/runtime_filter/runtime_filter_slots.h | 2 +-
be/src/runtime_filter/runtime_filter_slots_cross.h | 2 +-
be/src/runtime_filter/runtime_filter_wrapper.h | 2 +-
be/src/util/jni-util.cpp | 7 +-
be/src/vec/common/columns_hashing.h | 8 +-
be/src/vec/core/block.h | 7 +-
be/src/vec/core/sort_cursor.h | 2 +-
be/src/vec/data_types/data_type.h | 6 +
.../exec/format/parquet/vparquet_column_reader.cpp | 23 +-
.../exec/format/parquet/vparquet_column_reader.h | 21 +-
be/src/vec/exec/scan/scanner_context.cpp | 89 ++-
be/src/vec/exec/scan/scanner_scheduler.h | 22 +-
be/src/vec/exec/scan/vscanner.cpp | 3 +-
be/src/vec/functions/like.cpp | 2 +-
be/test/exprs/runtime_filter_test.cpp | 110 ---
.../segment_v2/inverted_index_array_test.cpp | 879 ++++++++++++++++++++-
.../exec/multi_cast_data_streamer_test.cpp | 145 ++++
be/test/pipeline/pipeline_test.cpp | 30 +-
.../in.cpp => test/scan/mock_scanner_scheduler.h} | 16 +-
.../scan/mock_simplified_scan_scheduler.h} | 24 +-
be/test/scan/scanner_context_test.cpp | 847 ++++++++++++++++++++
be/test/testutil/column_helper.h | 36 +-
.../agg_group_array_intersect_test.cpp | 348 ++++++++
be/test/vec/data_types/common_data_type_test.h | 17 +-
.../vec/data_types/data_type_agg_state_test.cpp | 257 ++++++
be/test/vec/data_types/data_type_array_test.cpp | 22 +-
be/test/vec/data_types/data_type_bitmap_test.cpp | 218 +++++
.../data_type_fixed_length_object_test.cpp | 153 ++++
be/test/vec/data_types/data_type_hll_test.cpp | 216 +++++
be/test/vec/data_types/data_type_ip_test.cpp | 4 +-
.../data_types/data_type_quantile_state_test.cpp | 198 +++++
.../serde/data_type_serde_arrow_test.cpp | 591 ++++++++++++++
be/test/vec/exec/scan_operator_test.cpp | 114 +++
be/test/vec/runtime/sort_merger_test.cpp | 252 ++++++
bin/start_be.sh | 5 +-
bin/start_fe.sh | 5 +-
conf/be.conf | 3 +
conf/fe.conf | 3 +
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 14 +-
.../apache/doris/analysis/AddFollowerClause.java | 6 +
.../apache/doris/analysis/AddObserverClause.java | 6 +
.../doris/analysis/DecommissionBackendClause.java | 10 +
.../apache/doris/analysis/DropFollowerClause.java | 6 +
.../apache/doris/analysis/DropObserverClause.java | 6 +
.../main/java/org/apache/doris/catalog/Env.java | 6 +-
.../main/java/org/apache/doris/load/ExportJob.java | 5 +-
.../mysql/authenticate/AuthenticatorManager.java | 2 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 42 +
.../trees/expressions/functions/window/Lag.java | 34 +-
.../trees/expressions/functions/window/Lead.java | 34 +-
.../trees/plans/commands/AlterSystemCommand.java | 12 +-
.../{DropBackendOp.java => AddFollowerOp.java} | 31 +-
.../trees/plans/commands/info/AddObserverOp.java} | 18 +-
.../commands/info/DecommissionBackendOp.java} | 17 +-
.../trees/plans/commands/info/DropBackendOp.java | 7 -
.../trees/plans/commands/info/DropFollowerOp.java} | 16 +-
.../trees/plans/commands/info/DropObserverOp.java} | 18 +-
.../trees/plans/commands/info/FrontendOp.java} | 41 +-
.../doris/scheduler/disruptor/TaskHandler.java | 12 +-
.../scheduler/manager/TransientTaskManager.java | 7 +-
.../apache/doris/service/FrontendServiceImpl.java | 3 +
.../apache/doris/catalog/CreateTableLikeTest.java | 31 +
.../data/correctness_p0/test_lag_lead_window.out | Bin 844 -> 1402 bytes
.../data/export_p0/test_export_basic.out | Bin 7131 -> 7131 bytes
.../tvf/{test_tvf_p2.out => test_tvf_p0.out} | Bin 5562 -> 5674 bytes
.../hive/test_parquet_complex_cross_page.out} | Bin 127 -> 137 bytes
.../window_functions/test_window_function.out | Bin 10367 -> 11741 bytes
.../data/query_p0/operator/test_set_operator.out | Bin 210 -> 223 bytes
.../window_functions/test_window_function.out | Bin 10367 -> 11741 bytes
.../org/apache/doris/regression/suite/Suite.groovy | 56 ++
.../correctness_p0/test_lag_lead_window.groovy | 9 +
.../suites/export_p0/test_export_basic.groovy | 304 +++----
.../suites/export_p0/test_export_csv.groovy | 208 ++---
.../export_p0/test_export_data_consistency.groovy | 69 +-
.../export_p0/test_export_empty_table.groovy | 142 +++-
.../test_export_table_with_label_retry.groovy | 80 +-
.../suites/export_p0/test_export_view.groovy | 327 +++-----
.../export/test_export_external_table.groovy | 341 +++-----
.../hive/test_external_sql_block_rule.groovy | 21 +
.../hive/test_trino_hive_serde_prop.groovy | 1 +
.../external_table_p0/tvf/test_catalogs_tvf.groovy | 8 +-
.../tvf/{test_tvf_p2.groovy => test_tvf_p0.groovy} | 24 +-
.../hive/test_parquet_complex_cross_page.groovy | 52 ++
.../test_group_commit_replay_wal.groovy | 5 +
.../window_functions/test_window_function.groovy | 27 +-
.../query_p0/operator/test_set_operator.groovy | 27 +
.../window_functions/test_window_function.groovy | 28 +-
124 files changed, 5818 insertions(+), 1587 deletions(-)
copy be/src/common/{env_config.h.in => be_mock_util.cpp} (65%)
rename be/src/{runtime => runtime_filter}/runtime_filter_mgr.cpp (84%)
rename be/src/{runtime => runtime_filter}/runtime_filter_mgr.h (86%)
delete mode 100644 be/test/exprs/runtime_filter_test.cpp
create mode 100644 be/test/pipeline/exec/multi_cast_data_streamer_test.cpp
copy be/{src/vec/functions/in.cpp => test/scan/mock_scanner_scheduler.h} (75%)
copy be/{src/vec/exec/format/parquet/byte_stream_split_decoder.h =>
test/scan/mock_simplified_scan_scheduler.h} (58%)
create mode 100644 be/test/scan/scanner_context_test.cpp
create mode 100644
be/test/vec/aggregate_functions/agg_group_array_intersect_test.cpp
create mode 100644 be/test/vec/data_types/data_type_agg_state_test.cpp
create mode 100644 be/test/vec/data_types/data_type_bitmap_test.cpp
create mode 100644
be/test/vec/data_types/data_type_fixed_length_object_test.cpp
create mode 100644 be/test/vec/data_types/data_type_hll_test.cpp
create mode 100644 be/test/vec/data_types/data_type_quantile_state_test.cpp
create mode 100644 be/test/vec/data_types/serde/data_type_serde_arrow_test.cpp
create mode 100644 be/test/vec/exec/scan_operator_test.cpp
create mode 100644 be/test/vec/runtime/sort_merger_test.cpp
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/info/{DropBackendOp.java
=> AddFollowerOp.java} (67%)
copy
fe/fe-core/src/main/java/org/apache/doris/{analysis/AddFollowerClause.java =>
nereids/trees/plans/commands/info/AddObserverOp.java} (69%)
copy
fe/fe-core/src/main/java/org/apache/doris/{analysis/DecommissionBackendClause.java
=> nereids/trees/plans/commands/info/DecommissionBackendOp.java} (73%)
copy
fe/fe-core/src/main/java/org/apache/doris/{analysis/DropFollowerClause.java =>
nereids/trees/plans/commands/info/DropFollowerOp.java} (72%)
copy
fe/fe-core/src/main/java/org/apache/doris/{analysis/DropObserverClause.java =>
nereids/trees/plans/commands/info/DropObserverOp.java} (69%)
copy fe/fe-core/src/main/java/org/apache/doris/{analysis/FrontendClause.java
=> nereids/trees/plans/commands/info/FrontendOp.java} (80%)
rename regression-test/data/external_table_p0/tvf/{test_tvf_p2.out =>
test_tvf_p0.out} (98%)
copy
regression-test/data/{nereids_rules_p0/defer_materialize_topn/one_phase.out =>
external_table_p2/hive/test_parquet_complex_cross_page.out} (83%)
rename regression-test/suites/external_table_p0/tvf/{test_tvf_p2.groovy =>
test_tvf_p0.groovy} (78%)
create mode 100644
regression-test/suites/external_table_p2/hive/test_parquet_complex_cross_page.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
