This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch auto-pick-52688-branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 03dccda2f60 [opt](create table) Fixed table creation becomes slower as
the number of tablets increases (#52688)
add 26bf3d93186 [Bug](schema-change) pass arena to agg function's add
method (#52930)
add 6f6590936d3 branch-2.1: [fix](be) fix macos report wrong cpu cores
#52726 (#52858)
add 1775200cbae branch-2.1: [fix](coordinator) fix cte with local shuffle
throw exception #52870 (#52871)
add 6c5ec15e100 branch-2.1: [fix](be) fix parquet file reader not updating
page index when processing it #52228 (#52782)
add 560097e491a branch-2.1: [Opt](mow) Move `DeleteBitmapAggCache` to
`ExecEnv` (#52649) (#52738)
add 3c38843e0d6 [Bug](branch-21) fix the compatibility cause coredump
during upgrade (#52720)
add 1a4e71610c9 [Chore](ub) fix some ub of vector (#52982)
add 6e12dc4b06b [opt](auditlog) Use varchar(1024) for column frontend_ip
of audit log table #52762 (#52985)
add 6e24d2c66e0 [chore](lsan) lsan add dl_find_object_update (#53049)
add 03994b8d939 branch-2.1: [fix](iceberg)Fix the thread pool issue used
for commit. #51508 (#51528)
add 2f7c15f38ea branch-2.1: [Bug](function) fix bitmap_from_base64
function cause heap-buffer-overflow error #53018 (#53044)
add f1b7acd098c branch-2.1: [fix](tvf) support compressed json file for
tvf and refactor code (#51983) (#53063)
add 412e5746a7e [fix](test) Fix the test case results (#53158)
add 4b261d43b6b [Enhancement](multi-catalog) Add PredicateFilterTime,
DictFilterRewriteTime, LazyReadFilteredRows profile metrics in parquet orc
profiles. (#52815)
add 1e19a3d8521 branch-2.1: [chore](information schema) rename
routine_load_job system table to routine_load_jobs (#49515) (#53246)
add 11142eee3a1 branch-2.1: [fix](httpserver) Fix lsan check error when
stop libevent server #53081 (#53112)
add e2fb2566dda [fix](nereids)should distinguish hash and other conjuncts
for outer join in MultiJoin (#53184)
add 140fb4c6e69 branch-2.1: [fix](iceberg) Fix transaction issues (#52716)
(#53238)
add d543713ceb7 [fix & opt](orc) ORC-1525: Fix bad read in
RleDecoderV2::readByte and Decompress zlib by libdeflate. (#53078)
add 83cdd44d6ba branch-2.1: [fix](catalog) synchronize reset methods in
catalog classes and remove Lombok annotations (#53168)
add cc387f362fb branch-2.1: [opt](identifer) let unicode format as a
superset of latin format #48078 (#53264)
add 70b7a0d7959 branch-2.1: [fix](regression)Fix test_analyze_mv case.
(#53361)
add eb6a5f884e0 branch-2.1: [fix](Nereids) not process must shuffle when
regulate cannot be banned agg #52827 (#53265)
add 982bc817448 branch-2.1: [fix](regression) Spark reads Doris data error
#48150 (#53233)
add 4d59af5aa35 branch-2.1: [fix](job) fix show routine load job result
incorrect after alter job property #53038 (#53094)
add 0f1f0cd4cad branch-2.1: [bugfix](load) Fixed import failure caused by
the $. symbol (#53337)
add ac36df29d66 branch-2.1: [fix](p0)Fix prepare stmt case failure.
(#53437)
add e8d18788f65 branch-2.1:[fix](function)fix month=0 of from_iso8601_date
function. (#53050) (#53438)
add fac42370c90 [branch-21](upgrate) fix upgrate error of branch-21
(#53353)
add 428d2e8a734 branch-2.1: [fix](regress) new thread should connect to
cluster.jdbcUrl in docker regression suite #53234 (#53316)
add b4df998c393 branch-2.1: [fix](case) fix some group commit case (#53295)
add a7fef00334c [enhance](compaction) limit time series table max version
using maximum of current backend (#53244) (#53561)
add 05e0ef10538 branch-2.1: [bugfix](regression) fix regression test
result errors (#53458)
add feae3a57efa [Chore](workflow) change workflow's thirdparty prebuild to
3.0 (#53638)
add 5216f3bf606 [Bug](datev2) fix wrong result of predicate about
cast(cast(datetimev2 as datev2) as datetimev2) #53485 (#53514)
add d316dbb3bda branch-2.1: [fix](catalog) fix deadlock of catalog and
database(#53626) (#53629)
add 5873aa3083e branch-2.1:[fix](auth)fix when authentication, the
permissions of multiple roles should be merged #52349 (#52947)
add ddb3b46fff7 branch-2.1: [fix](p2) throw Exception if hdfs is not
enable (#52761) (#53811)
add 850360c1c4d branch-2.1: [fix](sql_select_limit) sql_select_limit
should not affect DML #53379 (#53764)
add 77ff75b954c branch-2.1: [opt](nereids) use one fragment to execute
point query #53541 (#53574)
add c1fa17af388 branch-2.1: [feature](group by)Support group by with
order. (#53037) (#53840)
add a7f3c219834 branch-2.1: [opt](nereids) opt range inference for or
expression when out of order #46303 (#53706)
add 101ea8434b3 [Cherry-Pick](branch-2.1) Pick "[Fix](core) Fix null ptr
introduced by #42949 (#46074)" (#53865)
add fa10cd05df7 branch-2.1: [fix](ci) fix compile error 'Unknown host
repo.maven.apache.org' #53900 (#53906)
add a936c5132d9 branch-2.1: [fix](nereids) fix rule count on index #53825
(#53878)
add 79592c7f790 branch-2.1: [fix](load) stream load should not overwrite
existing error status in filtered rows check #53393 (#53696)
add 1eadb67c35b branch-2.1: [fix](nereids)'VALUES IN' keyword should be
optional in list partition definition #52986 (#53243)
add fb73066ca01 branch-2.1: [fix](case) fix regression case
create_commit_mtmv_many_tasks #53247 (#53304)
add 159975f2376 branch-2.1: [chore](load) optimize show create load error
message #53694 (#53731)
add 9285f3adde1 [opt](create table) Fixed table creation becomes slower as
the number of tablets increases (#52688)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (03dccda2f60)
\
N -- N -- N refs/heads/auto-pick-52688-branch-2.1 (9285f3adde1)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/be-ut-mac.yml | 10 +-
.github/workflows/build-extension.yml | 9 +-
.github/workflows/code-checks.yml | 2 +-
be/src/agent/be_exec_version_manager.h | 1 +
be/src/apache-orc | 2 +-
be/src/common/config.cpp | 2 +-
be/src/exec/schema_scanner.cpp | 2 +-
.../schema_routine_load_job_scanner.cpp | 2 +-
be/src/http/ev_http_server.cpp | 2 +-
be/src/olap/base_tablet.cpp | 5 +-
be/src/olap/olap_common.h | 4 +-
be/src/olap/rowset/unique_rowset_id_generator.cpp | 9 -
be/src/olap/schema_change.cpp | 3 +-
be/src/olap/tablet_meta.cpp | 47 +-
be/src/olap/tablet_meta.h | 53 +-
be/src/pipeline/exec/scan_operator.cpp | 3 +-
be/src/runtime/exec_env.h | 5 +
be/src/runtime/exec_env_init.cpp | 12 +
.../runtime/stream_load/stream_load_executor.cpp | 2 +-
be/src/util/cpu_info.cpp | 6 +-
be/src/vec/columns/column_dictionary.h | 2 +-
be/src/vec/exec/format/json/new_json_reader.cpp | 6 +-
be/src/vec/exec/format/orc/vorc_reader.cpp | 131 +--
be/src/vec/exec/format/orc/vorc_reader.h | 7 +-
.../exec/format/parquet/vparquet_group_reader.cpp | 159 ++--
.../exec/format/parquet/vparquet_group_reader.h | 2 +
be/src/vec/exec/format/parquet/vparquet_reader.cpp | 6 +-
be/src/vec/exec/format/parquet/vparquet_reader.h | 2 +
.../table_function/table_function_factory.cpp | 13 +-
.../exprs/table_function/table_function_factory.h | 15 +-
be/src/vec/exprs/table_function/vexplode.cpp | 2 +-
be/src/vec/exprs/table_function/vexplode_v2.cpp | 2 +-
be/src/vec/functions/function_bitmap.cpp | 4 +-
be/src/vec/functions/function_fake.cpp | 38 +-
be/src/vec/functions/simple_function_factory.h | 17 +-
be/src/vec/runtime/vdatetime_value.h | 7 +-
be/src/vec/sink/vrow_distribution.cpp | 2 +-
be/test/olap/rowset/rowset_meta_test.cpp | 10 +
be/test/testutil/run_all_tests.cpp | 4 +
be/test/vec/function/function_time_test.cpp | 72 ++
.../be_exec_version_test.cpp} | 23 +-
conf/lsan_suppr.conf | 3 +-
.../json_format_test/simple_object_json.json.gz | Bin 0 -> 211 bytes
.../parquet/small_2rowgroup.parquet | Bin 0 -> 13059 bytes
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 8 +-
.../org/apache/doris/analysis/SchemaTableType.java | 4 +-
.../catalog/BuiltinTableGeneratingFunctions.java | 11 +-
.../org/apache/doris/catalog/InternalSchema.java | 2 +-
.../java/org/apache/doris/catalog/SchemaTable.java | 4 +-
.../java/org/apache/doris/common/FeNameFormat.java | 6 +-
.../org/apache/doris/common/ThreadPoolManager.java | 68 ++
.../apache/doris/datasource/ExternalCatalog.java | 48 +-
.../apache/doris/datasource/ExternalDatabase.java | 68 +-
.../org/apache/doris/datasource/ExternalTable.java | 34 +-
.../doris/datasource/hive/HMSExternalCatalog.java | 8 +-
.../datasource/iceberg/IcebergExternalCatalog.java | 7 +
.../datasource/iceberg/IcebergMetadataOps.java | 5 +
.../datasource/iceberg/IcebergTransaction.java | 25 +-
.../doris/datasource/jdbc/JdbcExternalCatalog.java | 8 +-
.../org/apache/doris/load/loadv2/LoadManager.java | 5 +-
.../doris/load/routineload/RoutineLoadJob.java | 1 +
.../org/apache/doris/mysql/privilege/Auth.java | 41 +-
.../org/apache/doris/mysql/privilege/Role.java | 40 +-
.../apache/doris/mysql/privilege/RoleManager.java | 2 +-
.../GroupKeyWithOrder.java} | 45 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 45 +-
.../properties/ChildOutputPropertyDeriver.java | 4 +
.../properties/ChildrenPropertiesRegulator.java | 6 +-
.../nereids/rules/analysis/CheckAnalysis.java | 13 +-
.../nereids/rules/analysis/SubqueryToApply.java | 18 +-
.../rules/expression/rules/SimplifyRange.java | 44 +-
.../rules/implementation/AggregateStrategies.java | 16 +-
.../nereids/rules/rewrite/AddDefaultLimit.java | 10 +
.../nereids/rules/rewrite/ExistsApplyToJoin.java | 5 +-
.../doris/nereids/rules/rewrite/InApplyToJoin.java | 21 +-
.../doris/nereids/rules/rewrite/MultiJoin.java | 24 +-
.../nereids/rules/rewrite/PullUpCteAnchor.java | 24 +-
.../rules/rewrite/PullUpProjectUnderApply.java | 3 +-
.../doris/nereids/rules/rewrite/ReorderJoin.java | 17 +-
.../nereids/rules/rewrite/ScalarApplyToJoin.java | 2 +-
.../rewrite/UnCorrelatedApplyAggregateFilter.java | 3 +-
.../rules/rewrite/UnCorrelatedApplyFilter.java | 3 +-
.../rewrite/UnCorrelatedApplyProjectFilter.java | 3 +-
.../trees/copier/LogicalPlanDeepCopier.java | 10 +-
.../expressions/functions/generator/Explode.java | 61 +-
.../functions/generator/ExplodeOuter.java | 61 +-
.../{ExplodeOuter.java => ExplodeOuterV2.java} | 13 +-
.../generator/{Explode.java => ExplodeV2.java} | 12 +-
.../visitor/TableGeneratingFunctionVisitor.java | 10 +
.../nereids/trees/plans/logical/LogicalApply.java | 104 ++-
.../main/java/org/apache/doris/qe/Coordinator.java | 4 +-
.../java/org/apache/doris/qe/SessionVariable.java | 2 +-
.../apache/doris/qe/ShortCircuitQueryContext.java | 6 +-
.../org/apache/doris/rewrite/FunctionAlias.java | 3 +-
.../{CheckedMathTest.java => ConfigTest.java} | 23 +-
.../org/apache/doris/common/FeNameFormatTest.java | 109 ++-
.../datasource/iceberg/CreateIcebergTableTest.java | 4 +-
.../paimon/PaimonExternalCatalogTest.java | 2 +-
.../doris/nereids/parser/NereidsParserTest.java | 54 ++
.../rules/expression/SimplifyRangeTest.java | 40 +-
.../rules/rewrite/ExistsApplyToJoinTest.java | 17 +-
.../functions/generator/ExplodeOuterTest.java | 6 +-
.../functions/generator/ExplodeTest.java | 6 +-
.../apache/doris/planner/HiveTableSinkTest.java | 2 +-
.../java/org/apache/doris/qe/LocalShuffleTest.java | 221 +++++
gensrc/thrift/Descriptors.thrift | 2 +-
.../data/audit/test_audit_log_behavior.out | Bin 1154 -> 1155 bytes
.../test_ignore.out => cast_p0/cast_ignore.out} | Bin 134 -> 151 bytes
.../spark_connector/spark_connector_read_type.out | Bin 670 -> 670 bytes
.../hive/test_hive_parquet_skip_page.out | Bin 31833 -> 31867 bytes
.../data/external_table_p0/tvf/test_hdfs_tvf.out | Bin 40945 -> 41176 bytes
.../jsonb_p0/test_jsonb_load_and_function.out | Bin 182404 -> 181651 bytes
.../session_variable/test_default_limit.out | Bin 0 -> 257 bytes
.../test_cte_subquery_many.out} | Bin 109 -> 117 bytes
.../test_nereids_group_by_with_order.out | Bin 0 -> 901 bytes
.../query_p0/group_concat/test_group_concat.out | Bin 1132 -> 1158 bytes
.../datetime_functions/test_from_iso8601_date.out | Bin 2281 -> 2676 bytes
.../org/apache/doris/regression/Config.groovy | 7 -
.../doris/regression/action/WaitForAction.groovy | 8 +-
.../org/apache/doris/regression/suite/Suite.groovy | 45 +-
.../doris/regression/suite/SuiteCluster.groovy | 2 +
.../doris/regression/suite/SuiteContext.groovy | 27 +-
regression-test/pipeline/performance/compile.sh | 1 +
.../suites/account_p0/test_grant_priv.groovy | 38 +
.../cast_ignore.groovy} | 27 +-
.../add_drop_partition_by_hdfs.groovy | 2 +-
...eate_table_use_dynamic_partition_by_hdfs.groovy | 2 +-
...reate_table_use_partition_policy_by_hdfs.groovy | 2 +-
.../create_table_use_policy_by_hdfs.groovy | 2 +-
.../load_colddata_to_hdfs.groovy | 2 +-
.../modify_replica_use_partition_by_hdfs.groovy | 2 +-
.../table_modify_resouce_and_policy_by_hdfs.groovy | 2 +-
.../suites/demo_p0/docker_action.groovy | 7 +
.../hive/test_hive_parquet_skip_page.groovy | 12 +-
.../external_table_p0/tvf/test_hdfs_tvf.groovy | 10 +
..._local_multi_segments_re_calc_in_publish.groovy | 2 +-
.../insert_group_commit_with_exception.groovy | 2 +-
.../test_group_commit_interval_ms_property.groovy | 4 +-
.../inverted_index_p0/test_count_on_index.groovy | 11 +
.../broker_load/test_show_create_load.groovy} | 20 +-
.../test_routine_load_jsonpath_dollar_job.json | 3 +
.../load_p0/routine_load/test_routine_load.groovy | 4 +-
.../test_routine_load_job_info_system_table.groovy | 2 +-
.../test_routine_load_jsonpath_dollar.groovy | 158 ++++
.../suites/manager/test_manager_interface_1.groovy | 2 +-
.../nereids_p0/join/test_many_multi_join.groovy | 905 +++++++++++++++++++++
.../session_variable/test_default_limit.groovy | 38 +
.../nereids_p0/test_cte_subquery_many.groovy | 696 ++++++++++++++++
.../create_commit_mtmv_many_task.groovy | 8 +-
.../test_nereids_group_by_with_order.groovy | 89 ++
.../list_partition/test_list_partition.groovy | 6 +-
.../suites/point_query_p0/test_point_query.groovy | 10 +
.../suites/prepared_stmt_p0/prepared_stmt.groovy | 1 +
.../query_p0/group_concat/test_group_concat.groovy | 13 +
.../bitmap_functions/test_bitmap_function.groovy | 5 +
.../test_from_iso8601_date.groovy | 58 ++
.../suites/statistics/test_analyze_mv.groovy | 42 +-
regression-test/suites/trash_p0/clean_trash.groovy | 2 +-
158 files changed, 3613 insertions(+), 847 deletions(-)
copy be/test/vec/{core/column_vector_test.cpp =>
utils/be_exec_version_test.cpp} (70%)
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/json_format_test/simple_object_json.json.gz
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/parquet/small_2rowgroup.parquet
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/{properties/OrderKey.java =>
parser/GroupKeyWithOrder.java} (56%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/generator/{ExplodeOuter.java
=> ExplodeOuterV2.java} (89%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/generator/{Explode.java
=> ExplodeV2.java} (90%)
copy fe/fe-core/src/test/java/org/apache/doris/common/{CheckedMathTest.java =>
ConfigTest.java} (61%)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/qe/LocalShuffleTest.java
copy regression-test/data/{query_p0/join/test_ignore/test_ignore.out =>
cast_p0/cast_ignore.out} (80%)
create mode 100644
regression-test/data/nereids_p0/session_variable/test_default_limit.out
copy regression-test/data/{correctness/test_crossjoin_inlineview_slot.out =>
nereids_p0/test_cte_subquery_many.out} (91%)
create mode 100644
regression-test/data/nereids_syntax_p0/test_nereids_group_by_with_order.out
copy
regression-test/suites/{nereids_rules_p0/fill_up_missing_slots/test_having_with_aggregate_function.groovy
=> cast_p0/cast_ignore.groovy} (60%)
copy
regression-test/suites/{query_p0/session_variable/test_invalid_session.groovy
=> load_p0/broker_load/test_show_create_load.groovy} (61%)
create mode 100644
regression-test/suites/load_p0/routine_load/data/test_routine_load_jsonpath_dollar_job.json
create mode 100644
regression-test/suites/load_p0/routine_load/test_routine_load_jsonpath_dollar.groovy
create mode 100644
regression-test/suites/nereids_p0/join/test_many_multi_join.groovy
create mode 100644
regression-test/suites/nereids_p0/test_cte_subquery_many.groovy
create mode 100644
regression-test/suites/nereids_syntax_p0/test_nereids_group_by_with_order.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
