This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch branch-0.13
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git.
from 237271c [Bug] Fix fe meta version problem, make drop meta check code
easy to read and add doc content for drop meta check (#4205)
add 594e53e [Spill To Disk][1/6] The adjustment of the basic
BufferedBlockMgr includes the following change (#4151)
add fdcc223 [Bug][Json] Refactor the json load logic to fix some bug
add b4cb8fb [Feature][Cache]Add interface, metric, variable and config
for query cache (#4159)
add e605934 [Spill To Disk][2/6] Add some runningtime function and change
some function will be called in the future (#4152)
add 1ebd156 [Feature]Add fetch/update/clear proto of fe&be for cache
(#4190)
add f412f99 [Bug][ColocateJoin] Make a wrong choice of colocate join
(#4216)
add 10f822e [MemTracker] make all MemTrackers shared (#4135)
add 25f3420 [MaterializedView] Change type of sum, min, max function
column in mv (#4199)
add c32ddce [SQL][BUG]Fix window function with limit zero bug (#4207)
add 16c89c7 [BUG]Fix remove expired stale rowset path order error (#4214)
add 3ce6fc6 [BUG] Fix wrong result of querying with cast expr in where
clause (#4219)
add 116d7ff [SQL][Function] Add approx_count_distinct() function (#4221)
add bdaef84 [FE] [HttpServer] Config netty param in HttpServer (#4225)
add d64d653 [Bug][DynamicPartition]Fix bug that Modify a dynamic
partition property in a non-dynamic partition table will throw a Exception
(#4127)
add 85e0a68 [SQL][Bug] Fix multi predicate in correlation subquery
analyze fail (#4211)
add 5caa347 [ColocateJoin] ColocateJoin support table join itself
(#4230) (#4231)
add de7f832 [Delete][Bug]fix decimal delete error (#4228)
add 3f31866 [Bug][Load][Json] #4124 Load json format with stream load
failed (#4217)
add bfb8c65 [Bug] Fix UT bug after making MemTracker shared (#4243)
add 120f30b [BUG] Using attachement strategy of brpc to send packet with
big size. (#4237)
add 1b34160 Generate jave files using maven (#4133)
add 421828d [Doc] Fix format in doris_storage_optimization.md (#4250)
add a4f3d43 fix version check bug (#4244)
add 173bc09 [Alter]Analyze define expr before replay Rollup job (#4236)
add b62ff85 Revert "[BUG] Using attachement strategy of brpc to send
packet with big size. (#4237)" (#4267)
add c98b411 [Bug] Revert part of #4199 to avoid BE crash(#4269)
add 237c080 [RoutineLoad] Support modify routine load job (#4158)
add 3372958 [BUG] Fix calculation of cumulative point (#4259)
add 4c05edd [SQL] Support approx_count_distinct rewrite to hll union in
mv rewriter (#4239)
add 5ba4b02 [Docs] Add Materialized view manual (#4229)
add eefad13 [Feature] Support InPredicate in delete statement (#4006)
add e711521 [metrics] Redesign metrics to 3 layers (#4115)
add d5909ae [MaterializedView]Change the type of slot when mv is selected
(#4272)
add a54b0ea [Bug]fix cancel query bug (#4275)
add 4beed51 [Comment]Fix spelling error (#4249)
add bdbe59a [Bug]Fix be crash caused by decimal to date (#4282)
add 47fff68 [Bug][ColocateJoin] Fix bug of #4287 and #4285 of
Colocatejoin (#4289)
add 651a7e5 [Doc] Update compilation.md (#4297)
add c81862e Remove palo::PInternalService_Stub in BE code. (#4298)
add f516172 Fix window function with limit zero bug 2 (#4235)
add 411ced5 Secure singleton mode (#4257)
add 4ad943e [Feature][Cache] Cache proxy and coordinator #2581 (#4248)
add 0f30e03 [BUG] Fix TabletSinkTest unit test (#4318)
add 6abb374 Fix duplicate table export fail (#4293)
add a480dec Do not wrap NULL type tuple (#4245)
add 9125472 [UnitTest] Refactor BE unit test script (#4266)
add 493c88c [BUG] Fix NPE when distinct in predicate push down (#4294)
add 48f3ba3 [Doris On ES][Bug-Fix] Resolve NullPointerException when
multi fields with `text` type (#4300)
add 3354645 [BugFix][ColocateJoin] Fix bug of issue 4305 (#4306)
add d655b27 [Feature][Web] Add new feature to list all tablets on a
particular BE (#4268)
add 98fe80d [MV]Forbidden no grouping mv on aggregation table (#4317)
add 10e3fc2 [BUG] Fix abs function cannot handle bigint or bigger data
type (#4326)
add 48d89e0 [Bug fix]fix query id assign bug (#4291)
add 790779f [SparkLoad]remove unncessary convert from dataframe to rdd
(#4304)
add 11ec7bb [Bug]Add LargeInt cast to Date and Datatime, add timezone
to stale_version_path_json_doc (#4321)
add ac9c774 [SQL]Support datagrip show database information (#4332)
add 1d9b3ae [Doc] Repair document format (#4336)
add 05fa550 [Doc][Json Load] Improve json data format load documents
(#4337)
add 4fa35c9 [Bug][RoutineLoad] Fix routine load timezone property invalid
(#4339)
add d602886 [Compaction] Manually trigger compaction RESTapi interface
(#4312)
add 38921d4 [MV]Forbidden aggregated partition key column on mv (#4343)
add e69496f [MysqlCompatibility] Support collate field option in expr
(#4365)
add 391d534 [Bug]Fix bug that BE crash when load ORC file (#4350)
add 26fe510 [Doc] modify the document error (#4357)
add d5e456a [BUG] Fix except wrong answer bug (#4369)
add 53d00d9 [Doris On ES][Bug-Fix] ES queries always route at same 3 BE
nodes (#4351) (#4352)
add 3359467 [Tablet][Recovery] Support using empty tablet to repair the
damaged or missing tablet (#4255)
add 8a3eaee Update support batch delete storage design document (#4234)
add 38a2a7a [Bug] Fix bug that modification of global variable can not be
persisted. (#4324)
add e251080 [Bug][MemTracker] Cleanup the mem tracker's constructor to
avoid wrong usage (#4345)
add 56260a6 [Metrics] Support tablet level metrics (#4327)
add dc3ed1c [Compaction]Compaction rules optimization (#4212)
add f924282 Support udaf_orthogonal_bitmap (#4198)
add ea6d7c2 [Bug] Remove RECOVER_TABLET worker pool to make ASAN compile
happy (#4392)
add 4c571cb Revert "[Metrics] Support tablet level metrics (#4327)"
(#4397)
add bfb39a2 [SQL][Function] Add replace() function (#4347)
add 60d9d31 [Optimize] Optimize coding bit operation in BE (#4366)
add b6859f1 [JsonLoad] Fix bug that row num stat is not correct when
loading json (#4379)
add 6bb111b Modify mv rewrite rule on 'Count distinct' (#4382)
add 008149a [Doc] Increase mailing list subscription method. (#4391)
add 04a75b7 [Doc] Fix spelling errors in dynamic partition docs (#4395)
add 0715c54 Fix mispelling (#4407)
add 09b1965 [MV] Fix errors when alter materialized view which based on
dup table (#4375)
add a7422ee [UT][Bug-Fix] Resolve UT memory leak problem (#4406)
add 76a04de [MV] Input correct keys type of index meta when `Add
Partition` (#4408)
add 5976395 [BUG] Remove the deduplication of LEFT SEMI/ANTI JOIN with
not equal predicate (#4417)
add a8fe54b [ODBC SCAN NODE] 1/4 Add unix odbc library. (#4377)
add 984006a [ODBC SCAN NODE] 2/4 Add Thrift Interface of odbc_scan_node
(#4389)
add d61c10b [Delete] Support batch delete [part 1] (#4310)
add af2b749 make some readFields Deprecated (#4399)
add 5fc7956 [MemTracker][Bug-Fix] Fix core in DECHECK in memory tracker
(#4421)
add 976820b [SegmentV2] Change the default storage format to SegmentV2
(#4387)
add 67b842c [License] Organize and modify the license of the code (#4371)
add 1410d4e [Doc] Add in predicate support content in delete-manual.md
(#4404)
add c201cf6 Support batch delete[part 2] (#4425)
add 6912279 [SQL Plan]Fix explicit broadcast join bug (#4424)
add d5a0a73 [SQL] Rewrite count(distinct if(bool, bitmap, null)) to
bitmap_union_count (#4201)
add b1c7841 [SQL] Fix TupleIsNull miss in SelectStmt resultExpr (#4279)
add 0040153 [MySQL Compatibility 1/4][Bug] Fix bug that set sql_mode with
concat() function failed (#4359)
add 613c44e [Optimize]Optimize the disk selection strategy on BE for
tablet creation (#4373)
add 763a42c [MySQL Compatibility 2/4][Bug] Fix bug and improve
compatibility with mysql protocol (#4362)
add ca5e224 [Bug] Fix the bug that replication_num in show create table
is incorrect (#4393)
add 664e6a5 [Storage] "align_tag_path" and ALIGN_TAG_PREFIX is needless
(#4410)
add a5d1d01 [Doc] Fix typo about plugin content (#4416)
add b4d8b3d Forbidden the illegal column types on BITMAP_UNION OR
HLL_UNION mv (#4432)
add 09129b5 [MV] Keep the scale and precision of type when creating mv
(#4436)
add 97d9634 [Code Cleanup] Template nest convert to c++11 syntax and
style (#4442)
add 78e1615 Show column display name on `Show Proc` stmt (#4446)
add e4e9af4 This PR contain three things (#4448)
add 8b0b120 [Profile] Add 2 Segment related metrics in query profile
(#4348)
add f218327 [Mysql Compatibility] Support convert() and signed/unsigned
interger cast (#4364)
add 8c38c79 [SparkLoad]Use the yarn command to get status and kill the
application (#4383)
add b85bb0e [Bug-Fix] Some deleted tablets are not recycled on BE (#4401)
add 3c784b9 [SQL] support StringLiteral try to cast BigInt (#4445)
add fe0c21b [Bug] Fix mysql return bug (#4450)
add ad738fa Add OLAP_ERR_DATE_QUALITY_ERR error status to display schema
change failure (#4388)
add 976e3bb [Bug][Compile] Add missing imports (#4468)
add 84c63f1 [Bug] replace libltdl.so when compile the unixodbc library
(#4461)
add 82940a4 [Spark Load] Fix spark load bugs (#4464)
add 174c9f8 [DOCS] Add batch delete docs (#4435)
add ec64789 [Bug][Colocation Join] Fix colocation balance endless loop
bug (#4471)
add 004b955 [Bug] Fix a null pointer bug in PlanFragmentExecutor. (#4473)
add 0db9194 [Doc] Fix wrong doc name (#4477)
add 3b7614e [Refactor] Use camelCase in thrift generated java sources
(#4443)
add 123237a [Compaction] Persistence stale rowsets meta (#4454)
add 65cacbf [Bug] Fix bug that memory copy may overflow in
MemIndex::load_segment (#4458)
add ffe696d [Doc] Add spark load sql statement doc and update manual
(#4463)
add 1d93ba0 [Compaction] Compaction show policy type and disk format
(#4466)
add 7b67da3 [Spark Load] Redirect the spark launcher's log to a separated
log file (#4470)
add 8bb6586 [Doc] Update doc of fe-idea-dev.md (#4485)
add a864db0 [Bug] Fix bug of load error hub and schema change (#4486)
add d495661 [Bug] Fix bug of select @@sql_mode (#4484)
add f3a9f3f Do not add exchange when table's distributioin satisfy the
distribution requirements (#4482)
add 498b06f [Metrics] Support tablet level metrics (#4428)
add 1a22f3b [SQL][Function] Validate the param of rand function in
compile step (#4439)
add f207036 [Spark load][Document] Add docs about spark and yarn client
for spark load (#4489)
add f5ee854 [Spark load][Bug] Fix column terminator for spark load (#4491)
add e6367e9 [Bug] Support disable colocate join where join clause has
join hint (#4497)
add c019547 [Feature][Cache] Sql cache and partition cache #2581 (#4330)
add ac3bbdd [BatchDelete] Add a configuration indicating whether to
enable the batch delete function (#4493)
add d7ac44a [Bug] Fix bug that BE will crash when querying
information_schema.columns (#4511)
add c29d41f [BUG] Fix recover persistent stale rowsets bug from
multi-single version rowsets in stale rowsets (#4513)
add 1a30bcb [SQL Function][Bug] Fix parse_url() bug (#4429)
add d0d394a [SQL][Bug]fix semi/anti join error when table has delete sign
column (#4498)
add 5166a6c [Bug] function str_to_date()'s behavior on BE and FE is
inconsistent (#4495)
add a64c3a7 [ODBC SCAN NODE] 3/4 Add ODBC_TABLE and ODBC_SCAN NODE in FE.
(#4430)
add 15f3e5a [Bug] Fix bug of core local value (#4523)
add 8d60352 [BUG] Fix segment group add zone map bug when schema change.
(#4526)
add 72f04eb [Bug] Fix bug that query meta fields has been sent twice
(#4529)
new 33c4bc9 [Spark Load] [Bug] Load job's state will stay in ETL state
all the time after FE restart (#4528)
new 2271ccd [Bug] Fix bug that table ids is not set right for hadoop load
job (#4535)
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/PULL_REQUEST_TEMPLATE.md | 2 +-
.gitignore | 3 +
.rat-excludes | 2 +-
DISCLAIMER-WIP | 18 -
LICENSE.txt | 118 +-
README.md | 2 +-
be/CMakeLists.txt | 8 +-
be/src/agent/agent_server.cpp | 2 -
be/src/agent/heartbeat_server.cpp | 1 -
be/src/agent/task_worker_pool.cpp | 105 +-
be/src/agent/task_worker_pool.h | 1 -
be/src/common/atomic.h | 6 +
be/src/common/config.h | 36 +-
be/src/common/daemon.cpp | 22 +-
be/src/common/logging.h | 6 +
be/src/exec/aggregation_node.cpp | 8 +-
be/src/exec/analytic_eval_node.cpp | 26 +-
be/src/exec/analytic_eval_node.h | 4 +-
be/src/exec/base_scanner.cpp | 34 +-
be/src/exec/base_scanner.h | 4 +-
be/src/exec/blocking_join_node.cpp | 4 +-
be/src/exec/broker_scan_node.cpp | 8 +-
be/src/exec/broker_scanner.cpp | 2 +-
be/src/exec/cross_join_node.cpp | 2 +-
be/src/exec/csv_scan_node.cpp | 2 +-
be/src/exec/data_sink.cpp | 3 +-
be/src/exec/data_sink.h | 4 +-
be/src/exec/es_http_scan_node.cpp | 2 +-
be/src/exec/es_http_scanner.cpp | 54 +-
be/src/exec/es_http_scanner.h | 2 +-
be/src/exec/es_scan_node.cpp | 2 +-
be/src/exec/except_node.cpp | 16 +-
be/src/exec/exec_node.cpp | 27 +-
be/src/exec/exec_node.h | 12 +-
be/src/exec/hash_join_node.cpp | 12 +-
be/src/exec/hash_table.cpp | 16 +-
be/src/exec/hash_table.h | 4 +-
be/src/exec/intersect_node.cpp | 2 +-
be/src/exec/json_scanner.cpp | 326 +-
be/src/exec/json_scanner.h | 21 +-
be/src/exec/merge_join_node.h | 9 +-
be/src/exec/merge_node.cpp | 6 +-
be/src/exec/merge_node.h | 4 +-
be/src/exec/mysql_scan_node.cpp | 2 +-
be/src/exec/olap_common.h | 2 +-
be/src/exec/olap_rewrite_node.cpp | 2 +-
be/src/exec/olap_scan_node.cpp | 7 +-
be/src/exec/olap_scan_node.h | 7 +-
be/src/exec/olap_scanner.cpp | 12 +-
be/src/exec/orc_scanner.cpp | 21 +-
be/src/exec/orc_scanner.h | 1 +
be/src/exec/parquet_scanner.cpp | 3 +-
be/src/exec/parquet_scanner.h | 1 -
be/src/exec/partitioned_aggregation_node.cc | 14 +-
be/src/exec/partitioned_hash_table.cc | 107 +-
be/src/exec/partitioned_hash_table.h | 37 +-
be/src/exec/repeat_node.cpp | 2 +-
be/src/exec/schema_scan_node.cpp | 2 +-
.../exec/schema_scanner/schema_columns_scanner.cpp | 45 +-
be/src/exec/select_node.cpp | 2 +-
be/src/exec/set_operation_node.cpp | 4 +-
be/src/exec/sort_exec_exprs.cpp | 2 +-
be/src/exec/sort_exec_exprs.h | 3 +-
be/src/exec/spill_sort_node.cc | 2 +-
be/src/exec/tablet_info.cpp | 2 +-
be/src/exec/tablet_info.h | 2 +-
be/src/exec/tablet_sink.cpp | 19 +-
be/src/exec/tablet_sink.h | 7 +-
be/src/exec/topn_node.cpp | 6 +-
be/src/exec/topn_node.h | 2 +-
be/src/exec/union_node.cpp | 7 +-
be/src/exec/union_node.h | 2 +
be/src/exec/union_node_ir.cpp | 11 +
be/src/exprs/agg_fn_evaluator.cpp | 8 +-
be/src/exprs/agg_fn_evaluator.h | 4 +-
be/src/exprs/cast_functions.cpp | 3 +
be/src/exprs/cast_functions.h | 2 +
be/src/exprs/decimalv2_operators.cpp | 18 +
be/src/exprs/decimalv2_operators.h | 1 +
be/src/exprs/expr.cpp | 26 +-
be/src/exprs/expr.h | 17 +-
be/src/exprs/expr_context.cpp | 8 +-
be/src/exprs/expr_context.h | 2 +-
be/src/exprs/json_functions.cpp | 25 +-
be/src/exprs/json_functions.h | 5 +
be/src/exprs/math_functions.cpp | 64 +-
be/src/exprs/math_functions.h | 16 +
be/src/exprs/new_agg_fn_evaluator.cc | 39 +-
be/src/exprs/new_agg_fn_evaluator.h | 8 +-
be/src/exprs/string_functions.cpp | 29 +-
be/src/exprs/string_functions.h | 3 +
be/src/gutil/gscoped_ptr.h | 4 +-
be/src/gutil/hash/hash.h | 12 +-
be/src/gutil/ref_counted.h | 6 +-
be/src/gutil/stl_util.h | 2 +-
be/src/gutil/strings/join.cc | 2 +-
be/src/gutil/strings/join.h | 2 +-
be/src/gutil/strings/split.cc | 12 +-
be/src/gutil/strings/split.h | 2 +-
be/src/gutil/strings/split_internal.h | 2 +-
be/src/gutil/type_traits.h | 8 +-
be/src/http/CMakeLists.txt | 1 +
be/src/http/action/compaction_action.cpp | 213 +-
be/src/http/action/compaction_action.h | 39 +-
be/src/http/action/metrics_action.cpp | 184 +-
be/src/http/action/metrics_action.h | 4 +-
be/src/http/action/stream_load.cpp | 85 +-
be/src/http/action/stream_load.h | 6 +
be/src/http/action/tablets_info_action.cpp | 81 +
.../{metrics_action.h => tablets_info_action.h} | 21 +-
be/src/http/default_path_handlers.cpp | 28 +-
be/src/http/default_path_handlers.h | 6 +-
be/src/http/http_common.h | 7 +-
be/src/http/web_page_handler.cpp | 10 +-
be/src/olap/CMakeLists.txt | 1 +
be/src/olap/aggregate_func.h | 4 +-
be/src/olap/base_compaction.cpp | 6 +-
be/src/olap/base_compaction.h | 3 +-
be/src/olap/base_tablet.cpp | 16 +-
be/src/olap/base_tablet.h | 7 +
be/src/olap/compaction.cpp | 8 +-
be/src/olap/compaction.h | 6 +-
be/src/olap/cumulative_compaction.cpp | 70 +-
be/src/olap/cumulative_compaction.h | 6 +-
be/src/olap/cumulative_compaction_policy.cpp | 470 +
be/src/olap/cumulative_compaction_policy.h | 264 +
be/src/olap/data_dir.cpp | 89 +-
be/src/olap/data_dir.h | 16 +-
be/src/olap/delete_handler.cpp | 157 +-
be/src/olap/delete_handler.h | 13 +-
be/src/olap/delta_writer.cpp | 34 +-
be/src/olap/delta_writer.h | 8 +-
be/src/olap/field.h | 5 +-
be/src/olap/fs/block_manager_metrics.cpp | 18 +-
be/src/olap/fs/file_block_manager.cpp | 2 +-
be/src/olap/fs/file_block_manager.h | 2 +-
be/src/olap/memtable.cpp | 35 +-
be/src/olap/memtable.h | 5 +-
be/src/olap/memtable_flush_executor.h | 2 +-
be/src/olap/merger.cpp | 2 +-
be/src/olap/olap_common.h | 4 +
be/src/olap/olap_cond.cpp | 177 +-
be/src/olap/olap_cond.h | 12 +-
be/src/olap/olap_define.h | 3 +-
be/src/olap/olap_index.cpp | 54 +-
be/src/olap/olap_index.h | 2 +-
be/src/olap/olap_meta.cpp | 12 +-
be/src/olap/olap_server.cpp | 77 +-
be/src/olap/push_handler.cpp | 8 +-
be/src/olap/push_handler.h | 2 +-
be/src/olap/reader.cpp | 19 +-
be/src/olap/reader.h | 3 +-
be/src/olap/row_block.cpp | 4 +-
be/src/olap/row_block.h | 5 +-
be/src/olap/row_block2.cpp | 15 +-
be/src/olap/row_block2.h | 2 +-
be/src/olap/row_cursor.h | 8 +
be/src/olap/rowset/alpha_rowset.cpp | 2 +-
be/src/olap/rowset/alpha_rowset.h | 2 +-
be/src/olap/rowset/alpha_rowset_reader.cpp | 2 +-
be/src/olap/rowset/alpha_rowset_reader.h | 4 +-
be/src/olap/rowset/beta_rowset.cpp | 2 +-
be/src/olap/rowset/beta_rowset.h | 2 +-
be/src/olap/rowset/beta_rowset_reader.cpp | 3 +-
be/src/olap/rowset/beta_rowset_reader.h | 5 +-
be/src/olap/rowset/column_data.cpp | 28 +-
be/src/olap/rowset/column_data.h | 8 +-
be/src/olap/rowset/rowset.h | 2 +-
be/src/olap/rowset/rowset_meta.h | 4 +
be/src/olap/rowset/segment_group.cpp | 43 +-
be/src/olap/rowset/segment_group.h | 2 +-
be/src/olap/rowset/segment_reader.cpp | 11 +-
be/src/olap/rowset/segment_reader.h | 4 +-
be/src/olap/rowset/segment_v2/binary_dict_page.cpp | 3 +-
be/src/olap/rowset/segment_v2/binary_dict_page.h | 2 +-
.../olap/rowset/segment_v2/bitmap_index_reader.h | 14 +-
.../olap/rowset/segment_v2/bitmap_index_writer.cpp | 7 +-
.../rowset/segment_v2/bloom_filter_index_reader.h | 5 +-
.../segment_v2/bloom_filter_index_writer.cpp | 12 +-
be/src/olap/rowset/segment_v2/column_reader.h | 20 +-
.../rowset/segment_v2/indexed_column_writer.cpp | 7 +-
.../olap/rowset/segment_v2/indexed_column_writer.h | 2 +-
be/src/olap/rowset/segment_v2/segment.cpp | 2 +
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 8 +-
be/src/olap/rowset/segment_v2/zone_map_index.cpp | 7 +-
be/src/olap/rowset/segment_v2/zone_map_index.h | 2 +-
be/src/olap/rowset/unique_rowset_id_generator.cpp | 8 +-
be/src/olap/rowset/unique_rowset_id_generator.h | 2 +-
be/src/olap/schema.h | 15 +-
be/src/olap/schema_change.cpp | 108 +-
be/src/olap/schema_change.h | 10 +-
be/src/olap/storage_engine.cpp | 57 +-
be/src/olap/storage_engine.h | 6 +-
be/src/olap/tablet.cpp | 197 +-
be/src/olap/tablet.h | 33 +-
be/src/olap/tablet_manager.cpp | 87 +-
be/src/olap/tablet_manager.h | 11 +
be/src/olap/tablet_meta.cpp | 19 +-
be/src/olap/tablet_meta.h | 2 +-
be/src/olap/tablet_schema.cpp | 7 +
be/src/olap/tablet_schema.h | 5 +
be/src/olap/task/engine_alter_tablet_task.cpp | 4 +-
be/src/olap/task/engine_batch_load_task.cpp | 18 +-
be/src/olap/task/engine_checksum_task.cpp | 2 +-
be/src/olap/task/engine_clone_task.cpp | 8 +
be/src/olap/task/engine_clone_task.h | 2 +
be/src/olap/task/engine_storage_migration_task.cpp | 2 +-
be/src/olap/utils.h | 1 +
be/src/olap/version_graph.cpp | 176 +-
be/src/olap/version_graph.h | 18 +-
be/src/olap/wrapper_field.cpp | 4 +
be/src/olap/wrapper_field.h | 9 +
be/src/runtime/CMakeLists.txt | 1 +
be/src/runtime/broker_mgr.cpp | 5 +-
be/src/runtime/buffered_block_mgr2.cc | 123 +-
be/src/runtime/buffered_block_mgr2.h | 19 +-
be/src/runtime/buffered_tuple_stream2.cc | 2 +-
be/src/runtime/buffered_tuple_stream2.h | 4 +-
be/src/runtime/buffered_tuple_stream3.cc | 4 +-
be/src/runtime/buffered_tuple_stream3.h | 2 +-
be/src/runtime/bufferpool/buffer_pool.cc | 8 +-
be/src/runtime/bufferpool/buffer_pool.h | 4 +-
be/src/runtime/bufferpool/buffer_pool_internal.h | 2 +-
be/src/runtime/bufferpool/reservation_tracker.cc | 14 +-
be/src/runtime/bufferpool/suballocator.cc | 21 +-
be/src/runtime/bufferpool/suballocator.h | 11 +-
be/src/runtime/client_cache.cpp | 30 +-
be/src/runtime/client_cache.h | 19 +-
be/src/runtime/data_spliter.cpp | 9 +-
be/src/runtime/data_stream_mgr.cpp | 11 +-
be/src/runtime/data_stream_mgr.h | 3 +-
be/src/runtime/data_stream_recvr.cc | 14 +-
be/src/runtime/data_stream_recvr.h | 6 +-
be/src/runtime/data_stream_sender.cpp | 17 +-
be/src/runtime/data_stream_sender.h | 2 +-
be/src/runtime/datetime_value.cpp | 35 +-
be/src/runtime/descriptors.cpp | 16 +
be/src/runtime/descriptors.h | 2 +
be/src/runtime/disk_io_mgr.cc | 45 +-
be/src/runtime/disk_io_mgr.h | 20 +-
be/src/runtime/disk_io_mgr_internal.h | 6 +-
be/src/runtime/disk_io_mgr_reader_context.cc | 5 +-
be/src/runtime/dpp_sink.cpp | 4 +-
be/src/runtime/dpp_sink_internal.cpp | 15 +-
be/src/runtime/dpp_sink_internal.h | 4 +-
be/src/runtime/exec_env.cpp | 9 +-
be/src/runtime/exec_env.h | 54 +-
be/src/runtime/exec_env_init.cpp | 17 +-
be/src/runtime/export_sink.cpp | 4 +-
be/src/runtime/export_sink.h | 2 +-
be/src/runtime/external_scan_context_mgr.cpp | 10 +-
be/src/runtime/external_scan_context_mgr.h | 5 +-
be/src/runtime/fragment_mgr.cpp | 9 +-
be/src/runtime/initial_reservations.cc | 10 +-
be/src/runtime/initial_reservations.h | 4 +-
be/src/runtime/load_channel.cpp | 6 +-
be/src/runtime/load_channel.h | 4 +-
be/src/runtime/load_channel_mgr.cpp | 9 +-
be/src/runtime/load_channel_mgr.h | 2 +-
be/src/runtime/mem_pool.cpp | 24 +-
be/src/runtime/mem_tracker.cpp | 712 +-
be/src/runtime/mem_tracker.h | 903 +-
be/src/runtime/memory/chunk_allocator.cpp | 55 +-
be/src/runtime/memory/chunk_allocator.h | 3 +
be/src/runtime/memory_scratch_sink.cpp | 3 +-
be/src/runtime/mysql_table_sink.cpp | 15 +-
be/src/runtime/mysql_table_sink.h | 2 +-
be/src/runtime/plan_fragment_executor.cpp | 20 +-
be/src/runtime/plan_fragment_executor.h | 5 +-
be/src/runtime/qsorter.cpp | 2 +-
be/src/runtime/result_buffer_mgr.cpp | 7 +-
be/src/runtime/result_buffer_mgr.h | 2 +-
be/src/runtime/result_queue_mgr.cpp | 5 +-
be/src/runtime/result_sink.cpp | 3 +-
.../routine_load/routine_load_task_executor.cpp | 29 +
.../routine_load/routine_load_task_executor.h | 28 +-
be/src/runtime/row_batch.cpp | 14 +-
be/src/runtime/row_batch.h | 3 +
be/src/runtime/runtime_state.cpp | 53 +-
be/src/runtime/runtime_state.h | 48 +-
be/src/runtime/small_file_mgr.cpp | 5 +-
be/src/runtime/spill_sorter.cc | 8 +-
be/src/runtime/spill_sorter.h | 4 +-
.../load_stream_mgr.cpp} | 20 +-
be/src/runtime/stream_load/load_stream_mgr.h | 11 +-
.../runtime/stream_load/stream_load_executor.cpp | 12 +-
be/src/runtime/stream_load/stream_load_pipe.h | 82 +-
be/src/runtime/tablets_channel.cpp | 10 +-
be/src/runtime/tablets_channel.h | 4 +-
be/src/runtime/test_env.cc | 20 +-
be/src/runtime/test_env.h | 15 +-
be/src/runtime/tmp_file_mgr.cc | 43 +-
be/src/runtime/tmp_file_mgr.h | 17 +-
be/src/runtime/vectorized_row_batch.cpp | 4 +-
be/src/runtime/vectorized_row_batch.h | 4 +-
be/src/service/backend_service.cpp | 1 -
be/src/service/http_service.cpp | 9 +-
be/src/testutil/function_utils.cpp | 9 +-
be/src/testutil/function_utils.h | 4 +-
be/src/util/CMakeLists.txt | 1 +
be/src/util/arrow/row_batch.cpp | 8 +-
be/src/util/arrow/row_batch.h | 2 +-
.../function_utils.h => util/brpc_stub_cache.cpp} | 34 +-
be/src/util/brpc_stub_cache.h | 25 +-
be/src/util/coding.h | 5 +-
be/src/util/core_local.cpp | 9 +-
be/src/util/doris_metrics.cpp | 382 +-
be/src/util/doris_metrics.h | 276 +-
be/src/util/metrics.cpp | 270 +-
be/src/util/metrics.h | 411 +-
be/src/util/perf_counters.h | 2 +-
be/src/util/runtime_profile.cpp | 24 +
be/src/util/runtime_profile.h | 12 +-
be/src/util/system_metrics.cpp | 368 +-
be/src/util/system_metrics.h | 28 +-
be/src/util/thrift_server.cpp | 33 +-
be/src/util/thrift_server.h | 20 +-
be/src/util/url_parser.cpp | 56 +-
be/src/util/url_parser.h | 4 +-
be/test/agent/CMakeLists.txt | 4 +-
be/test/agent/cgroups_mgr_test.cpp | 10 +
be/test/env/env_posix_test.cpp | 2 +-
be/test/exec/CMakeLists.txt | 1 +
be/test/exec/broker_scan_node_test.cpp | 4 +-
be/test/exec/broker_scanner_test.cpp | 30 +-
be/test/exec/csv_scan_node_test.cpp | 15 +-
be/test/exec/es_scan_node_test.cpp | 2 +-
be/test/exec/hash_table_test.cpp | 19 +-
be/test/exec/json_scanner_test.cpp | 2 +
be/test/exec/orc_scanner_test.cpp | 15 +-
be/test/exec/parquet_scanner_test.cpp | 4 +-
be/test/exec/tablet_info_test.cpp | 8 +-
be/test/exec/tablet_sink_test.cpp | 22 +-
.../exec_env.cpp => test/exec/unix_odbc_test.cpp} | 20 +-
be/test/exprs/CMakeLists.txt | 4 +-
be/test/exprs/hybird_set_test.cpp | 2 +
be/test/exprs/math_functions_test.cpp | 144 +
be/test/exprs/string_functions_test.cpp | 87 +
be/test/http/metrics_action_test.cpp | 51 +-
be/test/olap/CMakeLists.txt | 4 +-
be/test/olap/aggregate_func_test.cpp | 10 +-
be/test/olap/column_reader_test.cpp | 2 +-
be/test/olap/comparison_predicate_test.cpp | 2 +-
be/test/olap/cumulative_compaction_policy_test.cpp | 1022 ++
be/test/olap/delete_handler_test.cpp | 39 +-
be/test/olap/delta_writer_test.cpp | 9 +-
be/test/olap/in_list_predicate_test.cpp | 2 +-
be/test/olap/key_coder_test.cpp | 4 +-
be/test/olap/null_predicate_test.cpp | 2 +-
be/test/olap/push_handler_test.cpp | 7 +-
be/test/olap/row_block_v2_test.cpp | 4 +-
be/test/olap/row_cursor_test.cpp | 6 +-
be/test/olap/rowset/alpha_rowset_test.cpp | 2 +-
be/test/olap/rowset/beta_rowset_test.cpp | 4 +-
be/test/olap/rowset/rowset_converter_test.cpp | 2 +-
.../rowset/segment_v2/binary_dict_page_test.cpp | 8 +-
.../rowset/segment_v2/binary_plain_page_test.cpp | 6 +-
.../rowset/segment_v2/binary_prefix_page_test.cpp | 8 +-
.../olap/rowset/segment_v2/bitmap_index_test.cpp | 4 +-
.../rowset/segment_v2/bitshuffle_page_test.cpp | 34 +-
.../rowset/segment_v2/bloom_filter_page_test.cpp | 4 +-
.../segment_v2/column_reader_writer_test.cpp | 22 +-
.../segment_v2/frame_of_reference_page_test.cpp | 26 +-
be/test/olap/rowset/segment_v2/plain_page_test.cpp | 34 +-
be/test/olap/rowset/segment_v2/rle_page_test.cpp | 16 +-
be/test/olap/rowset/segment_v2/segment_test.cpp | 4 +-
.../rowset/unique_rowset_id_generator_test.cpp | 61 +-
be/test/olap/schema_change_test.cpp | 83 +-
be/test/olap/skiplist_test.cpp | 16 +-
be/test/olap/storage_types_test.cpp | 8 +-
be/test/olap/tablet_test.cpp | 206 +
be/test/olap/test_data/header.txt | 12 +-
be/test/olap/timestamped_version_tracker_test.cpp | 51 +-
be/test/runtime/CMakeLists.txt | 15 +-
be/test/runtime/buffered_block_mgr2_test.cpp | 55 +-
be/test/runtime/buffered_tuple_stream2_test.cpp | 16 +-
be/test/runtime/data_stream_test.cpp | 18 +-
be/test/runtime/datetime_value_test.cpp | 2 +-
be/test/runtime/disk_io_mgr_test.cpp | 140 +-
be/test/runtime/load_channel_mgr_test.cpp | 28 +-
be/test/runtime/mem_limit_test.cpp | 206 +-
be/test/runtime/memory_scratch_sink_test.cpp | 5 +-
be/test/runtime/tmp_file_mgr_test.cpp | 33 +-
be/test/util/arrow/arrow_row_batch_test.cpp | 20 +-
be/test/util/arrow/arrow_row_block_test.cpp | 24 +-
be/test/util/arrow/arrow_work_flow_test.cpp | 25 +-
be/test/util/blocking_queue_test.cpp | 2 +-
be/test/util/doris_metrics_test.cpp | 168 +-
be/test/util/internal_queue_test.cpp | 2 +-
be/test/util/new_metrics_test.cpp | 334 +-
be/test/util/system_metrics_test.cpp | 164 +-
build.sh | 34 +-
contrib/udf/CMakeLists.txt | 1 +
.../udf/src/udaf_orthogonal_bitmap/CMakeLists.txt | 92 +
.../udf/src/udaf_orthogonal_bitmap/bitmap_value.h | 1326 ++
.../orthogonal_bitmap_function.cpp | 492 +
.../orthogonal_bitmap_function.h | 62 +
.../udf/src/udaf_orthogonal_bitmap/string_value.h | 175 +
docs/.vuepress/public/images/DEBUG1.png | Bin 125281 -> 0 bytes
docs/.vuepress/public/images/DEBUG2.png | Bin 14924 -> 0 bytes
docs/.vuepress/public/images/DEBUG3.png | Bin 58637 -> 0 bytes
docs/.vuepress/public/images/gen_code.png | Bin 0 -> 362310 bytes
docs/.vuepress/sidebar/en.js | 11 +-
docs/.vuepress/sidebar/zh-CN.js | 17 +-
docs/en/README.md | 17 +
.../alter-table/alter-table-bitmap-index.md | 5 +-
docs/en/administrator-guide/config/be_config.md | 66 +-
docs/en/administrator-guide/config/fe_config.md | 49 +
docs/en/administrator-guide/dynamic-partition.md | 15 +-
.../http-actions/compaction-action.md | 108 +-
.../http-actions/get-tablets.md | 65 +
.../http-actions/restore-tablet.md | 2 +-
.../load-data/broker-load-manual.md | 4 +
.../administrator-guide/load-data/delete-manual.md | 18 +-
.../load-data/load-json-format.md | 122 +-
.../load-data/routine-load-manual.md | 8 +
.../load-data/spark-load-manual.md | 580 +
.../load-data/stream-load-manual.md | 4 +
docs/en/administrator-guide/materialized_view.md | 493 +
.../operation/tablet-restore-tool.md | 136 +
docs/en/administrator-guide/running-profile.md | 7 +
docs/en/administrator-guide/variables.md | 2 +-
docs/en/developer-guide/fe-eclipse-dev.md | 27 +-
docs/en/downloads/downloads.md | 19 +
.../udf/contrib/udaf-orthogonal-bitmap-manual.md | 249 +
docs/en/getting-started/hit-the-rollup.md | 2 +-
docs/en/installing/compilation.md | 21 +-
docs/en/installing/install-deploy.md | 2 +-
docs/en/internal/doris_storage_optimization.md | 90 +-
.../{ndv.md => approx_count_distinct.md} | 15 +-
.../sql-functions/aggregate-functions/avg.md | 3 +-
.../sql-functions/aggregate-functions/count.md | 2 +-
.../aggregate-functions/hll_union_agg.md | 2 +-
.../sql-functions/aggregate-functions/max.md | 2 +-
.../sql-functions/aggregate-functions/min.md | 2 +-
.../aggregate-functions/percentile_approx.md | 2 +-
.../sql-functions/aggregate-functions/stddev.md | 2 +-
.../aggregate-functions/stddev_samp.md | 2 +-
.../sql-functions/aggregate-functions/sum.md | 2 +-
.../sql-functions/aggregate-functions/var_samp.md | 2 +-
.../sql-functions/aggregate-functions/variance.md | 2 +-
docs/en/sql-reference/sql-functions/cast.md | 2 +-
.../sql-functions/date-time-functions/curdate.md | 2 +-
.../date-time-functions/current_timestamp.md | 2 +-
.../sql-functions/date-time-functions/date_add.md | 2 +-
.../date-time-functions/date_format.md | 2 +-
.../sql-functions/date-time-functions/date_sub.md | 2 +-
.../sql-functions/date-time-functions/datediff.md | 2 +-
.../sql-functions/date-time-functions/day.md | 2 +-
.../sql-functions/date-time-functions/dayname.md | 2 +-
.../date-time-functions/dayofmonth.md | 2 +-
.../sql-functions/date-time-functions/dayofweek.md | 2 +-
.../sql-functions/date-time-functions/dayofyear.md | 2 +-
.../sql-functions/date-time-functions/from_days.md | 2 +-
.../date-time-functions/from_unixtime.md | 2 +-
.../sql-functions/date-time-functions/hour.md | 2 +-
.../sql-functions/date-time-functions/minute.md | 2 +-
.../sql-functions/date-time-functions/month.md | 2 +-
.../sql-functions/date-time-functions/monthname.md | 2 +-
.../sql-functions/date-time-functions/now.md | 2 +-
.../sql-functions/date-time-functions/second.md | 2 +-
.../date-time-functions/str_to_date.md | 10 +-
.../sql-functions/date-time-functions/timediff.md | 2 +-
.../date-time-functions/timestampadd.md | 2 +-
.../date-time-functions/timestampdiff.md | 2 +-
.../sql-functions/date-time-functions/to_date.md | 2 +-
.../sql-functions/date-time-functions/to_days.md | 2 +-
.../date-time-functions/utc_timestamp.md | 2 +-
.../date-time-functions/workofyear.md | 2 +-
.../sql-functions/date-time-functions/year.md | 2 +-
.../sql-functions/spatial-functions/st_astext.md | 2 +-
.../sql-functions/spatial-functions/st_circle.md | 2 +-
.../sql-functions/spatial-functions/st_contains.md | 2 +-
.../spatial-functions/st_distance_sphere.md | 2 +-
.../spatial-functions/st_geometryfromtext.md | 2 +-
.../spatial-functions/st_linefromtext.md | 2 +-
.../sql-functions/spatial-functions/st_point.md | 2 +-
.../sql-functions/spatial-functions/st_polygon.md | 2 +-
.../sql-functions/spatial-functions/st_x.md | 2 +-
.../sql-functions/spatial-functions/st_y.md | 2 +-
.../sql-functions/string-functions/ascii.md | 2 +-
.../sql-functions/string-functions/concat.md | 2 +-
.../sql-functions/string-functions/concat_ws.md | 2 +-
.../sql-functions/string-functions/ends_with.md | 2 +-
.../sql-functions/string-functions/find_in_set.md | 2 +-
.../string-functions/get_json_double.md | 2 +-
.../sql-functions/string-functions/get_json_int.md | 2 +-
.../string-functions/get_json_string.md | 2 +-
.../sql-functions/string-functions/group_concat.md | 2 +-
.../sql-functions/string-functions/instr.md | 2 +-
.../sql-functions/string-functions/lcase.md | 2 +-
.../sql-functions/string-functions/left.md | 2 +-
.../sql-functions/string-functions/length.md | 2 +-
.../sql-functions/string-functions/locate.md | 2 +-
.../sql-functions/string-functions/lower.md | 2 +-
.../sql-functions/string-functions/lpad.md | 2 +-
.../sql-functions/string-functions/ltrim.md | 2 +-
.../sql-functions/string-functions/money_format.md | 2 +-
.../string-functions/null_or_empty.md | 2 +-
.../string-functions/regexp_extract.md | 2 +-
.../string-functions/regexp_replace.md | 2 +-
.../sql-functions/string-functions/repeat.md | 2 +-
.../sql-functions/string-functions/replace.md} | 28 +-
.../sql-functions/string-functions/right.md | 2 +-
.../sql-functions/string-functions/rpad.md | 2 +-
.../sql-functions/string-functions/split_part.md | 2 +-
.../sql-functions/string-functions/starts_with.md | 2 +-
.../sql-functions/string-functions/strleft.md | 2 +-
.../sql-functions/string-functions/strright.md | 2 +-
.../{UNINTALL PLUGIN.md => UNINSTALL PLUGIN.md} | 4 +-
.../sql-statements/Data Definition/ALTER TABLE.md | 7 +
.../sql-statements/Data Definition/CREATE TABLE.md | 2 +-
.../sql-statements/Data Definition/HLL.md | 2 +-
.../Data Definition/create-function.md | 2 +-
.../Data Definition/drop-function.md | 2 +-
.../Data Definition/show-functions.md | 2 +-
.../Data Manipulation/BROKER LOAD.md | 35 +-
.../sql-statements/Data Manipulation/DELETE.md | 6 +-
.../Data Manipulation/RESTORE TABLET.md | 2 +-
.../Data Manipulation/ROUTINE LOAD.md | 66 +
.../Data Manipulation/STREAM LOAD.md | 26 +-
.../Data Manipulation/alter-routine-load.md | 111 +
.../sql-statements/Data Manipulation/insert.md | 2 +-
.../sql-statements/Data Types/BIGINT.md | 2 +-
.../sql-statements/Data Types/BOOLEAN.md | 2 +-
.../sql-statements/Data Types/CHAR.md | 2 +-
.../sql-statements/Data Types/DATE.md | 2 +-
.../sql-statements/Data Types/DATETIME.md | 2 +-
.../sql-statements/Data Types/DECIMAL.md | 2 +-
.../sql-statements/Data Types/DOUBLE.md | 2 +-
.../sql-statements/Data Types/FLOAT.md | 2 +-
.../sql-statements/Data Types/HLL(HyperLogLog).md | 2 +-
.../sql-reference/sql-statements/Data Types/INT.md | 2 +-
.../sql-statements/Data Types/SMALLINT.md | 2 +-
.../sql-statements/Data Types/TINYINT.md | 2 +-
.../sql-statements/Data Types/VARCHAR.md | 2 +-
docs/zh-CN/README.md | 17 +
.../alter-table/alter-table-bitmap-index.md | 6 +-
docs/zh-CN/administrator-guide/config/be_config.md | 64 +
docs/zh-CN/administrator-guide/config/fe_config.md | 53 +
.../zh-CN/administrator-guide/dynamic-partition.md | 15 +-
.../http-actions/compaction-action.md | 106 +-
.../http-actions/get-tablets.md | 65 +
.../load-data/broker-load-manual.md | 2 +
.../administrator-guide/load-data/delete-manual.md | 16 +-
.../load-data/load-json-format.md | 120 +
.../load-data/routine-load-manual.md | 6 +
.../load-data/spark-load-manual.md | 107 +-
.../load-data/stream-load-manual.md | 2 +
.../zh-CN/administrator-guide/materialized_view.md | 495 +
.../operation/tablet-restore-tool.md | 110 +-
docs/zh-CN/administrator-guide/running-profile.md | 7 +
docs/zh-CN/administrator-guide/segment-v2-usage.md | 5 +-
docs/zh-CN/administrator-guide/variables.md | 2 +-
docs/zh-CN/developer-guide/fe-eclipse-dev.md | 28 +-
docs/zh-CN/developer-guide/fe-idea-dev.md | 31 +-
.../extending-doris/plugin-development-manual.md | 1 -
.../udf/contrib/udaf-orthogonal-bitmap-manual.md | 238 +
docs/zh-CN/getting-started/hit-the-rollup.md | 2 +-
docs/zh-CN/installing/compilation.md | 23 +-
docs/zh-CN/internal/doris_storage_optimization.md | 38 +-
.../{ndv.md => approx_count_distinct.md} | 14 +-
.../sql-functions/aggregate-functions/avg.md | 2 +-
.../sql-functions/aggregate-functions/count.md | 2 +-
.../aggregate-functions/hll_union_agg.md | 2 +-
.../sql-functions/aggregate-functions/max.md | 2 +-
.../sql-functions/aggregate-functions/min.md | 2 +-
.../aggregate-functions/percentile_approx.md | 2 +-
.../sql-functions/aggregate-functions/stddev.md | 2 +-
.../aggregate-functions/stddev_samp.md | 2 +-
.../sql-functions/aggregate-functions/sum.md | 2 +-
.../sql-functions/aggregate-functions/var_samp.md | 4 +-
.../sql-functions/aggregate-functions/variance.md | 4 +-
docs/zh-CN/sql-reference/sql-functions/cast.md | 2 +-
.../sql-functions/date-time-functions/date_sub.md | 2 +-
.../sql-functions/date-time-functions/datediff.md | 2 +-
.../sql-functions/date-time-functions/day.md | 2 +-
.../sql-functions/date-time-functions/dayname.md | 2 +-
.../date-time-functions/dayofmonth.md | 2 +-
.../sql-functions/date-time-functions/dayofweek.md | 2 +-
.../sql-functions/date-time-functions/dayofyear.md | 2 +-
.../sql-functions/date-time-functions/from_days.md | 2 +-
.../date-time-functions/from_unixtime.md | 2 +-
.../sql-functions/date-time-functions/hour.md | 2 +-
.../sql-functions/date-time-functions/minute.md | 2 +-
.../sql-functions/date-time-functions/month.md | 2 +-
.../sql-functions/date-time-functions/monthname.md | 2 +-
.../sql-functions/date-time-functions/now.md | 2 +-
.../sql-functions/date-time-functions/second.md | 2 +-
.../date-time-functions/str_to_date.md | 11 +-
.../sql-functions/date-time-functions/timediff.md | 2 +-
.../date-time-functions/timestampadd.md | 2 +-
.../date-time-functions/timestampdiff.md | 2 +-
.../sql-functions/date-time-functions/to_date.md | 2 +-
.../sql-functions/date-time-functions/to_days.md | 2 +-
.../date-time-functions/unix_timestamp.md | 2 +-
.../date-time-functions/utc_timestamp.md | 2 +-
.../date-time-functions/workofyear.md | 2 +-
.../sql-functions/date-time-functions/year.md | 2 +-
.../sql-functions/spatial-functions/st_astext.md | 2 +-
.../sql-functions/spatial-functions/st_circle.md | 2 +-
.../sql-functions/spatial-functions/st_contains.md | 2 +-
.../spatial-functions/st_distance_sphere.md | 2 +-
.../spatial-functions/st_geometryfromtext.md | 2 +-
.../spatial-functions/st_linefromtext.md | 2 +-
.../sql-functions/spatial-functions/st_point.md | 2 +-
.../sql-functions/spatial-functions/st_polygon.md | 2 +-
.../sql-functions/spatial-functions/st_x.md | 2 +-
.../sql-functions/spatial-functions/st_y.md | 2 +-
.../sql-functions/string-functions/ascii.md | 2 +-
.../sql-functions/string-functions/char_length.md | 2 +-
.../sql-functions/string-functions/concat.md | 2 +-
.../sql-functions/string-functions/concat_ws.md | 2 +-
.../sql-functions/string-functions/ends_with.md | 2 +-
.../sql-functions/string-functions/find_in_set.md | 2 +-
.../string-functions/get_json_double.md | 2 +-
.../sql-functions/string-functions/get_json_int.md | 2 +-
.../string-functions/get_json_string.md | 2 +-
.../sql-functions/string-functions/group_concat.md | 2 +-
.../sql-functions/string-functions/instr.md | 2 +-
.../sql-functions/string-functions/lcase.md | 2 +-
.../sql-functions/string-functions/left.md | 2 +-
.../sql-functions/string-functions/length.md | 2 +-
.../sql-functions/string-functions/locate.md | 2 +-
.../sql-functions/string-functions/lower.md | 2 +-
.../sql-functions/string-functions/lpad.md | 2 +-
.../sql-functions/string-functions/ltrim.md | 2 +-
.../sql-functions/string-functions/money_format.md | 2 +-
.../string-functions/null_or_empty.md | 2 +-
.../string-functions/regexp_extract.md | 2 +-
.../string-functions/regexp_replace.md | 2 +-
.../sql-functions/string-functions/repeat.md | 2 +-
.../stddev_samp.md => string-functions/replace.md} | 28 +-
.../sql-functions/string-functions/right.md | 2 +-
.../sql-functions/string-functions/rpad.md | 2 +-
.../sql-functions/string-functions/split_part.md | 2 +-
.../sql-functions/string-functions/starts_with.md | 2 +-
.../sql-functions/string-functions/strleft.md | 2 +-
.../sql-functions/string-functions/strright.md | 2 +-
.../Administration/UNINSTALL PLUGIN.md | 4 +-
.../sql-statements/Data Definition/ALTER TABLE.md | 9 +
.../Data Definition/CREATE MATERIALIZED VIEW.md | 2 +-
.../sql-statements/Data Definition/CREATE TABLE.md | 2 +-
.../sql-statements/Data Definition/HLL.md | 2 +-
.../Data Manipulation/BROKER LOAD.md | 37 +-
.../sql-statements/Data Manipulation/DELETE.md | 6 +-
.../Data Manipulation/ROUTINE LOAD.md | 63 +-
.../sql-statements/Data Manipulation/SPARK LOAD.md | 265 +
.../Data Manipulation/STREAM LOAD.md | 22 +
.../Data Manipulation/alter-routine-load.md | 115 +
fe/fe-core/pom.xml | 76 +-
fe/fe-core/src/main/cup/sql_parser.cup | 155 +-
.../src/main/java/org/apache/doris/PaloFe.java | 7 +-
.../main/java/org/apache/doris/alter/Alter.java | 28 +-
.../java/org/apache/doris/alter/AlterJobV2.java | 1 +
.../java/org/apache/doris/alter/AlterOpType.java | 6 +-
.../org/apache/doris/alter/AlterOperations.java | 3 +
.../doris/alter/MaterializedViewHandler.java | 17 +-
.../java/org/apache/doris/alter/RollupJob.java | 12 +-
.../java/org/apache/doris/alter/RollupJobV2.java | 31 +-
.../apache/doris/alter/SchemaChangeHandler.java | 52 +-
.../org/apache/doris/alter/SchemaChangeJob.java | 14 +-
.../org/apache/doris/alter/SchemaChangeJobV2.java | 10 +-
.../org/apache/doris/analysis/AggregateInfo.java | 32 +
.../doris/analysis/AlterRoutineLoadStmt.java | 189 +
.../org/apache/doris/analysis/AlterTableStmt.java | 53 +-
.../org/apache/doris/analysis/AnalyticWindow.java | 6 +-
.../java/org/apache/doris/analysis/Analyzer.java | 4 +-
.../org/apache/doris/analysis/ArithmeticExpr.java | 2 +-
.../org/apache/doris/analysis/BinaryPredicate.java | 26 +-
.../doris/analysis/BuiltinAggregateFunction.java | 2 +-
.../java/org/apache/doris/analysis/CastExpr.java | 7 +-
.../java/org/apache/doris/analysis/ColumnDef.java | 26 +-
.../doris/analysis/CreateMaterializedViewStmt.java | 60 +-
.../doris/analysis/CreateRoutineLoadStmt.java | 174 +-
.../org/apache/doris/analysis/CreateTableStmt.java | 15 +-
.../org/apache/doris/analysis/DataDescription.java | 58 +-
.../org/apache/doris/analysis/DateLiteral.java | 494 +-
.../java/org/apache/doris/analysis/DeleteStmt.java | 27 +-
.../org/apache/doris/analysis/DescribeStmt.java | 34 +-
.../apache/doris/analysis/EnableFeatureClause.java | 71 +
.../java/org/apache/doris/analysis/ExportStmt.java | 1 +
.../main/java/org/apache/doris/analysis/Expr.java | 11 +-
.../apache/doris/analysis/ExpressionFunctions.java | 18 +-
.../apache/doris/analysis/FunctionCallExpr.java | 2 +-
.../org/apache/doris/analysis/FunctionName.java | 6 +-
.../apache/doris/analysis/ImportColumnDesc.java | 6 +
.../apache/doris/analysis/ImportDeleteOnStmt.java | 25 +-
.../org/apache/doris/analysis/InPredicate.java | 2 +-
.../apache/doris/analysis/InformationFunction.java | 9 +-
.../java/org/apache/doris/analysis/InsertStmt.java | 18 +-
.../java/org/apache/doris/analysis/LoadStmt.java | 18 +
.../doris/analysis/MVColumnBitmapUnionPattern.java | 10 +-
.../doris/analysis/MVColumnHLLUnionPattern.java | 13 +-
.../org/apache/doris/analysis/MVColumnItem.java | 12 +-
.../org/apache/doris/analysis/OutFileClause.java | 8 +-
.../analysis/RoutineLoadDataSourceProperties.java | 138 +
.../java/org/apache/doris/analysis/SelectStmt.java | 30 +-
.../java/org/apache/doris/analysis/SetVar.java | 23 +-
.../java/org/apache/doris/analysis/SlotRef.java | 6 +-
.../org/apache/doris/analysis/StmtRewriter.java | 1 +
.../org/apache/doris/analysis/StringLiteral.java | 38 +-
.../org/apache/doris/analysis/SysVariableDesc.java | 39 +-
.../doris/analysis/TupleIsNullPredicate.java | 4 +-
.../org/apache/doris/analysis/UserIdentity.java | 2 +-
.../java/org/apache/doris/backup/BackupJob.java | 22 +-
.../java/org/apache/doris/backup/RestoreJob.java | 12 +-
.../apache/doris/catalog/AggregateFunction.java | 22 +-
.../java/org/apache/doris/catalog/Catalog.java | 118 +-
.../main/java/org/apache/doris/catalog/Column.java | 48 +-
.../doris/catalog/DynamicPartitionProperty.java | 12 +-
.../java/org/apache/doris/catalog/FsBroker.java | 1 +
.../java/org/apache/doris/catalog/Function.java | 10 +-
.../java/org/apache/doris/catalog/FunctionSet.java | 11 +
.../main/java/org/apache/doris/catalog/Index.java | 4 +-
.../doris/catalog/MaterializedIndexMeta.java | 10 +
.../java/org/apache/doris/catalog/OdbcTable.java | 295 +
.../java/org/apache/doris/catalog/OlapTable.java | 104 +-
.../org/apache/doris/catalog/ScalarFunction.java | 8 +-
.../java/org/apache/doris/catalog/ScalarType.java | 6 +-
.../java/org/apache/doris/catalog/SchemaTable.java | 4 +
.../org/apache/doris/catalog/SparkResource.java | 43 +-
.../java/org/apache/doris/catalog/StructType.java | 2 +-
.../main/java/org/apache/doris/catalog/Table.java | 13 +
.../apache/doris/catalog/TabletInvertedIndex.java | 46 +-
.../org/apache/doris/catalog/TabletStatMgr.java | 8 +-
.../org/apache/doris/catalog/TempPartitions.java | 1 +
.../main/java/org/apache/doris/catalog/Type.java | 26 +-
.../apache/doris/clone/ColocateTableBalancer.java | 18 +-
.../org/apache/doris/clone/TabletSchedCtx.java | 34 +-
.../main/java/org/apache/doris/common/Config.java | 90 +-
.../org/apache/doris/common/FeMetaVersion.java | 6 +-
.../doris/common/InvalidFormatException.java | 20 +-
.../main/java/org/apache/doris/common/Status.java | 2 +-
.../java/org/apache/doris/common/TreeNode.java | 6 +
.../main/java/org/apache/doris/common/log4j2.xml | 13 -
.../apache/doris/common/proc/IndexInfoProcDir.java | 2 +-
.../doris/common/proc/IndexSchemaProcNode.java | 2 +-
.../common/publish/ClusterStatePublisher.java | 8 +-
.../doris/common/publish/ClusterStateUpdate.java | 2 +-
.../org/apache/doris/common/util/DebugUtil.java | 3 +
.../doris/common/util/DynamicPartitionUtil.java | 6 +-
.../apache/doris/common/util/ProfileManager.java | 5 +-
.../apache/doris/common/util/PropertyAnalyzer.java | 6 +-
.../org/apache/doris/common/util/TimeUtils.java | 6 +-
.../doris/external/elasticsearch/MappingPhase.java | 6 +-
.../java/org/apache/doris/http/HttpServer.java | 22 +-
.../doris/http/action/StaticResourceAction.java | 2 +-
.../apache/doris/http/action/WebBaseAction.java | 12 +-
.../apache/doris/http/rest/TableSchemaAction.java | 2 +-
.../org/apache/doris/journal/JournalEntity.java | 16 +-
.../org/apache/doris/load/BrokerFileGroup.java | 13 +
.../java/org/apache/doris/load/DeleteHandler.java | 72 +-
.../java/org/apache/doris/load/DppScheduler.java | 22 +-
.../main/java/org/apache/doris/load/ExportJob.java | 11 +-
.../src/main/java/org/apache/doris/load/Load.java | 6 +-
.../java/org/apache/doris/load/LoadErrorHub.java | 4 +-
.../main/java/org/apache/doris/load/LoadJob.java | 10 +-
.../org/apache/doris/load/RoutineLoadDesc.java | 17 +-
.../java/org/apache/doris/load/TabletLoadInfo.java | 1 +
.../org/apache/doris/load/loadv2/BulkLoadJob.java | 7 +
.../org/apache/doris/load/loadv2/ConfigFile.java | 27 +-
.../org/apache/doris/load/loadv2/LoadManager.java | 4 +-
.../org/apache/doris/load/loadv2/LoadTask.java | 6 +
.../org/apache/doris/load/loadv2/MiniLoadJob.java | 12 +-
.../doris/load/loadv2/SparkEtlJobHandler.java | 217 +-
.../doris/load/loadv2/SparkLauncherMonitor.java | 245 +
.../doris/load/loadv2/SparkLoadAppHandle.java | 202 +
.../org/apache/doris/load/loadv2/SparkLoadJob.java | 96 +-
.../load/loadv2/SparkPendingTaskAttachment.java | 8 +-
.../apache/doris/load/loadv2/SparkRepository.java | 2 +-
.../doris/load/loadv2/SparkYarnConfigFiles.java | 245 +
.../doris/load/loadv2/YarnApplicationReport.java | 121 +
.../doris/load/routineload/KafkaProgress.java | 17 +
.../load/routineload/KafkaRoutineLoadJob.java | 134 +-
.../doris/load/routineload/KafkaTaskInfo.java | 18 +-
.../doris/load/routineload/RoutineLoadJob.java | 146 +-
.../doris/load/routineload/RoutineLoadManager.java | 105 +-
.../load/routineload/RoutineLoadTaskScheduler.java | 8 +-
.../java/org/apache/doris/master/MasterImpl.java | 131 +-
.../org/apache/doris/master/ReportHandler.java | 418 +-
.../java/org/apache/doris/metric/MetricRepo.java | 30 +
.../java/org/apache/doris/mysql/MysqlProto.java | 1 +
.../persist/AlterRoutineLoadJobOperationLog.java | 70 +
.../apache/doris/persist/BackendTabletsInfo.java | 30 +-
.../java/org/apache/doris/persist/DropDbInfo.java | 1 +
.../apache/doris/persist/DropPartitionInfo.java | 1 +
.../java/org/apache/doris/persist/EditLog.java | 20 +-
.../apache/doris/persist/GlobalVarPersistInfo.java | 141 +
.../org/apache/doris/persist/OperationType.java | 5 +-
.../apache/doris/persist/ReplicaPersistInfo.java | 60 +-
.../apache/doris/persist/TruncateTableInfo.java | 1 +
.../org/apache/doris/persist/gson/GsonUtils.java | 4 +-
.../org/apache/doris/planner/AggregationNode.java | 6 +-
.../org/apache/doris/planner/AnalyticEvalNode.java | 16 +-
.../apache/doris/planner/AssertNumRowsNode.java | 4 +-
.../org/apache/doris/planner/BrokerScanNode.java | 133 +-
.../java/org/apache/doris/planner/CsvScanNode.java | 20 +-
.../org/apache/doris/planner/DataPartition.java | 4 +-
.../org/apache/doris/planner/DataSplitSink.java | 10 +-
.../org/apache/doris/planner/DataStreamSink.java | 2 +-
.../apache/doris/planner/DistributedPlanner.java | 95 +-
.../java/org/apache/doris/planner/EsScanNode.java | 21 +-
.../org/apache/doris/planner/ExchangeNode.java | 4 +-
.../java/org/apache/doris/planner/ExportSink.java | 4 +-
.../org/apache/doris/planner/HashJoinNode.java | 6 +-
.../org/apache/doris/planner/LoadScanNode.java | 99 +-
.../org/apache/doris/planner/MergeJoinNode.java | 4 +-
.../org/apache/doris/planner/MysqlTableSink.java | 2 +-
.../org/apache/doris/planner/OdbcScanNode.java | 191 +
.../org/apache/doris/planner/OlapRewriteNode.java | 6 +-
.../org/apache/doris/planner/OlapScanNode.java | 53 +-
.../org/apache/doris/planner/OlapTableSink.java | 52 +-
.../org/apache/doris/planner/PlanFragment.java | 8 +-
.../java/org/apache/doris/planner/PlanNode.java | 4 +-
.../java/org/apache/doris/planner/Planner.java | 10 +-
.../java/org/apache/doris/planner/ResultSink.java | 6 +-
.../org/apache/doris/planner/SchemaScanNode.java | 4 +-
.../apache/doris/planner/SingleNodePlanner.java | 48 +-
.../java/org/apache/doris/planner/SortNode.java | 10 +-
.../apache/doris/planner/StreamLoadPlanner.java | 63 +-
.../apache/doris/planner/StreamLoadScanNode.java | 147 +-
.../java/org/apache/doris/qe/ConnectProcessor.java | 41 +-
.../main/java/org/apache/doris/qe/Coordinator.java | 118 +-
.../main/java/org/apache/doris/qe/DdlExecutor.java | 6 +-
.../java/org/apache/doris/qe/GlobalVariable.java | 17 +
.../java/org/apache/doris/qe/MasterOpExecutor.java | 16 +-
.../java/org/apache/doris/qe/SessionVariable.java | 146 +-
.../java/org/apache/doris/qe/SimpleScheduler.java | 4 +
.../java/org/apache/doris/qe/StmtExecutor.java | 161 +-
.../main/java/org/apache/doris/qe/VariableMgr.java | 154 +-
.../main/java/org/apache/doris/qe/cache/Cache.java | 86 +
.../org/apache/doris/qe/cache/CacheAnalyzer.java | 456 +
.../org/apache/doris/qe/cache/CacheBeProxy.java | 165 +
.../apache/doris/qe/cache/CacheCoordinator.java | 162 +
.../java/org/apache/doris/qe/cache/CacheProxy.java | 299 +
.../org/apache/doris/qe/cache/PartitionCache.java | 217 +
.../org/apache/doris/qe/cache/PartitionRange.java | 604 +
.../org/apache/doris/qe/cache/RowBatchBuilder.java | 158 +
.../java/org/apache/doris/qe/cache/SqlCache.java | 80 +
.../java/org/apache/doris/rewrite/FEFunctions.java | 10 +-
.../doris/rewrite/mvrewrite/CountFieldToSum.java | 3 +
.../apache/doris/rewrite/mvrewrite/NDVToHll.java | 8 +-
.../org/apache/doris/rpc/BackendServiceProxy.java | 42 +
.../java/org/apache/doris/rpc/PBackendService.java | 14 +
.../java/org/apache/doris/service/ExecuteEnv.java | 8 +-
.../apache/doris/service/FrontendServiceImpl.java | 138 +-
.../main/java/org/apache/doris/system/Backend.java | 16 +-
.../java/org/apache/doris/system/HeartbeatMgr.java | 30 +-
.../java/org/apache/doris/task/AgentBatchTask.java | 58 +-
.../java/org/apache/doris/task/AgentClient.java | 16 +-
.../org/apache/doris/task/AlterReplicaTask.java | 10 +-
.../main/java/org/apache/doris/task/CloneTask.java | 14 +-
.../org/apache/doris/task/CreateReplicaTask.java | 63 +-
.../org/apache/doris/task/CreateRollupTask.java | 35 +-
.../java/org/apache/doris/task/DownloadTask.java | 2 +-
.../org/apache/doris/task/DropReplicaTask.java | 2 +-
.../org/apache/doris/task/ExportPendingTask.java | 20 +-
.../apache/doris/task/HadoopLoadPendingTask.java | 2 +-
.../org/apache/doris/task/LoadPendingTask.java | 9 +-
.../java/org/apache/doris/task/LoadTaskInfo.java | 49 +
.../org/apache/doris/task/MiniLoadEtlTask.java | 14 +-
.../org/apache/doris/task/MiniLoadPendingTask.java | 26 +-
.../main/java/org/apache/doris/task/PushTask.java | 38 +-
.../org/apache/doris/task/RecoverTabletTask.java | 44 -
.../org/apache/doris/task/SchemaChangeTask.java | 36 +-
.../java/org/apache/doris/task/SnapshotTask.java | 6 +-
.../java/org/apache/doris/task/StreamLoadTask.java | 78 +-
.../doris/task/UpdateTabletMetaInfoTask.java | 24 +-
.../java/org/apache/doris/task/UploadTask.java | 2 +-
.../doris/transaction/PublishVersionDaemon.java | 2 +-
fe/fe-core/src/main/jflex/sql_scanner.flex | 5 +
.../org/apache/doris/alter/AlterJobV2Test.java | 6 +-
.../java/org/apache/doris/alter/AlterTest.java | 137 +-
.../doris/alter/MaterializedViewHandlerTest.java | 62 +
.../org/apache/doris/alter/RollupJobV2Test.java | 12 +-
.../doris/alter/SchemaChangeHandlerTest.java | 64 +
.../apache/doris/alter/SchemaChangeJobV2Test.java | 3 +-
.../org/apache/doris/analysis/AggregateTest.java | 2 -
.../doris/analysis/AlterRoutineLoadStmtTest.java | 234 +
.../apache/doris/analysis/ColumnSeparatorTest.java | 14 +-
.../analysis/CreateMaterializedViewStmtTest.java | 212 +-
.../doris/analysis/CreateRoutineLoadStmtTest.java | 7 +-
.../apache/doris/analysis/DataDescriptionTest.java | 44 +-
.../org/apache/doris/analysis/DeleteStmtTest.java | 20 +-
.../apache/doris/analysis/DescribeStmtTest.java | 2 +-
.../org/apache/doris/analysis/InsertStmtTest.java | 2 +
.../org/apache/doris/analysis/LoadStmtTest.java | 3 +
.../analysis/MVColumnBitmapUnionPatternTest.java | 19 +
.../analysis/MVColumnHLLUnionPatternTest.java | 16 +
.../org/apache/doris/analysis/SelectStmtTest.java | 120 +-
.../org/apache/doris/analysis/SetVariableTest.java | 72 +
.../org/apache/doris/backup/BackupHandlerTest.java | 27 +-
.../org/apache/doris/backup/BackupJobTest.java | 13 +-
.../org/apache/doris/backup/RestoreJobTest.java | 12 +-
.../java/org/apache/doris/catalog/BackendTest.java | 15 +-
.../doris/clone/ColocateTableBalancerTest.java | 33 +
.../org/apache/doris/common/GenericPoolTest.java | 46 +-
.../doris/common/proc/IndexSchemaProcNodeTest.java | 55 +
.../external/elasticsearch/MappingPhaseTest.java | 13 +-
.../org/apache/doris/load/DeleteHandlerTest.java | 17 +
.../doris/load/loadv2/SparkEtlJobHandlerTest.java | 210 +-
.../load/loadv2/SparkLauncherMonitorTest.java | 92 +
.../apache/doris/load/loadv2/SparkLoadJobTest.java | 46 +-
.../doris/load/loadv2/SparkRepositoryTest.java | 17 +
.../load/loadv2/SparkYarnConfigFilesTest.java | 72 +
.../load/loadv2/YarnApplicationReportTest.java | 50 +
.../load/routineload/KafkaRoutineLoadJobTest.java | 10 +-
.../load/routineload/RoutineLoadManagerTest.java | 50 +-
.../persist/AlterRoutineLoadOperationLogTest.java | 83 +
.../persist/BatchModifyPartitionsInfoTest.java | 17 +
.../doris/persist/GlobalVarPersistInfoTest.java | 73 +
.../doris/planner/DistributedPlannerTest.java | 78 +-
.../planner/MaterializedViewFunctionTest.java | 31 +-
.../org/apache/doris/planner/QueryPlanTest.java | 372 +-
.../doris/planner/StreamLoadScanNodeTest.java | 1 +
.../java/org/apache/doris/qe/CoordinatorTest.java | 20 +-
.../org/apache/doris/qe/PartitionCacheTest.java | 851 ++
.../org/apache/doris/qe/SimpleSchedulerTest.java | 4 +-
.../java/org/apache/doris/qe/VariableMgrTest.java | 66 +-
.../org/apache/doris/rewrite/FEFunctionsTest.java | 52 +-
.../rewrite/mvrewrite/CountFieldToSumTest.java | 69 +
.../org/apache/doris/service/ExecuteEnvTest.java | 68 +
.../java/org/apache/doris/task/AgentTaskTest.java | 24 +-
.../transaction/GlobalTransactionMgrTest.java | 4 +
.../apache/doris/utframe/MockedBackendFactory.java | 48 +-
.../org/apache/doris/utframe/UtFrameUtils.java | 22 +-
.../es/test_index_mapping_field_mult_analyzer.json | 23 +
.../src/test/resources/spark_launcher_monitor.log | 264 +
.../apache/doris/load/loadv2/dpp/ColumnParser.java | 3 +-
.../org/apache/doris/load/loadv2/dpp/SparkDpp.java | 428 +-
.../doris/load/loadv2/dpp/SparkRDDAggregator.java | 75 +-
.../apache/doris/load/loadv2/etl/EtlJobConfig.java | 17 +-
.../auditloader/src/main/assembly/plugin.conf | 17 +
.../apache_hdfs_broker/conf/log4j.properties | 17 +
gensrc/proto/internal_service.proto | 62 +
gensrc/proto/olap_file.proto | 11 +
gensrc/proto/palo_internal_service.proto | 3 +
gensrc/script/Makefile | 3 +-
gensrc/script/doris_builtins_functions.py | 22 +
gensrc/script/gen_build_version.sh | 4 +-
gensrc/script/gen_builtins_functions.py | 3 +-
gensrc/thrift/AgentService.thrift | 2 +
gensrc/thrift/Descriptors.thrift | 12 +
gensrc/thrift/FrontendService.thrift | 3 +
gensrc/thrift/Makefile | 17 +-
gensrc/thrift/PlanNodes.thrift | 15 +-
gensrc/thrift/Types.thrift | 22 +-
run-be-ut.sh | 171 +
run-fe-ut.sh | 4 +-
run-ut.sh | 337 -
thirdparty/build-thirdparty.sh | 30 +
thirdparty/vars.sh | 34 +-
tools/row_to_column/README | 11 -
tools/row_to_column/README.md | 37 +
tools/row_to_column/conf | 17 +
tools/show_segment_status/conf | 17 +
webroot/be/bootstrap/css/bootstrap-table.min.css | 7 -
webroot/be/bootstrap/css/bootstrap.min.css | 6 -
.../fonts/glyphicons-halflings-regular.woff | Bin 23424 -> 0 bytes
webroot/be/bootstrap/js/bootstrap-table.min.js | 9 -
webroot/be/bootstrap/js/bootstrap.min.js | 7 -
webroot/be/d3.v2.js | 7034 ---------
webroot/be/epoch.0.5.2.min.css | 1 -
webroot/be/epoch.0.5.2.min.js | 92 -
webroot/be/jquery-3.2.1.min.js | 4 -
webroot/be/tablets_page.mustache | 40 +
webroot/static/bootstrap-theme.css | 587 -
webroot/static/bootstrap-theme.css.map | 1 -
webroot/static/bootstrap.css | 6757 --------
webroot/static/bootstrap.css.map | 1 -
webroot/static/datatables_bootstrap.css | 185 -
webroot/static/datatables_bootstrap.js | 182 -
webroot/static/glyphicons-halflings-regular.eot | Bin 20127 -> 0 bytes
webroot/static/glyphicons-halflings-regular.svg | 288 -
webroot/static/glyphicons-halflings-regular.ttf | Bin 45404 -> 0 bytes
webroot/static/glyphicons-halflings-regular.woff | Bin 23424 -> 0 bytes
webroot/static/glyphicons-halflings-regular.woff2 | Bin 18028 -> 0 bytes
webroot/static/jquery.dataTables.js | 15278 -------------------
webroot/static/jquery.js | 10337 -------------
980 files changed, 28066 insertions(+), 49166 deletions(-)
delete mode 100644 DISCLAIMER-WIP
create mode 100644 be/src/http/action/tablets_info_action.cpp
copy be/src/http/action/{metrics_action.h => tablets_info_action.h} (75%)
create mode 100644 be/src/olap/cumulative_compaction_policy.cpp
create mode 100644 be/src/olap/cumulative_compaction_policy.h
copy be/src/runtime/{exec_env.cpp => stream_load/load_stream_mgr.cpp} (60%)
copy be/src/{testutil/function_utils.h => util/brpc_stub_cache.cpp} (63%)
copy be/{src/runtime/exec_env.cpp => test/exec/unix_odbc_test.cpp} (78%)
create mode 100644 be/test/exprs/math_functions_test.cpp
create mode 100644 be/test/olap/cumulative_compaction_policy_test.cpp
create mode 100755 be/test/olap/tablet_test.cpp
create mode 100644 contrib/udf/src/udaf_orthogonal_bitmap/CMakeLists.txt
create mode 100644 contrib/udf/src/udaf_orthogonal_bitmap/bitmap_value.h
create mode 100644
contrib/udf/src/udaf_orthogonal_bitmap/orthogonal_bitmap_function.cpp
create mode 100644
contrib/udf/src/udaf_orthogonal_bitmap/orthogonal_bitmap_function.h
create mode 100644 contrib/udf/src/udaf_orthogonal_bitmap/string_value.h
delete mode 100644 docs/.vuepress/public/images/DEBUG1.png
delete mode 100644 docs/.vuepress/public/images/DEBUG2.png
delete mode 100644 docs/.vuepress/public/images/DEBUG3.png
create mode 100644 docs/.vuepress/public/images/gen_code.png
create mode 100644 docs/en/administrator-guide/http-actions/get-tablets.md
create mode 100644 docs/en/administrator-guide/load-data/spark-load-manual.md
create mode 100644 docs/en/administrator-guide/materialized_view.md
create mode 100644 docs/en/administrator-guide/operation/tablet-restore-tool.md
create mode 100644
docs/en/extending-doris/udf/contrib/udaf-orthogonal-bitmap-manual.md
rename docs/en/sql-reference/sql-functions/aggregate-functions/{ndv.md =>
approx_count_distinct.md} (82%)
copy docs/{zh-CN/sql-reference/sql-functions/aggregate-functions/max.md =>
en/sql-reference/sql-functions/string-functions/replace.md} (62%)
mode change 100755 => 100644
rename docs/en/sql-reference/sql-statements/Administration/{UNINTALL PLUGIN.md
=> UNINSTALL PLUGIN.md} (93%)
create mode 100644 docs/en/sql-reference/sql-statements/Data
Manipulation/alter-routine-load.md
create mode 100644 docs/zh-CN/administrator-guide/http-actions/get-tablets.md
create mode 100644 docs/zh-CN/administrator-guide/materialized_view.md
create mode 100644
docs/zh-CN/extending-doris/udf/contrib/udaf-orthogonal-bitmap-manual.md
rename docs/zh-CN/sql-reference/sql-functions/aggregate-functions/{ndv.md =>
approx_count_distinct.md} (82%)
copy
docs/zh-CN/sql-reference/sql-functions/{aggregate-functions/stddev_samp.md =>
string-functions/replace.md} (62%)
mode change 100755 => 100644
create mode 100644 docs/zh-CN/sql-reference/sql-statements/Data
Manipulation/SPARK LOAD.md
create mode 100644 docs/zh-CN/sql-reference/sql-statements/Data
Manipulation/alter-routine-load.md
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/AlterRoutineLoadStmt.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/EnableFeatureClause.java
mode change 100644 => 100755
fe/fe-core/src/main/java/org/apache/doris/analysis/Expr.java
copy be/src/runtime/exec_env.cpp =>
fe/fe-core/src/main/java/org/apache/doris/analysis/ImportDeleteOnStmt.java (70%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/RoutineLoadDataSourceProperties.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/catalog/OdbcTable.java
copy be/src/runtime/exec_env.cpp =>
fe/fe-core/src/main/java/org/apache/doris/common/InvalidFormatException.java
(78%)
delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/common/log4j2.xml
copy be/src/http/action/metrics_action.h =>
fe/fe-core/src/main/java/org/apache/doris/load/loadv2/ConfigFile.java (67%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/load/loadv2/SparkLauncherMonitor.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/load/loadv2/SparkLoadAppHandle.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/load/loadv2/SparkYarnConfigFiles.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/load/loadv2/YarnApplicationReport.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/persist/AlterRoutineLoadJobOperationLog.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/persist/GlobalVarPersistInfo.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/planner/OdbcScanNode.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/qe/cache/Cache.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/qe/cache/CacheAnalyzer.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/qe/cache/CacheBeProxy.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/qe/cache/CacheCoordinator.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/qe/cache/CacheProxy.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/qe/cache/PartitionCache.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/qe/cache/PartitionRange.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/qe/cache/RowBatchBuilder.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/qe/cache/SqlCache.java
mode change 100644 => 100755
fe/fe-core/src/main/java/org/apache/doris/service/ExecuteEnv.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/task/LoadTaskInfo.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/task/RecoverTabletTask.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/alter/SchemaChangeHandlerTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/analysis/AlterRoutineLoadStmtTest.java
mode change 100644 => 100755
fe/fe-core/src/test/java/org/apache/doris/analysis/SelectStmtTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/analysis/SetVariableTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/common/proc/IndexSchemaProcNodeTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/load/loadv2/SparkLauncherMonitorTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/load/loadv2/SparkYarnConfigFilesTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/load/loadv2/YarnApplicationReportTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/persist/AlterRoutineLoadOperationLogTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/persist/GlobalVarPersistInfoTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/qe/PartitionCacheTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/rewrite/mvrewrite/CountFieldToSumTest.java
create mode 100755
fe/fe-core/src/test/java/org/apache/doris/service/ExecuteEnvTest.java
create mode 100644
fe/fe-core/src/test/resources/data/es/test_index_mapping_field_mult_analyzer.json
create mode 100644 fe/fe-core/src/test/resources/spark_launcher_monitor.log
create mode 100755 run-be-ut.sh
delete mode 100755 run-ut.sh
delete mode 100644 tools/row_to_column/README
create mode 100644 tools/row_to_column/README.md
delete mode 100644 webroot/be/bootstrap/css/bootstrap-table.min.css
delete mode 100644 webroot/be/bootstrap/css/bootstrap.min.css
delete mode 100644 webroot/be/bootstrap/fonts/glyphicons-halflings-regular.woff
delete mode 100644 webroot/be/bootstrap/js/bootstrap-table.min.js
delete mode 100644 webroot/be/bootstrap/js/bootstrap.min.js
delete mode 100644 webroot/be/d3.v2.js
delete mode 100644 webroot/be/epoch.0.5.2.min.css
delete mode 100644 webroot/be/epoch.0.5.2.min.js
delete mode 100644 webroot/be/jquery-3.2.1.min.js
create mode 100644 webroot/be/tablets_page.mustache
delete mode 100644 webroot/static/bootstrap-theme.css
delete mode 100644 webroot/static/bootstrap-theme.css.map
delete mode 100644 webroot/static/bootstrap.css
delete mode 100644 webroot/static/bootstrap.css.map
delete mode 100644 webroot/static/datatables_bootstrap.css
delete mode 100755 webroot/static/datatables_bootstrap.js
delete mode 100644 webroot/static/glyphicons-halflings-regular.eot
delete mode 100644 webroot/static/glyphicons-halflings-regular.svg
delete mode 100644 webroot/static/glyphicons-halflings-regular.ttf
delete mode 100644 webroot/static/glyphicons-halflings-regular.woff
delete mode 100644 webroot/static/glyphicons-halflings-regular.woff2
delete mode 100644 webroot/static/jquery.dataTables.js
delete mode 100755 webroot/static/jquery.js
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
