This is an automated email from the ASF dual-hosted git repository.
panxiaolei pushed a change to branch dev_join
in repository https://gitbox.apache.org/repos/asf/doris.git
omit 166bf53fdda fix
omit e370ff8b89f update
omit 591bf213bcf fix
omit 8b3a79cb5fc update
omit bc1110750a3 fix some bug of tpch (#25931)
omit 4e16520bfd8 update
omit 29e3377c9b0 update
omit 7b8d22c91c7 fix tpch some bug of right semi/anti join (#25896)
omit 78f91914363 support right anti/semi/outer join (#25785)
omit d9ea1a1723e update dev_join to pre calculate bucket num (#25663)
omit feecd5e3711 support batch size (#25629)
omit 82501bda3f7 update rf
omit f6435141d7a merge block to single block on join/set node
add 6ce1087c231 [enhancement](stats) Limit analyze info count (#25576)
add d6c64d305f0 [chore](log) Add log to trace query execution #25739
add bc606859c73 [enhancement](regression-test) add test for test_avg
(#25892)
add 2229d82acd8 [fix](Nereids) should not put bound expr into unbound
group by list (#25938)
add 1ba8a9bae40 [feature-wip](executor)Fe send topic info to be (#25798)
add de06a2f8b78 [minor](test) remove useless date case (#25941)
add 642c7018199 [doc](partial update) add flink-connector docs (#25843)
add 9705ec760c1 [fix](regression-test) use correct dataset for
unique_with_mow_p2 (#25653)
add c1d64a7128a [Feature](datatype) Add IPv4/v6 data type for doris
(#24965)
add c3527672a5a [refactor & pipelineX][pick fix] Pick fix of predicate
pushdown to pipelineX (#25953)
add 2679fa4ea7f [improvement](tablet clone) furthur repair replicas should
be check even if they are versions catchup (#25551)
add 678dc366e0b [fix](export) fix timeout property not work for export job
(#25913)
add a2a157fcde8 [ci](pipeline) add required of "P0 Regression PipelineX
(Doris Regression)" (#25967)
add 9faa6e083b1 [fix](udf) avoid exception when fail to find udf in replay
logic (#25965)
add 1e39636fbfd [fix](nereids) fix wrong result precision for add/sub
(#25751)
add 69015df767d [Fix](inverted index) reorder ConjunctionQuery deconstruct
order (#25972)
add 36be7dcc13b [enhancement](regression) add normal query before date
convert for debug (#25970)
add d9a3aa5c068 [pipelineX](improvement) improve local shuffle (#25964)
add c86fad7cbd9 [Fix](orc-reader) Fix orc decimal128 scale issue. (#25977)
new eab42792699 merge block to single block on join/set node
new 19d8a96398d update rf
new b9bba03a1c2 support batch size (#25629)
new 63854df8f5f update dev_join to pre calculate bucket num (#25663)
new 7a1d112f3ba support right anti/semi/outer join (#25785)
new 90b226c08e1 fix tpch some bug of right semi/anti join (#25896)
new 0b2e1748ec2 update
new bf503464d25 update
new 9eecb95dd05 fix some bug of tpch (#25931)
new 922134f3ce0 update
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (166bf53fdda)
\
N -- N -- N refs/heads/dev_join (922134f3ce0)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 10 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.asf.yaml | 1 +
be/src/agent/agent_server.cpp | 13 +-
be/src/agent/agent_server.h | 5 +-
be/src/agent/task_worker_pool.cpp | 3 -
be/src/agent/topic_listener.h | 11 +-
be/src/agent/topic_subscriber.cpp | 40 +---
be/src/agent/topic_subscriber.h | 16 +-
be/src/agent/user_resource_listener.cpp | 105 ---------
.../types.h => agent/workload_group_listener.cpp} | 39 ++-
...source_listener.h => workload_group_listener.h} | 26 +-
be/src/apache-orc | 2 +-
be/src/exec/exec_node.cpp | 7 +-
be/src/exprs/create_predicate_function.h | 4 +-
be/src/olap/delete_handler.cpp | 4 +
be/src/olap/key_coder.cpp | 2 +
be/src/olap/olap_common.h | 2 +
be/src/olap/predicate_creator.h | 18 ++
be/src/olap/rowset/segment_v2/encoding_info.cpp | 6 +
.../inverted_index/query/conjunction_query.cpp | 10 +-
be/src/olap/rowset/segment_v2/zone_map_index.cpp | 2 +
be/src/olap/schema.cpp | 6 +
be/src/olap/tablet_schema.cpp | 14 ++
be/src/olap/types.cpp | 2 +
be/src/olap/types.h | 109 ++++++++-
be/src/olap/utils.cpp | 20 ++
be/src/olap/utils.h | 4 +
be/src/pipeline/exec/scan_operator.cpp | 3 +-
be/src/pipeline/pipeline_fragment_context.cpp | 24 +-
be/src/pipeline/pipeline_fragment_context.h | 2 +-
be/src/pipeline/pipeline_x/dependency.h | 6 +-
.../local_exchange_sink_operator.cpp | 47 ++--
.../local_exchange/local_exchange_sink_operator.h | 6 +-
.../local_exchange_source_operator.cpp | 21 +-
.../local_exchange_source_operator.h | 1 +
be/src/pipeline/pipeline_x/operator.cpp | 1 +
be/src/pipeline/pipeline_x/operator.h | 6 +-
.../pipeline_x/pipeline_x_fragment_context.cpp | 1 -
be/src/pipeline/task_scheduler.cpp | 17 +-
be/src/runtime/define_primitive_type.h | 2 +
be/src/runtime/fragment_mgr.cpp | 25 +-
be/src/runtime/plan_fragment_executor.cpp | 18 +-
be/src/runtime/plan_fragment_executor.h | 2 +
be/src/runtime/primitive_type.cpp | 24 ++
be/src/runtime/primitive_type.h | 15 +-
be/src/runtime/query_context.h | 8 +-
be/src/runtime/runtime_state.h | 2 +-
be/src/runtime/task_group/task_group_manager.cpp | 50 ++++
be/src/runtime/task_group/task_group_manager.h | 2 +
be/src/service/backend_service.h | 5 +
be/src/util/debug_points.h | 39 ++-
be/src/util/debug_util.cpp | 4 +-
be/src/util/debug_util.h | 2 +-
be/src/util/mysql_row_buffer.cpp | 14 ++
be/src/util/mysql_row_buffer.h | 4 +
be/src/util/types.h | 6 +
be/src/vec/columns/columns_number.h | 3 +
be/src/vec/columns/predicate_column.h | 8 +
be/src/vec/common/format_ip.h | 3 +-
be/src/vec/common/uint128.h | 6 +
be/src/vec/core/call_on_type_index.h | 7 +
be/src/vec/core/types.h | 10 +
be/src/vec/data_types/data_type.cpp | 4 +
be/src/vec/data_types/data_type_factory.cpp | 26 ++
be/src/vec/data_types/data_type_ipv4.cpp | 92 ++++++++
be/src/vec/data_types/data_type_ipv4.h | 75 ++++++
be/src/vec/data_types/data_type_ipv6.cpp | 72 ++++++
be/src/vec/data_types/data_type_ipv6.h | 86 +++++++
.../vec/data_types/serde/data_type_ipv4_serde.cpp | 53 +++++
be/src/vec/data_types/serde/data_type_ipv4_serde.h | 53 +++++
.../vec/data_types/serde/data_type_ipv6_serde.cpp | 53 +++++
be/src/vec/data_types/serde/data_type_ipv6_serde.h | 56 +++++
be/src/vec/exec/scan/scanner_scheduler.h | 11 +-
be/src/vec/exec/scan/vscan_node.cpp | 2 +-
be/src/vec/exprs/vexpr.cpp | 11 +
be/src/vec/exprs/vexpr.h | 16 +-
be/src/vec/functions/function.h | 7 +-
be/src/vec/functions/function_case.h | 4 +-
be/src/vec/functions/function_cast.h | 37 ++-
be/src/vec/functions/functions_comparison.h | 2 +-
be/src/vec/io/io_helper.h | 28 +++
be/src/vec/olap/olap_data_convertor.cpp | 8 +-
be/src/vec/runtime/ipv4_value.h | 124 ++++++++++
be/src/vec/runtime/ipv6_value.h | 262 +++++++++++++++++++++
be/src/vec/runtime/vdata_stream_mgr.cpp | 13 +-
be/src/vec/runtime/vdata_stream_recvr.cpp | 7 +-
be/test/util/debug_points_test.cpp | 29 ++-
.../hive/scripts/create_preinstalled_table.hql | 19 ++
.../orc_table/orc_decimal_table/orc_decimal_table | Bin 0 -> 1169 bytes
.../data-operate/update-delete/partial-update.md | 10 +
.../data-operate/update-delete/partial-update.md | 7 +
.../org/apache/doris/catalog/PrimitiveType.java | 42 ++++
.../java/org/apache/doris/catalog/ScalarType.java | 4 +
.../main/java/org/apache/doris/catalog/Type.java | 97 +++++++-
.../main/java/org/apache/doris/common/Config.java | 4 +-
.../antlr4/org/apache/doris/nereids/DorisLexer.g4 | 2 +
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 2 +
fe/fe-core/src/main/cup/sql_parser.cup | 6 +
.../org/apache/doris/analysis/BinaryPredicate.java | 26 ++
.../java/org/apache/doris/analysis/ExportStmt.java | 22 +-
.../org/apache/doris/analysis/IPv4Literal.java | 146 ++++++++++++
.../org/apache/doris/analysis/IPv6Literal.java | 111 +++++++++
.../org/apache/doris/analysis/LiteralExpr.java | 6 +
.../org/apache/doris/analysis/StringLiteral.java | 38 +++
.../java/org/apache/doris/catalog/Database.java | 9 +-
.../main/java/org/apache/doris/catalog/Env.java | 11 +
.../apache/doris/clone/LoadStatisticForTag.java | 55 ++++-
.../org/apache/doris/clone/TabletSchedCtx.java | 70 ++++--
.../org/apache/doris/clone/TabletScheduler.java | 17 ++
.../doris/common/profile/ExecutionProfile.java | 19 +-
.../doris/common/publish/AckResponseHandler.java | 13 +-
.../doris/common/publish/TopicPublisher.java | 21 +-
.../doris/common/publish/TopicPublisherThread.java | 121 ++++++++++
...nseHandler.java => WorkloadGroupPublisher.java} | 29 +--
.../apache/doris/common/util/DebugPointUtil.java | 26 ++
.../org/apache/doris/load/ExportTaskExecutor.java | 1 +
.../nereids/rules/analysis/BindExpression.java | 18 +-
.../doris/nereids/trees/expressions/Add.java | 4 +-
.../doris/nereids/trees/expressions/Subtract.java | 4 +-
.../trees/expressions/literal/IPv4Literal.java | 93 ++++++++
.../trees/expressions/literal/IPv6Literal.java | 71 ++++++
.../nereids/trees/expressions/literal/Literal.java | 8 +
.../expressions/visitor/ExpressionVisitor.java | 10 +
.../trees/plans/commands/ExportCommand.java | 18 +-
.../org/apache/doris/nereids/txn/Transaction.java | 2 +-
.../org/apache/doris/nereids/types/DataType.java | 18 ++
.../org/apache/doris/nereids/types/IPv4Type.java | 69 ++++++
.../org/apache/doris/nereids/types/IPv6Type.java | 69 ++++++
.../doris/nereids/util/TypeCoercionUtils.java | 18 ++
.../main/java/org/apache/doris/qe/Coordinator.java | 55 ++++-
.../java/org/apache/doris/qe/QeProcessorImpl.java | 16 +-
.../java/org/apache/doris/qe/SimpleScheduler.java | 4 -
.../java/org/apache/doris/qe/StmtExecutor.java | 11 +-
.../resource/workloadgroup/WorkloadGroup.java | 12 +
.../resource/workloadgroup/WorkloadGroupMgr.java | 15 ++
.../apache/doris/statistics/AnalysisManager.java | 17 +-
fe/fe-core/src/main/jflex/sql_scanner.flex | 2 +
.../org/apache/doris/common/GenericPoolTest.java | 7 +
.../doris/common/util/DebugPointUtilTest.java | 6 +
.../doris/nereids/util/TypeCoercionUtilsTest.java | 4 +-
.../apache/doris/utframe/MockedBackendFactory.java | 7 +
gensrc/proto/types.proto | 2 +
gensrc/thrift/AgentService.thrift | 3 +-
gensrc/thrift/BackendService.thrift | 20 ++
gensrc/thrift/Exprs.thrift | 13 +
gensrc/thrift/Types.thrift | 4 +-
regression-test/data/correctness_p0/test_avg.out | 105 ++++++++-
.../data/datatype_p0/ip/test_data/test.csv | 100 ++++++++
.../data/datatype_p0/ip/test_ip_crud.out | 54 +++++
.../data/datatype_p0/ip/test_ip_implicit_cast.out | 7 +
.../data/datatype_p0/ip/test_ip_in_predicate.out | 19 ++
.../data/datatype_p0/ip/test_ip_stream_load.out | 102 ++++++++
.../data/external_table_p0/hive/test_hive_orc.out | 18 ++
.../datetime_functions/test_date_function.out | 4 +
.../datetime_functions/test_date_function.out | 3 -
.../data/types/test_show_data_types.out | 2 +
.../suites/correctness_p0/test_avg.groovy | 3 +-
.../suites/datatype_p0/ip/test_ip_crud.groovy | 105 +++++++++
.../datatype_p0/ip/test_ip_implicit_cast.groovy | 46 ++++
.../datatype_p0/ip/test_ip_in_predicate.groovy | 47 ++++
.../datatype_p0/ip/test_ip_stream_load.groovy | 64 +++++
.../external_table_p0/hive/test_hive_orc.groovy | 10 +
.../datetime_functions/test_date_function.groovy | 48 ++--
.../suites/nereids_syntax_p0/analyze_agg.groovy | 6 +-
.../datetime_functions/test_date_function.groovy | 1 -
.../ssb_unique_load_zstd}/ddl/customer_load.sql | 0
.../ddl/customer_part_delete.sql | 2 +-
.../ddl/customer_sequence_create.sql | 2 +-
.../ssb_unique_load_zstd}/ddl/date_load.sql | 0
.../ssb_unique_load_zstd/ddl/date_part_delete.sql | 2 +-
.../ddl/date_sequence_create.sql | 2 +-
.../ssb_unique_load_zstd}/ddl/lineorder_load.sql | 0
.../ddl/lineorder_part_delete.sql | 2 +-
.../ddl/lineorder_sequence_create.sql | 2 +-
.../ssb_unique_load_zstd}/ddl/part_load.sql | 0
.../ssb_unique_load_zstd/ddl/part_part_delete.sql | 2 +-
.../ddl/part_sequence_create.sql | 2 +-
.../ssb_unique_load_zstd}/ddl/supplier_load.sql | 0
.../ddl/supplier_part_delete.sql | 2 +-
.../ddl/supplier_sequence_create.sql | 2 +-
.../four/load_four_step.groovy | 122 +++++-----
.../ssb_unique_load_zstd/one/load_one_step.groovy | 70 +++---
.../three/load_three_step.groovy | 84 ++++---
.../ssb_unique_load_zstd/two/load_two_step.groovy | 74 +++---
183 files changed, 3985 insertions(+), 659 deletions(-)
delete mode 100644 be/src/agent/user_resource_listener.cpp
copy be/src/{util/types.h => agent/workload_group_listener.cpp} (50%)
rename be/src/agent/{user_resource_listener.h => workload_group_listener.h}
(54%)
create mode 100644 be/src/vec/data_types/data_type_ipv4.cpp
create mode 100644 be/src/vec/data_types/data_type_ipv4.h
create mode 100755 be/src/vec/data_types/data_type_ipv6.cpp
create mode 100755 be/src/vec/data_types/data_type_ipv6.h
create mode 100644 be/src/vec/data_types/serde/data_type_ipv4_serde.cpp
create mode 100644 be/src/vec/data_types/serde/data_type_ipv4_serde.h
create mode 100644 be/src/vec/data_types/serde/data_type_ipv6_serde.cpp
create mode 100644 be/src/vec/data_types/serde/data_type_ipv6_serde.h
create mode 100644 be/src/vec/runtime/ipv4_value.h
create mode 100644 be/src/vec/runtime/ipv6_value.h
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/orc_table/orc_decimal_table/orc_decimal_table
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/IPv4Literal.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/IPv6Literal.java
copy be/src/agent/topic_listener.h =>
fe/fe-core/src/main/java/org/apache/doris/common/publish/TopicPublisher.java
(60%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/common/publish/TopicPublisherThread.java
copy
fe/fe-core/src/main/java/org/apache/doris/common/publish/{AckResponseHandler.java
=> WorkloadGroupPublisher.java} (59%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/literal/IPv4Literal.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/literal/IPv6Literal.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/types/IPv4Type.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/types/IPv6Type.java
create mode 100644 regression-test/data/datatype_p0/ip/test_data/test.csv
create mode 100644 regression-test/data/datatype_p0/ip/test_ip_crud.out
create mode 100644
regression-test/data/datatype_p0/ip/test_ip_implicit_cast.out
create mode 100644 regression-test/data/datatype_p0/ip/test_ip_in_predicate.out
create mode 100644 regression-test/data/datatype_p0/ip/test_ip_stream_load.out
create mode 100644 regression-test/suites/datatype_p0/ip/test_ip_crud.groovy
create mode 100644
regression-test/suites/datatype_p0/ip/test_ip_implicit_cast.groovy
create mode 100644
regression-test/suites/datatype_p0/ip/test_ip_in_predicate.groovy
create mode 100644
regression-test/suites/datatype_p0/ip/test_ip_stream_load.groovy
copy regression-test/suites/{ssb_sf100_p2 =>
unique_with_mow_p2/ssb_unique_load_zstd}/ddl/customer_load.sql (100%)
copy regression-test/suites/{ssb_sf100_p2 =>
unique_with_mow_p2/ssb_unique_load_zstd}/ddl/date_load.sql (100%)
copy regression-test/suites/{ssb_sf100_p2 =>
unique_with_mow_p2/ssb_unique_load_zstd}/ddl/lineorder_load.sql (100%)
copy regression-test/suites/{ssb_sf100_p2 =>
unique_with_mow_p2/ssb_unique_load_zstd}/ddl/part_load.sql (100%)
copy regression-test/suites/{ssb_sf100_p2 =>
unique_with_mow_p2/ssb_unique_load_zstd}/ddl/supplier_load.sql (100%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
