This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch branch-0.15
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git.
from 259cc7b [ARM64] Fix some problem when compiling on ARM64 platform
(#6836) (#6872)
new b913aa1 Replace replica_allocation to replication_allocation (#6870)
new 56f01d6 [Bug][Memory Leak] Fix the issue of Catalog instance leakage
(#6895)
new 582f417 [Flink][Bug] Fix potential NPE when cancel
DorisSourceFunction (#6838)
new e83a867 [Bug] Fix bug to reject request with no SQL in
TableQueryPlanAction (#6843)
new 6d35560 [Refactor] remove unused code (#6879)
new 2efb7f9 [Bug][Binlog] Fix the number of versions may exceed the limit
during data synchronization (#6889)
new 0695671 [MetaTool]add error message when loading meta by meta tool
(#6893)
new 959b7f1 [Docs] fix urls and format in routine load docs (#6896)
new a99f2b5 [Cache][Bug] Fix sql_key of getting and updating Cache is
inconsistent (#6903)
new cef3d31 [Flink]Simplify the use of flink connector (#6892)
new 1241992 [Bug] Fix bug of decommission (#6826)
new 1c8b7df [Memory Usage] Implement segment lru cache to save memory of
BE (#6829)
new b2b39f3 [Bug] Fix bug that truncate table may change the storage
medium property (#6905)
new 20caf42 [Spark-Doris-Connector] fixed some spark-doris-connector doc
typo
new 6e388a7 Fix String type column using zonemap to filter data maybe
core dump (#6939)
new 4bb24d2 [Cache][Bug] Correct update cache timeout unit (#6888)
new 9cc9465 [Bug] Fix treat tuple_is_null_predicate is const expr cause
core problem (#6919)
new 6664aae [Bug] fix Runtime filter can't find fragment-id when
apply_filter called early (#6923)
new dd9dfba [Benchmark] Add star schema benchmark tools (#6925)
new c385536 [Enhance] Add BackendHbResponse info (#6929)
new 26a81f2 [Optimize] optimize some session variable and profile (#6920)
The 21 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/agent/cgroups_mgr.cpp | 4 +-
be/src/agent/task_worker_pool.cpp | 65 ++++--
be/src/agent/task_worker_pool.h | 3 +
be/src/common/config.h | 10 +-
be/src/exec/olap_scan_node.cpp | 8 +-
be/src/exec/tablet_sink.cpp | 32 +--
be/src/exec/tablet_sink.h | 12 +-
be/src/exprs/bloomfilter_predicate.cpp | 2 +-
be/src/exprs/runtime_filter_rpc.cpp | 4 +-
be/src/exprs/tuple_is_null_predicate.h | 3 +
be/src/olap/CMakeLists.txt | 1 +
be/src/olap/delta_writer.cpp | 3 +
be/src/olap/lru_cache.cpp | 119 ++++++++---
be/src/olap/lru_cache.h | 42 +++-
be/src/olap/olap_server.cpp | 4 +-
be/src/olap/rowset/alpha_rowset.cpp | 36 +---
be/src/olap/rowset/alpha_rowset.h | 6 +-
be/src/olap/rowset/alpha_rowset_reader.cpp | 2 +-
be/src/olap/rowset/beta_rowset.cpp | 14 +-
be/src/olap/rowset/beta_rowset.h | 5 +-
be/src/olap/rowset/beta_rowset_reader.cpp | 10 +-
be/src/olap/rowset/beta_rowset_reader.h | 5 +
be/src/olap/rowset/rowset.cpp | 4 +-
be/src/olap/rowset/rowset.h | 6 +-
be/src/olap/segment_loader.cpp | 98 +++++++++
be/src/olap/segment_loader.h | 171 ++++++++++++++++
be/src/olap/snapshot_manager.cpp | 2 +-
be/src/olap/storage_engine.cpp | 6 +-
be/src/olap/storage_engine.h | 2 +-
be/src/olap/tablet.cpp | 16 +-
be/src/olap/tablet_manager.cpp | 5 +-
be/src/olap/tablet_meta_manager.cpp | 4 +-
be/src/olap/wrapper_field.cpp | 11 +-
be/src/olap/wrapper_field.h | 4 +
be/src/runtime/data_stream_sender.cpp | 2 +-
be/src/runtime/exec_env_init.cpp | 3 +
be/src/runtime/fragment_mgr.cpp | 14 +-
be/src/runtime/fragment_mgr.h | 2 +
be/src/runtime/runtime_filter_mgr.cpp | 2 +-
be/src/service/internal_service.cpp | 2 +-
be/test/olap/lru_cache_test.cpp | 82 ++++++--
be/test/olap/rowset/beta_rowset_test.cpp | 1 +
be/test/olap/rowset/rowset_converter_test.cpp | 1 +
docs/.vuepress/sidebar/en.js | 3 +-
docs/.vuepress/sidebar/zh-CN.js | 3 +-
docs/en/administrator-guide/config/be_config.md | 15 +-
.../load-data/binlog-load-manual.md | 33 +++-
.../load-data/broker-load-manual.md | 2 +-
.../load-data/routine-load-manual.md | 6 +-
docs/en/administrator-guide/multi-tenant.md | 4 +-
docs/en/administrator-guide/running-profile.md | 4 +-
docs/en/administrator-guide/runtime-filter.md | 2 +-
docs/en/administrator-guide/variables.md | 6 +-
docs/en/best-practices/star-schema-benchmark.md | 163 +++++++++++++++
docs/en/extending-doris/flink-doris-connector.md | 107 +++++++++-
.../Create/CREATE-TABLE.md | 12 +-
.../sql-statements/Data Definition/CREATE TABLE.md | 10 +-
docs/zh-CN/administrator-guide/config/be_config.md | 17 +-
.../load-data/binlog-load-manual.md | 34 +++-
.../load-data/broker-load-manual.md | 2 +-
.../load-data/routine-load-manual.md | 4 +-
docs/zh-CN/administrator-guide/multi-tenant.md | 4 +-
docs/zh-CN/administrator-guide/running-profile.md | 4 +-
docs/zh-CN/administrator-guide/runtime-filter.md | 2 +-
docs/zh-CN/administrator-guide/variables.md | 6 +-
docs/zh-CN/best-practices/star-schema-benchmark.md | 164 +++++++++++++++
.../zh-CN/extending-doris/flink-doris-connector.md | 106 +++++++++-
.../zh-CN/extending-doris/spark-doris-connector.md | 4 +-
.../Create/CREATE-TABLE.md | 12 +-
.../sql-statements/Data Definition/CREATE TABLE.md | 10 +-
.../doris/flink/cfg/DorisExecutionOptions.java | 20 +-
.../apache/doris/flink/cfg/DorisReadOptions.java | 5 +
.../java/org/apache/doris/flink/cfg/DorisSink.java | 95 +++++++++
.../doris/flink/cfg/GenericDorisSinkFunction.java | 53 +++++
.../flink/datastream/DorisSourceFunction.java | 19 +-
.../flink/table/DorisDynamicOutputFormat.java | 77 +++++---
.../doris/flink/datastream/ScalaValueReader.scala | 3 +-
.../doris/flink/DorisOutPutFormatExample.java | 84 ++++++++
.../apache/doris/flink/DorisStreamSinkExample.java | 219 +++++++++++++++++++++
.../apache/doris/alter/SchemaChangeHandler.java | 8 +-
.../doris/analysis/ModifyPartitionClause.java | 2 +-
.../java/org/apache/doris/analysis/SetVar.java | 13 +-
.../java/org/apache/doris/backup/BackupJob.java | 8 +-
.../java/org/apache/doris/catalog/Catalog.java | 3 +-
.../java/org/apache/doris/catalog/Database.java | 4 -
.../java/org/apache/doris/catalog/OlapTable.java | 47 ++---
.../main/java/org/apache/doris/catalog/Tablet.java | 15 ++
.../apache/doris/clone/ClusterLoadStatistic.java | 7 +
.../org/apache/doris/clone/TabletSchedCtx.java | 23 ++-
.../org/apache/doris/clone/TabletScheduler.java | 7 +-
.../main/java/org/apache/doris/common/Config.java | 36 +++-
.../org/apache/doris/common/ThreadPoolManager.java | 8 +-
.../doris/http/rest/TableQueryPlanAction.java | 2 +-
.../doris/httpv2/rest/TableQueryPlanAction.java | 2 +-
.../src/main/java/org/apache/doris/load/Load.java | 20 +-
.../apache/doris/load/loadv2/BrokerLoadJob.java | 10 +-
.../load/routineload/RoutineLoadTaskScheduler.java | 6 +-
.../apache/doris/load/sync/canal/CanalConfigs.java | 3 -
.../load/sync/canal/CanalSyncDataConsumer.java | 11 +-
.../apache/doris/load/sync/canal/CanalSyncJob.java | 5 +-
.../doris/load/sync/canal/SyncCanalClient.java | 15 +-
.../org/apache/doris/master/ReportHandler.java | 4 +-
.../apache/doris/metric/DorisMetricRegistry.java | 14 +-
.../java/org/apache/doris/metric/MetricRepo.java | 26 ++-
.../org/apache/doris/planner/OlapScanNode.java | 1 +
.../main/java/org/apache/doris/qe/Coordinator.java | 2 +-
.../java/org/apache/doris/qe/GlobalVariable.java | 1 -
.../java/org/apache/doris/qe/QeProcessorImpl.java | 2 +-
.../java/org/apache/doris/qe/SessionVariable.java | 14 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 2 +-
.../org/apache/doris/qe/cache/CacheBeProxy.java | 4 +-
.../org/apache/doris/qe/cache/PartitionCache.java | 4 +-
.../java/org/apache/doris/qe/cache/SqlCache.java | 3 +-
.../org/apache/doris/system/BackendHbResponse.java | 11 ++
.../main/java/org/apache/doris/task/PushTask.java | 2 +-
.../apache/doris/catalog/ModifyBackendTagTest.java | 2 +-
.../doris/clone/TabletRepairAndBalanceTest.java | 58 ++++++
.../doris/http/TableQueryPlanActionTest.java | 40 ++++
.../org/apache/doris/qe/SessionVariablesTest.java | 4 +-
.../java/org/apache/doris/qe/VariableMgrTest.java | 2 +-
.../doris/utframe/DemoMultiBackendsTest.java | 3 +-
.../doris/broker/hdfs/FileSystemManager.java | 4 +-
gensrc/thrift/PlanNodes.thrift | 1 +
.../ssb-tools/build-ssb-dbgen.sh | 29 ++-
tools/ssb-tools/create-tables.sql | 117 +++++++++++
.../ssb-tools/doris-cluster.conf | 17 +-
tools/ssb-tools/gen-ssb-data.sh | 112 +++++++++++
tools/ssb-tools/load-dimension-data.sh | 68 +++++++
tools/ssb-tools/load-fact-data.sh | 126 ++++++++++++
tools/ssb-tools/queries/q1.1.sql | 24 +++
tools/ssb-tools/queries/q1.2.sql | 24 +++
tools/ssb-tools/queries/q1.3.sql | 25 +++
tools/ssb-tools/queries/q2.1.sql | 26 +++
tools/ssb-tools/queries/q2.2.sql | 27 +++
tools/ssb-tools/queries/q2.3.sql | 26 +++
tools/ssb-tools/queries/q3.1.sql | 28 +++
tools/ssb-tools/queries/q3.2.sql | 28 +++
tools/ssb-tools/queries/q3.3.sql | 30 +++
tools/ssb-tools/queries/q3.4.sql | 30 +++
tools/ssb-tools/queries/q4.1.sql | 30 +++
tools/ssb-tools/queries/q4.2.sql | 31 +++
tools/ssb-tools/queries/q4.3.sql | 29 +++
142 files changed, 3006 insertions(+), 422 deletions(-)
create mode 100644 be/src/olap/segment_loader.cpp
create mode 100644 be/src/olap/segment_loader.h
create mode 100644 docs/en/best-practices/star-schema-benchmark.md
create mode 100644 docs/zh-CN/best-practices/star-schema-benchmark.md
create mode 100644
extension/flink-doris-connector/src/main/java/org/apache/doris/flink/cfg/DorisSink.java
create mode 100644
extension/flink-doris-connector/src/main/java/org/apache/doris/flink/cfg/GenericDorisSinkFunction.java
create mode 100644
extension/flink-doris-connector/src/test/java/org/apache/doris/flink/DorisOutPutFormatExample.java
create mode 100644
extension/flink-doris-connector/src/test/java/org/apache/doris/flink/DorisStreamSinkExample.java
copy build-support/check-format.sh => tools/ssb-tools/build-ssb-dbgen.sh (57%)
create mode 100644 tools/ssb-tools/create-tables.sql
copy be/test/common/CMakeLists.txt => tools/ssb-tools/doris-cluster.conf (78%)
create mode 100755 tools/ssb-tools/gen-ssb-data.sh
create mode 100755 tools/ssb-tools/load-dimension-data.sh
create mode 100755 tools/ssb-tools/load-fact-data.sh
create mode 100644 tools/ssb-tools/queries/q1.1.sql
create mode 100644 tools/ssb-tools/queries/q1.2.sql
create mode 100644 tools/ssb-tools/queries/q1.3.sql
create mode 100644 tools/ssb-tools/queries/q2.1.sql
create mode 100644 tools/ssb-tools/queries/q2.2.sql
create mode 100644 tools/ssb-tools/queries/q2.3.sql
create mode 100644 tools/ssb-tools/queries/q3.1.sql
create mode 100644 tools/ssb-tools/queries/q3.2.sql
create mode 100644 tools/ssb-tools/queries/q3.3.sql
create mode 100644 tools/ssb-tools/queries/q3.4.sql
create mode 100644 tools/ssb-tools/queries/q4.1.sql
create mode 100644 tools/ssb-tools/queries/q4.2.sql
create mode 100644 tools/ssb-tools/queries/q4.3.sql
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
