This is an automated email from the ASF dual-hosted git repository.
luzhijing pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new fe1980d7f27 [docs](docs) Add release note 2.0.2 (#25375)
fe1980d7f27 is described below
commit fe1980d7f276f90d5a2c78ce1c3aef50e2add8cc
Author: Hu Yanjun <[email protected]>
AuthorDate: Mon Oct 16 20:38:45 2023 +0800
[docs](docs) Add release note 2.0.2 (#25375)
---
docs/en/docs/releasenotes/release-2.0.2.md | 157 +++++++++++++++++++
docs/sidebars.json | 1 +
docs/zh-CN/docs/releasenotes/release-2.0.2.md | 210 ++++++++++++++++++++++++++
3 files changed, 368 insertions(+)
diff --git a/docs/en/docs/releasenotes/release-2.0.2.md
b/docs/en/docs/releasenotes/release-2.0.2.md
new file mode 100644
index 00000000000..3f8e89cddf9
--- /dev/null
+++ b/docs/en/docs/releasenotes/release-2.0.2.md
@@ -0,0 +1,157 @@
+---
+{
+ "title": "Release 2.0.2",
+ "language": "en"
+}
+---
+
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Release 2.0.2
+
+Thanks to our community users and developers, 489 improvements and bug fixes
have been made in Doris 2.0.2.
+
+## Behavior Changes
+
+- [Remove json -> operator convert to json_extract
#24679](https://github.com/apache/doris/pull/24679)
+
+ Remove json '->' operator since it is conflicted with lambda function
syntax. It's a syntax sugar for function json_extract and can be replaced with
the former.
+- [Start the script to set metadata_failure_recovery
#24308](https://github.com/apache/doris/pull/24308)
+
+ Move metadata_failure_recovery from fe.conf to start_fe.sh argument to
prevent being used unexpectedly.
+- [Change ordinary type null value is \N,complex type null value is null
#24207](https://github.com/apache/doris/pull/24207)
+- [Optimize priority_ network matching logic for be
#23795](https://github.com/apache/doris/pull/23795)
+- [Fix cancel load failed because Job could not be cancelled…
#17730](https://github.com/apache/doris/pull/17730)
+
+ Allow cancel a retrying load job.
+
+## Improvements
+
+### Easier to use
+
+- [Support custom lib dir to save custom libs
#23887](https://github.com/apache/doris/pull/23887)
+
+ Add a custom_lib dir to allow users place custom lib files and custom_lib
will not be replaced.
+- [Optimize priority_ network matching logic
#23784](https://github.com/apache/doris/pull/23784)
+
+ Optimize priority_network logic to avoid error when this config is wrong or
not configured.
+- [Row policy support role #23022](https://github.com/apache/doris/pull/23022)
+
+ Support role based auth for row policy.
+
+### New optimizer Nereids statistics collection improvement
+
+- [Disable file cache while running analysis tasks.
#23663](https://github.com/apache/doris/pull/23663)
+- [Show column stats even when error occurred.
#23703](https://github.com/apache/doris/pull/23703)
+- [Support basic jdbc external table stats collection.
#23965](https://github.com/apache/doris/pull/23965)
+- [Skip unknown col stats check on __internal_scheam and information_schema
#24625](https://github.com/apache/doris/pull/24625)
+
+### Better support for JDBC, HDFS, Hive, MySQL, Max Compute, Multi-Catalog
+
+- [Support hadoop viewfs. #24168](https://github.com/apache/doris/pull/24168)
+- [Avoid calling checksum when replaying creating jdbc catalog and fix ranger
issue #22369](https://github.com/apache/doris/pull/22369)
+- [Optimize the JDBC Catalog connection error message
#23868](https://github.com/apache/doris/pull/23868)
+
+ Improve property check and error message for JDBC catalog
+- [Fix mc decimal type parse, fix wrong obj location
#24242](https://github.com/apache/doris/pull/24242)
+
+ Fix some issues for Max Compute catalog
+- [Support sql cache for hms catalog
#23391](https://github.com/apache/doris/pull/23391)
+
+ SQL cache for Hive catalog
+- [Merge hms partition events.
#22869](https://github.com/apache/doris/pull/22869)
+
+ Improve performance for Hive metadata sync
+- [Add metadata_name_ids for quickly get catlogs,db,table and add profiling
table in order to Compatible with mysql
#22702](https://github.com/apache/doris/pull/22702)
+
+### Performance for inverted index query
+
+- [Add bkd index query cache to improve perf
#23952](https://github.com/apache/doris/pull/23952)
+- [Improve performance for count on index other than match
#24678](https://github.com/apache/doris/pull/24678)
+- [Improve match performance without index
#24751](https://github.com/apache/doris/pull/24751)
+- [Optimize multiple terms conjunction query
#23871](https://github.com/apache/doris/pull/23871)
+Improve performance of MATCH_ALL
+- [Optimize unnecessary conversions
#24389](https://github.com/apache/doris/pull/24389)
+Improve performance of MATCH
+
+### Improve Array functions
+
+- [[Fix old optimizer with some array literal functions
#23630](https://github.com/apache/doris/pull/23630)
+- [Improve array union support multi params
#24327](https://github.com/apache/doris/pull/24327)
+- [Improve explode func with array nested complex type
#24455](https://github.com/apache/doris/pull/24455)
+
+## Important Bug fixes
+
+- [The parameter positions of timestamp diff function to sql are reversed
#23601](https://github.com/apache/doris/pull/23601)
+- [Fix old optimizer with some array literal functions
#23630](https://github.com/apache/doris/pull/23630)
+- [Fix query cache returns wrong result after deleting partitions.
#23555](https://github.com/apache/doris/pull/23555)
+- [Fix potential data loss when clone task's dst tablet is cooldown replica
#17644](https://github.com/apache/doris/pull/17644)
+- [Fix array map batch append data with right next_array_item_rowid
#23779](https://github.com/apache/doris/pull/23779)
+- [Fix or to in rule #23940](https://github.com/apache/doris/pull/23940)
+- [Fix 'char' function's toSql implementation is wrong
#23860](https://github.com/apache/doris/pull/23860)
+- [Record wrong best plan properties
#23973](https://github.com/apache/doris/pull/23973)
+- [Make TVF's distribution spec always be RANDOM
#24020](https://github.com/apache/doris/pull/24020)
+- [External scan use STORAGE_ANY instead of ANY as distibution
#24039](https://github.com/apache/doris/pull/24039)
+- [Runtimefilter target is not SlotReference
#23958](https://github.com/apache/doris/pull/23958)
+- [mv in select materialized_view should disable show table
#24104](https://github.com/apache/doris/pull/24104)
+- [Fail over to remote file reader if local cache failed
#24097](https://github.com/apache/doris/pull/24097)
+- [Fix revoke role operation cause fe down
#23852](https://github.com/apache/doris/pull/23852)
+- [Handle status code correctly and add a new error code `ENTRY_NOT_FOUND`
#24139](https://github.com/apache/doris/pull/24139)
+- [Fix leaky abstraction and shield the status code `END_OF_FILE` from upper
layers #24165](https://github.com/apache/doris/pull/24165)
+- [Fix bug that Read garbled files caused be crash.
#24164](https://github.com/apache/doris/pull/24164)
+- [Fix be core when user sepcified empty `column_separator` using hdfs tvf
#24369](https://github.com/apache/doris/pull/24369)
+- [Fix need to restart BE after replacing the jar package in java-udf
#24372](https://github.com/apache/doris/pull/24372)
+- [Need to call 'set_version' in nested functions
#24381](https://github.com/apache/doris/pull/24381)
+- [windown_funnel compatibility issue with multi backends
#24385](https://github.com/apache/doris/pull/24385)
+- [correlated anti join shouldn't be translated to null aware anti join
#24290](https://github.com/apache/doris/pull/24290)
+- [Change ordinary type null value is \N,complex type null value is null
#24207](https://github.com/apache/doris/pull/24207)
+- [Fix analyze failed when there are thousands of partitions.
#24521](https://github.com/apache/doris/pull/24521)
+- [Do not use enum as the data type for JavaUdfDataType.
#24460](https://github.com/apache/doris/pull/24460)
+- [Fix multi window projection issue temporarily
#24568](https://github.com/apache/doris/pull/24568)
+- [Make metadata compatible with 2.0.3
#24610](https://github.com/apache/doris/pull/24610)
+- [Select outfile column order is wrong
#24595](https://github.com/apache/doris/pull/24595)
+- [Incorrect result of semi/anti mark join
#24616](https://github.com/apache/doris/pull/24616)
+- [Fix broker read issue #24635](https://github.com/apache/doris/pull/24635)
+- [Skip unknown col stats check on __internal_scheam and information_schema
#24625](https://github.com/apache/doris/pull/24625)
+- [Fixed bug when parsing multi-character delimiters.
#24572](https://github.com/apache/doris/pull/24572)
+- [Fix timezone parse when there is no tzfile
#24578](https://github.com/apache/doris/pull/24578)
+- [We need to issue an error when starting FE without setting the Java home
environment #23943](https://github.com/apache/doris/pull/23943)
+- [Enable_unique_key_partial_update should be forwarded to master
#24697](https://github.com/apache/doris/pull/24697)
+- [Fix paimon file catalog meta issue and replication num analysis issue
#24681](https://github.com/apache/doris/pull/24681)
+- [Add more log for ingest_binlog && Fix ingest_binlog not rewrite rowset_meta
tablet_uid #24617](https://github.com/apache/doris/pull/24617)
+- [Do not abort when a disk is broken
#24692](https://github.com/apache/doris/pull/24692)
+- [colocate join could not work well on full outer join
#24700](https://github.com/apache/doris/pull/24700)
+- [Optimize unnecessary conversions
#24389](https://github.com/apache/doris/pull/24389)
+- [Optimize the reading efficiency of nullable (string) columns.
#24698](https://github.com/apache/doris/pull/24698)
+- [Fix segment cache core when output rowset is nullptr
#24778](https://github.com/apache/doris/pull/24778)
+- [Fix duplicate key in schema change
#24782](https://github.com/apache/doris/pull/24782)
+- [Make metadata compatible for future version after 2.0.2
#24800](https://github.com/apache/doris/pull/24800)
+- [Fix map/array deserialize string with quote pair
#24808](https://github.com/apache/doris/pull/24808)
+- [Failed on arm platform, with clang compiler and pch on, close #24633
#24636](https://github.com/apache/doris/pull/24636)
+- [Table column order is changed if add a column and do truncate
#24981](https://github.com/apache/doris/pull/24981)
+- [Make parser mode coarse grained by default
#24949](https://github.com/apache/doris/pull/24949)
+
+See the complete list of improvements and bug fixes on
[github](https://github.com/apache/doris/issues?q=label%3Adev%2F2.0.2-merged+is%3Aclosed)
.
+
+## Big Thanks
+
+Thanks all who contribute to this release:
+
+[@adonis0147](https://github.com/adonis0147)
[@airborne12](https://github.com/airborne12)
[@amorynan](https://github.com/amorynan)
[@AshinGau](https://github.com/AshinGau)
[@BePPPower](https://github.com/BePPPower)
[@BiteTheDDDDt](https://github.com/BiteTheDDDDt)
[@bobhan1](https://github.com/bobhan1) [@ByteYue](https://github.com/ByteYue)
[@caiconghui](https://github.com/caiconghui)
[@CalvinKirs](https://github.com/CalvinKirs)
[@cambyzju](https://github.com/cambyzju) [@ChengDaqi2023](ht [...]
diff --git a/docs/sidebars.json b/docs/sidebars.json
index b0015f1a4fb..b1ba566c560 100644
--- a/docs/sidebars.json
+++ b/docs/sidebars.json
@@ -1319,6 +1319,7 @@
"type": "category",
"label": "Release notes",
"items": [
+ "releasenotes/release-2.0.2",
"releasenotes/release-2.0.1",
"releasenotes/release-2.0.0",
"releasenotes/release-1.2.7",
diff --git a/docs/zh-CN/docs/releasenotes/release-2.0.2.md
b/docs/zh-CN/docs/releasenotes/release-2.0.2.md
new file mode 100644
index 00000000000..e8fc592bb02
--- /dev/null
+++ b/docs/zh-CN/docs/releasenotes/release-2.0.2.md
@@ -0,0 +1,210 @@
+---
+{
+ "title": "Release 2.0.2",
+ "language": "zh-CN"
+}
+---
+
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+亲爱的社区小伙伴们，Apache Doris 2.0.2 版本已于 2023 年 10 月 6
日正式发布，该版本对多个功能进行了更新优化，旨在更好地满足用户的需求。有 92 位贡献者为 Apache Doris 2.0.2
版本提交了功能优化项以及问题修复，进一步提升了系统的稳定性和性能，欢迎大家下载体验。
+
+**GitHub下载**：https://github.com/apache/doris/releases/tag/2.0.2-rc05
+
+**官网下载页**：https://doris.apache.org/download/
+
+## Behavior Changes
+
+- https://github.com/apache/doris/pull/24679
+
+ 删除与 lambda 函数语法冲突的 json“->”运算符，可以使用函数 json_extract 代替。
+
+- https://github.com/apache/doris/pull/24308
+
+将 `metadata_failure_recovery` 从 fe.conf 移动到 start_fe.sh 参数，以避免异常操作。
+
+- https://github.com/apache/doris/pull/24207
+
+对于普通类型中的 null 值使用 \n 来表示，对于复杂类型或嵌套类型的 null 值，跟 JSON 类型保持一致、采取 null 来表示。
+
+- https://github.com/apache/doris/pull/23795
+- https://github.com/apache/doris/pull/23784
+
+优化 BE 节点 priority_network 配置项的绑定策略，如果用户配置了错误的 priority_network
则直接启动失败，以避免用户错误地认为配置是正确的。如果用户没有配置 priority_network，则仅从 IPv4 列表中选择第一个 IP，而不是从所有
IP 中选择，以避免用户的服务器不支持 IPv4。
+
+- https://github.com/apache/doris/pull/17730
+
+支持取消正在重试的导入任务，修复取消加载失败的问题。
+
+## 功能优化
+
+### 易用性提升
+
+- https://github.com/apache/doris/pull/23887
+
+某些场景下，用户需要向集群中添加一些自定义的库，如 lzo.jar、orai18n.jar 等。在过去的版本中，这些 lib 文件位于 fe/lib 或
be/lib 中，但在升级集群时，lib 库将被新的 lib 库替换，导致所有自定义的 lib 库都会丢失。
+
+在新版本中，为 FE 和 BE 添加了新的自定义目录 custom_lib，用户可以在其中放置自定义 lib 文件。
+
+- https://github.com/apache/doris/pull/23022
+
+支持基于用户角色的权限访问控制，实现了行级细粒度的权限控制策略。
+
+### 改进查询优化器 Nereids 统计信息收集
+
+- https://github.com/apache/doris/pull/23663
+
+在运行 Analysis 任务时禁用 File Cache，Analysis 任务是后台任务，不应影响用户本地 File Cache 数据。
+
+- https://github.com/apache/doris/pull/23703
+
+在过去版本中，查看列的统计信息时将忽略出现错误的列。
+
+在新版本中，当 min 或 max 值未能反序列化时，查看列的统计信息时将使用 N/A 作为 min 或 max 的值并仍显示其余的统计信息，包括
count、null_count、ndv 等。
+
+- https://github.com/apache/doris/pull/23965
+
+支持 JDBC 外部表的统计信息收集。
+
+- https://github.com/apache/doris/pull/24625
+
+跳过 `__internal_schema` 和 `information_schema` 上未知列的统计信息检查。
+
+### Multi-Catalog 功能优化
+
+- https://github.com/apache/doris/pull/24168
+
+支持 Hadoop viewfs；
+
+- https://github.com/apache/doris/pull/22369
+
+优化 JDBC Catalog Checksum Replay 和 Range 相关问题；
+
+- https://github.com/apache/doris/pull/23868
+
+优化了 JDBC Catalog 的 Property 检查和错误消息提示。
+
+- https://github.com/apache/doris/pull/24242
+
+修复了 MaxCompute Catalog Decimal 类型解析问题以及使用对象存储地址错误的问题。
+
+- https://github.com/apache/doris/pull/23391
+
+支持 Hive Metastore Catalog 的 SQL Cache。
+
+- https://github.com/apache/doris/pull/22869
+
+提高了 Hive Metastore Catalog 的元数据同步性能。
+
+- https://github.com/apache/doris/pull/22702
+
+添加 metadata_name_ids 以快速获取 Catalogs、DB、Table，在创建或删除 Catalog 和 Table 时无需
Refresh Catalog， 并添加 Profiling 表从而与 MySQL 兼容。
+
+### 倒排索引性能优化
+
+- https://github.com/apache/doris/pull/23952
+
+增加 bkd 索引的查询缓存，通过缓存可以加速在命中 bkd 索引时的查询性能，在高并发场景中效果更为明显；
+
+- https://github.com/apache/doris/pull/24678
+
+提升倒排索引在 Count 算子上的查询性能；
+
+- https://github.com/apache/doris/pull/24751
+
+提升了 Match 算子在未命中索引时的效率，在测试表现中性能最高提升 60 倍；
+
+- https://github.com/apache/doris/pull/23871
+- https://github.com/apache/doris/pull/24389
+
+提升了 MATCH 和 MATCH_ALL 在倒排索引上的查询性能；
+
+### Array 函数优化
+
+- https://github.com/apache/doris/pull/23630
+
+优化了老版本查询优化器 Array 函数无法处理 Decimal 类型的问题；
+
+- https://github.com/apache/doris/pull/24327
+
+优化了 `array_union` 数组函数对多个参数的支持；
+
+- https://github.com/apache/doris/pull/24455
+
+支持通过 explode 函数来处理数组嵌套复杂类型；
+
+## Bug修复
+
+ 修复了之前版本存在的部分 Bug，使系统整体稳定性表现得到大幅提升，完整 BugFix 列表请参考 GitHub Commits 记录；
+
+- https://github.com/apache/doris/pull/23601
+- https://github.com/apache/doris/pull/23630
+- https://github.com/apache/doris/pull/23555
+- https://github.com/apache/doris/pull/17644
+- https://github.com/apache/doris/pull/23779
+- https://github.com/apache/doris/pull/23940
+- https://github.com/apache/doris/pull/23860
+- https://github.com/apache/doris/pull/23973
+- https://github.com/apache/doris/pull/24020
+- https://github.com/apache/doris/pull/24039
+- https://github.com/apache/doris/pull/23958
+- https://github.com/apache/doris/pull/24104
+- https://github.com/apache/doris/pull/24097
+- https://github.com/apache/doris/pull/23852
+- https://github.com/apache/doris/pull/24139
+- https://github.com/apache/doris/pull/24165
+- https://github.com/apache/doris/pull/24164
+- https://github.com/apache/doris/pull/24369
+- https://github.com/apache/doris/pull/24372
+- https://github.com/apache/doris/pull/24381
+- https://github.com/apache/doris/pull/24385
+- https://github.com/apache/doris/pull/24290
+- https://github.com/apache/doris/pull/24207
+- https://github.com/apache/doris/pull/24521
+- https://github.com/apache/doris/pull/24460
+- https://github.com/apache/doris/pull/24568
+- https://github.com/apache/doris/pull/24610
+- https://github.com/apache/doris/pull/24595
+- https://github.com/apache/doris/pull/24616
+- https://github.com/apache/doris/pull/24635
+- https://github.com/apache/doris/pull/24625
+- https://github.com/apache/doris/pull/24572
+- https://github.com/apache/doris/pull/24578
+- https://github.com/apache/doris/pull/23943
+- https://github.com/apache/doris/pull/24697
+- https://github.com/apache/doris/pull/24681
+- https://github.com/apache/doris/pull/24617
+- https://github.com/apache/doris/pull/24692
+- https://github.com/apache/doris/pull/24700
+- https://github.com/apache/doris/pull/24389
+- https://github.com/apache/doris/pull/24698
+- https://github.com/apache/doris/pull/24778
+- https://github.com/apache/doris/pull/24782
+- https://github.com/apache/doris/pull/24800
+- https://github.com/apache/doris/pull/24808
+- https://github.com/apache/doris/pull/24636
+- https://github.com/apache/doris/pull/24981
+- https://github.com/apache/doris/pull/24949
+
+## 致谢
+
+感谢所有在 2.0.2 版本中参与功能开发与优化以及问题修复的所有贡献者，他们分别是：
+
+[@adonis0147](https://github.com/adonis0147)
[@airborne12](https://github.com/airborne12)
[@amorynan](https://github.com/amorynan)
[@AshinGau](https://github.com/AshinGau)
[@BePPPower](https://github.com/BePPPower)
[@BiteTheDDDDt](https://github.com/BiteTheDDDDt)
[@bobhan1](https://github.com/bobhan1) [@ByteYue](https://github.com/ByteYue)
[@caiconghui](https://github.com/caiconghui)
[@CalvinKirs](https://github.com/CalvinKirs)
[@cambyzju](https://github.com/cambyzju) [@ChengDaqi2023](ht [...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
