This is an automated email from the ASF dual-hosted git repository. luzhijing pushed a commit to branch 1.2.3 in repository https://gitbox.apache.org/repos/asf/doris.git
commit 8aecf890ce8600ea1ca580d6771e166bc90e9c28 Author: luzhijing <[email protected]> AuthorDate: Sun Mar 19 11:08:05 2023 +0800 [doc](releasenote) update 1.2.3 release note --- docs/en/docs/releasenotes/release-1.2.3.md | 109 +++++++++++++++++++++++++ docs/zh-CN/docs/releasenotes/release-1.2.3.md | 111 ++++++++++++++++++++++++++ 2 files changed, 220 insertions(+) diff --git a/docs/en/docs/releasenotes/release-1.2.3.md b/docs/en/docs/releasenotes/release-1.2.3.md new file mode 100644 index 0000000000..cd9226b15e --- /dev/null +++ b/docs/en/docs/releasenotes/release-1.2.3.md @@ -0,0 +1,109 @@ +--- +{ + "title": "Release 1.2.3", + "language": "en" +} +--- + +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + +# Improvement + +### JDBC Catalog + +- Support connecting to Doris clusters through JDBC Catalog. + +Currently, Jdbc Catalog only support to use 5.x version of JDBC jar package to connect another Doris database. If you use 8.x version of JDBC jar package, the data type of column may not be matched. + +Reference: [https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc/#doris](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc/#doris) + +- Support to synchronize only the specified database through the `only_specified_database` attribute. + +- Support synchronizing table names in the form of lowercase through `lower_case_table_names` to solve the problem of case sensitivity of table names. + +Reference: [https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc) + +- Optimize the read performance of JDBC Catalog. + +### Elasticsearch Catalog + +- Support Array type mapping. + +- Support whether to push down the like expression through the `like_push_down` attribute to control the CPU overhead of the ES cluster. + +Reference: [https://doris.apache.org/docs/dev/lakehouse/multi-catalog/es](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/es) + +### Hive Catalog + +- Support Hive table default partition `_HIVE_DEFAULT_PARTITION_`. + +- Hive Metastore metadata automatic synchronization supports notification event in compressed format. + +### Dynamic Partition Improvement + +- Dynamic partition supports specifying the `storage_medium` parameter to control the storage medium of the newly added partition. + +Reference: [https://doris.apache.org/docs/dev/advanced/partition/dynamic-partition](https://doris.apache.org/docs/dev/advanced/partition/dynamic-partition) + + +### Optimize BE's Threading Model + +- Optimize BE's threading model to avoid stability problems caused by frequent thread creation and destroy. + +# Bugfix + +- Fixed issues with Merge-On-Write Unique Key tables. + +- Fixed compaction related issues. + +- Fixed some delete statement issues causing data errors. + +- Fixed several query execution errors. + +- Fixed the problem of using JDBC catalog to cause BE crash on some operating system. + +- Fixed Multi-Catalog issues. + +- Fixed memory statistics and optimization issues. + +- Fixed decimalV3 and date/datetimev2 related issues. + +- Fixed load transaction stability issues. + +- Fixed light-weight schema change issues. + +- Fixed the issue of using `datetime` type for batch partition creation. + +- Fixed the problem that a large number of failed broker loads would cause the FE memory usage to be too high. + +- Fixed the problem that stream load cannot be canceled after dropping the table. + +- Fixed querying `information_schema` timeout in some cases. + +- Fixed the problem of BE crash caused by concurrent data export using `select outfile`. + +- Fixed transactional insert operation memory leak. + +- Fixed several query/load profile issues, and supports direct download of profiles through FE web ui. + +- Fixed the problem that the BE tablet GC thread caused the IO util to be too high. + +- Fixed the problem that the commit offset is inaccurate in Kafka routine load. + diff --git a/docs/zh-CN/docs/releasenotes/release-1.2.3.md b/docs/zh-CN/docs/releasenotes/release-1.2.3.md new file mode 100644 index 0000000000..2747b358c6 --- /dev/null +++ b/docs/zh-CN/docs/releasenotes/release-1.2.3.md @@ -0,0 +1,111 @@ +--- +{ + "title": "Release 1.2.3", + "language": "zh-CN" +} +--- + +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + +在 1.2.3 版本中，Doris 团队已经修复了自 1.2.2 版本发布以来超过 200 个问题或性能改进项。同时，1.2.3 版本也作为 1.2 LTS 的迭代版本，具备更高的稳定性，建议所有用户升级到这个版本。 + + +# Improvement + +### JDBC Catalog + +- 支持通过 JDBC Catalog 连接到另一个 Doris 数据库。 + +目前 JDBC Catalog 连接 Doris 只支持用 5.x 版本的 JDBC jar 包。如果使用 8.x JDBC jar 包可能会出现列类型无法匹配问题。 + +参考文档：[https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc/#doris](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc/#doris) + +- 支持通过参数 `only_specified_database` 来同步指定的数据库。 + +- 支持通过 `lower_case_table_names` 参数控制是否以小写形式同步表名，解决表名区分大小写的问题。 + +参考文档：[https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/jdbc) + +- 优化 JDBC Catalog 的读取性能。 + +### Elasticsearch Catalog + +- 支持 Array 类型映射。 + +- 支持通过 `like_push_down` 属性下推 like 表达式来控制 ES 集群的 CPU 开销。 + +参考文档：[https://doris.apache.org/docs/dev/lakehouse/multi-catalog/es](https://doris.apache.org/docs/dev/lakehouse/multi-catalog/es) + +### Hive Catalog + +- 支持 Hive 表默认分区 `__Hive_default_partition__`。 + +- Hive Metastore 元数据自动同步支持压缩格式的通知事件。 + +### 动态分区优化 + +- 支持通过 storage_medium 参数来控制创建动态分区的默认存储介质。 + +参考文档：[https://doris.apache.org/docs/dev/advanced/partition/dynamic-partition](https://doris.apache.org/docs/dev/advanced/partition/dynamic-partition) + + +### 优化 BE 的线程模型 + +- 优化 BE 的线程模型，以避免频繁创建和销毁线程所带来的稳定性问题。 + +# Bug 修复 + +- 修复了部分 Unique Key 模型 Merge-on-Write 表的问题； + +- 修复了部分 Compaction 相关问题； + +- 修复了部分 Delete 语句导致的数据问题； + +- 修复了部分 Query 执行问题； + +- 修复了在某些操作系统上使用 JDBC Catalog 导致 BE 宕机的问题； + +- 修复了部分 Multi-Catalog 的问题； + +- 修复了部分内存统计和优化问题； + +- 修复了部分 DecimalV3 和 date/datetimev2 的相关问题。 + +- 修复了部分导入过程中的稳定性问题； + +- 修复了部分 Light Schema Change 的问题； + +- 修复了使用 `datetime` 类型创建批处理分区的问题； + +- 修复了 Broker Load 大数据量导入失败而导致的 FE 内存使用过高的问题； + +- 修复了删除表后无法取消 Stream Load 的问题； + +- 修复了某些情况下查询 `information_schema` 超时的问题； + +- 修复了使用 `select outfile` 并发数据导出导致 BE 宕机的问题； + +- 修复了事务性插入操作导致内存泄漏的问题； + +- 修复了部分查询和导入 Profile 的问题，并支持通过 FE web ui 直接下载 Profile 文件； + +- 修复了 BE Tablet GC 线程导致 IO 负载过高的问题； + +- 修复了 Kafka Routine Load 中提交 Offset 不准确的问题。 \ No newline at end of file --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
