This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new 1e3592b1a1b [opt](catalog) add serde doc (#2688)
1e3592b1a1b is described below
commit 1e3592b1a1b9c06e390cd2cc1ab2aeaaac0745f9
Author: Mingyu Chen (Rayner) <[email protected]>
AuthorDate: Fri Aug 1 00:36:35 2025 -0700
[opt](catalog) add serde doc (#2688)
---
docs/lakehouse/file-formats/text.md | 12 +++++++++---
.../current/lakehouse/file-formats/text.md | 12 +++++++++---
.../version-2.1/lakehouse/file-formats/text.md | 12 +++++++++---
.../version-3.0/lakehouse/file-formats/text.md | 12 +++++++++---
versioned_docs/version-2.1/lakehouse/file-formats/text.md | 12 +++++++++---
versioned_docs/version-3.0/lakehouse/file-formats/text.md | 12 +++++++++---
6 files changed, 54 insertions(+), 18 deletions(-)
diff --git a/docs/lakehouse/file-formats/text.md
b/docs/lakehouse/file-formats/text.md
index 76ec1b05ef7..202123ff6da 100644
--- a/docs/lakehouse/file-formats/text.md
+++ b/docs/lakehouse/file-formats/text.md
@@ -13,7 +13,11 @@ This document introduces the support for reading and writing
text file formats i
Supports reading Hive tables in the
`org.apache.hadoop.mapred.TextInputFormat` format.
- Supports reading Hive tables in the
`org.apache.hadoop.hive.serde2.OpenCSVSerde` format. (Supported from version
2.1.7)
+ Support following SerDes:
+
+ - `org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe`
+ - `org.apache.hadoop.hive.serde2.OpenCSVSerde` (Since 2.1.7)
+ - `org.apache.hadoop.hive.serde2.MultiDelimitSerDe` (Since 3.1.0)
* Table Valued Function
@@ -40,12 +44,14 @@ This document introduces the support for reading and
writing text file formats i
### Catalog
-- Hive table in `org.apache.hive.hcatalog.data.JsonSerDe` format (supported
since version 3.0.4)
+- `org.apache.hadoop.hive.serde2.JsonSerDe` (Since 3.0.4)
+
+- `org.apache.hive.hcatalog.data.JsonSerDe` (Since 3.0.4)
1. Supports both primitive and complex types.
2. Does not support the `timestamp.formats` SERDEPROPERTIES.
-- Hive table in
[`org.openx.data.jsonserde.JsonSerDe`](https://github.com/rcongiu/Hive-JSON-Serde)
format (supported since version 3.0.6)
+- Hive table in
[`org.openx.data.jsonserde.JsonSerDe`](https://github.com/rcongiu/Hive-JSON-Serde)
(Since 3.0.6)
1. Supports both primitive and complex types.
2. SERDEPROPERTIES: Only
[`ignore.malformed.json`](https://github.com/rcongiu/Hive-JSON-Serde?tab=readme-ov-file#importing-malformed-data)
is supported and behaves the same as in this JsonSerDe. Other SERDEPROPERTIES
are not effective.
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/lakehouse/file-formats/text.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/lakehouse/file-formats/text.md
index 24948267873..9f7fa53a615 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/lakehouse/file-formats/text.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/lakehouse/file-formats/text.md
@@ -13,7 +13,11 @@
支持读取 `org.apache.hadoop.mapred.TextInputFormat` 格式的 Hive 表。
- 支持读取 `org.apache.hadoop.hive.serde2.OpenCSVSerde` 格式的 Hive 表。（2.1.7 版本支持）
+ 支持以下 Serde：
+
+ - `org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe`
+ - `org.apache.hadoop.hive.serde2.OpenCSVSerde` (2.1.7 版本支持)
+ - `org.apache.hadoop.hive.serde2.MultiDelimitSerDe` (3.1.0 版本支持)
* Table Valued Function
@@ -47,12 +51,14 @@
### Catalog
-- `org.apache.hive.hcatalog.data.JsonSerDe` 格式的 Hive 表（自 3.0.4 版本支持）
+- `org.apache.hadoop.hive.serde2.JsonSerDe`（3.0.4 版本支持）
+
+- `org.apache.hive.hcatalog.data.JsonSerDe`（3.0.4 版本支持）
1. 支持普通类型和复杂类型。
2. 不支持 `timestamp.formats` SERDEPROPERTIES
--
[`org.openx.data.jsonserde.JsonSerDe`](https://github.com/rcongiu/Hive-JSON-Serde)
格式的 Hive 表（自 3.0.6 版本支持）
+-
[`org.openx.data.jsonserde.JsonSerDe`](https://github.com/rcongiu/Hive-JSON-Serde)（3.0.6
版本支持）
1. 支持普通类型和复杂类型。
2. SERDEPROPERTIES: 只支持
[`ignore.malformed.json`](https://github.com/rcongiu/Hive-JSON-Serde?tab=readme-ov-file#importing-malformed-data)
且行为与该 JsonSerDe 一致，其他 SERDEPROPERTIES 不生效。
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/lakehouse/file-formats/text.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/lakehouse/file-formats/text.md
index 24948267873..9f7fa53a615 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/lakehouse/file-formats/text.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/lakehouse/file-formats/text.md
@@ -13,7 +13,11 @@
支持读取 `org.apache.hadoop.mapred.TextInputFormat` 格式的 Hive 表。
- 支持读取 `org.apache.hadoop.hive.serde2.OpenCSVSerde` 格式的 Hive 表。（2.1.7 版本支持）
+ 支持以下 Serde：
+
+ - `org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe`
+ - `org.apache.hadoop.hive.serde2.OpenCSVSerde` (2.1.7 版本支持)
+ - `org.apache.hadoop.hive.serde2.MultiDelimitSerDe` (3.1.0 版本支持)
* Table Valued Function
@@ -47,12 +51,14 @@
### Catalog
-- `org.apache.hive.hcatalog.data.JsonSerDe` 格式的 Hive 表（自 3.0.4 版本支持）
+- `org.apache.hadoop.hive.serde2.JsonSerDe`（3.0.4 版本支持）
+
+- `org.apache.hive.hcatalog.data.JsonSerDe`（3.0.4 版本支持）
1. 支持普通类型和复杂类型。
2. 不支持 `timestamp.formats` SERDEPROPERTIES
--
[`org.openx.data.jsonserde.JsonSerDe`](https://github.com/rcongiu/Hive-JSON-Serde)
格式的 Hive 表（自 3.0.6 版本支持）
+-
[`org.openx.data.jsonserde.JsonSerDe`](https://github.com/rcongiu/Hive-JSON-Serde)（3.0.6
版本支持）
1. 支持普通类型和复杂类型。
2. SERDEPROPERTIES: 只支持
[`ignore.malformed.json`](https://github.com/rcongiu/Hive-JSON-Serde?tab=readme-ov-file#importing-malformed-data)
且行为与该 JsonSerDe 一致，其他 SERDEPROPERTIES 不生效。
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/lakehouse/file-formats/text.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/lakehouse/file-formats/text.md
index 24948267873..9f7fa53a615 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/lakehouse/file-formats/text.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/lakehouse/file-formats/text.md
@@ -13,7 +13,11 @@
支持读取 `org.apache.hadoop.mapred.TextInputFormat` 格式的 Hive 表。
- 支持读取 `org.apache.hadoop.hive.serde2.OpenCSVSerde` 格式的 Hive 表。（2.1.7 版本支持）
+ 支持以下 Serde：
+
+ - `org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe`
+ - `org.apache.hadoop.hive.serde2.OpenCSVSerde` (2.1.7 版本支持)
+ - `org.apache.hadoop.hive.serde2.MultiDelimitSerDe` (3.1.0 版本支持)
* Table Valued Function
@@ -47,12 +51,14 @@
### Catalog
-- `org.apache.hive.hcatalog.data.JsonSerDe` 格式的 Hive 表（自 3.0.4 版本支持）
+- `org.apache.hadoop.hive.serde2.JsonSerDe`（3.0.4 版本支持）
+
+- `org.apache.hive.hcatalog.data.JsonSerDe`（3.0.4 版本支持）
1. 支持普通类型和复杂类型。
2. 不支持 `timestamp.formats` SERDEPROPERTIES
--
[`org.openx.data.jsonserde.JsonSerDe`](https://github.com/rcongiu/Hive-JSON-Serde)
格式的 Hive 表（自 3.0.6 版本支持）
+-
[`org.openx.data.jsonserde.JsonSerDe`](https://github.com/rcongiu/Hive-JSON-Serde)（3.0.6
版本支持）
1. 支持普通类型和复杂类型。
2. SERDEPROPERTIES: 只支持
[`ignore.malformed.json`](https://github.com/rcongiu/Hive-JSON-Serde?tab=readme-ov-file#importing-malformed-data)
且行为与该 JsonSerDe 一致，其他 SERDEPROPERTIES 不生效。
diff --git a/versioned_docs/version-2.1/lakehouse/file-formats/text.md
b/versioned_docs/version-2.1/lakehouse/file-formats/text.md
index 76ec1b05ef7..202123ff6da 100644
--- a/versioned_docs/version-2.1/lakehouse/file-formats/text.md
+++ b/versioned_docs/version-2.1/lakehouse/file-formats/text.md
@@ -13,7 +13,11 @@ This document introduces the support for reading and writing
text file formats i
Supports reading Hive tables in the
`org.apache.hadoop.mapred.TextInputFormat` format.
- Supports reading Hive tables in the
`org.apache.hadoop.hive.serde2.OpenCSVSerde` format. (Supported from version
2.1.7)
+ Support following SerDes:
+
+ - `org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe`
+ - `org.apache.hadoop.hive.serde2.OpenCSVSerde` (Since 2.1.7)
+ - `org.apache.hadoop.hive.serde2.MultiDelimitSerDe` (Since 3.1.0)
* Table Valued Function
@@ -40,12 +44,14 @@ This document introduces the support for reading and
writing text file formats i
### Catalog
-- Hive table in `org.apache.hive.hcatalog.data.JsonSerDe` format (supported
since version 3.0.4)
+- `org.apache.hadoop.hive.serde2.JsonSerDe` (Since 3.0.4)
+
+- `org.apache.hive.hcatalog.data.JsonSerDe` (Since 3.0.4)
1. Supports both primitive and complex types.
2. Does not support the `timestamp.formats` SERDEPROPERTIES.
-- Hive table in
[`org.openx.data.jsonserde.JsonSerDe`](https://github.com/rcongiu/Hive-JSON-Serde)
format (supported since version 3.0.6)
+- Hive table in
[`org.openx.data.jsonserde.JsonSerDe`](https://github.com/rcongiu/Hive-JSON-Serde)
(Since 3.0.6)
1. Supports both primitive and complex types.
2. SERDEPROPERTIES: Only
[`ignore.malformed.json`](https://github.com/rcongiu/Hive-JSON-Serde?tab=readme-ov-file#importing-malformed-data)
is supported and behaves the same as in this JsonSerDe. Other SERDEPROPERTIES
are not effective.
diff --git a/versioned_docs/version-3.0/lakehouse/file-formats/text.md
b/versioned_docs/version-3.0/lakehouse/file-formats/text.md
index 76ec1b05ef7..202123ff6da 100644
--- a/versioned_docs/version-3.0/lakehouse/file-formats/text.md
+++ b/versioned_docs/version-3.0/lakehouse/file-formats/text.md
@@ -13,7 +13,11 @@ This document introduces the support for reading and writing
text file formats i
Supports reading Hive tables in the
`org.apache.hadoop.mapred.TextInputFormat` format.
- Supports reading Hive tables in the
`org.apache.hadoop.hive.serde2.OpenCSVSerde` format. (Supported from version
2.1.7)
+ Support following SerDes:
+
+ - `org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe`
+ - `org.apache.hadoop.hive.serde2.OpenCSVSerde` (Since 2.1.7)
+ - `org.apache.hadoop.hive.serde2.MultiDelimitSerDe` (Since 3.1.0)
* Table Valued Function
@@ -40,12 +44,14 @@ This document introduces the support for reading and
writing text file formats i
### Catalog
-- Hive table in `org.apache.hive.hcatalog.data.JsonSerDe` format (supported
since version 3.0.4)
+- `org.apache.hadoop.hive.serde2.JsonSerDe` (Since 3.0.4)
+
+- `org.apache.hive.hcatalog.data.JsonSerDe` (Since 3.0.4)
1. Supports both primitive and complex types.
2. Does not support the `timestamp.formats` SERDEPROPERTIES.
-- Hive table in
[`org.openx.data.jsonserde.JsonSerDe`](https://github.com/rcongiu/Hive-JSON-Serde)
format (supported since version 3.0.6)
+- Hive table in
[`org.openx.data.jsonserde.JsonSerDe`](https://github.com/rcongiu/Hive-JSON-Serde)
(Since 3.0.6)
1. Supports both primitive and complex types.
2. SERDEPROPERTIES: Only
[`ignore.malformed.json`](https://github.com/rcongiu/Hive-JSON-Serde?tab=readme-ov-file#importing-malformed-data)
is supported and behaves the same as in this JsonSerDe. Other SERDEPROPERTIES
are not effective.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
