This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new fa2a33592a2 [doc](iceberg) fix iceberg column type map error. (#567)
fa2a33592a2 is described below
commit fa2a33592a23b3767f1bec92eac095b4e133e317
Author: daidai <[email protected]>
AuthorDate: Tue Apr 30 11:05:14 2024 +0800
[doc](iceberg) fix iceberg column type map error. (#567)
1. add column mapping for iceberg
2. add orc/equality delete for iceberg
---
docs/lakehouse/datalake-analytics/iceberg.md | 27 +++++++++++++++++++---
.../lakehouse/datalake-analytics/iceberg.md | 27 ++++++++++++++++++++--
.../version-1.2/lakehouse/multi-catalog/iceberg.md | 21 ++++++++++++++++-
.../version-2.0/lakehouse/datalake/iceberg.md | 22 ++++++++++++++++--
.../lakehouse/datalake-analytics/iceberg.md | 26 +++++++++++++++++++--
.../version-1.2/lakehouse/multi-catalog/iceberg.md | 22 +++++++++++++++++-
.../version-2.0/lakehouse/datalake/iceberg.md | 21 ++++++++++++++++-
.../lakehouse/datalake-analytics/iceberg.md | 27 +++++++++++++++++++---
8 files changed, 178 insertions(+), 15 deletions(-)
diff --git a/docs/lakehouse/datalake-analytics/iceberg.md
b/docs/lakehouse/datalake-analytics/iceberg.md
index 5941dcfd6af..3c6ea5ce8d4 100644
--- a/docs/lakehouse/datalake-analytics/iceberg.md
+++ b/docs/lakehouse/datalake-analytics/iceberg.md
@@ -29,8 +29,11 @@ under the License.
## Limitations
-1. Support Iceberg V1/V2.
-2. The V2 format only supports Position Delete, not Equality Delete.
+1. Supports Iceberg V1/V2.
+2. Supports Position Delete
+3. Supports Equality Delete since 2.1.3
+4. Supports Parquet format.
+5. Supports ORC format since 2.1.3.
## Create Catalog
@@ -215,7 +218,25 @@ The data is stored on Huawei Cloud OBS:
## Column type mapping
-Consistent with Hive Catalog, please refer to the **column type mapping**
section in [Hive Catalog](./hive.md).
+| Iceberg Type | Doris Type |
+|--------------------------------------------|--------------|
+| boolean | boolean |
+| int | int |
+| long | bigint |
+| float | float |
+| double | double |
+| decimal(p,s) | decimal(p,s) |
+| date | date |
+| uuid | string |
+| timestamp (Timestamp without timezone) | datetime(6) |
+| timestamptz (Timestamp with timezone) | datetime(6) |
+| string | string |
+| fixed(L) | char(L) |
+| binary | string |
+| struct | struct (since 2.1.3) |
+| map | map (since 2.1.3) |
+| list | array |
+| time | unsupported |
## Time Travel
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/lakehouse/datalake-analytics/iceberg.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/lakehouse/datalake-analytics/iceberg.md
index 032fcb9eacf..2aed5c8cd93 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/lakehouse/datalake-analytics/iceberg.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/lakehouse/datalake-analytics/iceberg.md
@@ -30,7 +30,11 @@ under the License.
## 使用限制
1. 支持 Iceberg V1/V2 表格式。
-2. V2 格式仅支持 Position Delete 方式，不支持 Equality Delete。
+2. 支持 Position Delete。
+3. 2.1.3 版本开始支持 Equality Delete。
+4. 支持 Parquet 文件格式
+5. 2.1.3 版本开始支持 ORC 文件格式。
+
## 创建 Catalog
@@ -215,7 +219,26 @@ CREATE CATALOG iceberg PROPERTIES (
## 列类型映射
-和 Hive Catalog 一致，可参阅 [Hive Catalog](./hive.md) 中 **列类型映射** 一节。
+| Iceberg Type | Doris Type |
+|--------------------------------------------|--------------|
+| boolean | boolean |
+| int | int |
+| long | bigint |
+| float | float |
+| double | double |
+| decimal(p,s) | decimal(p,s) |
+| date | date |
+| uuid | string |
+| timestamp (Timestamp without timezone) | datetime(6) |
+| timestamptz (Timestamp with timezone) | datetime(6) |
+| string | string |
+| fixed(L) | char(L) |
+| binary | string |
+| struct | struct （2.1.3 版本开始支持） |
+| map | map （2.1.3 版本开始支持） |
+| list | array |
+| time | 不支持 |
+
## Time Travel
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.2/lakehouse/multi-catalog/iceberg.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.2/lakehouse/multi-catalog/iceberg.md
index 0cf10e23feb..28ac001f47b 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.2/lakehouse/multi-catalog/iceberg.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.2/lakehouse/multi-catalog/iceberg.md
@@ -31,6 +31,7 @@ under the License.
1. 支持 Iceberg V1/V2 表格式。
2. V2 格式仅支持 Position Delete 方式，不支持 Equality Delete。
+3. 支持 Parquet 文件格式
<version since="dev">
@@ -129,7 +130,25 @@ CREATE CATALOG iceberg PROPERTIES (
## 列类型映射
-和 Hive Catalog 一致，可参阅 [Hive Catalog](./hive.md) 中 **列类型映射** 一节。
+| Iceberg Type | Doris Type |
+|--------------------------------------------|--------------|
+| boolean | boolean |
+| int | int |
+| long | bigint |
+| float | float |
+| double | double |
+| decimal(p,s) | decimal(p,s) |
+| date | date |
+| uuid | string |
+| timestamp (Timestamp without timezone) | datetime(6) |
+| timestamptz (Timestamp with timezone) | datetime(6) |
+| string | string |
+| fixed(L) | char(L) |
+| binary | string |
+| list | array |
+| struct | 不支持 |
+| map | 不支持 |
+| time | 不支持 |
## Time Travel
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/lakehouse/datalake/iceberg.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/lakehouse/datalake/iceberg.md
index d97c5b73cb6..75769873c5f 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/lakehouse/datalake/iceberg.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/lakehouse/datalake/iceberg.md
@@ -30,8 +30,8 @@ under the License.
## 使用限制
1. 支持 Iceberg V1/V2 表格式。
-
2. V2 格式仅支持 Position Delete 方式，不支持 Equality Delete。
+3. 支持 Parquet 文件格式。
## 创建 Catalog
@@ -197,7 +197,25 @@ CREATE CATALOG iceberg PROPERTIES (
## 列类型映射
-和 Hive Catalog 一致，可参阅 [Hive Catalog](../../lakehouse/datalake/hive) 中
**列类型映射** 一节。
+| Iceberg Type | Doris Type |
+|--------------------------------------------|--------------|
+| boolean | boolean |
+| int | int |
+| long | bigint |
+| float | float |
+| double | double |
+| decimal(p,s) | decimal(p,s) |
+| date | date |
+| uuid | string |
+| timestamp (Timestamp without timezone) | datetime(6) |
+| timestamptz (Timestamp with timezone) | datetime(6) |
+| string | string |
+| fixed(L) | char(L) |
+| binary | string |
+| list | array |
+| struct | 不支持 |
+| map | 不支持 |
+| time | 不支持 |
## Time Travel
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/lakehouse/datalake-analytics/iceberg.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/lakehouse/datalake-analytics/iceberg.md
index 032fcb9eacf..ee5fd5c2aac 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/lakehouse/datalake-analytics/iceberg.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/lakehouse/datalake-analytics/iceberg.md
@@ -30,7 +30,10 @@ under the License.
## 使用限制
1. 支持 Iceberg V1/V2 表格式。
-2. V2 格式仅支持 Position Delete 方式，不支持 Equality Delete。
+2. 支持 Position Delete。
+3. 2.1.3 版本开始支持 Equality Delete。
+4. 支持 Parquet 文件格式
+5. 2.1.3 版本开始支持 ORC 文件格式。
## 创建 Catalog
@@ -215,7 +218,26 @@ CREATE CATALOG iceberg PROPERTIES (
## 列类型映射
-和 Hive Catalog 一致，可参阅 [Hive Catalog](./hive.md) 中 **列类型映射** 一节。
+| Iceberg Type | Doris Type |
+|--------------------------------------------|--------------|
+| boolean | boolean |
+| int | int |
+| long | bigint |
+| float | float |
+| double | double |
+| decimal(p,s) | decimal(p,s) |
+| date | date |
+| uuid | string |
+| timestamp (Timestamp without timezone) | datetime(6) |
+| timestamptz (Timestamp with timezone) | datetime(6) |
+| string | string |
+| fixed(L) | char(L) |
+| binary | string |
+| struct | struct （2.1.3 版本开始支持） |
+| map | map （2.1.3 版本开始支持） |
+| list | array |
+| time | 不支持 |
+
## Time Travel
diff --git a/versioned_docs/version-1.2/lakehouse/multi-catalog/iceberg.md
b/versioned_docs/version-1.2/lakehouse/multi-catalog/iceberg.md
index f4452a95a59..f94e7df8c43 100644
--- a/versioned_docs/version-1.2/lakehouse/multi-catalog/iceberg.md
+++ b/versioned_docs/version-1.2/lakehouse/multi-catalog/iceberg.md
@@ -33,6 +33,8 @@ When connecting to Iceberg, Doris:
1. Supports Iceberg V1/V2 table formats;
2. Supports Position Delete but not Equality Delete for V2 format;
+3. Supports Parquet formmat;
+
<version since="dev">
@@ -131,7 +133,25 @@ If you want to use S3 storage, the following properties
need to be set.
## Column Type Mapping
-Same as that in Hive Catalogs. See the relevant section in [Hive](./hive.md).
+| Iceberg Type | Doris Type |
+|--------------------------------------------|--------------|
+| boolean | boolean |
+| int | int |
+| long | bigint |
+| float | float |
+| double | double |
+| decimal(p,s) | decimal(p,s) |
+| date | date |
+| uuid | string |
+| timestamp (Timestamp without timezone) | datetime(6) |
+| timestamptz (Timestamp with timezone) | datetime(6) |
+| string | string |
+| fixed(L) | char(L) |
+| binary | string |
+| list | array |
+| struct | unsupported |
+| map | unsupported |
+| time | unsupported |
## Time Travel
diff --git a/versioned_docs/version-2.0/lakehouse/datalake/iceberg.md
b/versioned_docs/version-2.0/lakehouse/datalake/iceberg.md
index 99e49b217b3..21aee9fb451 100644
--- a/versioned_docs/version-2.0/lakehouse/datalake/iceberg.md
+++ b/versioned_docs/version-2.0/lakehouse/datalake/iceberg.md
@@ -31,6 +31,7 @@ under the License.
1. Support Iceberg V1/V2.
2. The V2 format only supports Position Delete, not Equality Delete.
+3. Supports Parquet format.
## Create Catalog
@@ -196,7 +197,25 @@ The data is stored on Huawei Cloud OBS:
## Column type mapping
-Consistent with Hive Catalog, please refer to the **column type mapping**
section in [Hive Catalog](./hive.md).
+| Iceberg Type | Doris Type |
+|--------------------------------------------|--------------|
+| boolean | boolean |
+| int | int |
+| long | bigint |
+| float | float |
+| double | double |
+| decimal(p,s) | decimal(p,s) |
+| date | date |
+| uuid | string |
+| timestamp (Timestamp without timezone) | datetime(6) |
+| timestamptz (Timestamp with timezone) | datetime(6) |
+| string | string |
+| fixed(L) | char(L) |
+| binary | string |
+| list | array |
+| struct | unsupported |
+| map | unsupported |
+| time | unsupported |
## Time Travel
diff --git a/versioned_docs/version-2.1/lakehouse/datalake-analytics/iceberg.md
b/versioned_docs/version-2.1/lakehouse/datalake-analytics/iceberg.md
index 5941dcfd6af..8da01d6b9aa 100644
--- a/versioned_docs/version-2.1/lakehouse/datalake-analytics/iceberg.md
+++ b/versioned_docs/version-2.1/lakehouse/datalake-analytics/iceberg.md
@@ -29,8 +29,11 @@ under the License.
## Limitations
-1. Support Iceberg V1/V2.
-2. The V2 format only supports Position Delete, not Equality Delete.
+1. Supports Iceberg V1/V2.
+2. Supports Position Delete
+3. Supports Equality Delete since 2.1.3
+4. Supports Parquet format.
+5. Supports ORC format since 2.1.3.
## Create Catalog
@@ -215,7 +218,25 @@ The data is stored on Huawei Cloud OBS:
## Column type mapping
-Consistent with Hive Catalog, please refer to the **column type mapping**
section in [Hive Catalog](./hive.md).
+| Iceberg Type | Doris Type |
+|--------------------------------------------|--------------|
+| boolean | boolean |
+| int | int |
+| long | bigint |
+| float | float |
+| double | double |
+| decimal(p,s) | decimal(p,s) |
+| date | date |
+| uuid | string |
+| timestamp (Timestamp without timezone) | datetime(6) |
+| timestamptz (Timestamp with timezone) | datetime(6) |
+| string | string |
+| fixed(L) | char(L) |
+| binary | string |
+| struct | struct (since 2.1.3) |
+| map | map (since 2.1.3) |
+| list | array |
+| time | unsupported |
## Time Travel
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
