This is an automated email from the ASF dual-hosted git repository.
JNSimba pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new cbbbe66c3f6 [docs] restructure streaming job continuous load: sink
data type mapping under each source and group prerequisites (#3937)
cbbbe66c3f6 is described below
commit cbbbe66c3f6296f5f86252f75117ac5e365dc35e
Author: wudi <[email protected]>
AuthorDate: Tue Jun 16 14:55:09 2026 +0800
[docs] restructure streaming job continuous load: sink data type mapping
under each source and group prerequisites (#3937)
## Summary
Reorganize the Continuous Load (streaming job) doc tree so the sidebar
reads more naturally:
- **Sink data type mapping under each data source.** The single
`data-type-mapping` page (which mixed MySQL and PostgreSQL tables) is
split into `data-type-mapping-mysql` and `data-type-mapping-postgresql`,
placed under their respective MySQL / PostgreSQL categories instead of
floating at the bottom.
- **Group prerequisites.** The Amazon RDS / Aurora prerequisite pages
are moved into a `Prerequisites` sub-category under each source, instead
of sitting flat next to the sync-method pages.
Per-source order is now: sync methods → Data Type Mapping →
Prerequisites.
Applied consistently across dev and 4.x, EN and ZH (content, shared
`sidebars.ts`, `versioned_sidebars`, and the `准备工作` label for the new
category).
---
.../streaming-job/continuous-load-overview.md | 2 +-
...-type-mapping.md => data-type-mapping-mysql.md} | 30 ++------------------
...-mapping.md => data-type-mapping-postgresql.md} | 33 ++--------------------
.../docusaurus-plugin-content-docs/current.json | 4 +++
.../streaming-job/continuous-load-overview.md | 2 +-
...-type-mapping.md => data-type-mapping-mysql.md} | 30 ++------------------
...-mapping.md => data-type-mapping-postgresql.md} | 33 ++--------------------
.../version-4.x.json | 4 +++
.../streaming-job/continuous-load-overview.md | 2 +-
...-type-mapping.md => data-type-mapping-mysql.md} | 30 ++------------------
.../streaming-job/data-type-mapping-postgresql.md} | 33 ++--------------------
sidebars.ts | 23 +++++++++++----
.../streaming-job/continuous-load-overview.md | 2 +-
...-type-mapping.md => data-type-mapping-mysql.md} | 30 ++------------------
.../streaming-job/data-type-mapping-postgresql.md | 33 ++--------------------
versioned_sidebars/version-4.x-sidebars.json | 25 ++++++++++++----
16 files changed, 65 insertions(+), 251 deletions(-)
diff --git
a/docs/data-operate/import/import-way/streaming-job/continuous-load-overview.md
b/docs/data-operate/import/import-way/streaming-job/continuous-load-overview.md
index 9b03d700601..f956ca1c192 100644
---
a/docs/data-operate/import/import-way/streaming-job/continuous-load-overview.md
+++
b/docs/data-operate/import/import-way/streaming-job/continuous-load-overview.md
@@ -46,7 +46,7 @@ Continuous load supports the following data sources and sync
modes:
| PostgreSQL | 14, 15, 16, 17 | [PostgreSQL CDC with SQL
Mapping](./continuous-load-postgresql-table.md) | [PostgreSQL CDC with Auto
Table Creation](./continuous-load-postgresql-database.md) | [Amazon RDS
PostgreSQL](./prerequisites/amazon-rds-postgresql.md) · [Amazon Aurora
PostgreSQL](./prerequisites/amazon-aurora-postgresql.md) |
| S3 | - | [S3 Continuous
Load](./continuous-load-s3.md) | -
| -
|
-For how upstream column types map to Doris types, see [Data Type
Mapping](./data-type-mapping.md).
+For how upstream column types map to Doris types, see Data Type Mapping for
[MySQL](./data-type-mapping-mysql.md) and
[PostgreSQL](./data-type-mapping-postgresql.md).
## How to Choose a Sync Method
diff --git
a/docs/data-operate/import/import-way/streaming-job/data-type-mapping.md
b/docs/data-operate/import/import-way/streaming-job/data-type-mapping-mysql.md
similarity index 54%
copy from docs/data-operate/import/import-way/streaming-job/data-type-mapping.md
copy to
docs/data-operate/import/import-way/streaming-job/data-type-mapping-mysql.md
index a1a6ee06daa..98bacb009c9 100644
--- a/docs/data-operate/import/import-way/streaming-job/data-type-mapping.md
+++
b/docs/data-operate/import/import-way/streaming-job/data-type-mapping-mysql.md
@@ -2,13 +2,13 @@
{
"title": "Data Type Mapping",
"language": "en",
- "description": "Data type mapping for Doris Streaming Job CDC: how
upstream MySQL and PostgreSQL types map to Doris column types during automatic
table creation, and how values are converted when written into Doris."
+ "description": "Data type mapping for Doris Streaming Job CDC: how
upstream MySQL types map to Doris column types during automatic table creation,
and how values are converted when written into Doris."
}
---
<!-- Knowledge type: Reference / data type mapping -->
-The tables below show how each upstream MySQL or PostgreSQL column type maps
to a Doris column type. There is a single mapping, shared by both sync methods
— the only difference is who creates the target table:
+The table below shows how each upstream MySQL column type maps to a Doris
column type. There is a single mapping, shared by both sync methods — the only
difference is who creates the target table:
- **Auto Table Creation Sync**: Doris reads the upstream schema and creates
the target table with these Doris column types automatically.
- **SQL Mapping Sync**: you create the target table yourself, using a
compatible Doris type for each column.
@@ -43,29 +43,3 @@ In both cases, the values are written following the same
mapping. For types that
| `ENUM` | `STRING` | Resolved to the label value |
| `SET` | `STRING` | Resolved to comma-separated labels |
| Spatial types (`GEOMETRY`, `POINT`, …) and other types | Not supported |
Auto Table Creation fails for tables with such columns; use SQL Mapping Sync
(cast in `SELECT`) or exclude the column |
-
-## PostgreSQL to Doris
-
-| PostgreSQL Type | Doris Type | Notes |
-| --- | --- | --- |
-| `bool` | `BOOLEAN` | |
-| `bit(1)` | `BOOLEAN` | |
-| `bit(n>1)` / `varbit` | `STRING` | |
-| `int2` / `smallserial` | `SMALLINT` | |
-| `int4` / `serial` | `INT` | |
-| `int8` / `bigserial` | `BIGINT` | |
-| `float4` | `FLOAT` | |
-| `float8` | `DOUBLE` | |
-| `numeric(p,s)` | `DECIMAL(min(p,38), s)` | Precision capped at 38; scale
defaults to 9 when unspecified |
-| `bpchar(n)` (i.e. `CHAR(n)`) | `CHAR` / `VARCHAR` | Length scaled ×3 for
UTF-8; `> 255` becomes `VARCHAR` |
-| `varchar` / `text` | `STRING` | PostgreSQL `varchar` maps to `STRING` (no
length) |
-| `date` | `DATE` | |
-| `timestamp` / `timestamptz` | `DATETIME(s)` | Scale 0–6; `timestamptz`
normalized to the server time zone |
-| `time` / `timetz` / `interval` | `STRING` | `timetz` keeps its
UTC-normalized offset |
-| `uuid` / `inet` / `cidr` / `macaddr` / `macaddr8` | `STRING` | |
-| `bytea` | `STRING` | Base64-encoded string |
-| `xml` / `hstore` | `STRING` | |
-| `json` / `jsonb` | `JSON` | |
-| Geometry types (`point`, `line`, `polygon`, …) | `STRING` | Serialized as a
GeoJSON string (`type` / `coordinates` / `srid`) |
-| Array types (e.g. `int4[]`, `text[]`) | `ARRAY<T>` | One-dimensional only |
-| Other / user-defined types | `STRING` | |
diff --git
a/docs/data-operate/import/import-way/streaming-job/data-type-mapping.md
b/docs/data-operate/import/import-way/streaming-job/data-type-mapping-postgresql.md
similarity index 51%
copy from docs/data-operate/import/import-way/streaming-job/data-type-mapping.md
copy to
docs/data-operate/import/import-way/streaming-job/data-type-mapping-postgresql.md
index a1a6ee06daa..bf89b8b68fd 100644
--- a/docs/data-operate/import/import-way/streaming-job/data-type-mapping.md
+++
b/docs/data-operate/import/import-way/streaming-job/data-type-mapping-postgresql.md
@@ -2,48 +2,19 @@
{
"title": "Data Type Mapping",
"language": "en",
- "description": "Data type mapping for Doris Streaming Job CDC: how
upstream MySQL and PostgreSQL types map to Doris column types during automatic
table creation, and how values are converted when written into Doris."
+ "description": "Data type mapping for Doris Streaming Job CDC: how
upstream PostgreSQL types map to Doris column types during automatic table
creation, and how values are converted when written into Doris."
}
---
<!-- Knowledge type: Reference / data type mapping -->
-The tables below show how each upstream MySQL or PostgreSQL column type maps
to a Doris column type. There is a single mapping, shared by both sync methods
— the only difference is who creates the target table:
+The table below shows how each upstream PostgreSQL column type maps to a Doris
column type. There is a single mapping, shared by both sync methods — the only
difference is who creates the target table:
- **Auto Table Creation Sync**: Doris reads the upstream schema and creates
the target table with these Doris column types automatically.
- **SQL Mapping Sync**: you create the target table yourself, using a
compatible Doris type for each column.
In both cases, the values are written following the same mapping. For types
that are not supported, see
[Limitations](./continuous-load-overview.md#limitations).
-## MySQL to Doris
-
-| MySQL Type | Doris Type | Notes |
-| --- | --- | --- |
-| `BOOLEAN` / `TINYINT(1)` | `BOOLEAN` | |
-| `TINYINT` | `TINYINT` | `UNSIGNED` → `SMALLINT` |
-| `SMALLINT` | `SMALLINT` | `UNSIGNED` → `INT` |
-| `MEDIUMINT` | `INT` | `UNSIGNED` → `INT` |
-| `INT` | `INT` | `UNSIGNED` → `BIGINT` |
-| `BIGINT` | `BIGINT` | `UNSIGNED` → `LARGEINT` |
-| `YEAR` | `SMALLINT` | |
-| `FLOAT` | `FLOAT` | |
-| `DOUBLE` | `DOUBLE` | |
-| `DECIMAL(p,s)` | `DECIMAL(p,s)` | Very high precision falls back to `STRING`
|
-| `DATE` | `DATE` | |
-| `DATETIME` | `DATETIME(s)` | Microsecond scale (0–6) preserved |
-| `TIMESTAMP` | `DATETIME(s)` | Normalized to the server time zone |
-| `TIME` | `STRING` | Serialized as a string, e.g. `12:34:56.000000` |
-| `CHAR` | `CHAR` | |
-| `VARCHAR` | `VARCHAR` | |
-| `TINYTEXT` / `TEXT` / `MEDIUMTEXT` / `LONGTEXT` | `STRING` | |
-| `BINARY` / `VARBINARY` / `TINYBLOB` / `BLOB` / `MEDIUMBLOB` / `LONGBLOB` |
`STRING` | Base64-encoded string |
-| `BIT(1)` | `BOOLEAN` | |
-| `BIT(n>1)` | `STRING` | Base64-encoded string |
-| `JSON` | `STRING` | Stored as JSON text |
-| `ENUM` | `STRING` | Resolved to the label value |
-| `SET` | `STRING` | Resolved to comma-separated labels |
-| Spatial types (`GEOMETRY`, `POINT`, …) and other types | Not supported |
Auto Table Creation fails for tables with such columns; use SQL Mapping Sync
(cast in `SELECT`) or exclude the column |
-
## PostgreSQL to Doris
| PostgreSQL Type | Doris Type | Notes |
diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current.json
b/i18n/zh-CN/docusaurus-plugin-content-docs/current.json
index 4bde38cdae4..a866aa23a31 100644
--- a/i18n/zh-CN/docusaurus-plugin-content-docs/current.json
+++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current.json
@@ -131,6 +131,10 @@
"message": "持续导入",
"description": "The label for category Continuous Load in sidebar docs"
},
+ "sidebar.docs.category.Prerequisites": {
+ "message": "准备工作",
+ "description": "The label for category Prerequisites in sidebar docs"
+ },
"sidebar.docs.category.Setup Guide": {
"message": "配置指南",
"description": "The label for category Setup Guide in sidebar docs"
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/continuous-load-overview.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/continuous-load-overview.md
index a22e3eb02b8..87e40e7e04a 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/continuous-load-overview.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/continuous-load-overview.md
@@ -46,7 +46,7 @@ Doris 支持通过 **Streaming Job** 的方式，从多种数据源持续导入
| PostgreSQL | 14、15、16、17 | [PostgreSQL CDC SQL
映射同步](./continuous-load-postgresql-table.md) | [PostgreSQL CDC
自动建表同步](./continuous-load-postgresql-database.md) | [Amazon RDS
PostgreSQL](./prerequisites/amazon-rds-postgresql.md) · [Amazon Aurora
PostgreSQL](./prerequisites/amazon-aurora-postgresql.md) |
| S3 | - | [S3 持续导入](./continuous-load-s3.md)
| -
| -
|
-上游列类型如何映射为 Doris 类型，见[数据类型映射](./data-type-mapping.md)。
+上游列类型如何映射为 Doris 类型，见 [MySQL](./data-type-mapping-mysql.md) /
[PostgreSQL](./data-type-mapping-postgresql.md) 数据类型映射。
## 如何选择同步方式
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/data-type-mapping.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/data-type-mapping-mysql.md
similarity index 53%
copy from
i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/data-type-mapping.md
copy to
i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/data-type-mapping-mysql.md
index 9a047267508..86cc7df8676 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/data-type-mapping.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/data-type-mapping-mysql.md
@@ -2,13 +2,13 @@
{
"title": "数据类型映射",
"language": "zh-CN",
- "description": "Doris Streaming Job CDC 的数据类型映射：自动建表时上游 MySQL / PostgreSQL
类型如何映射为 Doris 列类型，以及写入 Doris 时值如何转换。"
+ "description": "Doris Streaming Job CDC 的数据类型映射：自动建表时上游 MySQL 类型如何映射为
Doris 列类型，以及写入 Doris 时值如何转换。"
}
---
<!-- 知识类型: 参考 / 数据类型映射 -->
-下表展示上游 MySQL / PostgreSQL 的每个列类型如何映射为 Doris
列类型。**只有一套映射**，两种同步方式共用，区别只在于由谁创建目标表：
+下表展示上游 MySQL 的每个列类型如何映射为 Doris 列类型。**只有一套映射**，两种同步方式共用，区别只在于由谁创建目标表：
- **自动建表同步**：Doris 读取上游表结构，自动按这些 Doris 列类型创建目标表。
- **SQL 映射同步**：你自己创建目标表，每列使用兼容的 Doris 类型。
@@ -43,29 +43,3 @@
| `ENUM` | `STRING` | 解析为标签值 |
| `SET` | `STRING` | 解析为逗号分隔的标签 |
| 空间类型（`GEOMETRY`、`POINT` 等）及其他类型 | 不支持 | 含此类列的表自动建表会失败；可改用 SQL 映射同步（在
`SELECT` 中转换）或排除该列 |
-
-## PostgreSQL 到 Doris
-
-| PostgreSQL 类型 | Doris 类型 | 备注 |
-| --- | --- | --- |
-| `bool` | `BOOLEAN` | |
-| `bit(1)` | `BOOLEAN` | |
-| `bit(n>1)` / `varbit` | `STRING` | |
-| `int2` / `smallserial` | `SMALLINT` | |
-| `int4` / `serial` | `INT` | |
-| `int8` / `bigserial` | `BIGINT` | |
-| `float4` | `FLOAT` | |
-| `float8` | `DOUBLE` | |
-| `numeric(p,s)` | `DECIMAL(min(p,38), s)` | 精度上限 38；未指定 scale 时默认 9 |
-| `bpchar(n)`（即 `CHAR(n)`） | `CHAR` / `VARCHAR` | 长度 ×3 以兼容 UTF-8；`> 255` 转为
`VARCHAR` |
-| `varchar` / `text` | `STRING` | 注意：PostgreSQL `varchar` 映射为 `STRING`（不带长度） |
-| `date` | `DATE` | |
-| `timestamp` / `timestamptz` | `DATETIME(s)` | 精度 0–6；`timestamptz` 按 server
时区归一 |
-| `time` / `timetz` / `interval` | `STRING` | `timetz` 保留其 UTC 归一后的偏移量 |
-| `uuid` / `inet` / `cidr` / `macaddr` / `macaddr8` | `STRING` | |
-| `bytea` | `STRING` | Base64 编码字符串 |
-| `xml` / `hstore` | `STRING` | |
-| `json` / `jsonb` | `JSON` | |
-| 几何类型（`point`、`line`、`polygon` 等） | `STRING` | 序列化为 GeoJSON 字符串（`type` /
`coordinates` / `srid`） |
-| 数组类型（如 `int4[]`、`text[]`） | `ARRAY<T>` | 仅支持一维 |
-| 其他 / 用户自定义类型 | `STRING` | |
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/data-type-mapping.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/data-type-mapping-postgresql.md
similarity index 52%
copy from
i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/data-type-mapping.md
copy to
i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/data-type-mapping-postgresql.md
index 9a047267508..95adc0222d0 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/data-type-mapping.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/data-type-mapping-postgresql.md
@@ -2,48 +2,19 @@
{
"title": "数据类型映射",
"language": "zh-CN",
- "description": "Doris Streaming Job CDC 的数据类型映射：自动建表时上游 MySQL / PostgreSQL
类型如何映射为 Doris 列类型，以及写入 Doris 时值如何转换。"
+ "description": "Doris Streaming Job CDC 的数据类型映射：自动建表时上游 PostgreSQL 类型如何映射为
Doris 列类型，以及写入 Doris 时值如何转换。"
}
---
<!-- 知识类型: 参考 / 数据类型映射 -->
-下表展示上游 MySQL / PostgreSQL 的每个列类型如何映射为 Doris
列类型。**只有一套映射**，两种同步方式共用，区别只在于由谁创建目标表：
+下表展示上游 PostgreSQL 的每个列类型如何映射为 Doris 列类型。**只有一套映射**，两种同步方式共用，区别只在于由谁创建目标表：
- **自动建表同步**：Doris 读取上游表结构，自动按这些 Doris 列类型创建目标表。
- **SQL 映射同步**：你自己创建目标表，每列使用兼容的 Doris 类型。
两种方式下，写入的值都遵循同一套映射。不支持的类型请参见[使用限制](./continuous-load-overview.md#使用限制)。
-## MySQL 到 Doris
-
-| MySQL 类型 | Doris 类型 | 备注 |
-| --- | --- | --- |
-| `BOOLEAN` / `TINYINT(1)` | `BOOLEAN` | |
-| `TINYINT` | `TINYINT` | `UNSIGNED` → `SMALLINT` |
-| `SMALLINT` | `SMALLINT` | `UNSIGNED` → `INT` |
-| `MEDIUMINT` | `INT` | `UNSIGNED` → `INT` |
-| `INT` | `INT` | `UNSIGNED` → `BIGINT` |
-| `BIGINT` | `BIGINT` | `UNSIGNED` → `LARGEINT` |
-| `YEAR` | `SMALLINT` | |
-| `FLOAT` | `FLOAT` | |
-| `DOUBLE` | `DOUBLE` | |
-| `DECIMAL(p,s)` | `DECIMAL(p,s)` | 超高精度回退为 `STRING` |
-| `DATE` | `DATE` | |
-| `DATETIME` | `DATETIME(s)` | 保留微秒精度（0–6） |
-| `TIMESTAMP` | `DATETIME(s)` | 按 server 时区归一 |
-| `TIME` | `STRING` | 以字符串存储，如 `12:34:56.000000` |
-| `CHAR` | `CHAR` | |
-| `VARCHAR` | `VARCHAR` | |
-| `TINYTEXT` / `TEXT` / `MEDIUMTEXT` / `LONGTEXT` | `STRING` | |
-| `BINARY` / `VARBINARY` / `TINYBLOB` / `BLOB` / `MEDIUMBLOB` / `LONGBLOB` |
`STRING` | Base64 编码字符串 |
-| `BIT(1)` | `BOOLEAN` | |
-| `BIT(n>1)` | `STRING` | Base64 编码字符串 |
-| `JSON` | `STRING` | 以 JSON 文本存储 |
-| `ENUM` | `STRING` | 解析为标签值 |
-| `SET` | `STRING` | 解析为逗号分隔的标签 |
-| 空间类型（`GEOMETRY`、`POINT` 等）及其他类型 | 不支持 | 含此类列的表自动建表会失败；可改用 SQL 映射同步（在
`SELECT` 中转换）或排除该列 |
-
## PostgreSQL 到 Doris
| PostgreSQL 类型 | Doris 类型 | 备注 |
diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x.json
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x.json
index 4bde38cdae4..a866aa23a31 100644
--- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x.json
+++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x.json
@@ -131,6 +131,10 @@
"message": "持续导入",
"description": "The label for category Continuous Load in sidebar docs"
},
+ "sidebar.docs.category.Prerequisites": {
+ "message": "准备工作",
+ "description": "The label for category Prerequisites in sidebar docs"
+ },
"sidebar.docs.category.Setup Guide": {
"message": "配置指南",
"description": "The label for category Setup Guide in sidebar docs"
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/data-operate/import/import-way/streaming-job/continuous-load-overview.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/data-operate/import/import-way/streaming-job/continuous-load-overview.md
index a22e3eb02b8..87e40e7e04a 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/data-operate/import/import-way/streaming-job/continuous-load-overview.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/data-operate/import/import-way/streaming-job/continuous-load-overview.md
@@ -46,7 +46,7 @@ Doris 支持通过 **Streaming Job** 的方式，从多种数据源持续导入
| PostgreSQL | 14、15、16、17 | [PostgreSQL CDC SQL
映射同步](./continuous-load-postgresql-table.md) | [PostgreSQL CDC
自动建表同步](./continuous-load-postgresql-database.md) | [Amazon RDS
PostgreSQL](./prerequisites/amazon-rds-postgresql.md) · [Amazon Aurora
PostgreSQL](./prerequisites/amazon-aurora-postgresql.md) |
| S3 | - | [S3 持续导入](./continuous-load-s3.md)
| -
| -
|
-上游列类型如何映射为 Doris 类型，见[数据类型映射](./data-type-mapping.md)。
+上游列类型如何映射为 Doris 类型，见 [MySQL](./data-type-mapping-mysql.md) /
[PostgreSQL](./data-type-mapping-postgresql.md) 数据类型映射。
## 如何选择同步方式
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping-mysql.md
similarity index 53%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping.md
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping-mysql.md
index 9a047267508..86cc7df8676 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping-mysql.md
@@ -2,13 +2,13 @@
{
"title": "数据类型映射",
"language": "zh-CN",
- "description": "Doris Streaming Job CDC 的数据类型映射：自动建表时上游 MySQL / PostgreSQL
类型如何映射为 Doris 列类型，以及写入 Doris 时值如何转换。"
+ "description": "Doris Streaming Job CDC 的数据类型映射：自动建表时上游 MySQL 类型如何映射为
Doris 列类型，以及写入 Doris 时值如何转换。"
}
---
<!-- 知识类型: 参考 / 数据类型映射 -->
-下表展示上游 MySQL / PostgreSQL 的每个列类型如何映射为 Doris
列类型。**只有一套映射**，两种同步方式共用，区别只在于由谁创建目标表：
+下表展示上游 MySQL 的每个列类型如何映射为 Doris 列类型。**只有一套映射**，两种同步方式共用，区别只在于由谁创建目标表：
- **自动建表同步**：Doris 读取上游表结构，自动按这些 Doris 列类型创建目标表。
- **SQL 映射同步**：你自己创建目标表，每列使用兼容的 Doris 类型。
@@ -43,29 +43,3 @@
| `ENUM` | `STRING` | 解析为标签值 |
| `SET` | `STRING` | 解析为逗号分隔的标签 |
| 空间类型（`GEOMETRY`、`POINT` 等）及其他类型 | 不支持 | 含此类列的表自动建表会失败；可改用 SQL 映射同步（在
`SELECT` 中转换）或排除该列 |
-
-## PostgreSQL 到 Doris
-
-| PostgreSQL 类型 | Doris 类型 | 备注 |
-| --- | --- | --- |
-| `bool` | `BOOLEAN` | |
-| `bit(1)` | `BOOLEAN` | |
-| `bit(n>1)` / `varbit` | `STRING` | |
-| `int2` / `smallserial` | `SMALLINT` | |
-| `int4` / `serial` | `INT` | |
-| `int8` / `bigserial` | `BIGINT` | |
-| `float4` | `FLOAT` | |
-| `float8` | `DOUBLE` | |
-| `numeric(p,s)` | `DECIMAL(min(p,38), s)` | 精度上限 38；未指定 scale 时默认 9 |
-| `bpchar(n)`（即 `CHAR(n)`） | `CHAR` / `VARCHAR` | 长度 ×3 以兼容 UTF-8；`> 255` 转为
`VARCHAR` |
-| `varchar` / `text` | `STRING` | 注意：PostgreSQL `varchar` 映射为 `STRING`（不带长度） |
-| `date` | `DATE` | |
-| `timestamp` / `timestamptz` | `DATETIME(s)` | 精度 0–6；`timestamptz` 按 server
时区归一 |
-| `time` / `timetz` / `interval` | `STRING` | `timetz` 保留其 UTC 归一后的偏移量 |
-| `uuid` / `inet` / `cidr` / `macaddr` / `macaddr8` | `STRING` | |
-| `bytea` | `STRING` | Base64 编码字符串 |
-| `xml` / `hstore` | `STRING` | |
-| `json` / `jsonb` | `JSON` | |
-| 几何类型（`point`、`line`、`polygon` 等） | `STRING` | 序列化为 GeoJSON 字符串（`type` /
`coordinates` / `srid`） |
-| 数组类型（如 `int4[]`、`text[]`） | `ARRAY<T>` | 仅支持一维 |
-| 其他 / 用户自定义类型 | `STRING` | |
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/data-type-mapping.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping-postgresql.md
similarity index 52%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/data-type-mapping.md
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping-postgresql.md
index 9a047267508..95adc0222d0 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/streaming-job/data-type-mapping.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping-postgresql.md
@@ -2,48 +2,19 @@
{
"title": "数据类型映射",
"language": "zh-CN",
- "description": "Doris Streaming Job CDC 的数据类型映射：自动建表时上游 MySQL / PostgreSQL
类型如何映射为 Doris 列类型，以及写入 Doris 时值如何转换。"
+ "description": "Doris Streaming Job CDC 的数据类型映射：自动建表时上游 PostgreSQL 类型如何映射为
Doris 列类型，以及写入 Doris 时值如何转换。"
}
---
<!-- 知识类型: 参考 / 数据类型映射 -->
-下表展示上游 MySQL / PostgreSQL 的每个列类型如何映射为 Doris
列类型。**只有一套映射**，两种同步方式共用，区别只在于由谁创建目标表：
+下表展示上游 PostgreSQL 的每个列类型如何映射为 Doris 列类型。**只有一套映射**，两种同步方式共用，区别只在于由谁创建目标表：
- **自动建表同步**：Doris 读取上游表结构，自动按这些 Doris 列类型创建目标表。
- **SQL 映射同步**：你自己创建目标表，每列使用兼容的 Doris 类型。
两种方式下，写入的值都遵循同一套映射。不支持的类型请参见[使用限制](./continuous-load-overview.md#使用限制)。
-## MySQL 到 Doris
-
-| MySQL 类型 | Doris 类型 | 备注 |
-| --- | --- | --- |
-| `BOOLEAN` / `TINYINT(1)` | `BOOLEAN` | |
-| `TINYINT` | `TINYINT` | `UNSIGNED` → `SMALLINT` |
-| `SMALLINT` | `SMALLINT` | `UNSIGNED` → `INT` |
-| `MEDIUMINT` | `INT` | `UNSIGNED` → `INT` |
-| `INT` | `INT` | `UNSIGNED` → `BIGINT` |
-| `BIGINT` | `BIGINT` | `UNSIGNED` → `LARGEINT` |
-| `YEAR` | `SMALLINT` | |
-| `FLOAT` | `FLOAT` | |
-| `DOUBLE` | `DOUBLE` | |
-| `DECIMAL(p,s)` | `DECIMAL(p,s)` | 超高精度回退为 `STRING` |
-| `DATE` | `DATE` | |
-| `DATETIME` | `DATETIME(s)` | 保留微秒精度（0–6） |
-| `TIMESTAMP` | `DATETIME(s)` | 按 server 时区归一 |
-| `TIME` | `STRING` | 以字符串存储，如 `12:34:56.000000` |
-| `CHAR` | `CHAR` | |
-| `VARCHAR` | `VARCHAR` | |
-| `TINYTEXT` / `TEXT` / `MEDIUMTEXT` / `LONGTEXT` | `STRING` | |
-| `BINARY` / `VARBINARY` / `TINYBLOB` / `BLOB` / `MEDIUMBLOB` / `LONGBLOB` |
`STRING` | Base64 编码字符串 |
-| `BIT(1)` | `BOOLEAN` | |
-| `BIT(n>1)` | `STRING` | Base64 编码字符串 |
-| `JSON` | `STRING` | 以 JSON 文本存储 |
-| `ENUM` | `STRING` | 解析为标签值 |
-| `SET` | `STRING` | 解析为逗号分隔的标签 |
-| 空间类型（`GEOMETRY`、`POINT` 等）及其他类型 | 不支持 | 含此类列的表自动建表会失败；可改用 SQL 映射同步（在
`SELECT` 中转换）或排除该列 |
-
## PostgreSQL 到 Doris
| PostgreSQL 类型 | Doris 类型 | 备注 |
diff --git a/sidebars.ts b/sidebars.ts
index 9bf765b330a..34b9d609ff1 100644
--- a/sidebars.ts
+++ b/sidebars.ts
@@ -343,8 +343,15 @@ const sidebars: SidebarsConfig = {
items: [
'data-operate/import/import-way/streaming-job/continuous-load-mysql-table',
'data-operate/import/import-way/streaming-job/continuous-load-mysql-database',
-
'data-operate/import/import-way/streaming-job/prerequisites/amazon-rds-mysql',
-
'data-operate/import/import-way/streaming-job/prerequisites/amazon-aurora-mysql',
+
'data-operate/import/import-way/streaming-job/data-type-mapping-mysql',
+ {
+ type: 'category',
+ label: 'Prerequisites',
+ items: [
+
'data-operate/import/import-way/streaming-job/prerequisites/amazon-rds-mysql',
+
'data-operate/import/import-way/streaming-job/prerequisites/amazon-aurora-mysql',
+ ],
+ },
],
},
{
@@ -353,12 +360,18 @@ const sidebars: SidebarsConfig = {
items: [
'data-operate/import/import-way/streaming-job/continuous-load-postgresql-table',
'data-operate/import/import-way/streaming-job/continuous-load-postgresql-database',
-
'data-operate/import/import-way/streaming-job/prerequisites/amazon-rds-postgresql',
-
'data-operate/import/import-way/streaming-job/prerequisites/amazon-aurora-postgresql',
+
'data-operate/import/import-way/streaming-job/data-type-mapping-postgresql',
+ {
+ type: 'category',
+ label: 'Prerequisites',
+ items: [
+
'data-operate/import/import-way/streaming-job/prerequisites/amazon-rds-postgresql',
+
'data-operate/import/import-way/streaming-job/prerequisites/amazon-aurora-postgresql',
+ ],
+ },
],
},
'data-operate/import/import-way/streaming-job/continuous-load-s3',
-
'data-operate/import/import-way/streaming-job/data-type-mapping',
],
},
],
diff --git
a/versioned_docs/version-4.x/data-operate/import/import-way/streaming-job/continuous-load-overview.md
b/versioned_docs/version-4.x/data-operate/import/import-way/streaming-job/continuous-load-overview.md
index 9b03d700601..f956ca1c192 100644
---
a/versioned_docs/version-4.x/data-operate/import/import-way/streaming-job/continuous-load-overview.md
+++
b/versioned_docs/version-4.x/data-operate/import/import-way/streaming-job/continuous-load-overview.md
@@ -46,7 +46,7 @@ Continuous load supports the following data sources and sync
modes:
| PostgreSQL | 14, 15, 16, 17 | [PostgreSQL CDC with SQL
Mapping](./continuous-load-postgresql-table.md) | [PostgreSQL CDC with Auto
Table Creation](./continuous-load-postgresql-database.md) | [Amazon RDS
PostgreSQL](./prerequisites/amazon-rds-postgresql.md) · [Amazon Aurora
PostgreSQL](./prerequisites/amazon-aurora-postgresql.md) |
| S3 | - | [S3 Continuous
Load](./continuous-load-s3.md) | -
| -
|
-For how upstream column types map to Doris types, see [Data Type
Mapping](./data-type-mapping.md).
+For how upstream column types map to Doris types, see Data Type Mapping for
[MySQL](./data-type-mapping-mysql.md) and
[PostgreSQL](./data-type-mapping-postgresql.md).
## How to Choose a Sync Method
diff --git
a/versioned_docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping.md
b/versioned_docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping-mysql.md
similarity index 54%
rename from
versioned_docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping.md
rename to
versioned_docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping-mysql.md
index a1a6ee06daa..98bacb009c9 100644
---
a/versioned_docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping.md
+++
b/versioned_docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping-mysql.md
@@ -2,13 +2,13 @@
{
"title": "Data Type Mapping",
"language": "en",
- "description": "Data type mapping for Doris Streaming Job CDC: how
upstream MySQL and PostgreSQL types map to Doris column types during automatic
table creation, and how values are converted when written into Doris."
+ "description": "Data type mapping for Doris Streaming Job CDC: how
upstream MySQL types map to Doris column types during automatic table creation,
and how values are converted when written into Doris."
}
---
<!-- Knowledge type: Reference / data type mapping -->
-The tables below show how each upstream MySQL or PostgreSQL column type maps
to a Doris column type. There is a single mapping, shared by both sync methods
— the only difference is who creates the target table:
+The table below shows how each upstream MySQL column type maps to a Doris
column type. There is a single mapping, shared by both sync methods — the only
difference is who creates the target table:
- **Auto Table Creation Sync**: Doris reads the upstream schema and creates
the target table with these Doris column types automatically.
- **SQL Mapping Sync**: you create the target table yourself, using a
compatible Doris type for each column.
@@ -43,29 +43,3 @@ In both cases, the values are written following the same
mapping. For types that
| `ENUM` | `STRING` | Resolved to the label value |
| `SET` | `STRING` | Resolved to comma-separated labels |
| Spatial types (`GEOMETRY`, `POINT`, …) and other types | Not supported |
Auto Table Creation fails for tables with such columns; use SQL Mapping Sync
(cast in `SELECT`) or exclude the column |
-
-## PostgreSQL to Doris
-
-| PostgreSQL Type | Doris Type | Notes |
-| --- | --- | --- |
-| `bool` | `BOOLEAN` | |
-| `bit(1)` | `BOOLEAN` | |
-| `bit(n>1)` / `varbit` | `STRING` | |
-| `int2` / `smallserial` | `SMALLINT` | |
-| `int4` / `serial` | `INT` | |
-| `int8` / `bigserial` | `BIGINT` | |
-| `float4` | `FLOAT` | |
-| `float8` | `DOUBLE` | |
-| `numeric(p,s)` | `DECIMAL(min(p,38), s)` | Precision capped at 38; scale
defaults to 9 when unspecified |
-| `bpchar(n)` (i.e. `CHAR(n)`) | `CHAR` / `VARCHAR` | Length scaled ×3 for
UTF-8; `> 255` becomes `VARCHAR` |
-| `varchar` / `text` | `STRING` | PostgreSQL `varchar` maps to `STRING` (no
length) |
-| `date` | `DATE` | |
-| `timestamp` / `timestamptz` | `DATETIME(s)` | Scale 0–6; `timestamptz`
normalized to the server time zone |
-| `time` / `timetz` / `interval` | `STRING` | `timetz` keeps its
UTC-normalized offset |
-| `uuid` / `inet` / `cidr` / `macaddr` / `macaddr8` | `STRING` | |
-| `bytea` | `STRING` | Base64-encoded string |
-| `xml` / `hstore` | `STRING` | |
-| `json` / `jsonb` | `JSON` | |
-| Geometry types (`point`, `line`, `polygon`, …) | `STRING` | Serialized as a
GeoJSON string (`type` / `coordinates` / `srid`) |
-| Array types (e.g. `int4[]`, `text[]`) | `ARRAY<T>` | One-dimensional only |
-| Other / user-defined types | `STRING` | |
diff --git
a/docs/data-operate/import/import-way/streaming-job/data-type-mapping.md
b/versioned_docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping-postgresql.md
similarity index 51%
rename from
docs/data-operate/import/import-way/streaming-job/data-type-mapping.md
rename to
versioned_docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping-postgresql.md
index a1a6ee06daa..bf89b8b68fd 100644
--- a/docs/data-operate/import/import-way/streaming-job/data-type-mapping.md
+++
b/versioned_docs/version-4.x/data-operate/import/import-way/streaming-job/data-type-mapping-postgresql.md
@@ -2,48 +2,19 @@
{
"title": "Data Type Mapping",
"language": "en",
- "description": "Data type mapping for Doris Streaming Job CDC: how
upstream MySQL and PostgreSQL types map to Doris column types during automatic
table creation, and how values are converted when written into Doris."
+ "description": "Data type mapping for Doris Streaming Job CDC: how
upstream PostgreSQL types map to Doris column types during automatic table
creation, and how values are converted when written into Doris."
}
---
<!-- Knowledge type: Reference / data type mapping -->
-The tables below show how each upstream MySQL or PostgreSQL column type maps
to a Doris column type. There is a single mapping, shared by both sync methods
— the only difference is who creates the target table:
+The table below shows how each upstream PostgreSQL column type maps to a Doris
column type. There is a single mapping, shared by both sync methods — the only
difference is who creates the target table:
- **Auto Table Creation Sync**: Doris reads the upstream schema and creates
the target table with these Doris column types automatically.
- **SQL Mapping Sync**: you create the target table yourself, using a
compatible Doris type for each column.
In both cases, the values are written following the same mapping. For types
that are not supported, see
[Limitations](./continuous-load-overview.md#limitations).
-## MySQL to Doris
-
-| MySQL Type | Doris Type | Notes |
-| --- | --- | --- |
-| `BOOLEAN` / `TINYINT(1)` | `BOOLEAN` | |
-| `TINYINT` | `TINYINT` | `UNSIGNED` → `SMALLINT` |
-| `SMALLINT` | `SMALLINT` | `UNSIGNED` → `INT` |
-| `MEDIUMINT` | `INT` | `UNSIGNED` → `INT` |
-| `INT` | `INT` | `UNSIGNED` → `BIGINT` |
-| `BIGINT` | `BIGINT` | `UNSIGNED` → `LARGEINT` |
-| `YEAR` | `SMALLINT` | |
-| `FLOAT` | `FLOAT` | |
-| `DOUBLE` | `DOUBLE` | |
-| `DECIMAL(p,s)` | `DECIMAL(p,s)` | Very high precision falls back to `STRING`
|
-| `DATE` | `DATE` | |
-| `DATETIME` | `DATETIME(s)` | Microsecond scale (0–6) preserved |
-| `TIMESTAMP` | `DATETIME(s)` | Normalized to the server time zone |
-| `TIME` | `STRING` | Serialized as a string, e.g. `12:34:56.000000` |
-| `CHAR` | `CHAR` | |
-| `VARCHAR` | `VARCHAR` | |
-| `TINYTEXT` / `TEXT` / `MEDIUMTEXT` / `LONGTEXT` | `STRING` | |
-| `BINARY` / `VARBINARY` / `TINYBLOB` / `BLOB` / `MEDIUMBLOB` / `LONGBLOB` |
`STRING` | Base64-encoded string |
-| `BIT(1)` | `BOOLEAN` | |
-| `BIT(n>1)` | `STRING` | Base64-encoded string |
-| `JSON` | `STRING` | Stored as JSON text |
-| `ENUM` | `STRING` | Resolved to the label value |
-| `SET` | `STRING` | Resolved to comma-separated labels |
-| Spatial types (`GEOMETRY`, `POINT`, …) and other types | Not supported |
Auto Table Creation fails for tables with such columns; use SQL Mapping Sync
(cast in `SELECT`) or exclude the column |
-
## PostgreSQL to Doris
| PostgreSQL Type | Doris Type | Notes |
diff --git a/versioned_sidebars/version-4.x-sidebars.json
b/versioned_sidebars/version-4.x-sidebars.json
index 8db0dbc8ce0..1963c0873aa 100644
--- a/versioned_sidebars/version-4.x-sidebars.json
+++ b/versioned_sidebars/version-4.x-sidebars.json
@@ -394,8 +394,15 @@
"items": [
"data-operate/import/import-way/streaming-job/continuous-load-mysql-table",
"data-operate/import/import-way/streaming-job/continuous-load-mysql-database",
-
"data-operate/import/import-way/streaming-job/prerequisites/amazon-rds-mysql",
-
"data-operate/import/import-way/streaming-job/prerequisites/amazon-aurora-mysql"
+
"data-operate/import/import-way/streaming-job/data-type-mapping-mysql",
+ {
+ "type": "category",
+ "label": "Prerequisites",
+ "items": [
+
"data-operate/import/import-way/streaming-job/prerequisites/amazon-rds-mysql",
+
"data-operate/import/import-way/streaming-job/prerequisites/amazon-aurora-mysql"
+ ]
+ }
]
},
{
@@ -404,12 +411,18 @@
"items": [
"data-operate/import/import-way/streaming-job/continuous-load-postgresql-table",
"data-operate/import/import-way/streaming-job/continuous-load-postgresql-database",
-
"data-operate/import/import-way/streaming-job/prerequisites/amazon-rds-postgresql",
-
"data-operate/import/import-way/streaming-job/prerequisites/amazon-aurora-postgresql"
+
"data-operate/import/import-way/streaming-job/data-type-mapping-postgresql",
+ {
+ "type": "category",
+ "label": "Prerequisites",
+ "items": [
+
"data-operate/import/import-way/streaming-job/prerequisites/amazon-rds-postgresql",
+
"data-operate/import/import-way/streaming-job/prerequisites/amazon-aurora-postgresql"
+ ]
+ }
]
},
-
"data-operate/import/import-way/streaming-job/continuous-load-s3",
-
"data-operate/import/import-way/streaming-job/data-type-mapping"
+
"data-operate/import/import-way/streaming-job/continuous-load-s3"
]
}
]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
