This is an automated email from the ASF dual-hosted git repository.
jiafengzheng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new bcf11a07aed export doc fix
bcf11a07aed is described below
commit bcf11a07aed8781335df4e39f3c01099ceba0f40
Author: jiafeng.zhang <[email protected]>
AuthorDate: Mon Aug 8 09:25:17 2022 +0800
export doc fix
export doc fix
---
docs/data-operate/export/export-manual.md | 27 +++++++++++++++++++++-
.../current/data-operate/export/export-manual.md | 25 +++++++++++++++++++-
2 files changed, 50 insertions(+), 2 deletions(-)
diff --git a/docs/data-operate/export/export-manual.md
b/docs/data-operate/export/export-manual.md
index 221f2e1eebf..541bc6f3c0d 100644
--- a/docs/data-operate/export/export-manual.md
+++ b/docs/data-operate/export/export-manual.md
@@ -26,7 +26,7 @@ under the License.
# Data export
-Export is a function provided by Doris to export data. This function can
export user-specified table or partition data in text format to remote storage
through Broker process, such as HDFS/BOS.
+Export is a function provided by Doris to export data. This function can
export user-specified table or partition data in text format to remote storage
through Broker process, such as HDFS / Object storage (supports S3 protocol)
etc.
This document mainly introduces the basic principles, usage, best practices
and precautions of Export.
@@ -106,6 +106,8 @@ For detailed usage of Export, please refer to [SHOW
EXPORT](../../sql-manual/sql
Export's detailed commands can be passed through `HELP EXPORT;` Examples are
as follows:
+### Export to hdfs
+
```sql
EXPORT TABLE db1.tbl1
PARTITION (p1,p2)
@@ -134,6 +136,29 @@ WITH BROKER "hdfs"
* `timeout`: homework timeout. Default 2 hours. Unit seconds.
* `tablet_num_per_task`: The maximum number of fragments allocated per query
plan. The default is 5.
+### Export to object storage (supports S3 protocol)
+
+Create a repository named s3_repo to link cloud storage directly without going
through the broker.
+
+```sql
+CREATE REPOSITORY `s3_repo`
+WITH S3
+ON LOCATION "s3://s3-repo"
+PROPERTIES
+(
+ "AWS_ENDPOINT" = "http://s3-REGION.amazonaws.com",
+ "AWS_ACCESS_KEY" = "AWS_ACCESS_KEY",
+ "AWS_SECRET_KEY"="AWS_SECRET_KEY",
+ "AWS_REGION" = "REGION"
+);
+```
+
+- `AWS_ACCESS_KEY`/`AWS_SECRET_KEY`:Is your key to access the OSS API.
+- `AWS_ENDPOINT`:Endpoint indicates the access domain name of OSS external
services.
+- `AWS_REGION`:Region indicates the region where the OSS data center is
located.
+
+### View export status
+
After submitting a job, the job status can be imported by querying the [SHOW
EXPORT](../../sql-manual/sql-reference/Show-Statements/SHOW-EXPORT.md)
command. The results are as follows:
```sql
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/export/export-manual.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/export/export-manual.md
index 267061abd8e..fa687589dd3 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/export/export-manual.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/export/export-manual.md
@@ -26,7 +26,7 @@ under the License.
# 数据导出
-数据导出(Export)是 Doris 提供的一种将数据导出的功能。该功能可以将用户指定的表或分区的数据,以文本的格式,通过 Broker
进程导出到远端存储上,如 HDFS/BOS 等。
+数据导出(Export)是 Doris 提供的一种将数据导出的功能。该功能可以将用户指定的表或分区的数据,以文本的格式,通过 Broker
进程导出到远端存储上,如 HDFS / 对象存储(支持S3协议) 等。
本文档主要介绍 Export 的基本原理、使用方式、最佳实践以及注意事项。
@@ -126,6 +126,27 @@ WITH BROKER "hdfs"
* `timeout`:作业超时时间。默认 2小时。单位秒。
* `tablet_num_per_task`:每个查询计划分配的最大分片数。默认为 5。
+### 导出到对象存储
+
+创建名为 s3_repo 的仓库,直接链接云存储,而不通过broker.
+
+```sql
+CREATE REPOSITORY `s3_repo`
+WITH S3
+ON LOCATION "s3://s3-repo"
+PROPERTIES
+(
+ "AWS_ENDPOINT" = "http://s3-REGION.amazonaws.com",
+ "AWS_ACCESS_KEY" = "AWS_ACCESS_KEY",
+ "AWS_SECRET_KEY"="AWS_SECRET_KEY",
+ "AWS_REGION" = "REGION"
+);
+```
+
+- `AWS_ACCESS_KEY`/`AWS_SECRET_KEY`:是您访问OSS API 的密钥.
+- `AWS_ENDPOINT`:表示OSS的数据中心所在的地域.
+- `AWS_REGION`:Endpoint表示OSS对外服务的访问域名.
+
### 查看导出状态
提交作业后,可以通过 [SHOW
EXPORT](../../sql-manual/sql-reference/Show-Statements/SHOW-EXPORT.md)
命令查询导入作业状态。结果举例如下:
@@ -168,6 +189,8 @@ FinishTime: 2019-06-25 17:08:34
* Timeout:作业超时时间。单位是秒。该时间从 CreateTime 开始计算。
* ErrorMsg:如果作业出现错误,这里会显示错误原因。
+
+
## 最佳实践
### 查询计划的拆分
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]