This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git
The following commit(s) were added to refs/heads/asf-site by this push: new c87056c [MINOR] Update docs for oss_filesystem. (#1544) c87056c is described below commit c87056cc85a0f5d3d0fa9515cd97f4dbb42bba59 Author: Shen Hong <shenh062...@126.com> AuthorDate: Tue Apr 21 18:57:37 2020 +0800 [MINOR] Update docs for oss_filesystem. (#1544) --- docs/_docs/0_5_oss_filesystem.cn.md | 14 ++++++++++++-- docs/_docs/0_5_oss_filesystem.md | 14 ++++++++++++-- 2 files changed, 24 insertions(+), 4 deletions(-) diff --git a/docs/_docs/0_5_oss_filesystem.cn.md b/docs/_docs/0_5_oss_filesystem.cn.md index 5083b1d..a598f34 100644 --- a/docs/_docs/0_5_oss_filesystem.cn.md +++ b/docs/_docs/0_5_oss_filesystem.cn.md @@ -3,7 +3,7 @@ title: OSS Filesystem keywords: hudi, hive, aliyun, oss, spark, presto permalink: /docs/oss_hoodie.html summary: In this page, we go over how to configure Hudi with OSS filesystem. -last_modified_at: 2020-04-12T10:50:50-10:00 +last_modified_at: 2020-04-21T12:50:50-10:00 language: cn --- 这个页面描述了如何让你的Hudi spark任务使用Aliyun OSS存储。 @@ -51,7 +51,7 @@ language: cn ### Aliyun OSS Libs -新增Aliyun hadoop的jar包的MVN依赖到pom.xml文件。 +新增Aliyun hadoop的jar包的MVN依赖到pom.xml文件。由于hadoop-aliyun依赖hadoop 2.9.1+,因此你需要使用hadoop 2.9.1或更新的版本。 ```xml <dependency> @@ -59,4 +59,14 @@ language: cn <artifactId>hadoop-aliyun</artifactId> <version>3.2.1</version> </dependency> +<dependency> + <groupId>com.aliyun.oss</groupId> + <artifactId>aliyun-sdk-oss</artifactId> + <version>3.8.1</version> +</dependency> +<dependency> + <groupId>org.jdom</groupId> + <artifactId>jdom</artifactId> + <version>1.1</version> +</dependency> ``` diff --git a/docs/_docs/0_5_oss_filesystem.md b/docs/_docs/0_5_oss_filesystem.md index 5ecd155..afd114c 100644 --- a/docs/_docs/0_5_oss_filesystem.md +++ b/docs/_docs/0_5_oss_filesystem.md @@ -3,7 +3,7 @@ title: OSS Filesystem keywords: hudi, hive, aliyun, oss, spark, presto permalink: /docs/oss_hoodie.html summary: In this page, we go over how to configure Hudi with OSS filesystem. -last_modified_at: 2020-04-12T11:23:24-10:00 +last_modified_at: 2020-04-21T11:38:24-10:00 --- In this page, we explain how to get your Hudi spark job to store into Aliyun OSS. @@ -50,7 +50,7 @@ Add the required configs in your core-site.xml from where Hudi can fetch them. R ### Aliyun OSS Libs -Aliyun hadoop libraries jars to add to our pom.xml. +Aliyun hadoop libraries jars to add to our pom.xml. Since hadoop-aliyun depends on the version of hadoop 2.9.1+, you need to use the version of hadoop 2.9.1 or later. ```xml <dependency> @@ -58,4 +58,14 @@ Aliyun hadoop libraries jars to add to our pom.xml. <artifactId>hadoop-aliyun</artifactId> <version>3.2.1</version> </dependency> +<dependency> + <groupId>com.aliyun.oss</groupId> + <artifactId>aliyun-sdk-oss</artifactId> + <version>3.8.1</version> +</dependency> +<dependency> + <groupId>org.jdom</groupId> + <artifactId>jdom</artifactId> + <version>1.1</version> +</dependency> ```