pan3793 commented on code in PR #8347: URL: https://github.com/apache/hadoop/pull/8347#discussion_r3333002313
########## hadoop-cloud-storage-project/hadoop-bos/src/site/markdown/cloud-storage/index.md: ########## @@ -0,0 +1,395 @@ +<!-- + Licensed under the Apache License, Version 2.0 (the "License"); + you may not use this file except in compliance with the License. + You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. See accompanying LICENSE file. +--> + +# Integration of Baidu BOS in Hadoop + +## Overview + +BOS (Baidu Object Storage) is the object storage service provided by Baidu Cloud. Hadoop-BOS is a connector between computing systems and underlying storage. For systems like Hadoop MR, Hive, Spark and Alluxio, hadoop-bos helps them use BOS as the underlying storage system instead of HDFS. + +## Quick Start + +In quick start, we will use hadoop shell command to access a BOS bucket. + +### Requirements + +1. A Baidu Cloud account. Use the account to create a BOS bucket. +2. A dev environment that can access BOS. E.g. a local server or a Baidu Cloud cloud server. +3. Install hadoop to the dev environment. Hadoop is installed at `$HADOOP_HOME`. + +### Usage + +* The `hadoop-bos` connector jar is included in the Hadoop cloud storage distribution +(`hadoop-cloud-storage-dist`) and can be found in the release package at +`$HADOOP_HOME/share/hadoop/tools/lib/hadoop-bos-{VERSION}.jar`. Review Comment: This does not seem to be true, the packaging layout has been changed recently, could you please double-check it? BTW, how much size of the hadoop binary tarball will increase after this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
