Remove configurations for Kettle from installation-guide.md
Project: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/commit/1fc38510 Tree: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/tree/1fc38510 Diff: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/diff/1fc38510 Branch: refs/heads/12-dev Commit: 1fc38510c8ec78405c8040ea043e262637ca9ec1 Parents: 65e6791 Author: Manoj <ma...@knoldus.com> Authored: Wed Apr 5 17:42:50 2017 +0530 Committer: chenliang613 <chenliang...@huawei.com> Committed: Thu Apr 6 12:15:12 2017 +0530 ---------------------------------------------------------------------- docs/installation-guide.md | 30 +++++++++--------------------- 1 file changed, 9 insertions(+), 21 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-carbondata/blob/1fc38510/docs/installation-guide.md ---------------------------------------------------------------------- diff --git a/docs/installation-guide.md b/docs/installation-guide.md index c5bf6df..2fb6766 100644 --- a/docs/installation-guide.md +++ b/docs/installation-guide.md @@ -50,29 +50,23 @@ followed by : 4. Copy the `./conf/carbon.properties.template` file from CarbonData repository to `$SPARK_HOME/conf/` folder and rename the file to `carbon.properties`. -5. Copy the `./processing/carbonplugins` folder from CarbonData repository to `$SPARK_HOME/carbonlib/` folder. - - **NOTE**: carbonplugins will contain .kettle folder. - -6. Repeat Step 2 to Step 5 in all the nodes of the cluster. +5. Repeat Step 2 to Step 5 in all the nodes of the cluster. -7. In Spark node[master], configure the properties mentioned in the following table in `$SPARK_HOME/conf/spark-defaults.conf` file. +6. In Spark node[master], configure the properties mentioned in the following table in `$SPARK_HOME/conf/spark-defaults.conf` file. | Property | Value | Description | |---------------------------------|-----------------------------------------------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------| - | carbon.kettle.home | `$SPARK_HOME/carbonlib/carbonplugins` | Path that will be used by CarbonData internally to create graph for loading the data | | spark.driver.extraJavaOptions | `-Dcarbon.properties.filepath=$SPARK_HOME/conf/carbon.properties` | A string of extra JVM options to pass to the driver. For instance, GC settings or other logging. | | spark.executor.extraJavaOptions | `-Dcarbon.properties.filepath=$SPARK_HOME/conf/carbon.properties` | A string of extra JVM options to pass to executors. For instance, GC settings or other logging. **NOTE**: You can enter multiple values separated by space. | -8. Add the following properties in `$SPARK_HOME/conf/carbon.properties` file: +7. Add the following properties in `$SPARK_HOME/conf/carbon.properties` file: | Property | Required | Description | Example | Remark | |----------------------|----------|----------------------------------------------------------------------------------------|-------------------------------------|---------| | carbon.storelocation | NO | Location where data CarbonData will create the store and write the data in its own format. | hdfs://HOSTNAME:PORT/Opt/CarbonStore | Propose to set HDFS directory | - | carbon.kettle.home | YES | Path that will be used by CarbonData internally to create graph for loading the data. | `$SPARK_HOME/carbonlib/carbonplugins` | | -9. Verify the installation. For example: +8. Verify the installation. For example: ``` ./spark-shell --master spark://HOSTNAME:PORT --total-executor-cores 2 @@ -100,13 +94,9 @@ To get started with CarbonData : [Quick Start](quick-start-guide.md), [DDL Opera **NOTE**: Create the carbonlib folder if it does not exists inside `$SPARK_HOME` path. -2. Copy the `./processing/carbonplugins` folder from CarbonData repository to `$SPARK_HOME/carbonlib/` folder. - - **NOTE**: carbonplugins will contain .kettle folder. +2. Copy the `./conf/carbon.properties.template` file from CarbonData repository to `$SPARK_HOME/conf/` folder and rename the file to `carbon.properties`. -3. Copy the `./conf/carbon.properties.template` file from CarbonData repository to `$SPARK_HOME/conf/` folder and rename the file to `carbon.properties`. - -4. Create `tar,gz` file of carbonlib folder and move it inside the carbonlib folder. +3. Create `tar,gz` file of carbonlib folder and move it inside the carbonlib folder. ``` cd $SPARK_HOME @@ -114,7 +104,7 @@ To get started with CarbonData : [Quick Start](quick-start-guide.md), [DDL Opera mv carbondata.tar.gz carbonlib/ ``` -5. Configure the properties mentioned in the following table in `$SPARK_HOME/conf/spark-defaults.conf` file. +4. Configure the properties mentioned in the following table in `$SPARK_HOME/conf/spark-defaults.conf` file. | Property | Description | Value | |---------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|------------------------------------------------------------------------------| @@ -127,15 +117,13 @@ To get started with CarbonData : [Quick Start](quick-start-guide.md), [DDL Opera | spark.driver.extraJavaOptions | A string of extra JVM options to pass to the driver. For instance, GC settings or other logging. |`-Dcarbon.properties.filepath=$SPARK_HOME/conf/carbon.properties` | -6. Add the following properties in `$SPARK_HOME/conf/carbon.properties`: +5. Add the following properties in `$SPARK_HOME/conf/carbon.properties`: | Property | Required | Description | Example | Default Value | |----------------------|----------|----------------------------------------------------------------------------------------|-------------------------------------|---------------| | carbon.storelocation | NO | Location where CarbonData will create the store and write the data in its own format. | hdfs://HOSTNAME:PORT/Opt/CarbonStore | Propose to set HDFS directory| - | carbon.kettle.home | YES | Path that will be used by CarbonData internally to create graph for loading the data. | carbondata.tar.gz/carbonlib/carbonplugins | | - -7. Verify the installation. +6. Verify the installation. ``` ./bin/spark-shell --master yarn-client --driver-memory 1g
