[ 
https://issues.apache.org/jira/browse/HADOOP-4868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12665633#action_12665633
 ] 

Owen O'Malley commented on HADOOP-4868:
---------------------------------------

I think we should take a modified option 1.

I think that core, mapred, and hdfs need to be downloadable and installable 
separately.

I would propose a structure that looks like:

$HADOOP_HOME/{core,hdfs,mapred}

and a separated out conf dir:

$HADOOP_HOME/conf

Of course, we should make it configurable like:

HADOOP_CORE_HOME = $HADOOP_HOME/core
HADOOP_MAPRED_HOME = $HADOOP_HOME/mapred
HADOOP_HDFS_HOME= $HADOOP_HOME/hdfs
HADOOP_CONF_DIR = $HADOOP_HOME/conf

Each of the subproject subdirectories would contain:
  bin, lib, and doc

So to upgrade, you just untar the new release of the subproject into the 
corresponding spot and you are done.
It will also be easier to map this into rpms where you want to install core, 
mapred, and hdfs from individual rpms.

The scripts should probably be $HADOOP_CORE_HOME/bin/hadoop, 
$HADOOP_MAPRED_HOME/bin/mapred, and $HADOOP_HDFS_HOME/bin/hdfs. The mapred and 
hdfs scripts will handle all of the work for their respective projects. The 
hadoop script will delegate to the mapred and hdfs scripts as appropriate.

One note is that the hadoop script will need to include the hdfs jars on the 
classpath. Otherwise, the fs commands won't work for HDFS and that would be bad.

> Split the hadoop script into 3 parts
> ------------------------------------
>
>                 Key: HADOOP-4868
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4868
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: scripts
>            Reporter: Sharad Agarwal
>            Assignee: Sharad Agarwal
>         Attachments: 4868_v1.patch, 4868_v2.patch
>
>
> We need to split the bin/hadoop into 3 parts for core, mapred and hdfs. This 
> will enable us to distribute the individual scripts with each component.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to