[ 
https://issues.apache.org/jira/browse/OOZIE-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717429#comment-14717429
 ] 

Rohini Palaniswamy commented on OOZIE-2343:
-------------------------------------------

+1

> Shell Action should take Oozie Action config and setup HADOOP_CONF_DIR
> ----------------------------------------------------------------------
>
>                 Key: OOZIE-2343
>                 URL: https://issues.apache.org/jira/browse/OOZIE-2343
>             Project: Oozie
>          Issue Type: Improvement
>          Components: action
>    Affects Versions: trunk
>            Reporter: Robert Kanter
>            Assignee: Robert Kanter
>         Attachments: OOZIE-2343.001.patch, OOZIE-2343.002.patch
>
>
> Despite being not recommended, many users still run Hadoop ecosystem programs 
> from the Shell Action (e.g. hive, beeline, sqoop, etc), even though we have 
> Actions for those.  One of the common problems we've been seeing here lately 
> is that {{HADOOP_CONF_DIR}} is inherited from the NM, and is pointing to the 
> NM's copy of the Hadoop *-site.xml files, which is often not well suited for 
> client programs.  This can lead to all kinds of weird problems, such as 
> permissions errors, missing logs, etc.  
> As a workaround, we've been telling users to set {{HADOOP_CONF_DIR}} to 
> {{/etc/hadoop/conf}}, however, this has some disadvantages.  Ideally, these 
> client programs should pick up {{OOZIE_ACTION_CONF_XML}} instead.  Given that 
> {{OOZIE_ACTION_CONF_XML}} is an amalgamation of all of the Hadoop *-site.xml 
> plus things Oozie and the user set, we can simply have the Shell Action 
> copy-paste it to the correctly named *-site.xml files, and point 
> {{HADOOP_CONF_DIR}} to there.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to