[ 
https://issues.apache.org/jira/browse/OOZIE-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13160435#comment-13160435
 ] 

Mohammad Kamrul Islam commented on OOZIE-578:
---------------------------------------------

Requirements:

The common use-cases are as follows:
* Use-case 1: User wants to run a shell/perl/python script.
* Use case 2: User wants to run a C++ executable.
* Use case 3:  User wants to run a Java program.
* Use case 4: User wants to run script that contains a set of hadoop commands 
which needs Kerberos.
* Use case 5: For all cases, user wants to pass the environment variable such 
as LB_LIBRARY_PATH, JAVA_LIBRARY_PATH, PATH,  CLASSPATH etc.
* Use case 6: User could write the control output to a file that could be 
exposed to subsequent action through EL function.

Limitations:
* No interactive commands will be supported.
* Command can't be executed as different user such as sudo.
* User has to explicitly upload the required 3rd party packages (such as jar, 
so lib, executable etc). Oozie will provide a way through Hadoop's Distributed 
Cache.
* Since Oozie will execute the shell command into a Hadoop compute node, the 
default installation of compute node might not be fixed. However, the most 
common unix utilities are usually installed on all compute node.

 

Design Highlights:
* Oozie will execute the shell commands into  a hadoop compute node.
* There will be a way of uploading the file through <file> and <archive> option.
* User can pass any environment variables through configuration 
oozie.launcher.mapred.child.env .
* User can pass the requirements of extra resources (such as memory)   
oozie.launcher.mapred.child.java_opts.
* Oozie should , by default, include the current directory into common 
environment variables such as PATH, LD_LIBRARY_PATH, java_library_path, 
CLASSPATH.



                
> Support shell action in Oozie WF
> --------------------------------
>
>                 Key: OOZIE-578
>                 URL: https://issues.apache.org/jira/browse/OOZIE-578
>             Project: Oozie
>          Issue Type: New Feature
>            Reporter: Mohammad Kamrul Islam
>            Assignee: Mohammad Kamrul Islam
>
> Running a script (shell/perl/python/?) from a workflow is a very common 
> use-case. Currently, Oozie user needs to write  a custom java code to execute 
> the script which is not convenient.
> This JIRA is to discuss the feasibility and scope of the feature. The 
> proposed design of this feature will also be included.
>  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to