[
https://issues.apache.org/jira/browse/OOZIE-2687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Sasvari updated OOZIE-2687:
----------------------------------
Attachment: OOZIE-2687-002.patch
Tested on pseudo hadoop that submitting a workflow like:
{code}
<workflow-app xmlns="uri:oozie:workflow:0.6"
xmlns:common="uri:oozie:common:0.1" name="java-main-wf">
<start to="java-node"/>
<action name="java-node">
<java>
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<common:launcher>
<common:env>Q=Question:A=42</common:env>
</common:launcher>
...
{code}
will in fact result in a generated {{launch_container.sh}} that includes
environment variables:
{code}
head -3
nm-local-dir/nmPrivate/application_1502749591067_0005/container_1502749591067_0005_01_000001/launch_container.sh
#!/bin/bash
export A="42"
{code}
> Create XML schema for launcher configurations
> ---------------------------------------------
>
> Key: OOZIE-2687
> URL: https://issues.apache.org/jira/browse/OOZIE-2687
> Project: Oozie
> Issue Type: Sub-task
> Affects Versions: 5.0.0
> Reporter: Peter Cseh
> Assignee: Attila Sasvari
> Priority: Critical
> Attachments: OOZIE-2687-001.patch, OOZIE-2687-002.patch
>
>
> It was possible to manipulate the MapperLauncher's environment through
> properties like:
> # mapreduce.map.memory.mb
> # mapreduce.map.cpu.vcores
> # mapred.child.env
> # mapred.child.java.opts
> # mapred.job.queue.name - ability to set launcher queue
> E.g. We were using mapred.child.env to pass SPARK_HOME to the LauncherMapper
> and make PySpark work.
> Fixing OOZIE-2596 added a hack. We should decide how we support or break
> compatibility and how we allow the manipulation of the Launcher environment.
> Verify if the new launcher section in global applies to actions in
> sub-workflows as well. It did not use to work before and was only fixed in
> OOZIE-2030. It would be good to have that testcase
> (TestSubWorkflowActionExecutor. testParentGlobalConf) updated with the new
> launcher section as well.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
