[
https://issues.apache.org/jira/browse/OOZIE-2499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15229957#comment-15229957
]
KWON BYUNGCHANG commented on OOZIE-2499:
----------------------------------------
Usage:
if you do not want to deploy any files, archives to launcher mapper,
set {{oozie.launcher.deploy.distributed.cache.enable=false}} at workflow
map-reduce configuration. its default is {{true}}
if you want to deploy partial any jar(e.g. user defined
inputformat/outputformat class and its dependency) to launcher mapper,
set {{oozie.launcher.deploy.distributed.cache.enable=true}},
{{oozie.launcher.distributed.cache.filter=*.jar,*.properties,MyInputFormat.class}}
at workflow map-reduce configuration.
> map-reduce launcher does not need distributed files, archives except jar of
> input/outputformat class
> -----------------------------------------------------------------------------------------------------
>
> Key: OOZIE-2499
> URL: https://issues.apache.org/jira/browse/OOZIE-2499
> Project: Oozie
> Issue Type: Improvement
> Components: core
> Affects Versions: 4.2.0
> Reporter: KWON BYUNGCHANG
> Priority: Minor
> Fix For: 4.2.0
>
> Attachments: OOZIE-2499.001.patch
>
>
> In map-reduce action, when specify {{file}}, {{archives}} element,
> {{JavaActionExccutor}} add it to distributed cache for configuration of
> launcher.
> It cause slow launching mr job.
> In fact, all most launcher does not need {{file}} , {{archives}}. launcher
> need to inputformat/outputformat class and its dependency.
> I make a proposal below feature.
> * add property
> {{oozie.launcher.distributed.cache.filter=\*.jar,\*.properties}}. default is
> {{*}}
> * when configure launcher, filter cache files.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
