> On March 3, 2014, 7:30 a.m., Rohini Palaniswamy wrote: > > We need to add the killChildJobs in Java, Shell and Distcp as well. Many > > people launch hbase jobs from java action and instead of each user adding > > killChildJobs doing it in JavaActionExecutor should be good. Currently the > > configuration is not passed properly to distcp action. For killing child > > jobs in distcp to work, we need to fix that or pass the configuration as > > arg (i.e -Dmapreduce.job.tags=xxx) so that child jobs are launched with > > that tag. I think we can pass it as arg for now.
The reason I didn't add the killChildJobs to the Distcp action is that we don't have a "DistcpMain" to put it in. I didn't want to put the killChildJobs in the calling class LauncherMapper because (a) we handle this differently for the MR action and (b) someone writing a custom action (or us in a future action) may also want to handle this differently. I guess I could write a wrapper "DistcpMain" to call killChildJobs... For the Java and Shell actions, they don't necessarily launch any child jobs. And in general, we don't implement some of the "Oozie magic" stuff for the Java and Shell actions, leaving it up to the user instead (for example, propagating the action's <configuration> or the delegation token). The Java action also has the same problem as the Distcp action, in that there's no "JavaMain". What if I added documentation on how to call killChildJobs so the user can do this in their Main? - Robert ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18653/#review35947 ----------------------------------------------------------- On March 1, 2014, 2:01 a.m., Robert Kanter wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/18653/ > ----------------------------------------------------------- > > (Updated March 1, 2014, 2:01 a.m.) > > > Review request for oozie. > > > Bugs: OOZIE-1722 > https://issues.apache.org/jira/browse/OOZIE-1722 > > > Repository: oozie-git > > > Description > ------- > > See https://issues.apache.org/jira/browse/OOZIE-1722 > > > Diffs > ----- > > core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java > 68d77a8 > core/src/main/java/org/apache/oozie/action/hadoop/LauncherMapperHelper.java > 07de214 > core/src/test/java/org/apache/oozie/action/hadoop/TestLauncher.java b55b9d7 > hadooplibs/hadoop-utils-0.23/pom.xml PRE-CREATION > > hadooplibs/hadoop-utils-0.23/src/main/java/org/apache/oozie/action/hadoop/LauncherMainHadoopUtils.java > PRE-CREATION > hadooplibs/hadoop-utils-1/pom.xml PRE-CREATION > > hadooplibs/hadoop-utils-1/src/main/java/org/apache/oozie/action/hadoop/LauncherMainHadoopUtils.java > PRE-CREATION > hadooplibs/hadoop-utils-2/pom.xml PRE-CREATION > > hadooplibs/hadoop-utils-2/src/main/java/org/apache/oozie/action/hadoop/LauncherMainHadoopUtils.java > PRE-CREATION > hadooplibs/hadoop-utils-3/pom.xml PRE-CREATION > > hadooplibs/hadoop-utils-3/src/main/java/org/apache/oozie/action/hadoop/LauncherMainHadoopUtils.java > PRE-CREATION > hadooplibs/pom.xml 35875c8 > pom.xml 1223ec2 > sharelib/hive/pom.xml e355d97 > sharelib/hive/src/main/java/org/apache/oozie/action/hadoop/HiveMain.java > 8fa5ec8 > sharelib/oozie/pom.xml c70582d > > sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LauncherMapper.java > b5fa4a1 > > sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/MapReduceMain.java > 6230e64 > sharelib/pig/pom.xml a2bbeaf > sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java > 9c1e659 > sharelib/sqoop/pom.xml a962565 > sharelib/sqoop/src/main/java/org/apache/oozie/action/hadoop/SqoopMain.java > e45c8b2 > > Diff: https://reviews.apache.org/r/18653/diff/ > > > Testing > ------- > > > Thanks, > > Robert Kanter > >
