> On March 3, 2014, 7:30 a.m., Rohini Palaniswamy wrote: > > We need to add the killChildJobs in Java, Shell and Distcp as well. Many > > people launch hbase jobs from java action and instead of each user adding > > killChildJobs doing it in JavaActionExecutor should be good. Currently the > > configuration is not passed properly to distcp action. For killing child > > jobs in distcp to work, we need to fix that or pass the configuration as > > arg (i.e -Dmapreduce.job.tags=xxx) so that child jobs are launched with > > that tag. I think we can pass it as arg for now. > > Robert Kanter wrote: > The reason I didn't add the killChildJobs to the Distcp action is that we > don't have a "DistcpMain" to put it in. I didn't want to put the > killChildJobs in the calling class LauncherMapper because (a) we handle this > differently for the MR action and (b) someone writing a custom action (or us > in a future action) may also want to handle this differently. I guess I > could write a wrapper "DistcpMain" to call killChildJobs... > > For the Java and Shell actions, they don't necessarily launch any child > jobs. And in general, we don't implement some of the "Oozie magic" stuff for > the Java and Shell actions, leaving it up to the user instead (for example, > propagating the action's <configuration> or the delegation token). The Java > action also has the same problem as the Distcp action, in that there's no > "JavaMain". What if I added documentation on how to call killChildJobs so > the user can do this in their Main? > > Rohini Palaniswamy wrote: > Many users launch child jobs in their java actions (especially with > hbase). Would prefer as much less work for user as possible. If you are > writing a DistcpMain, you can just write a JavaMain that calls killChildJobs > and make DistcpMain just extend that. That way it will just work without > users having to bother about it and writing different code for different > versions of hadoop.
I can add a wrapper for Java and Distcp that does the killing. Though for the Java action, it will still be up to the user to propagate the actionConf prepared by Oozie, or at least just set the tag property. - Robert ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18653/#review35947 ----------------------------------------------------------- On March 1, 2014, 2:01 a.m., Robert Kanter wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/18653/ > ----------------------------------------------------------- > > (Updated March 1, 2014, 2:01 a.m.) > > > Review request for oozie. > > > Bugs: OOZIE-1722 > https://issues.apache.org/jira/browse/OOZIE-1722 > > > Repository: oozie-git > > > Description > ------- > > See https://issues.apache.org/jira/browse/OOZIE-1722 > > > Diffs > ----- > > core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java > 68d77a8 > core/src/main/java/org/apache/oozie/action/hadoop/LauncherMapperHelper.java > 07de214 > core/src/test/java/org/apache/oozie/action/hadoop/TestLauncher.java b55b9d7 > hadooplibs/hadoop-utils-0.23/pom.xml PRE-CREATION > > hadooplibs/hadoop-utils-0.23/src/main/java/org/apache/oozie/action/hadoop/LauncherMainHadoopUtils.java > PRE-CREATION > hadooplibs/hadoop-utils-1/pom.xml PRE-CREATION > > hadooplibs/hadoop-utils-1/src/main/java/org/apache/oozie/action/hadoop/LauncherMainHadoopUtils.java > PRE-CREATION > hadooplibs/hadoop-utils-2/pom.xml PRE-CREATION > > hadooplibs/hadoop-utils-2/src/main/java/org/apache/oozie/action/hadoop/LauncherMainHadoopUtils.java > PRE-CREATION > hadooplibs/hadoop-utils-3/pom.xml PRE-CREATION > > hadooplibs/hadoop-utils-3/src/main/java/org/apache/oozie/action/hadoop/LauncherMainHadoopUtils.java > PRE-CREATION > hadooplibs/pom.xml 35875c8 > pom.xml 1223ec2 > sharelib/hive/pom.xml e355d97 > sharelib/hive/src/main/java/org/apache/oozie/action/hadoop/HiveMain.java > 8fa5ec8 > sharelib/oozie/pom.xml c70582d > > sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LauncherMapper.java > b5fa4a1 > > sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/MapReduceMain.java > 6230e64 > sharelib/pig/pom.xml a2bbeaf > sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java > 9c1e659 > sharelib/sqoop/pom.xml a962565 > sharelib/sqoop/src/main/java/org/apache/oozie/action/hadoop/SqoopMain.java > e45c8b2 > > Diff: https://reviews.apache.org/r/18653/diff/ > > > Testing > ------- > > > Thanks, > > Robert Kanter > >
