See
<https://builds.apache.org/job/oozie-trunk-precommit-build/3814/display/redirect?page=changes>
Changes:
[gezapeti] OOZIE-2874 Make the Launcher Mapper map-only job's InputFormat class
[gezapeti] OOZIE-2824 Fix typos in documentation (lzeke via gezapeti)
------------------------------------------
[...truncated 568.47 KB...]
launcherConf.setBoolean("oozie.hadoop-2.0.2-alpha.workaround.for.distributed.cache",
true);
}
FileSystem fs =
Services.get().get(HadoopAccessorService.class).createFileSystem(launcherConf.get("user.name"),
actionDir.toUri(), launcherConf);
fs.mkdirs(actionDir);
OutputStream os = fs.create(new Path(actionDir,
LauncherMapper.ACTION_CONF_XML));
try {
actionConf.writeXml(os);
} finally {
IOUtils.closeSafely(os);
}
launcherConf.setInputFormat(OozieLauncherInputFormat.class);
launcherConf.setOutputFormat(OozieLauncherOutputFormat.class);
launcherConf.setOutputCommitter(OozieLauncherOutputCommitter.class);
}
public static void setupYarnRestartHandling(JobConf launcherJobConf,
Configuration actionConf, String launcherTag,
long launcherTime)
throws NoSuchAlgorithmException {
launcherJobConf.setLong(LauncherMainHadoopUtils.OOZIE_JOB_LAUNCH_TIME,
launcherTime);
// Tags are limited to 100 chars so we need to hash them to make sure
(the actionId otherwise doesn't have a max length)
String tag = getTag(launcherTag);
// keeping the oozie.child.mapreduce.job.tags instead of
mapreduce.job.tags to avoid killing launcher itself.
// mapreduce.job.tags should only go to child job launch by launcher.
actionConf.set(LauncherMainHadoopUtils.CHILD_MAPREDUCE_JOB_TAGS, tag);
}
public static String getTag(String launcherTag) throws
NoSuchAlgorithmException {
error: patch failed:
core/src/main/java/org/apache/oozie/action/hadoop/LauncherMapperHelper.java:147
error:
core/src/main/java/org/apache/oozie/action/hadoop/LauncherMapperHelper.java:
patch does not apply
Checking patch
core/src/main/java/org/apache/oozie/action/hadoop/MapReduceActionExecutor.java...
Checking patch
core/src/main/java/org/apache/oozie/action/hadoop/OozieJobInfo.java...
Checking patch
core/src/main/java/org/apache/oozie/action/hadoop/PigActionExecutor.java...
Checking patch
core/src/main/java/org/apache/oozie/action/hadoop/ScriptLanguageActionExecutor.java...
Checking patch
core/src/main/java/org/apache/oozie/action/hadoop/ShellActionExecutor.java...
Checking patch
core/src/main/java/org/apache/oozie/action/hadoop/SparkActionExecutor.java...
Checking patch
core/src/main/java/org/apache/oozie/action/hadoop/SqoopActionExecutor.java...
Checking patch
core/src/main/java/org/apache/oozie/client/rest/BulkResponseImpl.java...
Checking patch core/src/main/java/org/apache/oozie/command/XCommand.java...
Checking patch
core/src/main/java/org/apache/oozie/command/coord/CoordSubmitXCommand.java...
Checking patch
core/src/main/java/org/apache/oozie/command/wf/SubmitHttpXCommand.java...
Checking patch
core/src/main/java/org/apache/oozie/command/wf/SubmitMRXCommand.java...
Checking patch
core/src/main/java/org/apache/oozie/command/wf/SubmitScriptLanguageXCommand.java...
Checking patch
core/src/main/java/org/apache/oozie/command/wf/SubmitSqoopXCommand.java...
Checking patch
core/src/main/java/org/apache/oozie/coord/input/dependency/AbstractCoordInputDependency.java...
Checking patch
core/src/main/java/org/apache/oozie/dependency/hcat/EhcacheHCatDependencyCache.java...
Checking patch
core/src/main/java/org/apache/oozie/service/CallableQueueService.java...
Checking patch
core/src/main/java/org/apache/oozie/service/EventHandlerService.java...
Checking patch
core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java...
Checking patch core/src/main/java/org/apache/oozie/service/Services.java...
Checking patch
core/src/main/java/org/apache/oozie/service/ShareLibService.java...
Checking patch
core/src/main/java/org/apache/oozie/servlet/CallbackServlet.java...
Checking patch core/src/main/java/org/apache/oozie/store/OozieSchema.java...
Checking patch core/src/main/java/org/apache/oozie/util/ClasspathUtils.java...
Checking patch
hadooplibs/hadoop-utils-2/src/main/java/org/apache/oozie/hadoop/utils/HadoopShims.java
=> core/src/main/java/org/apache/oozie/util/FSUtils.java...
Checking patch core/src/main/java/org/apache/oozie/util/IOUtils.java...
Checking patch core/src/main/java/org/apache/oozie/util/Instrumentation.java...
Checking patch core/src/main/java/org/apache/oozie/util/JobUtils.java...
Checking patch core/src/main/resources/META-INF/persistence.xml...
Checking patch core/src/main/resources/oozie-default.xml...
error: while searching for:
</property>
<property>
<name>oozie.action.launcher.mapreduce.job.ubertask.enable</name>
<value>true</value>
<description>
Enables Uber Mode for the launcher job in YARN/Hadoop 2 (no effect
in Hadoop 1) for all action types by default.
This can be overridden on a per-action-type basis by setting
oozie.action.#action-type#.launcher.mapreduce.job.ubertask.enable
in oozie-site.xml (where #action-type# is the action
type; for example, "pig"). And that can be overridden on a
per-action basis by setting
oozie.launcher.mapreduce.job.ubertask.enable in an action's
configuration section in a workflow. In summary, the
priority is this:
1. action's configuration section in a workflow
2.
oozie.action.#action-type#.launcher.mapreduce.job.ubertask.enable in oozie-site
3. oozie.action.launcher.mapreduce.job.ubertask.enable in oozie-site
</description>
</property>
<property>
<name>oozie.action.shell.launcher.mapreduce.job.ubertask.enable</name>
<value>false</value>
<description>
The Shell action may have issues with the $PATH environment when
using Uber Mode, and so Uber Mode is disabled by
default for it. See
oozie.action.launcher.mapreduce.job.ubertask.enable
</description>
</property>
<property>
<name>oozie.action.spark.setup.hadoop.conf.dir</name>
<value>false</value>
<description>
error: patch failed: core/src/main/resources/oozie-default.xml:1835
error: core/src/main/resources/oozie-default.xml: patch does not apply
Checking patch core/src/main/resources/oozie-log4j.properties...
Checking patch core/src/test/java/org/apache/oozie/QueryServlet.java...
Checking patch
core/src/main/java/org/apache/oozie/action/hadoop/Credentials.java =>
core/src/test/java/org/apache/oozie/action/hadoop/BlockingMapper.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/CredentialForTest.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/InsertTestToken.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/LauncherMainTester.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/MapperReducerForTest.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/TestDistCpActionExecutor.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/TestFSPrepareActions.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/TestFsActionExecutor.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/TestHCatCredentials.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/TestHCatPrepareActions.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/TestJavaActionExecutor.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/TestLauncher.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/TestLauncherAMCallbackNotifier.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/TestMapReduceActionError.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/TestOozieJobInfo.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/TestPrepareActionsDriver.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/TestShellActionExecutor.java...
Checking patch
core/src/test/java/org/apache/oozie/action/hadoop/TestShellMain.java...
Checking patch core/src/test/java/org/apache/oozie/client/TestOozieCLI.java...
Checking patch
core/src/test/java/org/apache/oozie/client/TestWorkflowXClient.java...
Checking patch
core/src/test/java/org/apache/oozie/command/coord/TestCoordChangeXCommand.java...
Checking patch
core/src/test/java/org/apache/oozie/command/coord/TestCoordSubmitXCommand.java...
Checking patch
core/src/test/java/org/apache/oozie/command/wf/HangServlet.java...
Checking patch
core/src/test/java/org/apache/oozie/command/wf/TestActionCheckXCommand.java...
Checking patch
core/src/test/java/org/apache/oozie/command/wf/TestActionStartXCommand.java...
Checking patch
core/src/test/java/org/apache/oozie/command/wf/TestSubmitHiveXCommand.java...
Checking patch
core/src/test/java/org/apache/oozie/command/wf/TestSubmitMRXCommand.java...
Checking patch
core/src/test/java/org/apache/oozie/command/wf/TestSubmitPigXCommand.java...
Checking patch
core/src/test/java/org/apache/oozie/command/wf/TestSubmitSqoopXCommand.java...
Checking patch
core/src/test/java/org/apache/oozie/command/wf/TestWorkflowActionKillXCommand.java...
Checking patch
core/src/test/java/org/apache/oozie/service/TestConfigurationService.java...
Checking patch
core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java...
Checking patch
core/src/test/java/org/apache/oozie/service/TestRecoveryService.java...
Checking patch
core/src/test/java/org/apache/oozie/service/TestShareLibService.java...
Checking patch core/src/test/java/org/apache/oozie/test/XDataTestCase.java...
Checking patch core/src/test/java/org/apache/oozie/test/XFsTestCase.java...
Checking patch core/src/test/java/org/apache/oozie/test/XTestCase.java...
Checking patch
core/src/test/java/org/apache/oozie/util/TestClasspathUtils.java...
Checking patch
core/src/test/java/org/apache/oozie/workflow/lite/TestLiteWorkflowAppParser.java...
Checking patch core/src/test/resources/coord-invalid-el-function.xml...
Checking patch core/src/test/resources/coord-invalid-output-instance.xml...
Checking patch core/src/test/resources/coord-multiple-input-instance4.xml...
Checking patch
core/src/test/resources/coord-multiple-input-start-instance2.xml...
Checking patch core/src/test/resources/coord-multiple-output-instance4.xml...
Checking patch distro/src/main/bin/addtowar.sh...
Checking patch docs/src/site/twiki/CoordinatorFunctionalSpec.twiki...
error: while searching for:
<verbatim>
<coordinator-app name="hello-coord" frequency="${coord:days(1)}"
start="2009-01-02T08:00Z" end="2009-01-04T08:00Z"
timezone="America/Los_Angeles"
xmlns="uri:oozie:coordinator:0.1">
<controls>
<timeout>10</timeout>
<concurrency>${concurrency_level}</concurrency>
error: patch failed: docs/src/site/twiki/CoordinatorFunctionalSpec.twiki:265
error: docs/src/site/twiki/CoordinatorFunctionalSpec.twiki: patch does not apply
Checking patch docs/src/site/twiki/DG_QuickStart.twiki...
Checking patch docs/src/site/twiki/ENG_Building.twiki...
Checking patch findbugs-filter.xml...
Checking patch hadooplibs/hadoop-auth-1/pom.xml...
Checking patch hadooplibs/hadoop-auth-2/pom.xml...
Checking patch hadooplibs/hadoop-distcp-1/pom.xml...
Checking patch hadooplibs/hadoop-distcp-2/pom.xml...
Checking patch hadooplibs/hadoop-distcp-3/pom.xml...
Checking patch hadooplibs/hadoop-utils-1/pom.xml...
Checking patch hadooplibs/hadoop-utils-2/pom.xml...
Checking patch
hadooplibs/hadoop-utils-2/src/main/java/org/apache/oozie/action/hadoop/LauncherMainHadoopUtils.java...
Checking patch hadooplibs/hadoop-utils-3/pom.xml...
Checking patch
hadooplibs/hadoop-utils-3/src/main/java/org/apache/oozie/action/hadoop/LauncherMainHadoopUtils.java...
Checking patch
hadooplibs/hadoop-utils-3/src/main/java/org/apache/oozie/hadoop/utils/HadoopShims.java...
Checking patch hadooplibs/pom.xml...
Checking patch pom.xml...
Checking patch release-log.txt...
error: while searching for:
-- Oozie 4.4.0 release (trunk - unreleased)
OOZIE-2851 spelling mistakes in examples (Artem Ervits via gezapeti)
OOZIE-2863 SLACalculatorMemory.loadOnRestart causing delay in server start
(puru via satishsaley)
OOZIE-2843 Enhance logging inside ZKLocksService and MemoryLocksService
(andras.piros via pbacsko)
error: patch failed: release-log.txt:1
error: release-log.txt: patch does not apply
Checking patch sharelib/distcp/pom.xml...
Checking patch
sharelib/distcp/src/main/java/org/apache/oozie/action/hadoop/DistcpMain.java...
Checking patch sharelib/hcatalog/pom.xml...
Checking patch sharelib/hive/pom.xml...
Checking patch
sharelib/hive/src/main/java/org/apache/oozie/action/hadoop/HiveMain.java...
Checking patch
sharelib/hive/src/test/java/org/apache/oozie/action/hadoop/TestHiveActionExecutor.java...
Checking patch
sharelib/hive/src/test/java/org/apache/oozie/action/hadoop/TestHiveMain.java...
Checking patch sharelib/hive2/pom.xml...
Checking patch
sharelib/hive2/src/main/java/org/apache/oozie/action/hadoop/Hive2Main.java...
Checking patch
sharelib/hive2/src/test/java/org/apache/oozie/action/hadoop/TestHive2ActionExecutor.java...
Checking patch sharelib/oozie/pom.xml...
Checking patch
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/AMRMCallBackHandler.java...
Checking patch
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/AMRMClientAsyncFactory.java...
Checking patch
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/ActionUtils.java...
Checking patch
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/ErrorHolder.java...
Checking patch
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/HdfsOperations.java...
Checking patch
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/JavaMain.java...
Checking patch
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LauncherAM.java...
Checking patch
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LauncherAMCallbackNotifier.java...
Checking patch
hadooplibs/hadoop-utils-1/src/main/java/org/apache/oozie/action/hadoop/LauncherMainHadoopUtils.java
=>
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LauncherAMCallbackNotifierFactory.java...
Checking patch
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LauncherMain.java...
Checking patch
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LauncherMapper.java...
Checking patch
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LocalFsOperations.java...
Checking patch
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/MapReduceMain.java...
Checking patch
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/PrepareActionsDriver.java...
Checking patch
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/PrepareActionsHandler.java...
Checking patch
hadooplibs/hadoop-utils-1/src/main/java/org/apache/oozie/hadoop/utils/HadoopShims.java
=>
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/SequenceFileWriterFactory.java...
Checking patch
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/ShellMain.java...
Checking patch
sharelib/oozie/src/test/java/org/apache/oozie/action/hadoop/LauncherAMTestMainClass.java...
Checking patch
sharelib/oozie/src/test/java/org/apache/oozie/action/hadoop/TestHdfsOperations.java...
Checking patch
sharelib/oozie/src/test/java/org/apache/oozie/action/hadoop/TestLauncherAM.java...
Checking patch sharelib/pig/pom.xml...
Checking patch
sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java...
Checking patch
sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMainWithOldAPI.java...
Checking patch
sharelib/pig/src/test/java/org/apache/oozie/action/hadoop/TestPigActionExecutor.java...
Checking patch
sharelib/pig/src/test/java/org/apache/oozie/action/hadoop/TestPigMainWithOldAPI.java...
Checking patch sharelib/spark/pom.xml...
Checking patch
sharelib/spark/src/main/java/org/apache/oozie/action/hadoop/SparkMain.java...
Checking patch
sharelib/spark/src/test/java/org/apache/oozie/action/hadoop/TestPyspark.java...
Checking patch
sharelib/spark/src/test/java/org/apache/oozie/action/hadoop/TestSparkActionExecutor.java...
Checking patch sharelib/sqoop/pom.xml...
Checking patch
sharelib/sqoop/src/main/java/org/apache/oozie/action/hadoop/SqoopMain.java...
Checking patch
sharelib/sqoop/src/test/java/org/apache/oozie/action/hadoop/TestSqoopActionExecutor.java...
Checking patch sharelib/streaming/pom.xml...
Checking patch
sharelib/streaming/src/main/java/org/apache/oozie/action/hadoop/StreamingMain.java...
Checking patch
sharelib/streaming/src/test/java/org/apache/oozie/action/hadoop/TestMapReduceActionExecutor.java...
Checking patch
tools/src/main/java/org/apache/oozie/tools/OozieSharelibCLI.java...
Checking patch webapp/pom.xml...
Patch failed to apply to head of branch
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0
0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 3706k 100 3706k 0 0 4258k 0 --:--:-- --:--:-- --:--:-- 4258k
Adding comment to JIRA
Comment added.
test-patch exit code: 1
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
ERROR: Step ?Publish JUnit test result report? failed: No test report files
were found. Configuration error?
