Jira: https://issues.apache.org/jira/browse/OOZIE-2812
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/913/
###################################################################################
########################## LAST 100 LINES OF THE CONSOLE
###########################
[...truncated 786.69 KB...]
[INFO] ------------------------------------------------------------------------
[TRACE] FindBugs output in HEAD verified and saved
Running test-patch task BACKWARDS_COMPATIBILITY
Running test-patch task TESTS
Running test-patch task DISTRO
Applying patch
Checking patch
a/core/src/main/java/org/apache/oozie/action/hadoop/SparkActionExecutor.java =>
b/core/src/main/java/org/apache/oozie/action/hadoop/SparkActionExecutor.java...
error:
a/core/src/main/java/org/apache/oozie/action/hadoop/SparkActionExecutor.java:
No such file or directory
Checking patch
a/core/src/main/java/org/apache/oozie/service/SparkConfigurationService.java =>
b/core/src/main/java/org/apache/oozie/service/SparkConfigurationService.java...
error:
a/core/src/main/java/org/apache/oozie/service/SparkConfigurationService.java:
No such file or directory
Checking patch
b/core/src/main/java/org/apache/oozie/service/sparkconfiguration/SparkConfigReader.java...
Checking patch
b/core/src/main/java/org/apache/oozie/service/sparkconfiguration/SparkConfigurationStorage.java...
Checking patch a/core/src/main/resources/oozie-default.xml =>
b/core/src/main/resources/oozie-default.xml...
error: a/core/src/main/resources/oozie-default.xml: No such file or directory
Checking patch
a/core/src/test/java/org/apache/oozie/service/TestSparkConfigurationService.java
=>
b/core/src/test/java/org/apache/oozie/service/TestSparkConfigurationService.java...
error:
a/core/src/test/java/org/apache/oozie/service/TestSparkConfigurationService.java:
No such file or directory
Checking patch
b/core/src/test/java/org/apache/oozie/service/sparkconfiguration/TestSparkConfigurationStorage.java...
Checking patch a/docs/src/site/twiki/DG_SparkActionExtension.twiki =>
b/docs/src/site/twiki/DG_SparkActionExtension.twiki...
error: a/docs/src/site/twiki/DG_SparkActionExtension.twiki: No such file or
directory
Checking patch
core/src/main/java/org/apache/oozie/action/hadoop/SparkActionExecutor.java...
error: while searching for:
StringBuilder sparkOptsSb = new StringBuilder();
if (master.startsWith("yarn")) {
String resourceManager = actionConf.get(HADOOP_JOB_TRACKER);
Properties sparkConfig =
Services.get().get(SparkConfigurationService.class).getSparkConfig(resourceManager);
for (String property : sparkConfig.stringPropertyNames()) {
sparkOptsSb.append("--conf ")
.append(property).append("=").append(sparkConfig.getProperty(property)).append("
");
}
}
String sparkOpts = actionXml.getChildTextTrim("spark-opts", ns);
error: patch failed:
core/src/main/java/org/apache/oozie/action/hadoop/SparkActionExecutor.java:78
error:
core/src/main/java/org/apache/oozie/action/hadoop/SparkActionExecutor.java:
patch does not apply
Checking patch
core/src/main/java/org/apache/oozie/service/SparkConfigurationService.java...
Checking patch
core/src/main/java/org/apache/oozie/service/sparkconfiguration/SparkConfigReader.java...
Checking patch
core/src/main/java/org/apache/oozie/service/sparkconfiguration/SparkConfigurationStorage.java...
Checking patch core/src/main/resources/oozie-default.xml...
Hunk #1 succeeded at 3022 (offset 137 lines).
Hunk #2 succeeded at 3032 (offset 137 lines).
Checking patch
core/src/test/java/org/apache/oozie/service/TestSparkConfigurationService.java...
error: while searching for:
",rm3=" + sparkConf3Dir.getAbsolutePath() + // missing file
",rm4=" + sparkConf4Dir.getName()); // relative path
scs.init(Services.get());
Properties sparkConfigs = scs.getSparkConfig("foo");
assertEquals(sparkConfigs.toString(), 0, sparkConfigs.size());
sparkConfigs = scs.getSparkConfig("rm1");
assertEquals(sparkConfigs.toString(), 2, sparkConfigs.size());
assertEquals("A", sparkConfigs.get("a"));
assertEquals("B", sparkConfigs.get("b"));
sparkConfigs = scs.getSparkConfig("rm2");
assertEquals(sparkConfigs.toString(), 0, sparkConfigs.size());
sparkConfigs = scs.getSparkConfig("rm3");
assertEquals(sparkConfigs.toString(), 0, sparkConfigs.size());
sparkConfigs = scs.getSparkConfig("rm4");
assertEquals(sparkConfigs.toString(), 2, sparkConfigs.size());
assertEquals("Y", sparkConfigs.get("y"));
assertEquals("Z", sparkConfigs.get("z"));
scs.destroy();
// Setting this to false should make it not ignore spark.yarn.jar
ConfigurationService.setBoolean("oozie.service.SparkConfigurationService.spark.configurations.ignore.spark.yarn.jar",
false);
ConfigurationService.set("oozie.service.SparkConfigurationService.spark.configurations.blacklist",
" ");
scs.init(Services.get());
sparkConfigs = scs.getSparkConfig("rm1");
assertEquals(sparkConfigs.toString(), 3, sparkConfigs.size());
assertEquals("A", sparkConfigs.get("a"));
assertEquals("B", sparkConfigs.get("b"));
assertEquals("foo", sparkConfigs.get("spark.yarn.jar"));
ConfigurationService.setBoolean("oozie.service.SparkConfigurationService.spark.configurations.ignore.spark.yarn.jar",
true);
ConfigurationService.set("oozie.service.SparkConfigurationService.spark.configurations.blacklist",
"spark.yarn.jar,spark.yarn.jars");
error: patch failed:
core/src/test/java/org/apache/oozie/service/TestSparkConfigurationService.java:60
error:
core/src/test/java/org/apache/oozie/service/TestSparkConfigurationService.java:
patch does not apply
Checking patch
core/src/test/java/org/apache/oozie/service/sparkconfiguration/TestSparkConfigurationStorage.java...
Checking patch docs/src/site/twiki/DG_SparkActionExtension.twiki...
error: docs/src/site/twiki/DG_SparkActionExtension.twiki: No such file or
directory
Patch failed to apply to head of branch
Adding comment to JIRA
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:--
0100 199 0 0 100 199 0 230 --:--:-- --:--:-- --:--:--
230100 1774 0 1575 100 199 1826 230 --:--:-- --:--:-- --:--:--
1825
{"self":"https://issues.apache.org/jira/rest/api/2/issue/13047953/comment/16681437","id":"16681437","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa&avatarId=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small&ownerId=hadoopqa&avatarId=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall&ownerId=hadoopqa&avatarId=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium&ownerId=hadoopqa&avatarId=10393"},"displayName":"Hadoop
QA","active":true,"timeZone":"Etc/UTC"},"body":"\nTesting JIRA
OOZIE-2812\n\nCleaning local git
workspace\n\n----------------------------\n\n{color:red}-1{color} Patch failed
to apply to head of
branch\n\n----------------------------\n","updateAuthor":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa&avatarId=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small&ownerId=hadoopqa&avatarId=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall&ownerId=hadoopqa&avatarId=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium&ownerId=hadoopqa&avatarId=10393"},"displayName":"Hadoop
QA","active":true,"timeZone":"Etc/UTC"},"created":"2018-11-09T13:39:08.187+0000","updated":"2018-11-09T13:39:08.187+0000"}
test-patch exit code: 1
Build step 'Execute shell' marked build as failure
[description-setter] Description set: OOZIE-2812
Archiving artifacts
[Fast Archiver] Compressed 1.36 MB of artifacts by 13.8% relative to #889
Recording test results
ERROR: Step ?Publish JUnit test result report? failed: No test report files
were found. Configuration error?
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
###################################################################################
############################## FAILED TESTS (if any)
##############################
No tests ran.
