Jira: https://issues.apache.org/jira/browse/OOZIE-3112
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/197/
###################################################################################
########################## LAST 60 LINES OF THE CONSOLE
###########################
[...truncated 1.61 MB...]
+1 There are no new bugs found in [sharelib/oozie].
+1 There are no new bugs found in [sharelib/hcatalog].
+1 There are no new bugs found in [sharelib/streaming].
+1 There are no new bugs found in [sharelib/hive].
+1 There are no new bugs found in [sharelib/sqoop].
-1 There are [3] new bugs found below threshold in [sharelib/spark] that must
be fixed.
You can find the FindBugs diff here (look for the red and orange ones):
sharelib/spark/findbugs-new.html
The most important FindBugs errors are:
At SparkArgsExtractor.java:[line 376]: Found reliance on default encoding in
org.apache.oozie.action.hadoop.SparkArgsExtractor.loadProperties(File,
Properties): new java.io.FileReader(File)
At SparkArgsExtractor.java:[line 364]: Found reliance on default encoding in
org.apache.oozie.action.hadoop.SparkArgsExtractor.mergeAndAddPropetiesFile(List,
String): new java.io.FileWriter(String)
At SparkArgsExtractor.java:[line 359]: File(...) reads a file whose location
might be specified by user input
At SparkArgsExtractor.java:[line 147]: At SparkArgsExtractor.java:[line 144]
At SparkArgsExtractor.java:[line 298]: At SparkArgsExtractor.java:[line 190]
+1 There are no new bugs found in [sharelib/hive2].
+1 There are no new bugs found in [sharelib/pig].
+1 BACKWARDS_COMPATIBILITY
+1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient
annotations
+1 the patch does not modify JPA files
-1 TESTS
Tests run: 2055
Tests failed: 2
Tests errors: 1
The patch failed the following testcases:
testSetupMethodsWithSparkConfiguration(org.apache.oozie.action.hadoop.TestSparkActionExecutor)
testQuotedDriverAndExecutorExtraJavaOptionsParsing(org.apache.oozie.action.hadoop.TestSparkArgsExtractor)
Tests failing with errors:
testJMXInstrumentation(org.apache.oozie.util.TestMetricsInstrumentation)
+1 DISTRO
+1 distro tarball builds with the patch
----------------------------
-1 Overall result, please check the reported -1(s)
There is at least one warning, please check
The full output of the test-patch run is available at
https://builds.apache.org/job/PreCommit-OOZIE-Build/197/
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:--
0100 3706k 100 3706k 0 0 3907k 0 --:--:-- --:--:-- --:--:-- 6401k
Adding comment to JIRA
Comment added.
test-patch exit code: 1
Build step 'Execute shell' marked build as failure
[description-setter] Description set: OOZIE-3112
Archiving artifacts
[Fast Archiver] Compressed 1.82 MB of artifacts by 24.1% relative to #164
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
###################################################################################
############################## FAILED TESTS (if any)
##############################
3 tests failed.
FAILED: org.apache.oozie.util.TestMetricsInstrumentation.testJMXInstrumentation
Error Message:
Unable to open socket file: target process not responding or HotSpot VM not
loaded
Stack Trace:
com.sun.tools.attach.AttachNotSupportedException: Unable to open socket file:
target process not responding or HotSpot VM not loaded
at
sun.tools.attach.LinuxVirtualMachine.<init>(LinuxVirtualMachine.java:106)
at
sun.tools.attach.LinuxAttachProvider.attachVirtualMachine(LinuxAttachProvider.java:78)
at com.sun.tools.attach.VirtualMachine.attach(VirtualMachine.java:250)
at
org.apache.oozie.util.TestMetricsInstrumentation.testJMXInstrumentation(TestMetricsInstrumentation.java:235)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at junit.framework.TestCase.runTest(TestCase.java:176)
at junit.framework.TestCase.runBare(TestCase.java:141)
at junit.framework.TestResult$1.protect(TestResult.java:122)
at junit.framework.TestResult.runProtected(TestResult.java:142)
at junit.framework.TestResult.run(TestResult.java:125)
at junit.framework.TestCase.run(TestCase.java:129)
at junit.framework.TestSuite.runTest(TestSuite.java:255)
at junit.framework.TestSuite.run(TestSuite.java:250)
at
org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:84)
at org.junit.runners.Suite.runChild(Suite.java:127)
at org.junit.runners.Suite.runChild(Suite.java:26)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
FAILED:
org.apache.oozie.action.hadoop.TestSparkActionExecutor.testSetupMethodsWithSparkConfiguration
Error Message:
expected:<3> but was:<1>
Stack Trace:
junit.framework.AssertionFailedError: expected:<3> but was:<1>
at junit.framework.Assert.fail(Assert.java:57)
at junit.framework.Assert.failNotEquals(Assert.java:329)
at junit.framework.Assert.assertEquals(Assert.java:78)
at junit.framework.Assert.assertEquals(Assert.java:234)
at junit.framework.Assert.assertEquals(Assert.java:241)
at junit.framework.TestCase.assertEquals(TestCase.java:409)
at
org.apache.oozie.action.hadoop.TestSparkActionExecutor._testSetupMethods(TestSparkActionExecutor.java:149)
at
org.apache.oozie.action.hadoop.TestSparkActionExecutor.testSetupMethodsWithSparkConfiguration(TestSparkActionExecutor.java:102)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at junit.framework.TestCase.runTest(TestCase.java:176)
at junit.framework.TestCase.runBare(TestCase.java:141)
at junit.framework.TestResult$1.protect(TestResult.java:122)
at junit.framework.TestResult.runProtected(TestResult.java:142)
at junit.framework.TestResult.run(TestResult.java:125)
at junit.framework.TestCase.run(TestCase.java:129)
at junit.framework.TestSuite.runTest(TestSuite.java:255)
at junit.framework.TestSuite.run(TestSuite.java:250)
at
org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:84)
at org.junit.runners.Suite.runChild(Suite.java:127)
at org.junit.runners.Suite.runChild(Suite.java:26)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
FAILED:
org.apache.oozie.action.hadoop.TestSparkArgsExtractor.testQuotedDriverAndExecutorExtraJavaOptionsParsing
Error Message:
Spark args mismatch expected:<[--master, yarn, --deploy-mode, client, --name,
Spark Copy File, --class, org.apache.oozie.example.SparkFileCopy, --conf,
spark.executor.extraJavaOptions=-XX:+HeapDumpOnOutOfMemoryError
-XX:HeapDumpPath=/tmp -Dlog4j.configuration=spark-log4j.properties, --conf,
spark.driver.extraJavaOptions=-Xmn2703m -XX:SurvivorRatio=2
-XX:ParallelGCThreads=20 -Dlog4j.configuration=spark-log4j.properties, --conf,
spark.executor.extraClassPath=$PWD/*, --conf,
spark.driver.extraClassPath=$PWD/*, --conf,
spark.yarn.security.tokens.hadoopfs.enabled=false, --conf,
spark.yarn.security.tokens.hive.enabled=false, --conf,
spark.yarn.security.tokens.hbase.enabled=false, --conf,
spark.yarn.security.credentials.hadoopfs.enabled=false, --conf,
spark.yarn.security.credentials.hive.enabled=false, --conf,
spark.yarn.security.credentials.hbase.enabled=false, --files,
spark-log4j.properties,hive-site.xml, --conf, spark.yarn.jar=null, --verbose,
/lib/test.jar, arg0, arg1]> but was:<[--master, yarn, --deploy-mode, client,
--name, Spark Copy File, --class, org.apache.oozie.example.SparkFileCopy,
--conf, spark.executor.extraJavaOptions=-XX:+HeapDumpOnOutOfMemoryError
-XX:HeapDumpPath=/tmp -Dlog4j.configuration=spark-log4j.properties, --conf,
spark.driver.extraJavaOptions=-Xmn2703m -XX:SurvivorRatio=2
-XX:ParallelGCThreads=20 -Dlog4j.configuration=spark-log4j.properties, --conf,
spark.executor.extraClassPath=$PWD/*, --conf,
spark.driver.extraClassPath=$PWD/*, --conf,
spark.yarn.security.tokens.hadoopfs.enabled=false, --conf,
spark.yarn.security.tokens.hive.enabled=false, --conf,
spark.yarn.security.tokens.hbase.enabled=false, --conf,
spark.yarn.security.credentials.hadoopfs.enabled=false, --conf,
spark.yarn.security.credentials.hive.enabled=false, --conf,
spark.yarn.security.credentials.hbase.enabled=false, --properties-file,
spark-defaults-generated.properties, --files,
spark-log4j.properties,hive-site.xml, --conf, spark.yarn.jar=null, --verbose,
/lib/test.jar, arg0, arg1]>
Stack Trace:
java.lang.AssertionError: Spark args mismatch expected:<[--master, yarn,
--deploy-mode, client, --name, Spark Copy File, --class,
org.apache.oozie.example.SparkFileCopy, --conf,
spark.executor.extraJavaOptions=-XX:+HeapDumpOnOutOfMemoryError
-XX:HeapDumpPath=/tmp -Dlog4j.configuration=spark-log4j.properties, --conf,
spark.driver.extraJavaOptions=-Xmn2703m -XX:SurvivorRatio=2
-XX:ParallelGCThreads=20 -Dlog4j.configuration=spark-log4j.properties, --conf,
spark.executor.extraClassPath=$PWD/*, --conf,
spark.driver.extraClassPath=$PWD/*, --conf,
spark.yarn.security.tokens.hadoopfs.enabled=false, --conf,
spark.yarn.security.tokens.hive.enabled=false, --conf,
spark.yarn.security.tokens.hbase.enabled=false, --conf,
spark.yarn.security.credentials.hadoopfs.enabled=false, --conf,
spark.yarn.security.credentials.hive.enabled=false, --conf,
spark.yarn.security.credentials.hbase.enabled=false, --files,
spark-log4j.properties,hive-site.xml, --conf, spark.yarn.jar=null, --verbose,
/lib/test.jar, arg0, arg1]> but was:<[--master, yarn, --deploy-mode, client,
--name, Spark Copy File, --class, org.apache.oozie.example.SparkFileCopy,
--conf, spark.executor.extraJavaOptions=-XX:+HeapDumpOnOutOfMemoryError
-XX:HeapDumpPath=/tmp -Dlog4j.configuration=spark-log4j.properties, --conf,
spark.driver.extraJavaOptions=-Xmn2703m -XX:SurvivorRatio=2
-XX:ParallelGCThreads=20 -Dlog4j.configuration=spark-log4j.properties, --conf,
spark.executor.extraClassPath=$PWD/*, --conf,
spark.driver.extraClassPath=$PWD/*, --conf,
spark.yarn.security.tokens.hadoopfs.enabled=false, --conf,
spark.yarn.security.tokens.hive.enabled=false, --conf,
spark.yarn.security.tokens.hbase.enabled=false, --conf,
spark.yarn.security.credentials.hadoopfs.enabled=false, --conf,
spark.yarn.security.credentials.hive.enabled=false, --conf,
spark.yarn.security.credentials.hbase.enabled=false, --properties-file,
spark-defaults-generated.properties, --files,
spark-log4j.properties,hive-site.xml, --conf, spark.yarn.jar=null, --verbose,
/lib/test.jar, arg0, arg1]>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at
org.apache.oozie.action.hadoop.TestSparkArgsExtractor.testQuotedDriverAndExecutorExtraJavaOptionsParsing(TestSparkArgsExtractor.java:235)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.junit.runners.Suite.runChild(Suite.java:127)
at org.junit.runners.Suite.runChild(Suite.java:26)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
