[
https://issues.apache.org/jira/browse/OOZIE-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15878772#comment-15878772
]
Hadoop QA commented on OOZIE-2802:
----------------------------------
Testing JIRA OOZIE-2802
Cleaning local git workspace
----------------------------
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
. {color:green}+1{color} the patch does not introduce any @author tags
. {color:green}+1{color} the patch does not introduce any tabs
. {color:green}+1{color} the patch does not introduce any trailing spaces
. {color:green}+1{color} the patch does not introduce any line longer than
132
. {color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
. {color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
. {color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
{color:green}+1 COMPILE{color}
. {color:green}+1{color} HEAD compiles
. {color:green}+1{color} patch compiles
. {color:green}+1{color} the patch does not seem to introduce new javac
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in
[hadooplibs/hadoop-utils-2].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
. {color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
. {color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
. Tests run: 1879
. Tests failed: 2
. Tests errors: 0
. The patch failed the following testcases:
.
testMemoryUsageAndSpeed(org.apache.oozie.service.TestPartitionDependencyManagerEhcache)
.
testMemoryUsageAndSpeed(org.apache.oozie.service.TestPartitionDependencyManagerService)
. Tests failing with errors:
.
{color:green}+1 DISTRO{color}
. {color:green}+1{color} distro tarball builds with the patch
----------------------------
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/oozie-trunk-precommit-build/3656/
> Spark action failure on Spark 2.1.0 due to duplicate sharelibs
> --------------------------------------------------------------
>
> Key: OOZIE-2802
> URL: https://issues.apache.org/jira/browse/OOZIE-2802
> Project: Oozie
> Issue Type: Bug
> Reporter: Satish Subhashrao Saley
> Assignee: Peter Cseh
> Attachments: OOZIE-2802-001.patch, spark-2.1-failure-launcherlib.txt
>
>
> There are some same jars in launcher lib and sharelib. These jars are causing
> failures in spark action for spark 2.1.0. SPARK-18099 added an exception to
> be thrown if same file gets added multiple times to distributed cache.
> {code}
> $ hdfs dfs -ls /user/saley/share/lib/launcher_20170216150752/oozie
> 17/02/16 15:14:22 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> Found 3 items
> -rwxr-xr-x 1 saley supergroup 11871 2017-02-16 15:07
> /user/saley/share/lib/launcher_20170216150752/oozie/oozie-hadoop-utils-hadoop-2-4.4.0-SNAPSHOT.jar
> -rwxr-xr-x 1 saley supergroup 17514 2017-02-16 15:07
> /user/saley/share/lib/launcher_20170216150752/oozie/oozie-sharelib-hcatalog-4.4.0-SNAPSHOT.jar
> -rwxr-xr-x 1 saley supergroup 55092 2017-02-16 15:07
> /user/saley/share/lib/launcher_20170216150752/oozie/oozie-sharelib-oozie-4.4.0-SNAPSHOT.jar
> $ hdfs dfs -ls /user/saley/share/lib/lib_20170216150706/oozie
> 17/02/16 15:14:39 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> Found 3 items
> -rw-r--r-- 1 saley supergroup 16046 2017-02-16 15:07
> /user/saley/share/lib/lib_20170216150706/oozie/json-simple-1.1.jar
> -rw-r--r-- 1 saley supergroup 11871 2017-02-16 15:07
> /user/saley/share/lib/lib_20170216150706/oozie/oozie-hadoop-utils-hadoop-2-4.4.0-SNAPSHOT.jar
> -rw-r--r-- 1 saley supergroup 55092 2017-02-16 15:07
> /user/saley/share/lib/lib_20170216150706/oozie/oozie-sharelib-oozie-4.4.0-SNAPSHOT.jar
> {code}
> The file with same name can't be in twice in any of *--files , --archives,
> --jars* (ie one file in both --files and --jars) and can't be in --files
> twice and can't be in --archives twice. It is allowed to be in --jars twice.
> Possible solutions:
> 1. While specifying the --files options, filter out the duplicate jars
> 2. Separate out jars and files. Use --jars options to distribute jars and
> --files for files. Also remember to remove duplicates from --files, and make
> sure that there is nothing common in --jars and --files.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
