[
https://issues.apache.org/jira/browse/OOZIE-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16008449#comment-16008449
]
Artem Ervits commented on OOZIE-2780:
-------------------------------------
[~pbacsko] thanks for catching this. I looked at it briefly, specifically
testNewUsingACLs(org.apache.oozie.util.TestZKUtilsWithSecurity):
org/apache/commons/io/Charsets
is due to commons-io version. Both hadoop-2.4 and hadoop 2.6 ship with v. 2.4
and Oozie ships with commons-io 2.1. I was able to reproduce the tests and if I
change commons-io to 2.4 tests pass.
{noformat}
mvn clean -Dtest=org.apache.oozie.util.TestZKUtilsWithSecurity#testNewUsingACLs
test -Dhadoop.version=2.4.0
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m;
support was removed in 8.0
Concurrency config is parallel='classes', perCoreThreadCount=false,
threadCount=1, useUnlimitedThreads=false
objc[37421]: Class JavaLaunchHelper is implemented in both
/Library/Java/JavaVirtualMachines/jdk1.8.0_51.jdk/Contents/Home/jre/bin/java
(0x10f9dd4c0) and
/Library/Java/JavaVirtualMachines/jdk1.8.0_51.jdk/Contents/Home/jre/lib/libinstrument.dylib
(0x118ef04e0). One of the two will be used. Which one is undefined.
Running org.apache.oozie.util.TestZKUtilsWithSecurity
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.103 sec
Results :
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Oozie Main .................................. SUCCESS [ 0.561 s]
[INFO] Apache Oozie Hadoop Utils hadoop-2-4.4.0-SNAPSHOT .. SUCCESS [ 1.790 s]
[INFO] Apache Oozie Hadoop Distcp hadoop-2-4.4.0-SNAPSHOT . SUCCESS [ 0.074 s]
[INFO] Apache Oozie Hadoop Auth hadoop-2-4.4.0-SNAPSHOT Test SUCCESS [ 0.141 s]
[INFO] Apache Oozie Hadoop Libs ........................... SUCCESS [ 0.018 s]
[INFO] Apache Oozie Client ................................ SUCCESS [ 2.707 s]
[INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [ 2.717 s]
[INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [ 2.200 s]
[INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [ 0.731 s]
[INFO] Apache Oozie Core .................................. SUCCESS [ 21.682 s]
[INFO] Apache Oozie Share Lib Streaming ................... SUCCESS [ 4.871 s]
[INFO] Apache Oozie Share Lib Pig ......................... SUCCESS [ 3.887 s]
[INFO] Apache Oozie Share Lib Hive ........................ SUCCESS [ 3.992 s]
[INFO] Apache Oozie Share Lib Hive 2 ...................... SUCCESS [ 3.684 s]
[INFO] Apache Oozie Share Lib Sqoop ....................... SUCCESS [ 2.624 s]
[INFO] Apache Oozie Examples .............................. SUCCESS [ 8.485 s]
[INFO] Apache Oozie Share Lib Spark ....................... SUCCESS [ 27.002 s]
[INFO] Apache Oozie Share Lib ............................. SUCCESS [ 0.017 s]
[INFO] Apache Oozie Docs .................................. SUCCESS [ 0.342 s]
[INFO] Apache Oozie WebApp ................................ SUCCESS [ 1.809 s]
[INFO] Apache Oozie Tools ................................. SUCCESS [ 3.444 s]
[INFO] Apache Oozie MiniOozie ............................. SUCCESS [ 1.463 s]
[INFO] Apache Oozie Server ................................ SUCCESS [ 4.529 s]
[INFO] Apache Oozie Distro ................................ SUCCESS [ 1.836 s]
[INFO] Apache Oozie ZooKeeper Security Tests .............. SUCCESS [ 52.087 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:33 min
[INFO] Finished at: 2017-05-12T13:25:00-04:00
[INFO] Final Memory: 77M/403M
{noformat}
now changing commons-io to 2.4
{noformat}
mvn clean -Dtest=org.apache.oozie.util.TestZKUtilsWithSecurity#testNewUsingACLs
test -Dhadoop.version=2.6.0
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m;
support was removed in 8.0
Concurrency config is parallel='classes', perCoreThreadCount=false,
threadCount=1, useUnlimitedThreads=false
objc[37788]: Class JavaLaunchHelper is implemented in both
/Library/Java/JavaVirtualMachines/jdk1.8.0_51.jdk/Contents/Home/jre/bin/java
(0x1007094c0) and
/Library/Java/JavaVirtualMachines/jdk1.8.0_51.jdk/Contents/Home/jre/lib/libinstrument.dylib
(0x109dd54e0). One of the two will be used. Which one is undefined.
Running org.apache.oozie.util.TestZKUtilsWithSecurity
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.012 sec
Results :
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Oozie Main .................................. SUCCESS [ 0.571 s]
[INFO] Apache Oozie Hadoop Utils hadoop-2-4.4.0-SNAPSHOT .. SUCCESS [ 1.916 s]
[INFO] Apache Oozie Hadoop Distcp hadoop-2-4.4.0-SNAPSHOT . SUCCESS [ 0.072 s]
[INFO] Apache Oozie Hadoop Auth hadoop-2-4.4.0-SNAPSHOT Test SUCCESS [ 0.297 s]
[INFO] Apache Oozie Hadoop Libs ........................... SUCCESS [ 0.016 s]
[INFO] Apache Oozie Client ................................ SUCCESS [ 2.874 s]
[INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [ 2.831 s]
[INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [ 2.036 s]
[INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [ 0.605 s]
[INFO] Apache Oozie Core .................................. SUCCESS [ 22.656 s]
[INFO] Apache Oozie Share Lib Streaming ................... SUCCESS [ 5.421 s]
[INFO] Apache Oozie Share Lib Pig ......................... SUCCESS [ 3.797 s]
[INFO] Apache Oozie Share Lib Hive ........................ SUCCESS [ 4.016 s]
[INFO] Apache Oozie Share Lib Hive 2 ...................... SUCCESS [ 4.117 s]
[INFO] Apache Oozie Share Lib Sqoop ....................... SUCCESS [ 4.525 s]
[INFO] Apache Oozie Examples .............................. SUCCESS [ 12.379 s]
[INFO] Apache Oozie Share Lib Spark ....................... SUCCESS [01:08 min]
[INFO] Apache Oozie Share Lib ............................. SUCCESS [ 0.013 s]
[INFO] Apache Oozie Docs .................................. SUCCESS [ 1.005 s]
[INFO] Apache Oozie WebApp ................................ SUCCESS [ 20.973 s]
[INFO] Apache Oozie Tools ................................. SUCCESS [ 9.835 s]
[INFO] Apache Oozie MiniOozie ............................. SUCCESS [ 6.192 s]
[INFO] Apache Oozie Server ................................ SUCCESS [ 11.923 s]
[INFO] Apache Oozie Distro ................................ SUCCESS [ 1.344 s]
[INFO] Apache Oozie ZooKeeper Security Tests .............. SUCCESS [ 57.580 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 04:06 min
[INFO] Finished at: 2017-05-12T13:34:59-04:00
[INFO] Final Memory: 279M/451M
[INFO] ------------------------------------------------------------------------
{noformat}
Can we track that in a separate jira?
> Upgrade minimum Hadoop version to 2.6.0
> ---------------------------------------
>
> Key: OOZIE-2780
> URL: https://issues.apache.org/jira/browse/OOZIE-2780
> Project: Oozie
> Issue Type: Improvement
> Components: core
> Affects Versions: 4.3.0
> Reporter: Artem Ervits
> Assignee: Artem Ervits
> Priority: Minor
> Labels: newbie
> Fix For: 5.0.0
>
> Attachments: OOZIE-2780-0.patch, OOZIE-2780-1.patch,
> OOZIE-2780-2.patch
>
>
> I'd like to contribute an fs action enhancement to modify extended attributes
> to core but methods to change extended attributes is not available in
> hadoop-common < 2.6.0. Currently hadoop-common is at 2.4. I am contributing a
> patch to bump to 2.6 but so far I haven't been able to generate a clean test
> as tests in core module fail randomly. On the first run, I had a failure on
> {code} Failed tests:
> testCheckAfterActionDelete(org.apache.oozie.service.TestHAPartitionDependencyManagerService):
> Expected: <null> but was: [0000000-170123095541655-oozie-aerv-C@1]{code}
> and on second run
> {code}Failed tests: testWaitFor(org.apache.oozie.test.TestXTestCase):
> expected:<1000.0> but was:<2036.0>{code}
> I can't tell whether it is due to my patch?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
