[jira] [Commented] (HBASE-25920) Support Hadoop 3.3.1

2021-06-09 Thread Michael Stack (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17360460#comment-17360460
 ] 

Michael Stack commented on HBASE-25920:
---

So, w/ HBASE-25989 in place, I can't get TestLogRolling to fail locally.

 

I think that's enough for this Jira then.

 

We can column to refguide when we have an hbase release we want to call as 
supported on 3.3.1 – we don't have one such yet (2.5.0 will be the first? Or 
2.4.5?)

> Support Hadoop 3.3.1
> 
>
> Key: HBASE-25920
> URL: https://issues.apache.org/jira/browse/HBASE-25920
> Project: HBase
>  Issue Type: Task
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>Priority: Major
> Fix For: 3.0.0-alpha-1, 2.5.0
>
>
> The Hadoop 3.3.1 is a big release, quite different from 3.3.0.
> File this jira to track the support for Hadoop 3.3.1.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-25920) Support Hadoop 3.3.1

2021-06-09 Thread Michael Stack (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17360255#comment-17360255
 ] 

Michael Stack commented on HBASE-25920:
---

TestLogRolling fails most of the time. I was able to get it to fail locally if 
I ran the unit test on repeat. Looking...

> Support Hadoop 3.3.1
> 
>
> Key: HBASE-25920
> URL: https://issues.apache.org/jira/browse/HBASE-25920
> Project: HBase
>  Issue Type: Task
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>Priority: Major
> Fix For: 3.0.0-alpha-1, 2.5.0
>
>
> The Hadoop 3.3.1 is a big release, quite different from 3.3.0.
> File this jira to track the support for Hadoop 3.3.1.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-25920) Support Hadoop 3.3.1

2021-05-31 Thread Wei-Chiu Chuang (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354751#comment-17354751
 ] 

Wei-Chiu Chuang commented on HBASE-25920:
-

bq. Wei-Chiu Chuang yeah these looks like changes to transitive dependencies. 
You're reverting all these for a patch release?
BouncyCastle was committed in 3.3.1 only so no impact.

The lz4 and snappy codec change is a little too much for a patch release imo

> Support Hadoop 3.3.1
> 
>
> Key: HBASE-25920
> URL: https://issues.apache.org/jira/browse/HBASE-25920
> Project: HBase
>  Issue Type: Task
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>Priority: Major
> Fix For: 3.0.0-alpha-1, 2.5.0
>
>
> The Hadoop 3.3.1 is a big release, quite different from 3.3.0.
> File this jira to track the support for Hadoop 3.3.1.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-25920) Support Hadoop 3.3.1

2021-05-28 Thread Michael Stack (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17353632#comment-17353632
 ] 

Michael Stack commented on HBASE-25920:
---

I put up a version of [~weichiu]'s patch to run tests against hadoop 3.3.1.

> Support Hadoop 3.3.1
> 
>
> Key: HBASE-25920
> URL: https://issues.apache.org/jira/browse/HBASE-25920
> Project: HBase
>  Issue Type: Task
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>Priority: Major
> Fix For: 3.0.0-alpha-1, 2.5.0
>
>
> The Hadoop 3.3.1 is a big release, quite different from 3.3.0.
> File this jira to track the support for Hadoop 3.3.1.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-25920) Support Hadoop 3.3.1

2021-05-28 Thread Michael Stack (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17353574#comment-17353574
 ] 

Michael Stack commented on HBASE-25920:
---

I set target for this JIRA to be 2.5.0... so we can get away w/ a few more 
changes... and so a clean point at which we support 3.3.1.

> Support Hadoop 3.3.1
> 
>
> Key: HBASE-25920
> URL: https://issues.apache.org/jira/browse/HBASE-25920
> Project: HBase
>  Issue Type: Task
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>Priority: Major
> Fix For: 3.0.0-alpha-1, 2.5.0
>
>
> The Hadoop 3.3.1 is a big release, quite different from 3.3.0.
> File this jira to track the support for Hadoop 3.3.1.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-25920) Support Hadoop 3.3.1

2021-05-28 Thread Nick Dimiduk (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17353569#comment-17353569
 ] 

Nick Dimiduk commented on HBASE-25920:
--

Thanks for taking us for a spin, btw!

> Support Hadoop 3.3.1
> 
>
> Key: HBASE-25920
> URL: https://issues.apache.org/jira/browse/HBASE-25920
> Project: HBase
>  Issue Type: Task
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>Priority: Major
>
> The Hadoop 3.3.1 is a big release, quite different from 3.3.0.
> File this jira to track the support for Hadoop 3.3.1.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-25920) Support Hadoop 3.3.1

2021-05-28 Thread Nick Dimiduk (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17353568#comment-17353568
 ] 

Nick Dimiduk commented on HBASE-25920:
--

[~weichiu] yeah these looks like changes to transitive dependencies. You're 
reverting all these for a patch release?

> Support Hadoop 3.3.1
> 
>
> Key: HBASE-25920
> URL: https://issues.apache.org/jira/browse/HBASE-25920
> Project: HBase
>  Issue Type: Task
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>Priority: Major
>
> The Hadoop 3.3.1 is a big release, quite different from 3.3.0.
> File this jira to track the support for Hadoop 3.3.1.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-25920) Support Hadoop 3.3.1

2021-05-28 Thread Wei-Chiu Chuang (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17353418#comment-17353418
 ] 

Wei-Chiu Chuang commented on HBASE-25920:
-

For TestBackupSmallTests, we will revert the BouncyCastle change in Hadoop 
3.3.1 RC2. So that's not needed now.

> Support Hadoop 3.3.1
> 
>
> Key: HBASE-25920
> URL: https://issues.apache.org/jira/browse/HBASE-25920
> Project: HBase
>  Issue Type: Task
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>Priority: Major
>
> The Hadoop 3.3.1 is a big release, quite different from 3.3.0.
> File this jira to track the support for Hadoop 3.3.1.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-25920) Support Hadoop 3.3.1

2021-05-28 Thread Michael Stack (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17353410#comment-17353410
 ] 

Michael Stack commented on HBASE-25920:
---

The suggested fix for TestBackupSmallTests works for me. Let me see if can do 
one of the workarounds for the REST test (the test passes for me but my jvm is 
old currently).  TestHBaseConfiguration fixed by HBASE-25928.  The 
TestCompressionTest stuff is interesting to unravel Will be back w/ a 
patch



> Support Hadoop 3.3.1
> 
>
> Key: HBASE-25920
> URL: https://issues.apache.org/jira/browse/HBASE-25920
> Project: HBase
>  Issue Type: Task
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>Priority: Major
>
> The Hadoop 3.3.1 is a big release, quite different from 3.3.0.
> File this jira to track the support for Hadoop 3.3.1.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-25920) Support Hadoop 3.3.1

2021-05-25 Thread Duo Zhang (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351439#comment-17351439
 ] 

Duo Zhang commented on HBASE-25920:
---

Ping [~ndimiduk]. Seems something related to jersey.

> Support Hadoop 3.3.1
> 
>
> Key: HBASE-25920
> URL: https://issues.apache.org/jira/browse/HBASE-25920
> Project: HBase
>  Issue Type: Task
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>Priority: Major
>
> The Hadoop 3.3.1 is a big release, quite different from 3.3.0.
> File this jira to track the support for Hadoop 3.3.1.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-25920) Support Hadoop 3.3.1

2021-05-25 Thread Wei-Chiu Chuang (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351436#comment-17351436
 ] 

Wei-Chiu Chuang commented on HBASE-25920:
-

I am tracking 4 test failures. Some of them require HBase side of change.

[INFO] Running org.apache.hadoop.hbase.rest.TestRESTServerSSL
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.019 s 
<<< FAILURE! - in org.apache.hadoop.hbase.rest.TestRESTServerSSL
[ERROR] org.apache.hadoop.hbase.rest.TestRESTServerSSL  Time elapsed: 0.006 s  
<<< ERROR!
java.security.KeyStoreException: Key protection  algorithm not found: 
java.security.UnrecoverableKeyException: Encrypt Private Key failed: 
unrecognized algorithm name: PBEWithSHA1AndDESede
at 
org.apache.hadoop.hbase.rest.TestRESTServerSSL.generateKeyStore(TestRESTServerSSL.java:153)
at 
org.apache.hadoop.hbase.rest.TestRESTServerSSL.beforeClass(TestRESTServerSSL.java:73)
Caused by: java.security.UnrecoverableKeyException: Encrypt Private Key failed: 
unrecognized algorithm name: PBEWithSHA1AndDESede
at 
org.apache.hadoop.hbase.rest.TestRESTServerSSL.generateKeyStore(TestRESTServerSSL.java:153)
at 
org.apache.hadoop.hbase.rest.TestRESTServerSSL.beforeClass(TestRESTServerSSL.java:73)
Caused by: java.security.NoSuchAlgorithmException: unrecognized algorithm name: 
PBEWithSHA1AndDESede
at 
org.apache.hadoop.hbase.rest.TestRESTServerSSL.generateKeyStore(TestRESTServerSSL.java:153)
at org.apache.hadoop.hbase.rest.TestRESTServerSSL.b

This one appears to be a JDK bug with my jdk8u292. 
https://github.com/bcgit/bc-java/issues/941

[INFO] Running org.apache.hadoop.hbase.backup.TestBackupSmallTests
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.015 s 
<<< FAILURE! - in org.apache.hadoop.hbase.backup.TestBackupSmallTests
[ERROR] org.apache.hadoop.hbase.backup.TestBackupSmallTests  Time elapsed: 
0.007 s  <<< ERROR!
java.lang.NoClassDefFoundError: org/bouncycastle/asn1/edec/EdECObjectIdentifiers
Caused by: java.lang.ClassNotFoundException: 
org.bouncycastle.asn1.edec.EdECObjectIdentifiers


—> it requires updating org.bouncycastle:bcprov-jdk15on to 1.68
  

[ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.901 s 
<<< FAILURE! - in org.apache.hadoop.hbase.util.TestCompressionTest
[ERROR] org.apache.hadoop.hbase.util.TestCompressionTest.testTestCompression  
Time elapsed: 0.419 s  <<< FAILURE!
java.lang.AssertionError
at 
org.apache.hadoop.hbase.util.TestCompressionTest.testTestCompression(TestCompressionTest.java:89)

Hadoop replaced lz4 and lzo codec. The lz4-java is declared in provided scope, 
so downstreamers need to declare it explicitly.


Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.125 s <<< 
FAILURE! - in org.apache.hadoop.hbase.TestHBaseConfiguration
org.apache.hadoop.hbase.TestHBaseConfiguration.testDeprecatedConfigurations  
Time elapsed: 0.02 s  <<< FAILURE!
java.lang.AssertionError: expected null, but was:<1000>
at 
org.apache.hadoop.hbase.TestHBaseConfiguration.testDeprecatedConfigurations(TestHBaseConfiguration.java:150)

No idea at this point.

> Support Hadoop 3.3.1
> 
>
> Key: HBASE-25920
> URL: https://issues.apache.org/jira/browse/HBASE-25920
> Project: HBase
>  Issue Type: Task
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>Priority: Major
>
> The Hadoop 3.3.1 is a big release, quite different from 3.3.0.
> File this jira to track the support for Hadoop 3.3.1.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-25920) Support Hadoop 3.3.1

2021-05-25 Thread Duo Zhang (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351427#comment-17351427
 ] 

Duo Zhang commented on HBASE-25920:
---

Emmm

We introduce big differece with just a patch release? Why?

> Support Hadoop 3.3.1
> 
>
> Key: HBASE-25920
> URL: https://issues.apache.org/jira/browse/HBASE-25920
> Project: HBase
>  Issue Type: Task
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>Priority: Major
>
> The Hadoop 3.3.1 is a big release, quite different from 3.3.0.
> File this jira to track the support for Hadoop 3.3.1.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)