[jira] [Commented] (ZOOKEEPER-3727) Fix 3.5 source tarball to represent the git repository

2020-04-30 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096330#comment-17096330
 ] 

Hadoop QA commented on ZOOKEEPER-3727:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4452//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4452//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4452//console

This message is automatically generated.

> Fix 3.5 source tarball to represent the git repository
> --
>
> Key: ZOOKEEPER-3727
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3727
> Project: ZooKeeper
>  Issue Type: Improvement
>Reporter: Norbert Kalmár
>Assignee: Mate Szalay-Beko
>Priority: Major
> Fix For: 3.5.8
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> There are some difference in the source tarball for recent 3.5 releases, like:
> - Info.java file in zookeeper-server (generated class)
> - checkstyle.xml is missing
> - git.properties file present in tarball
> - missing .gitattributes and .gitignore (the question is should these be even 
> included?)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3355) Remove 'tbd' From Docs

2020-04-29 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17095306#comment-17095306
 ] 

Hadoop QA commented on ZOOKEEPER-3355:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4451//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4451//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4451//console

This message is automatically generated.

> Remove 'tbd' From Docs
> --
>
> Key: ZOOKEEPER-3355
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3355
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: documentation
>Affects Versions: 3.5.4, 3.6.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Trivial
>  Labels: pull-request-available
> Fix For: 3.6.0, 3.5.8
>
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> For years, there have been lots of 'tbd' recorded in the documentation.  It 
> does not look very polished and there is no one working on these.  I think 
> it's time to finally remove them.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3357) Remove Dead Link from ZooKeeper Programmer's Guide

2020-04-29 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17095259#comment-17095259
 ] 

Hadoop QA commented on ZOOKEEPER-3357:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4448//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4448//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4448//console

This message is automatically generated.

> Remove Dead Link from ZooKeeper Programmer's Guide
> --
>
> Key: ZOOKEEPER-3357
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3357
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: documentation
>Affects Versions: 3.5.4, 3.6.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Trivial
>  Labels: pull-request-available
> Fix For: 3.7.0, 3.5.8
>
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> Remove dead link to _ZooKeeper Talk at the Hadoup Summit 2008_



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3751) upgrade jackson-databind to 2.10 from 2.9

2020-04-28 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17094633#comment-17094633
 ] 

Hadoop QA commented on ZOOKEEPER-3751:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4443//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4443//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4443//console

This message is automatically generated.

> upgrade jackson-databind to 2.10 from 2.9
> -
>
> Key: ZOOKEEPER-3751
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3751
> Project: ZooKeeper
>  Issue Type: Task
>  Components: security
>Affects Versions: 3.6.0, 3.5.7, 3.7.0
>Reporter: Patrick D. Hunt
>Assignee: Patrick D. Hunt
>Priority: Critical
>  Labels: pull-request-available
> Fix For: 3.7.0, 3.6.1
>
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> Upgrade jackson-databind to 2.10 form 2.9. 2.10 is the current latest 
> version. Also we've been seeing lots of vulnerability reports with 2.9 - 
> perhaps this will help.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3739) Remove use of com.sun.nio.file.SensitivityWatchEventModifier

2020-04-28 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17094525#comment-17094525
 ] 

Hadoop QA commented on ZOOKEEPER-3739:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4439//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4439//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4439//console

This message is automatically generated.

> Remove use of com.sun.nio.file.SensitivityWatchEventModifier
> 
>
> Key: ZOOKEEPER-3739
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3739
> Project: ZooKeeper
>  Issue Type: Bug
>  Components: build, server
>Reporter: Christopher Tubbs
>Assignee: Christopher Tubbs
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.7.0, 3.6.1
>
>  Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> For better support building on newer JDKs, the unsupported class, 
> com.sun.nio.file.SensitivityWatchEventModifier, must not be used.
> I will submit a PR for this.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-2307) ZooKeeper not starting because acceptedEpoch is less than the currentEpoch

2020-04-28 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17094406#comment-17094406
 ] 

Hadoop QA commented on ZOOKEEPER-2307:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 5 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4436//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4436//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4436//console

This message is automatically generated.

> ZooKeeper not starting because acceptedEpoch is less than the currentEpoch
> --
>
> Key: ZOOKEEPER-2307
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2307
> Project: ZooKeeper
>  Issue Type: Bug
>  Components: server
>Reporter: Mohammad Arshad
>Assignee: Mohammad Arshad
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0
>
> Attachments: ZOOKEEPER-2307-01.patch, ZOOKEEPER-2307-02.patch, 
> ZOOKEEPER-2307-03.patch, ZOOKEEPER-2307-04.patch
>
>  Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> This issue occurred in one of our test environment where disk was being 
> changed to read only very frequently.
> The the scenario is as follows:
> # Configure three node ZooKeeper cluster, lets say nodes are A, B and C
> # Start A and B. Both A and B start successfully, quorum is running.
> # Start C, because of IO error C fails to update acceptedEpoch file. But C 
> also starts successfully, joins the quorum as follower
> # Stop C
> # Start C, bellow exception with message "The accepted epoch, 0 is less than 
> the current epoch, 1" is thrown
> {code}
> 2015-10-29 16:52:32,942 [myid:3] - ERROR [main:QuorumPeer@784] - Unable to 
> load database on disk
> java.io.IOException: The accepted epoch, 0 is less than the current epoch, 1
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeer.loadDataBase(QuorumPeer.java:781)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeer.start(QuorumPeer.java:720)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:202)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:139)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:88)
> 2015-10-29 16:52:32,946 [myid:3] - ERROR [main:QuorumPeerMain@111] - 
> Unexpected exception, exiting abnormally
> java.lang.RuntimeException: Unable to run quorum server 
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeer.loadDataBase(QuorumPeer.java:785)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeer.start(QuorumPeer.java:720)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:202)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:139)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:88)
> Caused by: java.io.IOException: The accepted epoch, 0 is less than the 
> current epoch, 1
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeer.loadDataBase(QuorumPeer.java:781)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-2307) ZooKeeper not starting because acceptedEpoch is less than the currentEpoch

2020-04-28 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17094322#comment-17094322
 ] 

Hadoop QA commented on ZOOKEEPER-2307:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 5 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4432//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4432//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4432//console

This message is automatically generated.

> ZooKeeper not starting because acceptedEpoch is less than the currentEpoch
> --
>
> Key: ZOOKEEPER-2307
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2307
> Project: ZooKeeper
>  Issue Type: Bug
>  Components: server
>Reporter: Mohammad Arshad
>Assignee: Mohammad Arshad
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0
>
> Attachments: ZOOKEEPER-2307-01.patch, ZOOKEEPER-2307-02.patch, 
> ZOOKEEPER-2307-03.patch, ZOOKEEPER-2307-04.patch
>
>  Time Spent: 2h 20m
>  Remaining Estimate: 0h
>
> This issue occurred in one of our test environment where disk was being 
> changed to read only very frequently.
> The the scenario is as follows:
> # Configure three node ZooKeeper cluster, lets say nodes are A, B and C
> # Start A and B. Both A and B start successfully, quorum is running.
> # Start C, because of IO error C fails to update acceptedEpoch file. But C 
> also starts successfully, joins the quorum as follower
> # Stop C
> # Start C, bellow exception with message "The accepted epoch, 0 is less than 
> the current epoch, 1" is thrown
> {code}
> 2015-10-29 16:52:32,942 [myid:3] - ERROR [main:QuorumPeer@784] - Unable to 
> load database on disk
> java.io.IOException: The accepted epoch, 0 is less than the current epoch, 1
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeer.loadDataBase(QuorumPeer.java:781)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeer.start(QuorumPeer.java:720)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:202)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:139)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:88)
> 2015-10-29 16:52:32,946 [myid:3] - ERROR [main:QuorumPeerMain@111] - 
> Unexpected exception, exiting abnormally
> java.lang.RuntimeException: Unable to run quorum server 
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeer.loadDataBase(QuorumPeer.java:785)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeer.start(QuorumPeer.java:720)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:202)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:139)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:88)
> Caused by: java.io.IOException: The accepted epoch, 0 is less than the 
> current epoch, 1
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeer.loadDataBase(QuorumPeer.java:781)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3780) restore Version.getRevision() to be backward compatible

2020-04-07 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17077547#comment-17077547
 ] 

Hadoop QA commented on ZOOKEEPER-3780:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4396//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4396//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4396//console

This message is automatically generated.

> restore Version.getRevision() to be backward compatible
> ---
>
> Key: ZOOKEEPER-3780
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3780
> Project: ZooKeeper
>  Issue Type: Bug
>Affects Versions: 3.6.0, 3.5.6, 3.5.7
>Reporter: Norbert Kalmár
>Assignee: Norbert Kalmár
>Priority: Critical
>  Labels: pull-request-available
> Fix For: 3.7.0, 3.6.1, 3.5.8
>
>  Time Spent: 3h 10m
>  Remaining Estimate: 0h
>
> We removed the getRevision() function in 3.5.6:
> https://github.com/apache/zookeeper/commit/96880c0b2ba39f1841f8bdc4a0119a467b462d03#diff-1d42dde48d42e3baf819e22b56a880a7
> Some projects (like HBase for example) are actually using this method. 
> (Although not relevant anymore, since we are on git).
> 3.5.6, 3.5.7 and 3.6.0 does not have this method anymore. However, if someone 
> is using this function, to make upgrading easier, we should restore it.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3716) upgrade netty 4.1.42 to address CVE-2019-20444 CVE-2019-20445

2020-02-03 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17029515#comment-17029515
 ] 

Hadoop QA commented on ZOOKEEPER-3716:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4344//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4344//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4344//console

This message is automatically generated.

> upgrade netty 4.1.42 to address CVE-2019-20444 CVE-2019-20445
> -
>
> Key: ZOOKEEPER-3716
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3716
> Project: ZooKeeper
>  Issue Type: Bug
>  Components: security, server
>Affects Versions: 3.6.0, 3.5.6, 3.7.0
>Reporter: Patrick D. Hunt
>Assignee: Patrick D. Hunt
>Priority: Blocker
>  Labels: pull-request-available
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> OWASP dependency-check is failing 
> upgrade netty 4.1.42 to address CVE-2019-20444 CVE-2019-20445
> [ERROR] netty-transport-4.1.42.Final.jar: CVE-2019-20445, CVE-2019-20444
> We need to upgrade to netty 4.1.45 (current latest) or later



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3701) Split brain on log disk full

2020-01-29 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17025973#comment-17025973
 ] 

Hadoop QA commented on ZOOKEEPER-3701:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 6 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4337//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4337//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4337//console

This message is automatically generated.

> Split brain on log disk full
> 
>
> Key: ZOOKEEPER-3701
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3701
> Project: ZooKeeper
>  Issue Type: Bug
>Affects Versions: 3.4.13, 3.5.6
>Reporter: Ivan Kelly
>Assignee: Andor Molnar
>Priority: Blocker
>  Labels: pull-request-available
>  Time Spent: 6h
>  Remaining Estimate: 0h
>
>  We ran into a situation where the cluster ended up with split brain when the 
> log disk filled up on a node.
> The ZK cluster(3 node) in question was being used as the metadata store for 
> Pulsar. There was an outage in the Pulsar cluster, where two the ZK nodes 
> filled up there log disks, causing the cluster to lose quorum. Once we 
> rectified the full disk situation and restarted the nodes everything seemed 
> to work, but we started getting a lot of log messages about 
> UpdateMetadataLoop retrying. UpdateMetadataLoop is used to update bookkeeper 
> ledger metadata. If it sees a write conflict it rereads the znode, checks 
> whether the update needs to happen, applies it and writes. These retries were 
> flooding the log on a subset of the brokers. It turned out that it was 
> reading a znode with version 0, but when it tried the setData with version 
> set to 0 it was failing because the znode had a version of 2 (there were many 
> instances of this). After investigating this, we saw that the znode had a 
> different stat and value on ZK-1 to that on ZK-0 & ZK-2.
> We resolved the situation by deleting the log and snapshots from ZK-1 and 
> restarting, at which point everything went back to normal. Had ZK-1 managed 
> to become leader we would have been in a lot of trouble, but thankfully this 
> didn't happen.
> For the sequence of events that led to split brain, I'll refer to the 
> following code.
> {code}
> public class FileTxnSnapLog {
> ...
> public boolean truncateLog(long zxid) throws IOException {
> // close the existing txnLog and snapLog
> close();
> // truncate it
> FileTxnLog truncLog = new FileTxnLog(dataDir);
> boolean truncated = truncLog.truncate(zxid);
> truncLog.close();
> // re-open the txnLog and snapLog
> // I'd rather just close/reopen this object itself, however that 
> // would have a big impact outside ZKDatabase as there are other
> // objects holding a reference to this object.
> txnLog = new FileTxnLog(dataDir);
> snapLog = new FileSnap(snapDir);
> return truncated;
> }
> public void close() throws IOException {
> txnLog.close();
> snapLog.close();
> }
> }
> public class FileSnap implements SnapShot {
> ...
> public synchronized void serialize(DataTree dt, Map 
> sessions, File snapShot)
> throws IOException {
> if (!close) {
> // actual snapshot code
> }
> }
> @Override
> public synchronized void close() throws IOException {
> close = true;
> }
> }
> {code}
> The sequence of events that lead to the failure are:
> | 2020-01-04 01:56:56Z | ZK-2 fails to write to its transaction log due to 
> disk full. ZK-2 is still participating in leader election. ZK-2 becomes a 
> follower of ZK-1. ZK-1 sends TRUNC to ZK-2. truncLog.truncate on ZK-2 throws 
> an exception because of the disk being full, and leaves the process in a 
> broken state. |
> |2020-01-04 02:35:23Z | ZK-2 removes 9 transaction logs from disk (bringing 
> it from 100% to 19%). It doesn't recover because its in a broken state. |

[jira] [Commented] (ZOOKEEPER-3638) Update Jetty to 9.4.24.v20191120

2020-01-06 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008932#comment-17008932
 ] 

Hadoop QA commented on ZOOKEEPER-3638:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

-1 release audit.  The applied patch generated 1 release audit warnings 
(more than the trunk's current 0 warnings).

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4313//testReport/
Release audit warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4313//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4313//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4313//console

This message is automatically generated.

> Update Jetty to 9.4.24.v20191120
> 
>
> Key: ZOOKEEPER-3638
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3638
> Project: ZooKeeper
>  Issue Type: Improvement
>Reporter: Colm O hEigeartaigh
>Assignee: Colm O hEigeartaigh
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.5.7, 3.7.0
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> Jetty should be updated to the latest version (9.4.24.v20191120) to pick up 
> some CVE fixes.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3539) Fix branch-3.5 after upgrade on ASF CI

2019-12-16 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997266#comment-16997266
 ] 

Hadoop QA commented on ZOOKEEPER-3539:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 1 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4299//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4299//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4299//console

This message is automatically generated.

> Fix branch-3.5 after upgrade on ASF CI
> --
>
> Key: ZOOKEEPER-3539
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3539
> Project: ZooKeeper
>  Issue Type: Task
>  Components: build, build-infrastructure
>Affects Versions: 3.5.5
>Reporter: Enrico Olivelli
>Assignee: Enrico Olivelli
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 3.5.6
>
>  Time Spent: 2h 10m
>  Remaining Estimate: 0h
>
> ASF CI now lacks "findbugs" tool.
> ASF CI upgraded gcc and now there are some errors related to the usage of 
> NULL in calls of fprintf.
> We should:
> - disable findbugs on CI ant-based tasks
> - use LOG_DEBUG consistently with the rest of code in C client
> Please note that on branch-3.5 we are officially using Maven and Spotbugs, 
> ant stuff is there only for compatibility in build, findbugs is not strictly 
> needed to check the goodness of code in branch-3.5.
> branch-3.4 is only with ANT, let's treat this problem as a different task 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3388) Allow client port to support plaintext and encrypted connections simultaneously

2019-12-16 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997188#comment-16997188
 ] 

Hadoop QA commented on ZOOKEEPER-3388:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 6 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4297//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4297//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4297//console

This message is automatically generated.

> Allow client port to support plaintext and encrypted connections 
> simultaneously
> ---
>
> Key: ZOOKEEPER-3388
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3388
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: server
>Affects Versions: 3.6.0
>Reporter: Brian Nixon
>Priority: Minor
>  Labels: pull-request-available
> Fix For: 3.6.0
>
>  Time Spent: 4h 10m
>  Remaining Estimate: 0h
>
> ZOOKEEPER-2125 extended the ZooKeeper server-side to handle encrypted client 
> connections by allowing the server to open a second client port (the secure 
> client port) to manage this new style of traffic. A server is able to handle 
> plaintext and encrypted clients simultaneously by managing each on their 
> respective ports. 
> When it comes time to get all clients connecting to your system to start 
> using encryption, this approach requires that they make two changes 
> simultaneously: altering their client properties to start use the secure 
> settings and altering the routing information that they provide in order to 
> know where to connect with the ensemble. If either is misconfigured then the 
> client is cut off from the ensemble. With a large deployment of clients that 
> are owned by a different teams and different tools, this presents a danger in 
> activating the feature. Ideally, the two changes could be staggered so that 
> first the encryption feature is activated and then the routing information is 
> changed in a subsequent phase.
> Allow the server connection factory managing the regular client port to 
> handle both plaintext and encrypted connections. This will be independent of 
> the operation of the server connection factory managing the secure client 
> port but similar settings ought to apply to both (e.g. cipher suites) to 
> maintain inter compatibility.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3644) Data loss after upgrading standalone ZK server 3.4.14 to 3.5.6 with snapshot.trust.empty=true

2019-12-15 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997014#comment-16997014
 ] 

Hadoop QA commented on ZOOKEEPER-3644:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 3 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4295//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4295//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4295//console

This message is automatically generated.

> Data loss after upgrading standalone ZK server 3.4.14 to 3.5.6 with 
> snapshot.trust.empty=true
> -
>
> Key: ZOOKEEPER-3644
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3644
> Project: ZooKeeper
>  Issue Type: Bug
>  Components: server
>Affects Versions: 3.5.6
>Reporter: Manikumar
>Assignee: Michael Han
>Priority: Blocker
>  Labels: pull-request-available
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> We have tried to upgrade single node *standalone* ZK server from 3.4.14 to 
> 3.5.6.  There were no snapshot files, so as suggested in ZOOKEEPER-3056, we 
> have set snapshot.trust.empty to true. After server startup, when we tried to 
> list the znodes, we found that znodes are missing.
> Steps to reproduce:
>  # Start a single node ZK 3.4.14 server and create few znodes
>  # Upgrade the server to 3.5.6 with  snapshot.trust.empty=true config
>  # try to list the znodes using zkShell
> Looking into the [source 
> code|https://github.com/apache/zookeeper/blob/release-3.5.6/zookeeper-server/src/main/java/org/apache/zookeeper/server/persistence/FileTxnSnapLog.java#L224],
>  looks like we are not reading transaction log if there are no snapshot files 
> and snapshot.trust.empty is set to true.
> ZK 3.5.6 logs:
> {quote}[2019-12-07 12:13:35,007] INFO Created server with tickTime 3000 
> minSessionTimeout 6000 maxSessionTimeout 6 datadir 
> /var/lib/zookeeper/version-2 snapdir /var/lib/zookeeper/version-2
>   (org.apache.zookeeper.server.ZooKeeperServer)
>  [2019-12-07 12:13:35,012] INFO Using 
> org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory 
> (org.apache.zookeeper.server.ServerCnxnFactory)
>  [2019-12-07 12:13:35,014] INFO Configuring NIO connection handler with 10s 
> sessionless connection timeout, 1 selector thread(s), 12 worker threads, and 
> 64 kB direct buffers. (org.apache
>  .zookeeper.server.NIOServerCnxnFactory)
>  [2019-12-07 12:13:35,017] INFO binding to port 
> [0.0.0.0/0.0.0.0:2181|http://0.0.0.0/0.0.0.0:2181] 
> (org.apache.zookeeper.server.NIOServerCnxnFactory)
>  [2019-12-07 12:13:35,027] INFO zookeeper.snapshotSizeFactor = 0.33 
> (org.apache.zookeeper.server.ZKDatabase)
>  [2019-12-07 12:13:35,029] DEBUG Created new input stream 
> /var/lib/zookeeper/version-2/log.1 
> (org.apache.zookeeper.server.persistence.FileTxnLog)
>  [2019-12-07 12:13:35,031] DEBUG Created new input archive 
> /var/lib/zookeeper/version-2/log.1 
> (org.apache.zookeeper.server.persistence.FileTxnLog)
>  [2019-12-07 12:13:35,035] DEBUG EOF exception java.io.EOFException: Failed 
> to read /var/lib/zookeeper/version-2/log.1 
> (org.apache.zookeeper.server.persistence.FileTxnLog)
>  [2019-12-07 12:13:35,035] WARN No snapshot found, but there are log entries. 
> This should only be allowed during upgrading. 
> (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
>  [2019-12-07 12:13:35,035] INFO Snapshotting: 0x0 to 
> /var/lib/zookeeper/version-2/snapshot.0 
> (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
>  [2019-12-07 12:13:35,036] INFO Snapshotting: 0x0 to 
> /var/lib/zookeeper/version-2/snapshot.0 
> (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
>  [2019-12-07 12:13:35,050] INFO Using checkIntervalMs=6 
> maxPerMinute=1 (org.apache.zookeeper.server.ContainerManager)
>  [2019-12-07 12:15:07,137] DEBUG Accepted socket connection from 
> /[127.0.0.1:3|http://127.0.0.1:3/] 
> (org.apache.zookeeper.server.NIOServerCnxnFacto

[jira] [Commented] (ZOOKEEPER-3388) Allow client port to support plaintext and encrypted connections simultaneously

2019-12-11 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993553#comment-16993553
 ] 

Hadoop QA commented on ZOOKEEPER-3388:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 6 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4291//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4291//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4291//console

This message is automatically generated.

> Allow client port to support plaintext and encrypted connections 
> simultaneously
> ---
>
> Key: ZOOKEEPER-3388
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3388
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: server
>Affects Versions: 3.6.0
>Reporter: Brian Nixon
>Priority: Minor
>  Labels: pull-request-available
> Fix For: 3.6.0
>
>  Time Spent: 3.5h
>  Remaining Estimate: 0h
>
> ZOOKEEPER-2125 extended the ZooKeeper server-side to handle encrypted client 
> connections by allowing the server to open a second client port (the secure 
> client port) to manage this new style of traffic. A server is able to handle 
> plaintext and encrypted clients simultaneously by managing each on their 
> respective ports. 
> When it comes time to get all clients connecting to your system to start 
> using encryption, this approach requires that they make two changes 
> simultaneously: altering their client properties to start use the secure 
> settings and altering the routing information that they provide in order to 
> know where to connect with the ensemble. If either is misconfigured then the 
> client is cut off from the ensemble. With a large deployment of clients that 
> are owned by a different teams and different tools, this presents a danger in 
> activating the feature. Ideally, the two changes could be staggered so that 
> first the encryption feature is activated and then the routing information is 
> changed in a subsequent phase.
> Allow the server connection factory managing the regular client port to 
> handle both plaintext and encrypted connections. This will be independent of 
> the operation of the server connection factory managing the secure client 
> port but similar settings ought to apply to both (e.g. cipher suites) to 
> maintain inter compatibility.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3539) Fix branch-3.5 after upgrade on ASF CI

2019-11-29 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16985066#comment-16985066
 ] 

Hadoop QA commented on ZOOKEEPER-3539:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 1 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4277//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4277//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4277//console

This message is automatically generated.

> Fix branch-3.5 after upgrade on ASF CI
> --
>
> Key: ZOOKEEPER-3539
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3539
> Project: ZooKeeper
>  Issue Type: Task
>  Components: build, build-infrastructure
>Affects Versions: 3.5.5
>Reporter: Enrico Olivelli
>Assignee: Enrico Olivelli
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 3.5.6
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>
> ASF CI now lacks "findbugs" tool.
> ASF CI upgraded gcc and now there are some errors related to the usage of 
> NULL in calls of fprintf.
> We should:
> - disable findbugs on CI ant-based tasks
> - use LOG_DEBUG consistently with the rest of code in C client
> Please note that on branch-3.5 we are officially using Maven and Spotbugs, 
> ant stuff is there only for compatibility in build, findbugs is not strictly 
> needed to check the goodness of code in branch-3.5.
> branch-3.4 is only with ANT, let's treat this problem as a different task 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3627) Update Jackson to 2.9.10.1 and the Owasp plugin to 5.2.4

2019-11-25 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981609#comment-16981609
 ] 

Hadoop QA commented on ZOOKEEPER-3627:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4269//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4269//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4269//console

This message is automatically generated.

> Update Jackson to 2.9.10.1 and the Owasp plugin to 5.2.4
> 
>
> Key: ZOOKEEPER-3627
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3627
> Project: ZooKeeper
>  Issue Type: Improvement
>Reporter: Colm O hEigeartaigh
>Assignee: Colm O hEigeartaigh
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0, 3.5.7
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>
> Jackson databind should be updated to 2.9.10.1 to pick up a CVE fix. This 
> task also includes updating the owasp maven plugin to the latest version, 
> which helps to detect CVE issues.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3627) Update Jackson to 2.9.10.1 and the Owasp plugin to 5.2.4

2019-11-25 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981436#comment-16981436
 ] 

Hadoop QA commented on ZOOKEEPER-3627:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4267//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4267//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4267//console

This message is automatically generated.

> Update Jackson to 2.9.10.1 and the Owasp plugin to 5.2.4
> 
>
> Key: ZOOKEEPER-3627
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3627
> Project: ZooKeeper
>  Issue Type: Improvement
>Reporter: Colm O hEigeartaigh
>Assignee: Colm O hEigeartaigh
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0, 3.5.7
>
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> Jackson databind should be updated to 2.9.10.1 to pick up a CVE fix. This 
> task also includes updating the owasp maven plugin to the latest version, 
> which helps to detect CVE issues.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-1260) Audit logging in ZooKeeper servers.

2019-10-03 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-1260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16943825#comment-16943825
 ] 

Hadoop QA commented on ZOOKEEPER-1260:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 10 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4189//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4189//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4189//console

This message is automatically generated.

> Audit logging in ZooKeeper servers.
> ---
>
> Key: ZOOKEEPER-1260
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-1260
> Project: ZooKeeper
>  Issue Type: New Feature
>  Components: server
>Reporter: Mahadev Konar
>Assignee: Mohammad Arshad
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0, 3.5.7
>
> Attachments: ZOOKEEPER-1260-01.patch, zookeeperAuditLogs.pdf
>
>  Time Spent: 5h 20m
>  Remaining Estimate: 0h
>
> Lots of users have had questions on debugging which client changed what znode 
> and what updates went through a znode. We should add audit logging as in 
> Hadoop (look at Namenode Audit logging) to log which client changed what in 
> the zookeeper servers. This could just be a log4j audit logger.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-1260) Audit logging in ZooKeeper servers.

2019-10-02 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-1260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16943051#comment-16943051
 ] 

Hadoop QA commented on ZOOKEEPER-1260:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 10 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4180//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4180//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4180//console

This message is automatically generated.

> Audit logging in ZooKeeper servers.
> ---
>
> Key: ZOOKEEPER-1260
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-1260
> Project: ZooKeeper
>  Issue Type: New Feature
>  Components: server
>Reporter: Mahadev Konar
>Assignee: Mohammad Arshad
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0, 3.5.7
>
> Attachments: ZOOKEEPER-1260-01.patch, zookeeperAuditLogs.pdf
>
>  Time Spent: 2h 40m
>  Remaining Estimate: 0h
>
> Lots of users have had questions on debugging which client changed what znode 
> and what updates went through a znode. We should add audit logging as in 
> Hadoop (look at Namenode Audit logging) to log which client changed what in 
> the zookeeper servers. This could just be a log4j audit logger.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3563) dependency check failing on 3.4 and 3.5 branches - CVE-2019-16869 on Netty

2019-10-01 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942041#comment-16942041
 ] 

Hadoop QA commented on ZOOKEEPER-3563:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4175//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4175//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4175//console

This message is automatically generated.

> dependency check failing on 3.4 and 3.5 branches - CVE-2019-16869 on Netty
> --
>
> Key: ZOOKEEPER-3563
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3563
> Project: ZooKeeper
>  Issue Type: Bug
>  Components: security
>Affects Versions: 3.5.5, 3.4.14
>Reporter: Patrick D. Hunt
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 3.4.15, 3.5.6
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> The mvn dependency check is failing on 3.4 and 3.5:
> 3.4:
> [ERROR] netty-3.10.6.Final.jar: CVE-2019-16869
> 3.5:
> [ERROR] netty-transport-4.1.29.Final.jar: CVE-2019-16869



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3563) dependency check failing on 3.4 and 3.5 branches - CVE-2019-16869 on Netty

2019-09-30 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941421#comment-16941421
 ] 

Hadoop QA commented on ZOOKEEPER-3563:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 2 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4169//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4169//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4169//console

This message is automatically generated.

> dependency check failing on 3.4 and 3.5 branches - CVE-2019-16869 on Netty
> --
>
> Key: ZOOKEEPER-3563
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3563
> Project: ZooKeeper
>  Issue Type: Bug
>  Components: security
>Affects Versions: 3.5.5, 3.4.14
>Reporter: Patrick D. Hunt
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 3.4.15, 3.5.6
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> The mvn dependency check is failing on 3.4 and 3.5:
> 3.4:
> [ERROR] netty-3.10.6.Final.jar: CVE-2019-16869
> 3.5:
> [ERROR] netty-transport-4.1.29.Final.jar: CVE-2019-16869



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3496) Transaction larger than jute.maxbuffer makes ZooKeeper unavailable

2019-09-24 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937045#comment-16937045
 ] 

Hadoop QA commented on ZOOKEEPER-3496:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 3 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4152//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4152//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4152//console

This message is automatically generated.

> Transaction larger than jute.maxbuffer makes ZooKeeper unavailable
> --
>
> Key: ZOOKEEPER-3496
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3496
> Project: ZooKeeper
>  Issue Type: Bug
>Affects Versions: 3.5.5, 3.4.14
>Reporter: Mohammad Arshad
>Assignee: Mohammad Arshad
>Priority: Critical
>  Labels: pull-request-available
> Fix For: 3.6.0, 3.4.15, 3.5.7
>
> Attachments: ZOOKEEPER-3496-001.patch
>
>  Time Spent: 4h 20m
>  Remaining Estimate: 0h
>
> *Problem:*
> ZooKeeper server fails to start, logs following error
> {code:java}
> Exception in thread "main" java.io.IOException: Unreasonable length = 1001025
>  at 
> org.apache.jute.BinaryInputArchive.checkLength(BinaryInputArchive.java:127)
>  at 
> org.apache.jute.BinaryInputArchive.readBuffer(BinaryInputArchive.java:92)
> {code}
> This indicates that one of the transactions size is more than the configured  
> jute.maxbuffer values. But how transaction more than jute.maxbuffer size is 
> allowed to write? 
> *Analysis:*
> At ZooKeeper server jute.maxbuffer specifies the maximum size of a 
> transaction. By default it is 1 MB at the server
> jute.maxbuffer is used for following:
> # Size sanity check of incoming request. Incoming requests size must not be 
> more than jute.maxbuffer
> # Size sanity check of the transaction while reading from transaction or 
> snapshot file. Transaction size must not be more than jute.maxbuffer+1024
> # Size sanity check of transaction while reading data from the leader. 
> Transaction size must not be more than jute.maxbuffer+1024
> Request size sanity check is done in the beginning of a request processing 
> but later request processing adds additional information into request then 
> writes to transaction file. This additional information size is not 
> considered in sanity check. This is how transaction larger than 
> jute.maxbuffer are accepted into ZooKeeper.  
> If this additional information size is less than 1024 Bytes then it is OK as 
> ZooKeeper already takes care of it. 
> But if this additional information size is more than 1024 bytes it allows the 
> request, But while reading from transaction/snapshot file and while reading 
> from leader it fails and make the ZooKeeper service unavailable  
> +Example:+
> Suppose incoming request size is 100 Bytes
> Configured jute.maxbuffer is 100
> After processing the request ZooKeeper server adds 1025 more bytes
> In this case, request will be processed successfully, and 100+1025 bytes 
> will be written to transaction file
> But while reading from the transaction log 100+1025 bytes cannot be read 
> as max allowed length is 100(effectively 100+1024).
> *Solutions:*
> If incoming request size sanity check is done after populating all additional 
> information then this problem is solved. But doing sanity check in the later 
> stage of request processing will defeat the purpose of sanity check itself. 
> So this we can not do
> Currently additional information size is constant 1024 Bytes [Code 
> Reference|https://github.com/apache/zookeeper/blob/branch-3.5/zookeeper-jute/src/main/java/org/apache/jute/BinaryInputArchive.java#L126].
>  We should increase this value and make it more reasonable. I propose to make 
> this additional information size to same as the jute.maxbuffer. Also make 
> additional information size configurable.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3496) Transaction larger than jute.maxbuffer makes ZooKeeper unavailable

2019-09-23 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16936131#comment-16936131
 ] 

Hadoop QA commented on ZOOKEEPER-3496:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 3 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4150//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4150//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4150//console

This message is automatically generated.

> Transaction larger than jute.maxbuffer makes ZooKeeper unavailable
> --
>
> Key: ZOOKEEPER-3496
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3496
> Project: ZooKeeper
>  Issue Type: Bug
>Affects Versions: 3.5.5, 3.4.14
>Reporter: Mohammad Arshad
>Assignee: Mohammad Arshad
>Priority: Critical
>  Labels: pull-request-available
> Fix For: 3.6.0, 3.4.15, 3.5.7
>
> Attachments: ZOOKEEPER-3496-001.patch
>
>  Time Spent: 4h
>  Remaining Estimate: 0h
>
> *Problem:*
> ZooKeeper server fails to start, logs following error
> {code:java}
> Exception in thread "main" java.io.IOException: Unreasonable length = 1001025
>  at 
> org.apache.jute.BinaryInputArchive.checkLength(BinaryInputArchive.java:127)
>  at 
> org.apache.jute.BinaryInputArchive.readBuffer(BinaryInputArchive.java:92)
> {code}
> This indicates that one of the transactions size is more than the configured  
> jute.maxbuffer values. But how transaction more than jute.maxbuffer size is 
> allowed to write? 
> *Analysis:*
> At ZooKeeper server jute.maxbuffer specifies the maximum size of a 
> transaction. By default it is 1 MB at the server
> jute.maxbuffer is used for following:
> # Size sanity check of incoming request. Incoming requests size must not be 
> more than jute.maxbuffer
> # Size sanity check of the transaction while reading from transaction or 
> snapshot file. Transaction size must not be more than jute.maxbuffer+1024
> # Size sanity check of transaction while reading data from the leader. 
> Transaction size must not be more than jute.maxbuffer+1024
> Request size sanity check is done in the beginning of a request processing 
> but later request processing adds additional information into request then 
> writes to transaction file. This additional information size is not 
> considered in sanity check. This is how transaction larger than 
> jute.maxbuffer are accepted into ZooKeeper.  
> If this additional information size is less than 1024 Bytes then it is OK as 
> ZooKeeper already takes care of it. 
> But if this additional information size is more than 1024 bytes it allows the 
> request, But while reading from transaction/snapshot file and while reading 
> from leader it fails and make the ZooKeeper service unavailable  
> +Example:+
> Suppose incoming request size is 100 Bytes
> Configured jute.maxbuffer is 100
> After processing the request ZooKeeper server adds 1025 more bytes
> In this case, request will be processed successfully, and 100+1025 bytes 
> will be written to transaction file
> But while reading from the transaction log 100+1025 bytes cannot be read 
> as max allowed length is 100(effectively 100+1024).
> *Solutions:*
> If incoming request size sanity check is done after populating all additional 
> information then this problem is solved. But doing sanity check in the later 
> stage of request processing will defeat the purpose of sanity check itself. 
> So this we can not do
> Currently additional information size is constant 1024 Bytes [Code 
> Reference|https://github.com/apache/zookeeper/blob/branch-3.5/zookeeper-jute/src/main/java/org/apache/jute/BinaryInputArchive.java#L126].
>  We should increase this value and make it more reasonable. I propose to make 
> this additional information size to same as the jute.maxbuffer. Also make 
> additional information size configurable.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3496) Transaction larger than jute.maxbuffer makes ZooKeeper unavailable

2019-09-20 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934358#comment-16934358
 ] 

Hadoop QA commented on ZOOKEEPER-3496:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 3 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4148//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4148//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4148//console

This message is automatically generated.

> Transaction larger than jute.maxbuffer makes ZooKeeper unavailable
> --
>
> Key: ZOOKEEPER-3496
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3496
> Project: ZooKeeper
>  Issue Type: Bug
>Affects Versions: 3.5.5, 3.4.14
>Reporter: Mohammad Arshad
>Assignee: Mohammad Arshad
>Priority: Critical
>  Labels: pull-request-available
> Fix For: 3.6.0, 3.4.15, 3.5.7
>
> Attachments: ZOOKEEPER-3496-001.patch
>
>  Time Spent: 3.5h
>  Remaining Estimate: 0h
>
> *Problem:*
> ZooKeeper server fails to start, logs following error
> {code:java}
> Exception in thread "main" java.io.IOException: Unreasonable length = 1001025
>  at 
> org.apache.jute.BinaryInputArchive.checkLength(BinaryInputArchive.java:127)
>  at 
> org.apache.jute.BinaryInputArchive.readBuffer(BinaryInputArchive.java:92)
> {code}
> This indicates that one of the transactions size is more than the configured  
> jute.maxbuffer values. But how transaction more than jute.maxbuffer size is 
> allowed to write? 
> *Analysis:*
> At ZooKeeper server jute.maxbuffer specifies the maximum size of a 
> transaction. By default it is 1 MB at the server
> jute.maxbuffer is used for following:
> # Size sanity check of incoming request. Incoming requests size must not be 
> more than jute.maxbuffer
> # Size sanity check of the transaction while reading from transaction or 
> snapshot file. Transaction size must not be more than jute.maxbuffer+1024
> # Size sanity check of transaction while reading data from the leader. 
> Transaction size must not be more than jute.maxbuffer+1024
> Request size sanity check is done in the beginning of a request processing 
> but later request processing adds additional information into request then 
> writes to transaction file. This additional information size is not 
> considered in sanity check. This is how transaction larger than 
> jute.maxbuffer are accepted into ZooKeeper.  
> If this additional information size is less than 1024 Bytes then it is OK as 
> ZooKeeper already takes care of it. 
> But if this additional information size is more than 1024 bytes it allows the 
> request, But while reading from transaction/snapshot file and while reading 
> from leader it fails and make the ZooKeeper service unavailable  
> +Example:+
> Suppose incoming request size is 100 Bytes
> Configured jute.maxbuffer is 100
> After processing the request ZooKeeper server adds 1025 more bytes
> In this case, request will be processed successfully, and 100+1025 bytes 
> will be written to transaction file
> But while reading from the transaction log 100+1025 bytes cannot be read 
> as max allowed length is 100(effectively 100+1024).
> *Solutions:*
> If incoming request size sanity check is done after populating all additional 
> information then this problem is solved. But doing sanity check in the later 
> stage of request processing will defeat the purpose of sanity check itself. 
> So this we can not do
> Currently additional information size is constant 1024 Bytes [Code 
> Reference|https://github.com/apache/zookeeper/blob/branch-3.5/zookeeper-jute/src/main/java/org/apache/jute/BinaryInputArchive.java#L126].
>  We should increase this value and make it more reasonable. I propose to make 
> this additional information size to same as the jute.maxbuffer. Also make 
> additional information size configurable.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3552) Source tarbal for branch-3.5 does not set execution permissions to "configure" file

2019-09-19 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933729#comment-16933729
 ] 

Hadoop QA commented on ZOOKEEPER-3552:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4146//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4146//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4146//console

This message is automatically generated.

> Source tarbal for branch-3.5 does not set execution permissions to 
> "configure" file
> ---
>
> Key: ZOOKEEPER-3552
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3552
> Project: ZooKeeper
>  Issue Type: Bug
>  Components: build, c client
>Affects Versions: 3.5.6
>Reporter: Enrico Olivelli
>Assignee: Enrico Olivelli
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 3.5.6
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> During the Rc0 VOTE of 3.5.6 we found that the 'configure' file inside the 
> source tarball does not have the right permissions.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ZOOKEEPER-3542) X509UtilTest#testClientRenegotiationFails is flaky on JDK8 + linux on machines with 2 cores

2019-09-11 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928095#comment-16928095
 ] 

Hadoop QA commented on ZOOKEEPER-3542:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 3 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4141//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4141//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4141//console

This message is automatically generated.

> X509UtilTest#testClientRenegotiationFails is flaky on JDK8 + linux on 
> machines with 2 cores
> ---
>
> Key: ZOOKEEPER-3542
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3542
> Project: ZooKeeper
>  Issue Type: Test
>  Components: build, tests
>Affects Versions: 3.5.5
>Reporter: Enrico Olivelli
>Assignee: Enrico Olivelli
>Priority: Critical
>  Labels: pull-request-available
> Fix For: 3.5.6
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> On this Fedora machine:
> [eolivelli@localhost zookeeper-server]$ uname -a
> Linux localhost.localdomain 5.2.9-200.fc30.x86_64 #1 SMP Fri Aug 16 21:37:45 
> UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
> [eolivelli@localhost zookeeper-server]$ mvn -v
> Apache Maven 3.6.2 (40f52333136460af0dc0d7232c0dc0bcf0d9e117; 
> 2019-08-27T17:06:16+02:00)
> Maven home: /home/eolivelli/Scaricati/maven
> Java version: 1.8.0_222, vendor: AdoptOpenJDK, runtime: 
> /home/eolivelli/dev/jdk8u222-b10/jre
> Default locale: it_IT, platform encoding: UTF-8
> OS name: "linux", version: "5.2.9-200.fc30.x86_64", arch: "amd64", family: 
> "unix"
> [eolivelli@localhost zookeeper-server]$ cat /proc/cpuinfo 
> processor : 0
> vendor_id : AuthenticAMD
> cpu family: 21
> model : 112
> model name: AMD A9-9410 RADEON R5, 5 COMPUTE CORES 2C+3G
> stepping  : 0
> microcode : 0x6006704
> cpu MHz   : 1444.800
> cache size: 1024 KB
> physical id   : 0
> siblings  : 2
> core id   : 0
> cpu cores : 2
> apicid: 16
> initial apicid: 0
> fpu   : yes
> fpu_exception : yes
> cpuid level   : 13
> wp: yes
> flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov 
> pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb 
> rdtscp lm constant_tsc rep_good acc_power nopl nonstop_tsc cpuid extd_apicid 
> aperfmperf pni pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 movbe popcnt 
> aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a 
> misalignsse 3dnowprefetch osvw ibs xop skinit wdt lwp fma4 tce nodeid_msr tbm 
> perfctr_core perfctr_nb bpext ptsc mwaitx cpb hw_pstate ssbd vmmcall fsgsbase 
> bmi1 avx2 smep bmi2 xsaveopt arat npt lbrv svm_lock nrip_save tsc_scale 
> vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic 
> v_vmsave_vmload vgif overflow_recov
> bugs  : fxsave_leak sysret_ss_attrs null_seg spectre_v1 spectre_v2 
> spec_store_bypass
> bogomips  : 5789.50
> TLB size  : 1536 4K pages
> clflush size  : 64
> cache_alignment   : 64
> address sizes : 48 bits physical, 48 bits virtual
> power management: ts ttp tm 100mhzsteps hwpstate cpb eff_freq_ro acc_power 
> [13]
> processor : 1
> vendor_id : AuthenticAMD
> cpu family: 21
> model : 112
> model name: AMD A9-9410 RADEON R5, 5 COMPUTE CORES 2C+3G
> stepping  : 0
> microcode : 0x6006704
> cpu MHz   : 1483.889
> cache size: 1024 KB
> physical id   : 0
> siblings  : 2
> core id   : 1
> cpu cores : 2
> apicid: 17
> initial apicid: 1
> fpu   : yes
> fpu_exception : yes
> cpuid level   : 13
> wp: yes
> flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov 
> pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb 
> rdtscp lm constant_tsc rep_good acc_power nopl nonstop_tsc cpuid extd_apic

[jira] [Commented] (ZOOKEEPER-3542) X509UtilTest#testClientRenegotiationFails is flaky on JDK8 + linux on machines with 2 cores

2019-09-11 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928089#comment-16928089
 ] 

Hadoop QA commented on ZOOKEEPER-3542:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 3 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4138//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4138//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4138//console

This message is automatically generated.

> X509UtilTest#testClientRenegotiationFails is flaky on JDK8 + linux on 
> machines with 2 cores
> ---
>
> Key: ZOOKEEPER-3542
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3542
> Project: ZooKeeper
>  Issue Type: Test
>  Components: build, tests
>Affects Versions: 3.5.5
>Reporter: Enrico Olivelli
>Assignee: Enrico Olivelli
>Priority: Critical
>  Labels: pull-request-available
> Fix For: 3.5.6
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> On this Fedora machine:
> [eolivelli@localhost zookeeper-server]$ uname -a
> Linux localhost.localdomain 5.2.9-200.fc30.x86_64 #1 SMP Fri Aug 16 21:37:45 
> UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
> [eolivelli@localhost zookeeper-server]$ mvn -v
> Apache Maven 3.6.2 (40f52333136460af0dc0d7232c0dc0bcf0d9e117; 
> 2019-08-27T17:06:16+02:00)
> Maven home: /home/eolivelli/Scaricati/maven
> Java version: 1.8.0_222, vendor: AdoptOpenJDK, runtime: 
> /home/eolivelli/dev/jdk8u222-b10/jre
> Default locale: it_IT, platform encoding: UTF-8
> OS name: "linux", version: "5.2.9-200.fc30.x86_64", arch: "amd64", family: 
> "unix"
> [eolivelli@localhost zookeeper-server]$ cat /proc/cpuinfo 
> processor : 0
> vendor_id : AuthenticAMD
> cpu family: 21
> model : 112
> model name: AMD A9-9410 RADEON R5, 5 COMPUTE CORES 2C+3G
> stepping  : 0
> microcode : 0x6006704
> cpu MHz   : 1444.800
> cache size: 1024 KB
> physical id   : 0
> siblings  : 2
> core id   : 0
> cpu cores : 2
> apicid: 16
> initial apicid: 0
> fpu   : yes
> fpu_exception : yes
> cpuid level   : 13
> wp: yes
> flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov 
> pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb 
> rdtscp lm constant_tsc rep_good acc_power nopl nonstop_tsc cpuid extd_apicid 
> aperfmperf pni pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 movbe popcnt 
> aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a 
> misalignsse 3dnowprefetch osvw ibs xop skinit wdt lwp fma4 tce nodeid_msr tbm 
> perfctr_core perfctr_nb bpext ptsc mwaitx cpb hw_pstate ssbd vmmcall fsgsbase 
> bmi1 avx2 smep bmi2 xsaveopt arat npt lbrv svm_lock nrip_save tsc_scale 
> vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic 
> v_vmsave_vmload vgif overflow_recov
> bugs  : fxsave_leak sysret_ss_attrs null_seg spectre_v1 spectre_v2 
> spec_store_bypass
> bogomips  : 5789.50
> TLB size  : 1536 4K pages
> clflush size  : 64
> cache_alignment   : 64
> address sizes : 48 bits physical, 48 bits virtual
> power management: ts ttp tm 100mhzsteps hwpstate cpb eff_freq_ro acc_power 
> [13]
> processor : 1
> vendor_id : AuthenticAMD
> cpu family: 21
> model : 112
> model name: AMD A9-9410 RADEON R5, 5 COMPUTE CORES 2C+3G
> stepping  : 0
> microcode : 0x6006704
> cpu MHz   : 1483.889
> cache size: 1024 KB
> physical id   : 0
> siblings  : 2
> core id   : 1
> cpu cores : 2
> apicid: 17
> initial apicid: 1
> fpu   : yes
> fpu_exception : yes
> cpuid level   : 13
> wp: yes
> flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov 
> pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb 
> rdtscp lm constant_tsc rep_good acc_power nopl nonstop_tsc cpuid extd_apic

[jira] [Commented] (ZOOKEEPER-3440) Fix Apache RAT check by excluding binary files (images)

2019-09-11 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928026#comment-16928026
 ] 

Hadoop QA commented on ZOOKEEPER-3440:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 3 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4135//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4135//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4135//console

This message is automatically generated.

> Fix Apache RAT check by excluding binary files (images)
> ---
>
> Key: ZOOKEEPER-3440
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3440
> Project: ZooKeeper
>  Issue Type: Bug
>  Components: build, documentation
>Affects Versions: 3.6.0
>Reporter: Enrico Olivelli
>Assignee: Enrico Olivelli
>Priority: Critical
>  Labels: pull-request-available
> Fix For: 3.6.0, 3.5.6
>
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> I see this error on Jenkins as we are missing the exclusion for the images of 
> the docs.
> {code:java}
> Unapproved licenses:
>   
> /home/jenkins/jenkins-slave/workspace/zookeeper-master-maven/zookeeper-docs/src/main/resources/markdown/images/state_dia.dia
> {code}
> We should also add this check to the precommit job on Travis (this will be 
> part of the commit) and on CI (this is a manual configuration, to be done 
> after fixing this issue)



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (ZOOKEEPER-3539) Fix branch-3.5 after upgrade on ASF CI

2019-09-08 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925133#comment-16925133
 ] 

Hadoop QA commented on ZOOKEEPER-3539:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4125//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4125//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4125//console

This message is automatically generated.

> Fix branch-3.5 after upgrade on ASF CI
> --
>
> Key: ZOOKEEPER-3539
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3539
> Project: ZooKeeper
>  Issue Type: Task
>  Components: build, build-infrastructure
>Affects Versions: 3.5.5
>Reporter: Enrico Olivelli
>Assignee: Enrico Olivelli
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 3.5.6
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> ASF CI now lacks "findbugs" tool.
> ASF CI upgraded gcc and now there are some errors related to the usage of 
> NULL in calls of fprintf.
> We should:
> - disable findbugs on CI ant-based tasks
> - use LOG_DEBUG consistently with the rest of code in C client
> Please note that on branch-3.5 we are officially using Maven and Spotbugs, 
> ant stuff is there only for compatibility in build, findbugs is not strictly 
> needed to check the goodness of code in branch-3.5.
> branch-3.4 is only with ANT, let's treat this problem as a different task 



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (ZOOKEEPER-3539) Fix branch-3.5 after upgrade on ASF CI

2019-09-08 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925112#comment-16925112
 ] 

Hadoop QA commented on ZOOKEEPER-3539:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version ) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4122//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4122//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4122//console

This message is automatically generated.

> Fix branch-3.5 after upgrade on ASF CI
> --
>
> Key: ZOOKEEPER-3539
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3539
> Project: ZooKeeper
>  Issue Type: Task
>  Components: build, build-infrastructure
>Affects Versions: 3.5.5
>Reporter: Enrico Olivelli
>Assignee: Enrico Olivelli
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 3.5.6
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> ASF CI now lacks "findbugs" tool.
> ASF CI upgraded gcc and now there are some errors related to the usage of 
> NULL in calls of fprintf.
> We should:
> - disable findbugs on CI ant-based tasks
> - use LOG_DEBUG consistently with the rest of code in C client
> Please note that on branch-3.5 we are officially using Maven and Spotbugs, 
> ant stuff is there only for compatibility in build, findbugs is not strictly 
> needed to check the goodness of code in branch-3.5.
> branch-3.4 is only with ANT, let's treat this problem as a different task 



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (ZOOKEEPER-3518) owasp check flagging jackson-databind 2.9.9.1

2019-08-25 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16915237#comment-16915237
 ] 

Hadoop QA commented on ZOOKEEPER-3518:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4104//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4104//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4104//console

This message is automatically generated.

> owasp check flagging jackson-databind 2.9.9.1
> -
>
> Key: ZOOKEEPER-3518
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3518
> Project: ZooKeeper
>  Issue Type: Bug
>  Components: security
>Affects Versions: 3.6.0, 3.5.5
>Reporter: Patrick Hunt
>Assignee: Patrick Hunt
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 3.6.0, 3.5.6
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> owasp check is flagging jackson-databind 2.9.9.1 - upgrade to 2.9.9.3
> CVE-2019-14379, CVE-2019-14439, CVE-2019-12384



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (ZOOKEEPER-3448) Introduce MessageTracker to assist debug leader and leaner connectivity issues

2019-08-21 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16912772#comment-16912772
 ] 

Hadoop QA commented on ZOOKEEPER-3448:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 4 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4102//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4102//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4102//console

This message is automatically generated.

> Introduce MessageTracker to assist debug leader and leaner connectivity issues
> --
>
> Key: ZOOKEEPER-3448
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3448
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: server
>Affects Versions: 3.6.0
>Reporter: Michael Han
>Assignee: Michael Han
>Priority: Major
>  Labels: Twitter, pull-request-available
>  Time Spent: 3h 20m
>  Remaining Estimate: 0h
>
> We want to have better insight on the state of the world when learners lost 
> connection with leader, so we need capture more information when that 
> happens. We capture more information through MessageTracker which will record 
> the last few sent and received messages at various protocol stage, and these 
> information will be dumped to log files for further analysis.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (ZOOKEEPER-3448) Introduce MessageTracker to assist debug leader and leaner connectivity issues

2019-08-21 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16912596#comment-16912596
 ] 

Hadoop QA commented on ZOOKEEPER-3448:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 4 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4101//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4101//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4101//console

This message is automatically generated.

> Introduce MessageTracker to assist debug leader and leaner connectivity issues
> --
>
> Key: ZOOKEEPER-3448
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3448
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: server
>Affects Versions: 3.6.0
>Reporter: Michael Han
>Assignee: Michael Han
>Priority: Major
>  Labels: Twitter, pull-request-available
>  Time Spent: 2h 40m
>  Remaining Estimate: 0h
>
> We want to have better insight on the state of the world when learners lost 
> connection with leader, so we need capture more information when that 
> happens. We capture more information through MessageTracker which will record 
> the last few sent and received messages at various protocol stage, and these 
> information will be dumped to log files for further analysis.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (ZOOKEEPER-3494) No need to depend on netty-all (SSL)

2019-08-06 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900719#comment-16900719
 ] 

Hadoop QA commented on ZOOKEEPER-3494:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4095//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4095//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4095//console

This message is automatically generated.

> No need to depend on netty-all (SSL)
> 
>
> Key: ZOOKEEPER-3494
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3494
> Project: ZooKeeper
>  Issue Type: Improvement
>Affects Versions: 3.6.0, 3.5.5
>Reporter: Norbert Kalmar
>Assignee: Norbert Kalmar
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0
>
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> ZooKeeper currently depends on netty-all to satisfy the requirements for the 
> SSL capability.
> netty-all is an unnecessarily broad dependency, we already had request to 
> revise (https://issues.apache.org/jira/browse/SOLR-13665)
> netty-handler (429KB) and netty-transport-native-epoll (115KB) looks like is 
> enough. 
> Netty-all was ~4MB. 
> This reduce size of netty dependency to 1/8.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3494) No need to depend on netty-all (SSL)

2019-08-05 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900065#comment-16900065
 ] 

Hadoop QA commented on ZOOKEEPER-3494:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4094//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4094//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4094//console

This message is automatically generated.

> No need to depend on netty-all (SSL)
> 
>
> Key: ZOOKEEPER-3494
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3494
> Project: ZooKeeper
>  Issue Type: Improvement
>Affects Versions: 3.6.0, 3.5.5
>Reporter: Norbert Kalmar
>Assignee: Norbert Kalmar
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> ZooKeeper currently depends on netty-all to satisfy the requirements for the 
> SSL capability.
> netty-all is an unnecessarily broad dependency, we already had request to 
> revise (https://issues.apache.org/jira/browse/SOLR-13665)
> netty-handler (429KB) and netty-transport-native-epoll (115KB) looks like is 
> enough. 
> Netty-all was ~4MB. 
> This reduce size of netty dependency to 1/8.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3480) Flaky test CommitProcessorMetricsTest.testConcurrentRequestProcessingInCommitProcessor

2019-08-03 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899408#comment-16899408
 ] 

Hadoop QA commented on ZOOKEEPER-3480:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 3 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4093//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4093//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4093//console

This message is automatically generated.

> Flaky test 
> CommitProcessorMetricsTest.testConcurrentRequestProcessingInCommitProcessor
> --
>
> Key: ZOOKEEPER-3480
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3480
> Project: ZooKeeper
>  Issue Type: Test
>  Components: tests
>Affects Versions: 3.6.0
>Reporter: Fangmin Lv
>Assignee: Fangmin Lv
>Priority: Minor
>  Labels: pull-request-available
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Found this flaky test on Jenkins, here is the log:
> Error Message
> expected:<3> but was:<2>
> h3. Stacktrace
> java.lang.AssertionError: expected:<3> but was:<2> at 
> org.apache.zookeeper.server.quorum.CommitProcessorMetricsTest.testConcurrentRequestProcessingInCommitProcessor(CommitProcessorMetricsTest.java:391)
> h3. Standard Output
> 2019-07-31 03:15:17,408 [myid:] - INFO [main:ZKTestCase$1@60] - STARTING 
> testConcurrentRequestProcessingInCommitProcessor 2019-07-31 03:15:17,408 
> [myid:] - INFO [main:CommitProcessorMetricsTest@52] - setup 2019-07-31 
> 03:15:17,409 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - 
> RUNNING TEST METHOD testConcurrentRequestProcessingInCommitProcessor 
> 2019-07-31 03:15:17,411 [myid:] - INFO [main:CommitProcessor@496] - 
> Configuring CommitProcessor with readBatchSize -1 commitBatchSize 1 
> 2019-07-31 03:15:17,411 [myid:] - INFO [main:CommitProcessor@454] - 
> Configuring CommitProcessor with 24 worker threads. 2019-07-31 03:15:17,461 
> [myid:] - INFO [main:CommitProcessorMetricsTest$TestCommitProcessor@109] - 
> numWorkerThreads in Test is 3 2019-07-31 03:15:19,466 [myid:] - INFO 
> [main:JUnit4ZKTestRunner$LoggedInvokeMethod@99] - TEST METHOD FAILED 
> testConcurrentRequestProcessingInCommitProcessor java.lang.AssertionError: 
> expected:<3> but was:<2> at org.junit.Assert.fail(Assert.java:88) at 
> org.junit.Assert.failNotEquals(Assert.java:834) at 
> org.junit.Assert.assertEquals(Assert.java:118) at 
> org.junit.Assert.assertEquals(Assert.java:144) at 
> org.apache.zookeeper.server.quorum.CommitProcessorMetricsTest.testConcurrentRequestProcessingInCommitProcessor(CommitProcessorMetricsTest.java:391)
>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 
> at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:498) at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
>  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
>  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
>  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
>  at 
> org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:80)
>  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) 
> at 
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) 
> at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20) at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
>  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
>  at org.junit.runners.ParentRunner$3.run(Pa

[jira] [Commented] (ZOOKEEPER-3448) Introduce MessageTracker to assist debug leader and leaner connectivity issues

2019-08-01 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898594#comment-16898594
 ] 

Hadoop QA commented on ZOOKEEPER-3448:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 4 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4091//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4091//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4091//console

This message is automatically generated.

> Introduce MessageTracker to assist debug leader and leaner connectivity issues
> --
>
> Key: ZOOKEEPER-3448
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3448
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: server
>Affects Versions: 3.6.0
>Reporter: Michael Han
>Assignee: Michael Han
>Priority: Major
>  Labels: Twitter, pull-request-available
>  Time Spent: 2h 40m
>  Remaining Estimate: 0h
>
> We want to have better insight on the state of the world when learners lost 
> connection with leader, so we need capture more information when that 
> happens. We capture more information through MessageTracker which will record 
> the last few sent and received messages at various protocol stage, and these 
> information will be dumped to log files for further analysis.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3473) Improving successful TLS handshake throughput with concurrent control

2019-08-01 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897828#comment-16897828
 ] 

Hadoop QA commented on ZOOKEEPER-3473:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 5 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4089//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4089//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4089//console

This message is automatically generated.

> Improving successful TLS handshake throughput with concurrent control
> -
>
> Key: ZOOKEEPER-3473
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3473
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: server
>Reporter: Fangmin Lv
>Assignee: Fangmin Lv
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> When there are lots of clients trying to re-establish sessions, there might 
> be lots of half finished handshake timed out, and those failed ones keep 
> reconnecting to another server and restarting the handshake from beginning 
> again, which caused herd effect.
>  
> And the number of total ZK sessions could be supported within session timeout 
> are impacted a lot after enabling TLS.
>  
> To improve the throughput, we added the TLS concurrent control to reduce the 
> herd effect, and from out benchmark this doubled the sessions we could 
> support within session timeout.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3473) Improving successful TLS handshake throughput with concurrent control

2019-07-31 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897782#comment-16897782
 ] 

Hadoop QA commented on ZOOKEEPER-3473:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 5 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4088//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4088//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4088//console

This message is automatically generated.

> Improving successful TLS handshake throughput with concurrent control
> -
>
> Key: ZOOKEEPER-3473
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3473
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: server
>Reporter: Fangmin Lv
>Assignee: Fangmin Lv
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> When there are lots of clients trying to re-establish sessions, there might 
> be lots of half finished handshake timed out, and those failed ones keep 
> reconnecting to another server and restarting the handshake from beginning 
> again, which caused herd effect.
>  
> And the number of total ZK sessions could be supported within session timeout 
> are impacted a lot after enabling TLS.
>  
> To improve the throughput, we added the TLS concurrent control to reduce the 
> herd effect, and from out benchmark this doubled the sessions we could 
> support within session timeout.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3473) Improving successful TLS handshake throughput with concurrent control

2019-07-31 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896862#comment-16896862
 ] 

Hadoop QA commented on ZOOKEEPER-3473:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 5 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4087//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4087//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4087//console

This message is automatically generated.

> Improving successful TLS handshake throughput with concurrent control
> -
>
> Key: ZOOKEEPER-3473
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3473
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: server
>Reporter: Fangmin Lv
>Assignee: Fangmin Lv
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> When there are lots of clients trying to re-establish sessions, there might 
> be lots of half finished handshake timed out, and those failed ones keep 
> reconnecting to another server and restarting the handshake from beginning 
> again, which caused herd effect.
>  
> And the number of total ZK sessions could be supported within session timeout 
> are impacted a lot after enabling TLS.
>  
> To improve the throughput, we added the TLS concurrent control to reduce the 
> herd effect, and from out benchmark this doubled the sessions we could 
> support within session timeout.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3150) Data integrity check when loading snapshot/txns from disk

2019-07-28 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894795#comment-16894795
 ] 

Hadoop QA commented on ZOOKEEPER-3150:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 53 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4079//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4079//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4079//console

This message is automatically generated.

> Data integrity check when loading snapshot/txns from disk
> -
>
> Key: ZOOKEEPER-3150
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3150
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: server
>Reporter: Fangmin Lv
>Assignee: Fangmin Lv
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0
>
>  Time Spent: 9h 20m
>  Remaining Estimate: 0h
>
> This is a sub task of ZOOKEEPER-3114, which is going to check the data 
> integrity by calculating the hash value of data tree, and compare the value 
> when reload the snapshot/txns from disk.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3473) Improving successful TLS handshake throughput with concurrent control

2019-07-28 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894786#comment-16894786
 ] 

Hadoop QA commented on ZOOKEEPER-3473:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 2 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4078//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4078//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4078//console

This message is automatically generated.

> Improving successful TLS handshake throughput with concurrent control
> -
>
> Key: ZOOKEEPER-3473
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3473
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: server
>Reporter: Fangmin Lv
>Assignee: Fangmin Lv
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> When there are lots of clients trying to re-establish sessions, there might 
> be lots of half finished handshake timed out, and those failed ones keep 
> reconnecting to another server and restarting the handshake from beginning 
> again, which caused herd effect.
>  
> And the number of total ZK sessions could be supported within session timeout 
> are impacted a lot after enabling TLS.
>  
> To improve the throughput, we added the TLS concurrent control to reduce the 
> herd effect, and from out benchmark this doubled the sessions we could 
> support within session timeout.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3472) Treat check request as a write request which needs to wait for the check txn commit from leader

2019-07-28 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894775#comment-16894775
 ] 

Hadoop QA commented on ZOOKEEPER-3472:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4077//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4077//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4077//console

This message is automatically generated.

> Treat check request as a write request which needs to wait for the check txn 
> commit from leader
> ---
>
> Key: ZOOKEEPER-3472
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3472
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: server
>Affects Versions: 3.6.0, 3.5.5
>Reporter: Fangmin Lv
>Assignee: Fangmin Lv
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Check op is usually used as a sub op in multi, but from the ZooKeeper server 
> implementation it can also called separately, the learner will forward this 
> request to leader, and the leader will check the version with the given 
> version in the request, and generate a txn (error) in the quorum.
>   
>  This is kind of a heavier sync to make sure when the client check on a 
> learner, it is syncing up to date with leader when the check request is being 
> processed. The learner need to wait for this remote commit before reply to 
> client in FinalRequestProcessor.
>   
>  There is no explicit API exposed for check, so it seems not a problem, but 
> it could leave an issue there if the check API is exposed in the future.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3471) Potential lock unavailable due to dangling ephemeral nodes left during local session upgrading

2019-07-28 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894762#comment-16894762
 ] 

Hadoop QA commented on ZOOKEEPER-3471:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 3 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4076//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4076//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4076//console

This message is automatically generated.

> Potential lock unavailable due to dangling ephemeral nodes left during local 
> session upgrading
> --
>
> Key: ZOOKEEPER-3471
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3471
> Project: ZooKeeper
>  Issue Type: Bug
>  Components: server
>Affects Versions: 3.6.0
>Reporter: Fangmin Lv
>Assignee: Fangmin Lv
>Priority: Critical
>  Labels: pull-request-available
> Fix For: 3.6.0
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> There is a race condition which might be triggered if the client create 
> session, upgrading the session with ephemeral node, then immediately issued 
> close session request before it's removed from local session tracker.
>  
> The close session request will be treated as a local session close request 
> since it still exists in the local session tracker, which goes through the ZK 
> pipeline and delete the session from both local and global session tracker. 
> Since the session is not tracked anymore, it will leave the ephemeral nodes 
> there.
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3150) Data integrity check when loading snapshot/txns from disk

2019-07-26 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894240#comment-16894240
 ] 

Hadoop QA commented on ZOOKEEPER-3150:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 53 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4074//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4074//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4074//console

This message is automatically generated.

> Data integrity check when loading snapshot/txns from disk
> -
>
> Key: ZOOKEEPER-3150
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3150
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: server
>Reporter: Fangmin Lv
>Assignee: Fangmin Lv
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0
>
>  Time Spent: 6h 20m
>  Remaining Estimate: 0h
>
> This is a sub task of ZOOKEEPER-3114, which is going to check the data 
> integrity by calculating the hash value of data tree, and compare the value 
> when reload the snapshot/txns from disk.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3418) Improve quorum throughput through eager ACL checks of requests on local servers

2019-07-26 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894224#comment-16894224
 ] 

Hadoop QA commented on ZOOKEEPER-3418:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 8 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4072//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4072//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4072//console

This message is automatically generated.

> Improve quorum throughput through eager ACL checks of requests on local 
> servers
> ---
>
> Key: ZOOKEEPER-3418
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3418
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: server
>Affects Versions: 3.6.0
>Reporter: Michael Han
>Assignee: Michael Han
>Priority: Major
>  Labels: Twitter, pull-request-available
>  Time Spent: 3h 20m
>  Remaining Estimate: 0h
>
> Serving write requests that change the state of the system requires quorum 
> operations, and in some cases, the quorum operations can be avoided if the 
> requests are doomed to fail. ACL check failure is such a case. To optimize 
> for this case, we elevate the ACL check logic and perform eager ACL check on 
> local server (where the requests are received), and fail fast, before sending 
> the requests to leader. 
> As with any features, there is a feature flag that can control this feature 
> on, or off (default). This feature is also forward compatible in that for new 
> any new Op code (and some existing Op code we did not explicit check 
> against), they will pass the check and (potentially) fail on leader side, 
> instead of being prematurely filtered out on local server.
> The end result is better throughput and stability of the quorum for certain 
> workloads.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-1634) A new feature proposal to ZooKeeper: authentication enforcement

2019-07-23 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891586#comment-16891586
 ] 

Hadoop QA commented on ZOOKEEPER-1634:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 16 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4070//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4070//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4070//console

This message is automatically generated.

> A new feature proposal to ZooKeeper: authentication enforcement
> ---
>
> Key: ZOOKEEPER-1634
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-1634
> Project: ZooKeeper
>  Issue Type: New Feature
>  Components: security, server
>Affects Versions: 3.4.5
>Reporter: Jaewoong Choi
>Assignee: Michael Han
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0
>
> Attachments: 
> zookeeper_3.4.5_patch_for_authentication_enforcement.patch
>
>   Original Estimate: 72h
>  Time Spent: 4h
>  Remaining Estimate: 68h
>
> Up to the version of 3.4.5, ZooKeeperServer doesn't force the authentication 
> if the client doesn't give any auth-info through ZooKeeper#addAuthInfo method 
> invocation.  Hence, every znode should have at least one ACL assigned 
> otherwise any unauthenticated client can do anything on it.
> The current authentication/authorization mechanism of ZooKeeper described 
> above has several points at issue:
> 1. At security standpoint, a maleficent client can access a znode which 
> doesn't have any proper authorization access control set.
> 2. At runtime performance standpoint, authorization for every znode to every 
> operation is unnecessarily but always evaluated against the client who 
> bypassed the authentication phase.
> In other words, the current mechanism doesn't address a certain requirement 
> at below:
> "We want to protect a ZK server by enforcing a simple authentication to every 
> client no matter which znode it is trying to access.  Every connection (or 
> operation) from the client won't be established but rejected if it doesn't 
> come with a valid authentication information.  As we don't have any other 
> distinction between znodes in term of authorization, we don't want any ACLs 
> on any znode."
> To address the issues mentioned above, we propose a feature called 
> "authentication enforcement" to the ZK source.  The idea is roughly but 
> clearly described in a form of patch in the attached file 
> (zookeeper_3.4.5_patch_for_authentication_enforcement.patch): which makes 
> ZooKeeperServer enforce the authentication with the given 2 configurations: 
> authenticationEnforced (boolean) and enforcedAuthenticationScheme (string) 
> against every operation coming through ZooKeeperServer#processPacket method 
> except for OpCode.auth operation.  The repository base of the patch is 
> "http://svn.apache.org/repos/asf/zookeeper/tags/release-3.4.5/";



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3418) Improve quorum throughput through eager ACL checks of requests on local servers

2019-07-23 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891540#comment-16891540
 ] 

Hadoop QA commented on ZOOKEEPER-3418:
--

-1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 8 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4069//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4069//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4069//console

This message is automatically generated.

> Improve quorum throughput through eager ACL checks of requests on local 
> servers
> ---
>
> Key: ZOOKEEPER-3418
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3418
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: server
>Affects Versions: 3.6.0
>Reporter: Michael Han
>Assignee: Michael Han
>Priority: Major
>  Labels: Twitter, pull-request-available
>  Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> Serving write requests that change the state of the system requires quorum 
> operations, and in some cases, the quorum operations can be avoided if the 
> requests are doomed to fail. ACL check failure is such a case. To optimize 
> for this case, we elevate the ACL check logic and perform eager ACL check on 
> local server (where the requests are received), and fail fast, before sending 
> the requests to leader. 
> As with any features, there is a feature flag that can control this feature 
> on, or off (default). This feature is also forward compatible in that for new 
> any new Op code (and some existing Op code we did not explicit check 
> against), they will pass the check and (potentially) fail on leader side, 
> instead of being prematurely filtered out on local server.
> The end result is better throughput and stability of the quorum for certain 
> workloads.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3448) Introduce MessageTracker to assist debug leader and leaner connectivity issues

2019-07-23 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891509#comment-16891509
 ] 

Hadoop QA commented on ZOOKEEPER-3448:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 4 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4068//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4068//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4068//console

This message is automatically generated.

> Introduce MessageTracker to assist debug leader and leaner connectivity issues
> --
>
> Key: ZOOKEEPER-3448
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3448
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: server
>Affects Versions: 3.6.0
>Reporter: Michael Han
>Assignee: Michael Han
>Priority: Major
>  Labels: Twitter, pull-request-available
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> We want to have better insight on the state of the world when learners lost 
> connection with leader, so we need capture more information when that 
> happens. We capture more information through MessageTracker which will record 
> the last few sent and received messages at various protocol stage, and these 
> information will be dumped to log files for further analysis.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3448) Introduce MessageTracker to assist debug leader and leaner connectivity issues

2019-07-23 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891422#comment-16891422
 ] 

Hadoop QA commented on ZOOKEEPER-3448:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 4 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4067//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4067//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4067//console

This message is automatically generated.

> Introduce MessageTracker to assist debug leader and leaner connectivity issues
> --
>
> Key: ZOOKEEPER-3448
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3448
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: server
>Affects Versions: 3.6.0
>Reporter: Michael Han
>Assignee: Michael Han
>Priority: Major
>  Labels: Twitter, pull-request-available
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> We want to have better insight on the state of the world when learners lost 
> connection with leader, so we need capture more information when that 
> happens. We capture more information through MessageTracker which will record 
> the last few sent and received messages at various protocol stage, and these 
> information will be dumped to log files for further analysis.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3356) Request throttling in Netty is not working as expected and could cause direct buffer OOM issue

2019-07-22 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890432#comment-16890432
 ] 

Hadoop QA commented on ZOOKEEPER-3356:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 12 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4066//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4066//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4066//console

This message is automatically generated.

> Request throttling in Netty is not working as expected and could cause direct 
> buffer OOM issue 
> ---
>
> Key: ZOOKEEPER-3356
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3356
> Project: ZooKeeper
>  Issue Type: Bug
>  Components: server
>Affects Versions: 3.5.4, 3.6.0
>Reporter: Fangmin Lv
>Assignee: Fangmin Lv
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0
>
>  Time Spent: 2h 40m
>  Remaining Estimate: 0h
>
> The current implementation of Netty enable/disable recv logic may cause the 
> direct buffer OOM because we may enable read a large chunk of packets and 
> disabled again after consuming a single ZK request. We have seen this problem 
> on prod occasionally.
>  
> Need a more advanced flow control in Netty instead of using AUTO_READ. Have 
> improved it internally by enable/disable recv based on the queuedBuffer size, 
> will upstream this soon.
>  
> With this implementation, the max Netty queued buffer size (direct memory 
> usage) will be 2 * recv_buffer size. It's not the per message size because in 
> epoll ET mode it will try to read until the socket is empty, and because of 
> SslHandler will trigger another read when it's not a full encrypt packet and 
> haven't issued any decrypt message.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3463) Enable warning messages in maven compiler plugin

2019-07-19 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16889168#comment-16889168
 ] 

Hadoop QA commented on ZOOKEEPER-3463:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4063//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4063//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4063//console

This message is automatically generated.

> Enable warning messages in maven compiler plugin
> 
>
> Key: ZOOKEEPER-3463
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3463
> Project: ZooKeeper
>  Issue Type: Task
>  Components: build
>Affects Versions: 3.6.0, 3.5.5, 3.4.14
>Reporter: Andor Molnar
>Assignee: Andor Molnar
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> "Show Warnings" is off by default in Maven Compiler Plugin. This invalidates 
> our most recent setting of -Werror (treat warnings as errors).
> Let's enable compiler warning messages in all projects and adjust Xdoclint 
> setting:
> {noformat}
> 
>   true
>   
> ...
> -Xdoclint:-missing
> ...
>  
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ZOOKEEPER-3463) Enable warning messages in maven compiler plugin

2019-07-16 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886268#comment-16886268
 ] 

Hadoop QA commented on ZOOKEEPER-3463:
--

+1 overall.  GitHub Pull Request  Build
  

+1 @author.  The patch does not contain any @author tags.

+0 tests included.  The patch appears to be a documentation patch that 
doesn't require tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs (version 3.0.1) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4061//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4061//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/4061//console

This message is automatically generated.

> Enable warning messages in maven compiler plugin
> 
>
> Key: ZOOKEEPER-3463
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3463
> Project: ZooKeeper
>  Issue Type: Task
>  Components: build
>Affects Versions: 3.6.0, 3.5.5, 3.4.14
>Reporter: Andor Molnar
>Assignee: Andor Molnar
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> "Show Warnings" is off by default in Maven Compiler Plugin. This invalidates 
> our most recent setting of -Werror (treat warnings as errors).
> Let's enable compiler warning messages in all projects and adjust Xdoclint 
> setting:
> {noformat}
> 
>   true
>   
> ...
> -Xdoclint:-missing
> ...
>  
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)