[GitHub] [hbase] jatsakthi commented on issue #1181: HBASE-23862 Fix flaky TestSnapshotFromMaster in 1.x versions
jatsakthi commented on issue #1181: HBASE-23862 Fix flaky TestSnapshotFromMaster in 1.x versions URL: https://github.com/apache/hbase/pull/1181#issuecomment-587318491 Thanks for pointing out the predicate, @infraio This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [hbase] infraio commented on a change in pull request #1181: HBASE-23862 Fix flaky TestSnapshotFromMaster in 1.x versions
infraio commented on a change in pull request #1181: HBASE-23862 Fix flaky
TestSnapshotFromMaster in 1.x versions
URL: https://github.com/apache/hbase/pull/1181#discussion_r380489633
##
File path:
hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestSnapshotFromMaster.java
##
@@ -530,8 +530,11 @@ public boolean evaluate() throws Exception {
return
UTIL.getHBaseAdmin().listSnapshots(Pattern.compile(snapshotName)).size() == 1;
}
});
-assertTrue(master.getSnapshotManager().isTakingAnySnapshot());
-Thread.sleep(11 * 1000L);
-assertFalse(master.getSnapshotManager().isTakingAnySnapshot());
+UTIL.waitFor(3, new Predicate() {
+ @Override
+ public boolean evaluate() throws Exception {
+return
UTIL.getHBaseAdmin().listSnapshots(Pattern.compile(snapshotName)).size() == 1;
Review comment:
UTIL.waitFor(3, () ->
!master.getSnapshotManager().isTakingAnySnapshot());?
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[GitHub] [hbase] jatsakthi opened a new pull request #1181: HBASE-23862 Fix flaky TestSnapshotFromMaster in 1.x versions
jatsakthi opened a new pull request #1181: HBASE-23862 Fix flaky TestSnapshotFromMaster in 1.x versions URL: https://github.com/apache/hbase/pull/1181 Backport of HBASE-23658 - Fix flaky TestSnapshotFromMaster Signed-off-by: Duo Zhang (cherry picked from commit e750d2c7af03bfcb85422077cf59ab4b1815cb12) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (HBASE-23864) No need to submit SplitTableRegionProcedure/MergeTableRegionsProcedure when split/merge switch is disabled
[ https://issues.apache.org/jira/browse/HBASE-23864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guanghao Zhang updated HBASE-23864: --- Attachment: HBASE-23864.PNG > No need to submit SplitTableRegionProcedure/MergeTableRegionsProcedure when > split/merge switch is disabled > -- > > Key: HBASE-23864 > URL: https://issues.apache.org/jira/browse/HBASE-23864 > Project: HBase > Issue Type: Improvement >Reporter: Guanghao Zhang >Priority: Major > Attachments: HBASE-23864.PNG > > > Now even the split/merge is disabled, master will submit a > SplitTableRegionProcedure, too. And rollback it when execute failed. I > thought the split/merge switch is a cluster level swtich. Master can check it > early and no need to submit > SplitTableRegionProcedure/MergeTableRegionsProcedure when split/merge switch > is disabled. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-23864) No need to submit SplitTableRegionProcedure/MergeTableRegionsProcedure when split/merge switch is disabled
Guanghao Zhang created HBASE-23864: -- Summary: No need to submit SplitTableRegionProcedure/MergeTableRegionsProcedure when split/merge switch is disabled Key: HBASE-23864 URL: https://issues.apache.org/jira/browse/HBASE-23864 Project: HBase Issue Type: Bug Reporter: Guanghao Zhang Now even the split/merge is disabled, master will submit a SplitTableRegionProcedure, too. And rollback it when execute failed. I thought the split/merge switch is a cluster level swtich. Master can check it early and no need to submit SplitTableRegionProcedure/MergeTableRegionsProcedure when split/merge switch is disabled. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-23864) No need to submit SplitTableRegionProcedure/MergeTableRegionsProcedure when split/merge switch is disabled
[ https://issues.apache.org/jira/browse/HBASE-23864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guanghao Zhang updated HBASE-23864: --- Issue Type: Improvement (was: Bug) > No need to submit SplitTableRegionProcedure/MergeTableRegionsProcedure when > split/merge switch is disabled > -- > > Key: HBASE-23864 > URL: https://issues.apache.org/jira/browse/HBASE-23864 > Project: HBase > Issue Type: Improvement >Reporter: Guanghao Zhang >Priority: Major > > Now even the split/merge is disabled, master will submit a > SplitTableRegionProcedure, too. And rollback it when execute failed. I > thought the split/merge switch is a cluster level swtich. Master can check it > early and no need to submit > SplitTableRegionProcedure/MergeTableRegionsProcedure when split/merge switch > is disabled. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23862) Fix flaky TestSnapshotFromMaster in 1.x versions
[ https://issues.apache.org/jira/browse/HBASE-23862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038828#comment-17038828 ] Sakthi commented on HBASE-23862: The change seems to help us. Let me create a pr. > Fix flaky TestSnapshotFromMaster in 1.x versions > > > Key: HBASE-23862 > URL: https://issues.apache.org/jira/browse/HBASE-23862 > Project: HBase > Issue Type: Task >Reporter: Sakthi >Assignee: Sakthi >Priority: Major > > HBASE-23658 was about fixing this flakey ut in branch-2+. I think it can be > backported to branch-1s as well. 18/30 times this test has failed in > branch-1, 10/30 in 1.4 and 3/30 in 1.3. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work started] (HBASE-23862) Fix flaky TestSnapshotFromMaster in 1.x versions
[ https://issues.apache.org/jira/browse/HBASE-23862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-23862 started by Sakthi. -- > Fix flaky TestSnapshotFromMaster in 1.x versions > > > Key: HBASE-23862 > URL: https://issues.apache.org/jira/browse/HBASE-23862 > Project: HBase > Issue Type: Task >Reporter: Sakthi >Assignee: Sakthi >Priority: Major > > HBASE-23658 was about fixing this flakey ut in branch-2+. I think it can be > backported to branch-1s as well. 18/30 times this test has failed in > branch-1, 10/30 in 1.4 and 3/30 in 1.3. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-22827) Expose multi-region merge in shell and Admin API
[ https://issues.apache.org/jira/browse/HBASE-22827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sakthi updated HBASE-22827: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Expose multi-region merge in shell and Admin API > > > Key: HBASE-22827 > URL: https://issues.apache.org/jira/browse/HBASE-22827 > Project: HBase > Issue Type: Improvement > Components: Admin, shell >Reporter: Michael Stack >Assignee: Sakthi >Priority: Major > Fix For: 3.0.0, 2.3.0 > > Attachments: hbase-22827.branch-2.001.patch > > > HBASE-22777 adds being able to merge more than two regions at once. It is > only available internally currently for use by hbck2 doing fixup of overlaps > in hbase:meta. This issue is about exposing it via the Admin Interface and in > turn, via the shell. Probably best if old two region merge method is > deprecated. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-22827) Expose multi-region merge in shell and Admin API
[ https://issues.apache.org/jira/browse/HBASE-22827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038814#comment-17038814 ] Sakthi commented on HBASE-22827: Pushed to branch-2. Closing the jira now. > Expose multi-region merge in shell and Admin API > > > Key: HBASE-22827 > URL: https://issues.apache.org/jira/browse/HBASE-22827 > Project: HBase > Issue Type: Improvement > Components: Admin, shell >Reporter: Michael Stack >Assignee: Sakthi >Priority: Major > Fix For: 3.0.0, 2.3.0 > > Attachments: hbase-22827.branch-2.001.patch > > > HBASE-22777 adds being able to merge more than two regions at once. It is > only available internally currently for use by hbck2 doing fixup of overlaps > in hbase:meta. This issue is about exposing it via the Admin Interface and in > turn, via the shell. Probably best if old two region merge method is > deprecated. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-22514) Move rsgroup feature into core of HBase
[
https://issues.apache.org/jira/browse/HBASE-22514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038812#comment-17038812
]
Hudson commented on HBASE-22514:
Results for branch HBASE-22514
[build #277 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22514/277/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22514/277//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22514/277//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22514/277//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Move rsgroup feature into core of HBase
> ---
>
> Key: HBASE-22514
> URL: https://issues.apache.org/jira/browse/HBASE-22514
> Project: HBase
> Issue Type: Umbrella
> Components: Admin, Client, rsgroup
>Reporter: Yechao Chen
>Assignee: Duo Zhang
>Priority: Major
> Attachments: HBASE-22514.master.001.patch,
> image-2019-05-31-18-25-38-217.png
>
>
> The class RSGroupAdminClient is not public
> we need to use java api RSGroupAdminClient to manager RSG
> so RSGroupAdminClient should be public
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-23863) [Flakey Test] TestReplicationEndpointWithMultipleWAL#testInterClusterReplication
[
https://issues.apache.org/jira/browse/HBASE-23863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038805#comment-17038805
]
Hudson commented on HBASE-23863:
Results for branch branch-2
[build #2480 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2480/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2480//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2480//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2480//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> [Flakey Test]
> TestReplicationEndpointWithMultipleWAL#testInterClusterReplication
>
>
> Key: HBASE-23863
> URL: https://issues.apache.org/jira/browse/HBASE-23863
> Project: HBase
> Issue Type: Bug
> Components: flakies
>Reporter: Michael Stack
>Priority: Major
> Fix For: 3.0.0, 2.3.0
>
> Attachments:
> 0001-HBASE-23863-Flakey-Test-TestReplicationEndpointWithM.patch
>
>
> This one fails in an odd way about 15% of the time where it replicates 2499
> edits of 2500 And seemingly always these numbers. Odd.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-23859) Modify "Block locality" of RegionServer Web UI to human readable percentage
[
https://issues.apache.org/jira/browse/HBASE-23859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038807#comment-17038807
]
Hudson commented on HBASE-23859:
Results for branch branch-2
[build #2480 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2480/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2480//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2480//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2480//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Modify "Block locality" of RegionServer Web UI to human readable percentage
> ---
>
> Key: HBASE-23859
> URL: https://issues.apache.org/jira/browse/HBASE-23859
> Project: HBase
> Issue Type: Improvement
>Affects Versions: master
>Reporter: Zhuoyue Huang
>Assignee: Zhuoyue Huang
>Priority: Trivial
> Fix For: 3.0.0, 2.3.0, 2.2.4, 2.1.10
>
> Attachments: image-2020-02-17-20-36-50-084.png,
> image-2020-02-17-20-38-52-990.png
>
>
> The unit of "Block locality" in Web UI just like picture 1
> !image-2020-02-17-20-36-50-084.png!
> I think we should change it to percentage unit like picture 2
> !image-2020-02-17-20-38-52-990.png!
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-23838) Adding debug logging to a few ExportSnapshot tests
[
https://issues.apache.org/jira/browse/HBASE-23838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038806#comment-17038806
]
Hudson commented on HBASE-23838:
Results for branch branch-2
[build #2480 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2480/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2480//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2480//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2480//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Adding debug logging to a few ExportSnapshot tests
> --
>
> Key: HBASE-23838
> URL: https://issues.apache.org/jira/browse/HBASE-23838
> Project: HBase
> Issue Type: Bug
>Reporter: Michael Stack
>Assignee: Michael Stack
>Priority: Trivial
> Fix For: 3.0.0, 2.3.0
>
> Attachments:
> 0001-HBASE-23838-Adding-debug-logging-to-a-few-ExportSnap.patch,
> 0001-HBASE-23838-Adding-debug-logging-to-a-few-ExportSnap.patch
>
>
> Bit of extra logging in tests to help me diagnose where they are going wrong.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (HBASE-23858) Set version as 2.1.10-SNAPSHOT in branch-2.1
[ https://issues.apache.org/jira/browse/HBASE-23858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-23858. --- Hadoop Flags: Reviewed Resolution: Fixed Merged to branch-2.1. Thanks [~zghao] for reviewing. > Set version as 2.1.10-SNAPSHOT in branch-2.1 > > > Key: HBASE-23858 > URL: https://issues.apache.org/jira/browse/HBASE-23858 > Project: HBase > Issue Type: Sub-task > Components: build, pom >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Fix For: 2.1.10 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-22749) Distributed MOB compactions
[
https://issues.apache.org/jira/browse/HBASE-22749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038763#comment-17038763
]
Hudson commented on HBASE-22749:
Results for branch HBASE-22749
[build #6 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22749/6/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22749/6//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22749/6//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22749/6//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Distributed MOB compactions
>
>
> Key: HBASE-22749
> URL: https://issues.apache.org/jira/browse/HBASE-22749
> Project: HBase
> Issue Type: New Feature
> Components: mob
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
>Priority: Major
> Attachments: HBASE-22749-branch-2.2-v4.patch,
> HBASE-22749-master-v1.patch, HBASE-22749-master-v2.patch,
> HBASE-22749-master-v3.patch, HBASE-22749-master-v4.patch,
> HBase-MOB-2.0-v3.0.pdf
>
>
> There are several drawbacks in the original MOB 1.0 (Moderate Object
> Storage) implementation, which can limit the adoption of the MOB feature:
> # MOB compactions are executed in a Master as a chore, which limits
> scalability because all I/O goes through a single HBase Master server.
> # Yarn/Mapreduce framework is required to run MOB compactions in a scalable
> way, but this won’t work in a stand-alone HBase cluster.
> # Two separate compactors for MOB and for regular store files and their
> interactions can result in a data loss (see HBASE-22075)
> The design goals for MOB 2.0 were to provide 100% MOB 1.0 - compatible
> implementation, which is free of the above drawbacks and can be used as a
> drop in replacement in existing MOB deployments. So, these are design goals
> of a MOB 2.0:
> # Make MOB compactions scalable without relying on Yarn/Mapreduce framework
> # Provide unified compactor for both MOB and regular store files
> # Make it more robust especially w.r.t. to data losses.
> # Simplify and reduce the overall MOB code.
> # Provide 100% compatible implementation with MOB 1.0.
> # No migration of data should be required between MOB 1.0 and MOB 2.0 - just
> software upgrade.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (HBASE-23857) Add 2.1.9 to download page
[ https://issues.apache.org/jira/browse/HBASE-23857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-23857. --- Hadoop Flags: Reviewed Resolution: Fixed Merged to master. Thanks [~janh] for reviewing. > Add 2.1.9 to download page > -- > > Key: HBASE-23857 > URL: https://issues.apache.org/jira/browse/HBASE-23857 > Project: HBase > Issue Type: Sub-task > Components: website >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Fix For: 3.0.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache9 merged pull request #1178: HBASE-23858 Set version as 2.1.10-SNAPSHOT in branch-2.1
Apache9 merged pull request #1178: HBASE-23858 Set version as 2.1.10-SNAPSHOT in branch-2.1 URL: https://github.com/apache/hbase/pull/1178 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Resolved] (HBASE-23859) Modify "Block locality" of RegionServer Web UI to human readable percentage
[ https://issues.apache.org/jira/browse/HBASE-23859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guanghao Zhang resolved HBASE-23859. Fix Version/s: 2.1.10 2.2.4 2.3.0 3.0.0 Resolution: Fixed Pushed to branch-2.1+. Thanks [~GeorryHuang] for contributing. > Modify "Block locality" of RegionServer Web UI to human readable percentage > --- > > Key: HBASE-23859 > URL: https://issues.apache.org/jira/browse/HBASE-23859 > Project: HBase > Issue Type: Improvement >Affects Versions: master >Reporter: Zhuoyue Huang >Assignee: Zhuoyue Huang >Priority: Trivial > Fix For: 3.0.0, 2.3.0, 2.2.4, 2.1.10 > > Attachments: image-2020-02-17-20-36-50-084.png, > image-2020-02-17-20-38-52-990.png > > > The unit of "Block locality" in Web UI just like picture 1 > !image-2020-02-17-20-36-50-084.png! > I think we should change it to percentage unit like picture 2 > !image-2020-02-17-20-38-52-990.png! > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] infraio merged pull request #1176: HBASE-23859:Modify "Block locality" of RegionServer Web UI to human r…
infraio merged pull request #1176: HBASE-23859:Modify "Block locality" of RegionServer Web UI to human r… URL: https://github.com/apache/hbase/pull/1176 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [hbase] Apache9 merged pull request #1177: HBASE-23857 Add 2.1.9 to download page
Apache9 merged pull request #1177: HBASE-23857 Add 2.1.9 to download page URL: https://github.com/apache/hbase/pull/1177 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (HBASE-23838) Adding debug logging to a few ExportSnapshot tests
[
https://issues.apache.org/jira/browse/HBASE-23838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038716#comment-17038716
]
Michael Stack commented on HBASE-23838:
---
Added another logging addendum to see if can catch where hdfs comes into the
mix (though no hdfs clusters in test). Attached what I pushed as
0001-HBASE-23838-Adding-debug-logging-to-a-few-ExportSnap.patch.
Here are changes applied to master and branch-2:
{code}
>From 0c18fa983be70db49541c27e95896eba874ff0fe Mon Sep 17 00:00:00 2001
From: stack
Date: Mon, 17 Feb 2020 17:17:40 -0800
Subject: [PATCH] HBASE-23838 Adding debug logging to a few ExportSnapshot
tests ADDENDUM 2: More logging to debug.
---
.../org/apache/hadoop/hbase/snapshot/ExportSnapshot.java | 4 ++--
.../apache/hadoop/hbase/snapshot/TestExportSnapshot.java | 9 ++---
.../hbase/snapshot/TestExportSnapshotV1NoCluster.java| 2 +-
3 files changed, 9 insertions(+), 6 deletions(-)
diff --git
a/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java
b/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java
index 36b75c43df..198ae97f9b 100644
---
a/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java
+++
b/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java
@@ -978,8 +978,8 @@ public class ExportSnapshot extends AbstractHBaseTool
implements Tool {
Path outputSnapshotDir =
SnapshotDescriptionUtils.getCompletedSnapshotDir(targetName, outputRoot);
Path initialOutputSnapshotDir = skipTmp ? outputSnapshotDir :
snapshotTmpDir;
LOG.debug("inputFs={}, inputRoot={}", inputFs.getUri().toString(),
inputRoot);
-LOG.debug("outputFs={}, outputRoot={}, outputFs.getUri().toString(), " +
-"initialOutputSnapshotDir={}", outputRoot.toString(), skipTmp,
initialOutputSnapshotDir);
+LOG.debug("outputFs={}, outputRoot={}, skipTmp={},
initialOutputSnapshotDir={}",
+ outputFs, outputRoot.toString(), skipTmp, initialOutputSnapshotDir);
// Find the necessary directory which need to change owner and group
Path needSetOwnerDir =
SnapshotDescriptionUtils.getSnapshotRootDir(outputRoot);
diff --git
a/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/snapshot/TestExportSnapshot.java
b/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/snapshot/TestExportSnapshot.java
index cfdca30f49..973e182133 100644
---
a/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/snapshot/TestExportSnapshot.java
+++
b/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/snapshot/TestExportSnapshot.java
@@ -87,13 +87,15 @@ public class TestExportSnapshot {
public static void setUpBaseConf(Configuration conf) {
conf.setBoolean(SnapshotManager.HBASE_SNAPSHOT_ENABLED, true);
conf.setInt("hbase.regionserver.msginterval", 100);
+// If a single node has enough failures (default 3), resource manager will
blacklist it.
+// With only 2 nodes and tests injecting faults, we don't want that.
+conf.setInt("mapreduce.job.maxtaskfailures.per.tracker", 100);
+/*
conf.setInt("hbase.client.pause", 250);
conf.setInt(HConstants.HBASE_CLIENT_RETRIES_NUMBER, 6);
conf.setBoolean("hbase.master.enabletable.roundrobin", true);
conf.setInt("mapreduce.map.maxattempts", 10);
-// If a single node has enough failures (default 3), resource manager will
blacklist it.
-// With only 2 nodes and tests injecting faults, we don't want that.
-conf.setInt("mapreduce.job.maxtaskfailures.per.tracker", 100);
+*/
}
@BeforeClass
@@ -213,6 +215,7 @@ public class TestExportSnapshot {
final RegionPredicate bypassregionPredicate, boolean success) throws
Exception {
URI hdfsUri = FileSystem.get(conf).getUri();
FileSystem fs = FileSystem.get(copyDir.toUri(), conf);
+LOG.info("DEBUG FS {} {} {}, hdfsUri={}", fs, copyDir, copyDir.toUri(),
hdfsUri);
copyDir = copyDir.makeQualified(fs.getUri(), fs.getWorkingDirectory());
List opts = new ArrayList<>();
opts.add("--snapshot");
{code}
> Adding debug logging to a few ExportSnapshot tests
> --
>
> Key: HBASE-23838
> URL: https://issues.apache.org/jira/browse/HBASE-23838
> Project: HBase
> Issue Type: Bug
>Reporter: Michael Stack
>Assignee: Michael Stack
>Priority: Trivial
> Fix For: 3.0.0, 2.3.0
>
> Attachments:
> 0001-HBASE-23838-Adding-debug-logging-to-a-few-ExportSnap.patch,
> 0001-HBASE-23838-Adding-debug-logging-to-a-few-ExportSnap.patch
>
>
> Bit of extra logging in tests to help me diagnose where they are going wrong.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HBASE-23838) Adding debug logging to a few ExportSnapshot tests
[ https://issues.apache.org/jira/browse/HBASE-23838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Stack updated HBASE-23838: -- Attachment: 0001-HBASE-23838-Adding-debug-logging-to-a-few-ExportSnap.patch > Adding debug logging to a few ExportSnapshot tests > -- > > Key: HBASE-23838 > URL: https://issues.apache.org/jira/browse/HBASE-23838 > Project: HBase > Issue Type: Bug >Reporter: Michael Stack >Assignee: Michael Stack >Priority: Trivial > Fix For: 3.0.0, 2.3.0 > > Attachments: > 0001-HBASE-23838-Adding-debug-logging-to-a-few-ExportSnap.patch, > 0001-HBASE-23838-Adding-debug-logging-to-a-few-ExportSnap.patch > > > Bit of extra logging in tests to help me diagnose where they are going wrong. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23702) `hbase.hstore.flusher.count` setting to 0 breaks HMaster
[
https://issues.apache.org/jira/browse/HBASE-23702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038693#comment-17038693
]
HBase QA commented on HBASE-23702:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
38s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:orange}-0{color} | {color:orange} test4tests {color} | {color:orange}
0m 0s{color} | {color:orange} The patch doesn't appear to include any new or
modified tests. Please justify why no new tests are needed for this patch. Also
please list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
15s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
54s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
7s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
41s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
33s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 4m
19s{color} | {color:blue} Used deprecated FindBugs config; considering
switching to SpotBugs. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
16s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
53s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
54s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
54s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m
4s{color} | {color:red} hbase-server: The patch generated 2 new + 21 unchanged
- 0 fixed = 23 total (was 21) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
39s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
15m 32s{color} | {color:green} Patch does not cause any errors with Hadoop
2.8.5 2.9.2 or 3.1.2. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
35s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
22s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 64m
5s{color} | {color:green} hbase-server in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
34s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}119m 52s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=19.03.6 Server=19.03.6 base:
https://builds.apache.org/job/PreCommit-HBASE-Build/1132/artifact/patchprocess/Dockerfile
|
| JIRA Issue | HBASE-23702 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12993723/HBASE-23702-000.patch
|
| Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs
shadedjars hadoopcheck hbaseanti checkstyle compile |
| uname | Linux 61f085826cf4 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6
11:12:41 UTC 2019 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/hbase-personality.sh |
| git revision | master / e11dbf36a5 |
| Default Java | 1.8.0_181 |
| checkstyle |
[jira] [Commented] (HBASE-22827) Expose multi-region merge in shell and Admin API
[
https://issues.apache.org/jira/browse/HBASE-22827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038679#comment-17038679
]
HBase QA commented on HBASE-22827:
--
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
36s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} branch-2 Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
15s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
14s{color} | {color:green} branch-2 passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
50s{color} | {color:green} branch-2 passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
50s{color} | {color:green} branch-2 passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 5m
36s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
38s{color} | {color:green} branch-2 passed {color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 1m
50s{color} | {color:blue} Used deprecated FindBugs config; considering
switching to SpotBugs. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
47s{color} | {color:green} branch-2 passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
14s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m
22s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
56s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
56s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
51s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} rubocop {color} | {color:green} 0m
12s{color} | {color:green} There were no new rubocop issues. {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 5m
30s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
20m 18s{color} | {color:green} Patch does not cause any errors with Hadoop
2.8.5 2.9.2 or 3.1.2. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
38s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
44s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 2m
30s{color} | {color:green} hbase-client in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 6m
57s{color} | {color:green} hbase-shell in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
17s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 71m 19s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=19.03.4 Server=19.03.4 base:
https://builds.apache.org/job/PreCommit-HBASE-Build/1133/artifact/patchprocess/Dockerfile
|
| JIRA Issue | HBASE-22827 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12993722/hbase-22827.branch-2.001.patch
|
| Optional
[GitHub] [hbase] Apache-HBase commented on issue #1167: HBASE-18095 Zookeeper-less client connection umbrella
Apache-HBase commented on issue #1167: HBASE-18095 Zookeeper-less client connection umbrella URL: https://github.com/apache/hbase/pull/1167#issuecomment-587183507 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 10s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 3s | No case conflicting files found. | | +0 :ok: | prototool | 0m 0s | prototool was not available. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | +1 :green_heart: | test4tests | 0m 0s | The patch appears to include 95 new or modified test files. | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 35s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 5m 52s | master passed | | +1 :green_heart: | compile | 3m 30s | master passed | | +1 :green_heart: | checkstyle | 2m 48s | master passed | | +0 :ok: | refguide | 5m 23s | branch has no errors when building the reference guide. See footer for rendered docs, which you should manually inspect. | | +1 :green_heart: | shadedjars | 5m 8s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 5m 26s | master passed | | +0 :ok: | spotbugs | 1m 26s | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 :green_heart: | findbugs | 27m 24s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 14s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 5m 40s | the patch passed | | +1 :green_heart: | compile | 3m 41s | the patch passed | | +1 :green_heart: | cc | 3m 41s | the patch passed | | +1 :green_heart: | javac | 3m 41s | the patch passed | | -1 :x: | checkstyle | 2m 49s | root: The patch generated 1 new + 753 unchanged - 96 fixed = 754 total (was 849) | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +0 :ok: | refguide | 5m 44s | patch has no errors when building the reference guide. See footer for rendered docs, which you should manually inspect. | | +1 :green_heart: | shadedjars | 5m 4s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 17m 35s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. | | +1 :green_heart: | hbaseprotoc | 9m 18s | the patch passed | | +1 :green_heart: | javadoc | 5m 30s | the patch passed | | +1 :green_heart: | findbugs | 28m 17s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 150m 44s | root in the patch failed. | | +1 :green_heart: | asflicense | 3m 44s | The patch does not generate ASF License warnings. | | | | 305m 16s | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.hbase.security.provider.example.TestShadeSaslAuthenticationProvider | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.6 Server=19.03.6 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1167/5/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1167 | | Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile cc hbaseprotoc prototool refguide | | uname | Linux 1b24014c16e5 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1167/out/precommit/personality/provided.sh | | git revision | master / e11dbf36a5 | | Default Java | 1.8.0_181 | | refguide | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1167/5/artifact/out/branch-site/book.html | | checkstyle | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1167/5/artifact/out/diff-checkstyle-root.txt | | refguide | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1167/5/artifact/out/patch-site/book.html | | unit | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1167/5/artifact/out/patch-unit-root.txt | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1167/5/testReport/ | | Max. process+thread count | 6659 (vs. ulimit of 1) | | modules | C: hbase-protocol-shaded hbase-common hbase-client hbase-zookeeper hbase-server hbase-mapreduce hbase-thrift . U: . | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1167/5/console |
[GitHub] [hbase] jojochuang commented on issue #1179: HBASE-23861. Reconcile Hadoop version.
jojochuang commented on issue #1179: HBASE-23861. Reconcile Hadoop version. URL: https://github.com/apache/hbase/pull/1179#issuecomment-587174353 Test failure doesn't look related. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (HBASE-23702) `hbase.hstore.flusher.count` setting to 0 breaks HMaster
[ https://issues.apache.org/jira/browse/HBASE-23702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HBASE-23702: -- Attachment: HBASE-23702-000.patch > `hbase.hstore.flusher.count` setting to 0 breaks HMaster > > > Key: HBASE-23702 > URL: https://issues.apache.org/jira/browse/HBASE-23702 > Project: HBase > Issue Type: Bug > Components: regionserver >Affects Versions: 2.2.3 > Environment: HBase-2.2.3 > Java openjdk 1.8.0_222 > Ubuntu 18.04 >Reporter: Ctest >Priority: Major > Attachments: HBASE-23702-000.patch, HBASE-23702-000.patch, > HBASE-23702-000.patch > > > Summary > The configuration parameter `hbase.hstore.flusher.count` allows `0` (which > turns out to be a bad value after I understand the source code). > When we set `hbase.hstore.flusher.count` to 0, HMaster will fail in 200,000 > ms without any error message, but > ``` > java.lang.RuntimeException: Master not initialized after 20ms > ``` > > There’s no messages pinpointing `hbase.hstore.flusher.count` being the root > cause. > > 0 means `MemStoreFlusher` is not alive. During the initialization time of > HMaster, `isHealthy()` will be called and it will try to check if > `MemStoreFlusher` is alive or not. However, since we set > `hbase.hstore.flusher.count` to 0, there will be no flusher created at the > first place, which cause`isHealthy()` to return false. As a consequence, > HRegionServer does not enter its main loop. > > *How To Reproduce* > > The version of HBase: 2.2.3 > > # Set the value of configuration parameter `hbase.hstore.flusher.count` to > `0` in “conf/hbase-site.xml” > # Start hbase by running “bin/start-hbase.sh” > # Wait for 3-4 minutes > # Open the log file “logs/hbase-- master -.log” -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on issue #1178: HBASE-23858 Set version as 2.1.10-SNAPSHOT in branch-2.1
Apache-HBase commented on issue #1178: HBASE-23858 Set version as 2.1.10-SNAPSHOT in branch-2.1 URL: https://github.com/apache/hbase/pull/1178#issuecomment-587171019 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 31s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 1s | No case conflicting files found. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ branch-2.1 Compile Tests _ | | +0 :ok: | mvndep | 1m 1s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 5m 10s | branch-2.1 passed | | +1 :green_heart: | compile | 3m 0s | branch-2.1 passed | | +1 :green_heart: | checkstyle | 2m 56s | branch-2.1 passed | | +1 :green_heart: | shadedjars | 4m 14s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 11m 56s | branch-2.1 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 4s | branch-2.1 passed | | +0 :ok: | mvndep | 5m 25s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 5m 7s | the patch passed | | +1 :green_heart: | compile | 3m 3s | the patch passed | | +1 :green_heart: | javac | 3m 3s | the patch passed | | +1 :green_heart: | checkstyle | 2m 56s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 51s | The patch has no ill-formed XML file. | | +1 :green_heart: | shadedjars | 4m 19s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 21m 37s | Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2. | | +1 :green_heart: | javadoc | 12m 17s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 211m 41s | root in the patch passed. | | +1 :green_heart: | asflicense | 18m 18s | The patch does not generate ASF License warnings. | | | | 325m 31s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.4 Server=19.03.4 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1178/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1178 | | Optional Tests | dupname asflicense javac javadoc unit shadedjars hadoopcheck xml compile checkstyle | | uname | Linux 8227ef44b170 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1178/out/precommit/personality/provided.sh | | git revision | branch-2.1 / c540d906df | | Default Java | 1.8.0_181 | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1178/1/testReport/ | | Max. process+thread count | 4834 (vs. ulimit of 1) | | modules | C: hbase-checkstyle hbase-annotations hbase-build-configuration hbase-protocol-shaded hbase-common hbase-metrics-api hbase-hadoop-compat hbase-metrics hbase-hadoop2-compat hbase-protocol hbase-client hbase-zookeeper hbase-replication hbase-resource-bundle hbase-http hbase-procedure hbase-server hbase-mapreduce hbase-testing-util hbase-thrift hbase-rsgroup hbase-shell hbase-endpoint hbase-it hbase-rest hbase-examples hbase-shaded hbase-shaded/hbase-shaded-client hbase-shaded/hbase-shaded-client-byo-hadoop hbase-shaded/hbase-shaded-mapreduce hbase-external-blockcache hbase-hbtop hbase-assembly hbase-shaded/hbase-shaded-testing-util hbase-shaded/hbase-shaded-testing-util-tester hbase-shaded/hbase-shaded-check-invariants hbase-shaded/hbase-shaded-with-hadoop-check-invariants hbase-archetypes hbase-archetypes/hbase-client-project hbase-archetypes/hbase-shaded-client-project hbase-archetypes/hbase-archetype-builder . U: . | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1178/1/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at:
[jira] [Updated] (HBASE-22827) Expose multi-region merge in shell and Admin API
[ https://issues.apache.org/jira/browse/HBASE-22827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sakthi updated HBASE-22827: --- Fix Version/s: 2.3.0 Status: Patch Available (was: In Progress) > Expose multi-region merge in shell and Admin API > > > Key: HBASE-22827 > URL: https://issues.apache.org/jira/browse/HBASE-22827 > Project: HBase > Issue Type: Improvement > Components: Admin, shell >Reporter: Michael Stack >Assignee: Sakthi >Priority: Major > Fix For: 3.0.0, 2.3.0 > > Attachments: hbase-22827.branch-2.001.patch > > > HBASE-22777 adds being able to merge more than two regions at once. It is > only available internally currently for use by hbck2 doing fixup of overlaps > in hbase:meta. This issue is about exposing it via the Admin Interface and in > turn, via the shell. Probably best if old two region merge method is > deprecated. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-22827) Expose multi-region merge in shell and Admin API
[ https://issues.apache.org/jira/browse/HBASE-22827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sakthi updated HBASE-22827: --- Attachment: hbase-22827.branch-2.001.patch > Expose multi-region merge in shell and Admin API > > > Key: HBASE-22827 > URL: https://issues.apache.org/jira/browse/HBASE-22827 > Project: HBase > Issue Type: Improvement > Components: Admin, shell >Reporter: Michael Stack >Assignee: Sakthi >Priority: Major > Fix For: 3.0.0 > > Attachments: hbase-22827.branch-2.001.patch > > > HBASE-22777 adds being able to merge more than two regions at once. It is > only available internally currently for use by hbck2 doing fixup of overlaps > in hbase:meta. This issue is about exposing it via the Admin Interface and in > turn, via the shell. Probably best if old two region merge method is > deprecated. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work started] (HBASE-23827) [HBCK2] Add mergeRegions method to hbck service
[ https://issues.apache.org/jira/browse/HBASE-23827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-23827 started by Sakthi. -- > [HBCK2] Add mergeRegions method to hbck service > --- > > Key: HBASE-23827 > URL: https://issues.apache.org/jira/browse/HBASE-23827 > Project: HBase > Issue Type: Task >Reporter: Sakthi >Assignee: Sakthi >Priority: Major > Fix For: 3.0.0, 2.3.0, 2.2.4, 2.1.10 > > > Let's add the mergeRegions method to the hbck service so that hbck2 can use > it from the client side. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-23863) [Flakey Test] TestReplicationEndpointWithMultipleWAL#testInterClusterReplication
[ https://issues.apache.org/jira/browse/HBASE-23863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Stack updated HBASE-23863: -- Attachment: 0001-HBASE-23863-Flakey-Test-TestReplicationEndpointWithM.patch > [Flakey Test] > TestReplicationEndpointWithMultipleWAL#testInterClusterReplication > > > Key: HBASE-23863 > URL: https://issues.apache.org/jira/browse/HBASE-23863 > Project: HBase > Issue Type: Bug > Components: flakies >Reporter: Michael Stack >Priority: Major > Attachments: > 0001-HBASE-23863-Flakey-Test-TestReplicationEndpointWithM.patch > > > This one fails in an odd way about 15% of the time where it replicates 2499 > edits of 2500 And seemingly always these numbers. Odd. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-23863) [Flakey Test] TestReplicationEndpointWithMultipleWAL#testInterClusterReplication
[ https://issues.apache.org/jira/browse/HBASE-23863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Stack updated HBASE-23863: -- Fix Version/s: 2.3.0 3.0.0 > [Flakey Test] > TestReplicationEndpointWithMultipleWAL#testInterClusterReplication > > > Key: HBASE-23863 > URL: https://issues.apache.org/jira/browse/HBASE-23863 > Project: HBase > Issue Type: Bug > Components: flakies >Reporter: Michael Stack >Priority: Major > Fix For: 3.0.0, 2.3.0 > > Attachments: > 0001-HBASE-23863-Flakey-Test-TestReplicationEndpointWithM.patch > > > This one fails in an odd way about 15% of the time where it replicates 2499 > edits of 2500 And seemingly always these numbers. Odd. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23863) [Flakey Test] TestReplicationEndpointWithMultipleWAL#testInterClusterReplication
[ https://issues.apache.org/jira/browse/HBASE-23863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038635#comment-17038635 ] Michael Stack commented on HBASE-23863: --- Pushed debug patch on branch-2. It puts up peer before replicates and uses trick from previous test to ensure it up. Lets see. > [Flakey Test] > TestReplicationEndpointWithMultipleWAL#testInterClusterReplication > > > Key: HBASE-23863 > URL: https://issues.apache.org/jira/browse/HBASE-23863 > Project: HBase > Issue Type: Bug > Components: flakies >Reporter: Michael Stack >Priority: Major > Fix For: 3.0.0, 2.3.0 > > Attachments: > 0001-HBASE-23863-Flakey-Test-TestReplicationEndpointWithM.patch > > > This one fails in an odd way about 15% of the time where it replicates 2499 > edits of 2500 And seemingly always these numbers. Odd. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-23863) [Flakey Test] TestReplicationEndpointWithMultipleWAL#testInterClusterReplication
Michael Stack created HBASE-23863: - Summary: [Flakey Test] TestReplicationEndpointWithMultipleWAL#testInterClusterReplication Key: HBASE-23863 URL: https://issues.apache.org/jira/browse/HBASE-23863 Project: HBase Issue Type: Bug Components: flakies Reporter: Michael Stack This one fails in an odd way about 15% of the time where it replicates 2499 edits of 2500 And seemingly always these numbers. Odd. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on issue #1179: HBASE-23861. Reconcile Hadoop version.
Apache-HBase commented on issue #1179: HBASE-23861. Reconcile Hadoop version. URL: https://github.com/apache/hbase/pull/1179#issuecomment-587152642 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 2m 14s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 54s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 7m 28s | master passed | | +1 :green_heart: | compile | 4m 16s | master passed | | +1 :green_heart: | shadedjars | 6m 14s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 4m 43s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 23s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 7m 18s | the patch passed | | +1 :green_heart: | compile | 4m 6s | the patch passed | | +1 :green_heart: | javac | 4m 6s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 4s | The patch has no ill-formed XML file. | | +1 :green_heart: | shadedjars | 5m 36s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 17m 34s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. | | +1 :green_heart: | javadoc | 3m 31s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 115m 1s | root in the patch failed. | | +1 :green_heart: | asflicense | 1m 9s | The patch does not generate ASF License warnings. | | | | 187m 34s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.6 Server=19.03.6 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1179/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1179 | | Optional Tests | dupname asflicense javac javadoc unit shadedjars hadoopcheck xml compile | | uname | Linux 7d3596172417 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1179/out/precommit/personality/provided.sh | | git revision | master / e11dbf36a5 | | Default Java | 1.8.0_181 | | unit | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1179/1/artifact/out/patch-unit-root.txt | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1179/1/testReport/ | | Max. process+thread count | 6562 (vs. ulimit of 1) | | modules | C: hbase-server . U: . | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1179/1/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (HBASE-23862) Fix flaky TestSnapshotFromMaster in 1.x versions
[ https://issues.apache.org/jira/browse/HBASE-23862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038621#comment-17038621 ] Sakthi commented on HBASE-23862: Have pushed change into the branch https://github.com/apache/hbase/tree/HBASE-23862 for testing using our adhoc UT running job. > Fix flaky TestSnapshotFromMaster in 1.x versions > > > Key: HBASE-23862 > URL: https://issues.apache.org/jira/browse/HBASE-23862 > Project: HBase > Issue Type: Task >Reporter: Sakthi >Assignee: Sakthi >Priority: Major > > HBASE-23658 was about fixing this flakey ut in branch-2+. I think it can be > backported to branch-1s as well. 18/30 times this test has failed in > branch-1, 10/30 in 1.4 and 3/30 in 1.3. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-23862) Fix flaky TestSnapshotFromMaster in 1.x versions
Sakthi created HBASE-23862: -- Summary: Fix flaky TestSnapshotFromMaster in 1.x versions Key: HBASE-23862 URL: https://issues.apache.org/jira/browse/HBASE-23862 Project: HBase Issue Type: Task Reporter: Sakthi Assignee: Sakthi HBASE-23658 was about fixing this flakey ut in branch-2+. I think it can be backported to branch-1s as well. 18/30 times this test has failed in branch-1, 10/30 in 1.4 and 3/30 in 1.3. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23658) Fix flaky TestSnapshotFromMaster
[
https://issues.apache.org/jira/browse/HBASE-23658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038612#comment-17038612
]
Sakthi commented on HBASE-23658:
I think this fix can be backported to branch-1+ as well. This UT has been very
flakey in those branches as well.
> Fix flaky TestSnapshotFromMaster
>
>
> Key: HBASE-23658
> URL: https://issues.apache.org/jira/browse/HBASE-23658
> Project: HBase
> Issue Type: Bug
>Reporter: Guanghao Zhang
>Assignee: Guanghao Zhang
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 2.2.3, 2.1.9
>
> Attachments: HBASE-23658.branch-2.2.001.patch
>
>
> testAsyncSnapshotWillNotBlockSnapshotHFileCleaner is flaky. The assert may
> fail.
> {code:java}
> assertTrue(master.getSnapshotManager().isTakingAnySnapshot());
> future.get(); // in branch-2.2, here is Thread.sleep
> assertFalse(master.getSnapshotManager().isTakingAnySnapshot());
> {code}
> See
> [https://builds.apache.org/job/HBase-Flaky-Tests/job/master/5227/testReport/junit/org.apache.hadoop.hbase.master.cleaner/TestSnapshotFromMaster/testAsyncSnapshotWillNotBlockSnapshotHFileCleaner/]
>
> [https://builds.apache.org/view/H-L/view/HBase/job/HBase-Find-Flaky-Tests/job/branch-2.2/lastSuccessfulBuild/artifact/dashboard.html]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-18095) Provide an option for clients to find the server hosting META that does not involve the ZooKeeper client
[
https://issues.apache.org/jira/browse/HBASE-18095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038609#comment-17038609
]
Hudson commented on HBASE-18095:
Results for branch HBASE-18095/client-locate-meta-no-zookeeper
[build #79 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-18095%252Fclient-locate-meta-no-zookeeper/79/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-18095%252Fclient-locate-meta-no-zookeeper/79//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-18095%252Fclient-locate-meta-no-zookeeper/79//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-18095%252Fclient-locate-meta-no-zookeeper/79//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Provide an option for clients to find the server hosting META that does not
> involve the ZooKeeper client
>
>
> Key: HBASE-18095
> URL: https://issues.apache.org/jira/browse/HBASE-18095
> Project: HBase
> Issue Type: New Feature
> Components: Client
>Reporter: Andrew Kyle Purtell
>Assignee: Bharath Vissapragada
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 1.7.0
>
> Attachments: HBASE-18095.master-v1.patch, HBASE-18095.master-v2.patch
>
>
> Clients are required to connect to ZooKeeper to find the location of the
> regionserver hosting the meta table region. Site configuration provides the
> client a list of ZK quorum peers and the client uses an embedded ZK client to
> query meta location. Timeouts and retry behavior of this embedded ZK client
> are managed orthogonally to HBase layer settings and in some cases the ZK
> cannot manage what in theory the HBase client can, i.e. fail fast upon outage
> or network partition.
> We should consider new configuration settings that provide a list of
> well-known master and backup master locations, and with this information the
> client can contact any of the master processes directly. Any master in either
> active or passive state will track meta location and respond to requests for
> it with its cached last known location. If this location is stale, the client
> can ask again with a flag set that requests the master refresh its location
> cache and return the up-to-date location. Every client interaction with the
> cluster thus uses only HBase RPC as transport, with appropriate settings
> applied to the connection. The configuration toggle that enables this
> alternative meta location lookup should be false by default.
> This removes the requirement that HBase clients embed the ZK client and
> contact the ZK service directly at the beginning of the connection lifecycle.
> This has several benefits. ZK service need not be exposed to clients, and
> their potential abuse, yet no benefit ZK provides the HBase server cluster is
> compromised. Normalizing HBase client and ZK client timeout settings and
> retry behavior - in some cases, impossible, i.e. for fail-fast - is no longer
> necessary.
> And, from [~ghelmling]: There is an additional complication here for
> token-based authentication. When a delegation token is used for SASL
> authentication, the client uses the cluster ID obtained from Zookeeper to
> select the token identifier to use. So there would also need to be some
> Zookeeper-less, unauthenticated way to obtain the cluster ID as well.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on issue #1180: HBASE-23834. HBase fails to run on Hadoop 3.3.0/3.2.2/3.1.4 due to jetty version mismatch.
Apache-HBase commented on issue #1180: HBASE-23834. HBase fails to run on Hadoop 3.3.0/3.2.2/3.1.4 due to jetty version mismatch. URL: https://github.com/apache/hbase/pull/1180#issuecomment-587130628 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 28s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 1s | No case conflicting files found. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 6m 28s | master passed | | +1 :green_heart: | compile | 3m 19s | master passed | | +1 :green_heart: | shadedjars | 5m 9s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 3m 8s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 58s | the patch passed | | +1 :green_heart: | compile | 3m 30s | the patch passed | | +1 :green_heart: | javac | 3m 30s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 2s | The patch has no ill-formed XML file. | | +1 :green_heart: | shadedjars | 5m 15s | patch has no errors when building our shaded downstream artifacts. | | -1 :x: | hadoopcheck | 15m 11s | The patch causes 52 errors with Hadoop v3.1.2. | | +1 :green_heart: | javadoc | 2m 57s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 5m 55s | root in the patch failed. | | +1 :green_heart: | asflicense | 0m 17s | The patch does not generate ASF License warnings. | | | | 59m 47s | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.hbase.http.TestHttpServer | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1180/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1180 | | Optional Tests | dupname asflicense javac javadoc unit shadedjars hadoopcheck xml compile | | uname | Linux 13b5584dbadb 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1180/out/precommit/personality/provided.sh | | git revision | master / e11dbf36a5 | | Default Java | 1.8.0_181 | | hadoopcheck | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1180/1/artifact/out/patch-javac-3.1.2.txt | | unit | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1180/1/artifact/out/patch-unit-root.txt | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1180/1/testReport/ | | Max. process+thread count | 470 (vs. ulimit of 1) | | modules | C: . U: . | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1180/1/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (HBASE-23853) [Flakey Test] TestBlockEvictionFromClient#testBlockRefCountAfterSplits
[
https://issues.apache.org/jira/browse/HBASE-23853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038559#comment-17038559
]
Hudson commented on HBASE-23853:
Results for branch branch-2
[build #2478 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2478/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2478//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2478//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2478//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> [Flakey Test] TestBlockEvictionFromClient#testBlockRefCountAfterSplits
> --
>
> Key: HBASE-23853
> URL: https://issues.apache.org/jira/browse/HBASE-23853
> Project: HBase
> Issue Type: Bug
> Components: flakies
>Reporter: Michael Stack
>Priority: Major
> Fix For: 3.0.0, 2.3.0
>
> Attachments:
> 0001-HBASE-23853-Flakey-Test-TestBlockEvictionFromClient-.patch, Screen Shot
> 2020-02-15 at 2.36.47 PM.png
>
>
> Fails 12-25% of the time in the GCE build.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-23855) Change bytes size to human readable size for Server Metrics of RegionServer Web UI
[
https://issues.apache.org/jira/browse/HBASE-23855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038560#comment-17038560
]
Hudson commented on HBASE-23855:
Results for branch branch-2
[build #2478 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2478/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2478//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2478//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2478//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Change bytes size to human readable size for Server Metrics of RegionServer
> Web UI
> --
>
> Key: HBASE-23855
> URL: https://issues.apache.org/jira/browse/HBASE-23855
> Project: HBase
> Issue Type: Improvement
>Affects Versions: master
>Reporter: Zhuoyue Huang
>Assignee: Zhuoyue Huang
>Priority: Trivial
> Fix For: 3.0.0, 2.3.0
>
> Attachments: image-2020-02-16-19-23-39-432.png,
> image-2020-02-16-19-28-23-449.png
>
>
> I found that the “BytesBufferAllocator Status” in RegionServer Web UI still
> using "Bytes" as a fixture unit. I think we should use "MB" or "GB" when the
> size is too large !image-2020-02-16-19-23-39-432.png!
>
> The Web UI after improvement:
> !image-2020-02-16-19-28-23-449.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (HBASE-23834) HBase fails to run on Hadoop 3.3.0/3.2.2/3.1.4 due to jetty version mismatch
[ https://issues.apache.org/jira/browse/HBASE-23834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HBASE-23834: --- Assignee: Wei-Chiu Chuang > HBase fails to run on Hadoop 3.3.0/3.2.2/3.1.4 due to jetty version mismatch > > > Key: HBASE-23834 > URL: https://issues.apache.org/jira/browse/HBASE-23834 > Project: HBase > Issue Type: Bug >Reporter: Wei-Chiu Chuang >Assignee: Wei-Chiu Chuang >Priority: Major > > HBase master branch is currently on Jetty 9.3, and latest Hadoop 3 > (unreleased branches trunk, branch-3.2 and branch-3.1) bumped Jetty to 9.4 to > address a vulnerability CVE-2017-9735. > (1) Jetty 9.3 and 9.4 are quite different (there are incompatible API > changes) and HBase won't start on the latest Hadoop 3. > (2) In any case, HBase should update its Jetty dependency to address the > vulnerability. > Fortunately for HBase, updating to Jetty 9.4 requires no code change other > than the maven version string. > More tests are needed to verify if HBase can run on older Hadoop versions if > its Jetty is updated. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] jojochuang opened a new pull request #1180: HBASE-23834. HBase fails to run on Hadoop 3.3.0/3.2.2/3.1.4 due to jetty version mismatch.
jojochuang opened a new pull request #1180: HBASE-23834. HBase fails to run on Hadoop 3.3.0/3.2.2/3.1.4 due to jetty version mismatch. URL: https://github.com/apache/hbase/pull/1180 (1) updated Jetty version. (2) hadoop-3 profile uses Hadoop 3.1.4-SNAPSHOT which runs on Jetty 9.4. There's not a Hadoop 2 version that runs on Jetty 9.4 so skip it for now. Create this PR and let it run through the precommit test. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [hbase] jojochuang opened a new pull request #1179: HBASE-23861. Reconcile Hadoop version.
jojochuang opened a new pull request #1179: HBASE-23861. Reconcile Hadoop version. URL: https://github.com/apache/hbase/pull/1179 Let it run through the precommit and see if it breaks anything. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (HBASE-23861) Reconcile Hadoop version
[
https://issues.apache.org/jira/browse/HBASE-23861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang updated HBASE-23861:
Description:
I followed the HBase book http://hbase.apache.org/book.html#maven.build.hadoop
and wanted to build HBase (master) on top of Hadoop 3.2/3.3 but tests failed
right away.
Build:
{code}
mvn clean install -Dhadoop.profile=3.0 -Dhadoop-three.version=3.2.1 -DskipTests
{code}
Test:
{code}
mvn test -Dtest=TestHelloHBase -Dhadoop.profile=3.0 -Dhadoop-three.version=3.2.1
{code}
{noformat}
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.296 s
<<< FAILURE! - in
org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase
[ERROR] org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase
Time elapsed: 1.284 s <<< ERROR!
java.lang.NoClassDefFoundError:
org/apache/hadoop/hdfs/protocol/HdfsConstants$StoragePolicySatisfierMode
at
org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase.beforeClass(TestHelloHBase.java:54)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hdfs.protocol.HdfsConstants$StoragePolicySatisfierMode
at
org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase.beforeClass(TestHelloHBase.java:54)
{noformat}
Adding mvn -X parameter, I was able to tell that it was because the
hbase-server module includes hadoop-distcp and hadoop-dfs-client 3.1.2 (the
default Hadoop 3 dependency version) while it uses version 3.2.1 of other
hadoop jars . The classpath conflict (the storage policy satisfier is a new
feature in Hadoop 3.2) failed the test.
This is reproducible on any Hadoop version 3.2 and above. It looks to me the
version of hadoop-distcp and hadoop-hdfs-client should be specified at the top
level pom (they are specified in hbase-server/pom.xml).
was:
I want to build HBase (master) on top of Hadoop 3.2/3.3 but tests failed right
away.
Build:
{code}
mvn clean install -Dhadoop.profile=3.0 -Dhadoop-three.version=3.2.1 -DskipTests
{code}
Test:
{code}
mvn test -Dtest=TestHelloHBase -Dhadoop.profile=3.0 -Dhadoop-three.version=3.2.1
{code}
{noformat}
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.296 s
<<< FAILURE! - in
org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase
[ERROR] org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase
Time elapsed: 1.284 s <<< ERROR!
java.lang.NoClassDefFoundError:
org/apache/hadoop/hdfs/protocol/HdfsConstants$StoragePolicySatisfierMode
at
org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase.beforeClass(TestHelloHBase.java:54)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hdfs.protocol.HdfsConstants$StoragePolicySatisfierMode
at
org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase.beforeClass(TestHelloHBase.java:54)
{noformat}
Adding mvn -X parameter, I was able to tell that it was because the
hbase-server module includes hadoop-distcp and hadoop-dfs-client 3.1.2 (the
default Hadoop 3 dependency version) while it uses version 3.2.1 of other
hadoop jars . The classpath conflict (the storage policy satisfier is a new
feature in Hadoop 3.2) failed the test.
This is reproducible on any Hadoop version 3.2 and above. It looks to me the
version of hadoop-distcp and hadoop-hdfs-client should be specified at the top
level pom (they are specified in hbase-server/pom.xml).
> Reconcile Hadoop version
>
>
> Key: HBASE-23861
> URL: https://issues.apache.org/jira/browse/HBASE-23861
> Project: HBase
> Issue Type: Bug
> Components: dependencies
>Affects Versions: 3.0.0
> Environment: Apache Maven 3.6.1
> Hadoop 3.2.0 and above.
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>Priority: Major
>
> I followed the HBase book
> http://hbase.apache.org/book.html#maven.build.hadoop and wanted to build
> HBase (master) on top of Hadoop 3.2/3.3 but tests failed right away.
> Build:
> {code}
> mvn clean install -Dhadoop.profile=3.0 -Dhadoop-three.version=3.2.1
> -DskipTests
> {code}
> Test:
> {code}
> mvn test -Dtest=TestHelloHBase -Dhadoop.profile=3.0
> -Dhadoop-three.version=3.2.1
> {code}
> {noformat}
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.296
> s <<< FAILURE! - in
> org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase
> [ERROR] org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase
> Time elapsed: 1.284 s <<< ERROR!
> java.lang.NoClassDefFoundError:
> org/apache/hadoop/hdfs/protocol/HdfsConstants$StoragePolicySatisfierMode
> at
> org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase.beforeClass(TestHelloHBase.java:54)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.hdfs.protocol.HdfsConstants$StoragePolicySatisfierMode
> at
[jira] [Updated] (HBASE-23861) Reconcile Hadoop version
[
https://issues.apache.org/jira/browse/HBASE-23861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang updated HBASE-23861:
Environment:
Apache Maven 3.6.1
Hadoop 3.2.0 and above.
> Reconcile Hadoop version
>
>
> Key: HBASE-23861
> URL: https://issues.apache.org/jira/browse/HBASE-23861
> Project: HBase
> Issue Type: Bug
> Components: dependencies
>Affects Versions: 3.0.0
> Environment: Apache Maven 3.6.1
> Hadoop 3.2.0 and above.
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>Priority: Major
>
> I want to build HBase (master) on top of Hadoop 3.2/3.3 but tests failed
> right away.
> Build:
> {code}
> mvn clean install -Dhadoop.profile=3.0 -Dhadoop-three.version=3.2.1
> -DskipTests
> {code}
> Test:
> {code}
> mvn test -Dtest=TestHelloHBase -Dhadoop.profile=3.0
> -Dhadoop-three.version=3.2.1
> {code}
> {noformat}
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.296
> s <<< FAILURE! - in
> org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase
> [ERROR] org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase
> Time elapsed: 1.284 s <<< ERROR!
> java.lang.NoClassDefFoundError:
> org/apache/hadoop/hdfs/protocol/HdfsConstants$StoragePolicySatisfierMode
> at
> org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase.beforeClass(TestHelloHBase.java:54)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.hdfs.protocol.HdfsConstants$StoragePolicySatisfierMode
> at
> org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase.beforeClass(TestHelloHBase.java:54)
> {noformat}
> Adding mvn -X parameter, I was able to tell that it was because the
> hbase-server module includes hadoop-distcp and hadoop-dfs-client 3.1.2 (the
> default Hadoop 3 dependency version) while it uses version 3.2.1 of other
> hadoop jars . The classpath conflict (the storage policy satisfier is a new
> feature in Hadoop 3.2) failed the test.
> This is reproducible on any Hadoop version 3.2 and above. It looks to me the
> version of hadoop-distcp and hadoop-hdfs-client should be specified at the
> top level pom (they are specified in hbase-server/pom.xml).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HBASE-23861) Reconcile Hadoop version
Wei-Chiu Chuang created HBASE-23861:
---
Summary: Reconcile Hadoop version
Key: HBASE-23861
URL: https://issues.apache.org/jira/browse/HBASE-23861
Project: HBase
Issue Type: Bug
Components: dependencies
Affects Versions: 3.0.0
Reporter: Wei-Chiu Chuang
Assignee: Wei-Chiu Chuang
I want to build HBase (master) on top of Hadoop 3.2/3.3 but tests failed right
away.
Build:
{code}
mvn clean install -Dhadoop.profile=3.0 -Dhadoop-three.version=3.2.1 -DskipTests
{code}
Test:
{code}
mvn test -Dtest=TestHelloHBase -Dhadoop.profile=3.0 -Dhadoop-three.version=3.2.1
{code}
{noformat}
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.296 s
<<< FAILURE! - in
org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase
[ERROR] org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase
Time elapsed: 1.284 s <<< ERROR!
java.lang.NoClassDefFoundError:
org/apache/hadoop/hdfs/protocol/HdfsConstants$StoragePolicySatisfierMode
at
org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase.beforeClass(TestHelloHBase.java:54)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hdfs.protocol.HdfsConstants$StoragePolicySatisfierMode
at
org.apache.hbase.archetypes.exemplars.shaded_client.TestHelloHBase.beforeClass(TestHelloHBase.java:54)
{noformat}
Adding mvn -X parameter, I was able to tell that it was because the
hbase-server module includes hadoop-distcp and hadoop-dfs-client 3.1.2 (the
default Hadoop 3 dependency version) while it uses version 3.2.1 of other
hadoop jars . The classpath conflict (the storage policy satisfier is a new
feature in Hadoop 3.2) failed the test.
This is reproducible on any Hadoop version 3.2 and above. It looks to me the
version of hadoop-distcp and hadoop-hdfs-client should be specified at the top
level pom (they are specified in hbase-server/pom.xml).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-23853) [Flakey Test] TestBlockEvictionFromClient#testBlockRefCountAfterSplits
[
https://issues.apache.org/jira/browse/HBASE-23853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038496#comment-17038496
]
Michael Stack commented on HBASE-23853:
---
Just pushed new addendum:
{code}
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheConfig.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheConfig.java
index dfce7914bc..be4c31f2b0 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheConfig.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheConfig.java
@@ -131,7 +131,7 @@ public class CacheConfig {
private boolean cacheBloomsOnWrite;
/** Whether blocks of a file should be evicted when the file is closed */
- private boolean evictOnClose;
+ private volatile boolean evictOnClose;
{code}
See if this helps.
After studying test more, looks like there is a bug in here. Lets see.
> [Flakey Test] TestBlockEvictionFromClient#testBlockRefCountAfterSplits
> --
>
> Key: HBASE-23853
> URL: https://issues.apache.org/jira/browse/HBASE-23853
> Project: HBase
> Issue Type: Bug
> Components: flakies
>Reporter: Michael Stack
>Priority: Major
> Fix For: 3.0.0, 2.3.0
>
> Attachments:
> 0001-HBASE-23853-Flakey-Test-TestBlockEvictionFromClient-.patch, Screen Shot
> 2020-02-15 at 2.36.47 PM.png
>
>
> Fails 12-25% of the time in the GCE build.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] Apache9 opened a new pull request #1178: HBASE-23858 Set version as 2.1.10-SNAPSHOT in branch-2.1
Apache9 opened a new pull request #1178: HBASE-23858 Set version as 2.1.10-SNAPSHOT in branch-2.1 URL: https://github.com/apache/hbase/pull/1178 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [hbase] Apache-HBase commented on issue #1177: HBASE-23857 Add 2.1.9 to download page
Apache-HBase commented on issue #1177: HBASE-23857 Add 2.1.9 to download page URL: https://github.com/apache/hbase/pull/1177#issuecomment-587068649 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 19s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 6m 3s | master passed | | +1 :green_heart: | mvnsite | 17m 41s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 36s | the patch passed | | +1 :green_heart: | mvnsite | 17m 22s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 1s | The patch has no ill-formed XML file. | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 19s | The patch does not generate ASF License warnings. | | | | 49m 35s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.6 Server=19.03.6 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1177/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1177 | | Optional Tests | dupname asflicense mvnsite xml | | uname | Linux ab737a8f5b5e 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1177/out/precommit/personality/provided.sh | | git revision | master / e11dbf36a5 | | Max. process+thread count | 86 (vs. ulimit of 1) | | modules | C: . U: . | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1177/1/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Assigned] (HBASE-23858) Set version as 2.1.10-SNAPSHOT in branch-2.1
[ https://issues.apache.org/jira/browse/HBASE-23858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang reassigned HBASE-23858: - Assignee: Duo Zhang > Set version as 2.1.10-SNAPSHOT in branch-2.1 > > > Key: HBASE-23858 > URL: https://issues.apache.org/jira/browse/HBASE-23858 > Project: HBase > Issue Type: Sub-task >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work started] (HBASE-23858) Set version as 2.1.10-SNAPSHOT in branch-2.1
[ https://issues.apache.org/jira/browse/HBASE-23858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-23858 started by Duo Zhang. - > Set version as 2.1.10-SNAPSHOT in branch-2.1 > > > Key: HBASE-23858 > URL: https://issues.apache.org/jira/browse/HBASE-23858 > Project: HBase > Issue Type: Sub-task >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-23858) Set version as 2.1.10-SNAPSHOT in branch-2.1
[ https://issues.apache.org/jira/browse/HBASE-23858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-23858: -- Fix Version/s: 2.1.10 > Set version as 2.1.10-SNAPSHOT in branch-2.1 > > > Key: HBASE-23858 > URL: https://issues.apache.org/jira/browse/HBASE-23858 > Project: HBase > Issue Type: Sub-task > Components: build, pom >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Fix For: 2.1.10 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-23858) Set version as 2.1.10-SNAPSHOT in branch-2.1
[ https://issues.apache.org/jira/browse/HBASE-23858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-23858: -- Component/s: pom build > Set version as 2.1.10-SNAPSHOT in branch-2.1 > > > Key: HBASE-23858 > URL: https://issues.apache.org/jira/browse/HBASE-23858 > Project: HBase > Issue Type: Sub-task > Components: build, pom >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache9 opened a new pull request #1177: HBASE-23857 Add 2.1.9 to download page
Apache9 opened a new pull request #1177: HBASE-23857 Add 2.1.9 to download page URL: https://github.com/apache/hbase/pull/1177 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (HBASE-23857) Add 2.1.9 to download page
[ https://issues.apache.org/jira/browse/HBASE-23857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-23857: -- Fix Version/s: 3.0.0 > Add 2.1.9 to download page > -- > > Key: HBASE-23857 > URL: https://issues.apache.org/jira/browse/HBASE-23857 > Project: HBase > Issue Type: Sub-task >Reporter: Duo Zhang >Priority: Major > Fix For: 3.0.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-23857) Add 2.1.9 to download page
[ https://issues.apache.org/jira/browse/HBASE-23857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-23857: -- Component/s: website > Add 2.1.9 to download page > -- > > Key: HBASE-23857 > URL: https://issues.apache.org/jira/browse/HBASE-23857 > Project: HBase > Issue Type: Sub-task > Components: website >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Fix For: 3.0.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work started] (HBASE-23857) Add 2.1.9 to download page
[ https://issues.apache.org/jira/browse/HBASE-23857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-23857 started by Duo Zhang. - > Add 2.1.9 to download page > -- > > Key: HBASE-23857 > URL: https://issues.apache.org/jira/browse/HBASE-23857 > Project: HBase > Issue Type: Sub-task >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Fix For: 3.0.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HBASE-23857) Add 2.1.9 to download page
[ https://issues.apache.org/jira/browse/HBASE-23857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang reassigned HBASE-23857: - Assignee: Duo Zhang > Add 2.1.9 to download page > -- > > Key: HBASE-23857 > URL: https://issues.apache.org/jira/browse/HBASE-23857 > Project: HBase > Issue Type: Sub-task >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Fix For: 3.0.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on issue #1176: HBASE-23859:Modify "Block locality" of RegionServer Web UI to human r…
Apache-HBase commented on issue #1176: HBASE-23859:Modify "Block locality" of RegionServer Web UI to human r… URL: https://github.com/apache/hbase/pull/1176#issuecomment-587032710 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 4m 5s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 6m 12s | master passed | | +1 :green_heart: | javadoc | 0m 40s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 39s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | javadoc | 0m 38s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 98m 34s | hbase-server in the patch passed. | | +1 :green_heart: | asflicense | 0m 28s | The patch does not generate ASF License warnings. | | | | 117m 26s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.6 Server=19.03.6 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1176/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1176 | | JIRA Issue | HBASE-23859 | | Optional Tests | dupname asflicense javac javadoc unit | | uname | Linux 8e4c44b7b5f5 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1176/out/precommit/personality/provided.sh | | git revision | master / e11dbf36a5 | | Default Java | 1.8.0_181 | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1176/1/testReport/ | | Max. process+thread count | 7549 (vs. ulimit of 1) | | modules | C: hbase-server U: hbase-server | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1176/1/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (HBASE-23859) Modify "Block locality" of RegionServer Web UI to human readable percentage
[
https://issues.apache.org/jira/browse/HBASE-23859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038419#comment-17038419
]
HBase QA commented on HBASE-23859:
--
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 4m
5s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:orange}-0{color} | {color:orange} test4tests {color} | {color:orange}
0m 0s{color} | {color:orange} The patch doesn't appear to include any new or
modified tests. Please justify why no new tests are needed for this patch. Also
please list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m
12s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
40s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
39s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
38s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 98m
34s{color} | {color:green} hbase-server in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
28s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}117m 26s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=19.03.6 Server=19.03.6 base:
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1176/1/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/hbase/pull/1176 |
| JIRA Issue | HBASE-23859 |
| Optional Tests | dupname asflicense javac javadoc unit |
| uname | Linux 8e4c44b7b5f5 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19
08:06:28 UTC 2019 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1176/out/precommit/personality/provided.sh
|
| git revision | master / e11dbf36a5 |
| Default Java | 1.8.0_181 |
| Test Results |
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1176/1/testReport/
|
| Max. process+thread count | 7549 (vs. ulimit of 1) |
| modules | C: hbase-server U: hbase-server |
| Console output |
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1176/1/console |
| versions | git=2.11.0 maven=2018-06-17T18:33:14Z) |
| Powered by | Apache Yetus 0.11.1 https://yetus.apache.org |
This message was automatically generated.
> Modify "Block locality" of RegionServer Web UI to human readable percentage
> ---
>
> Key: HBASE-23859
> URL: https://issues.apache.org/jira/browse/HBASE-23859
> Project: HBase
> Issue Type: Improvement
>Affects Versions: master
>Reporter: Zhuoyue Huang
>Assignee: Zhuoyue Huang
>Priority: Trivial
> Attachments: image-2020-02-17-20-36-50-084.png,
> image-2020-02-17-20-38-52-990.png
>
>
> The unit of "Block locality" in Web UI just like picture 1
> !image-2020-02-17-20-36-50-084.png!
> I think we should change it to percentage unit like picture 2
> !image-2020-02-17-20-38-52-990.png!
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HBASE-23860) HBase Thrift bindings generating broken code
[
https://issues.apache.org/jira/browse/HBASE-23860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hari Sekhon updated HBASE-23860:
Description:
Generated perl thrift bindings are broken:
{code:java}
$ thrift --gen perl
src/main/resources/org/apache/hadoop/hbase/thrift/Hbase.thrift
$ cd gen-perl
$ perl -I . -Tc Hbase/Hbase.pm
Subroutine new redefined at /Library/Perl/5.18/Thrift/Exception.pm line 38.
Bareword "Thrift::TMessageType::CALL" not allowed while "strict subs" in use at
Hbase/Hbase.pm line 9897.
BEGIN not safe after errors--compilation aborted at Hbase/Hbase.pm line 12163.
{code}
Tested from build from source of both HBase 2.1.2 and HBase 2.2.3 using both
Thrift 0.12 and 0.13.
was:
Generated perl thrift bindings are broken:
{code:java}
$ thrift --gen perl
src/main/resources/org/apache/hadoop/hbase/thrift/Hbase.thrift
$ cd gen-perl
$ perl -I . -Tc Hbase/Hbase.pm
Subroutine new redefined at /Library/Perl/5.18/Thrift/Exception.pm line 38.
Bareword "Thrift::TMessageType::CALL" not allowed while "strict subs" in use at
Hbase/Hbase.pm line 9897.
BEGIN not safe after errors--compilation aborted at Hbase/Hbase.pm line 12163.
{code}
Tested from build from source of both HBase 2.1.2 and 2.2.3 using both Thrift
0.12 and 0.13.
> HBase Thrift bindings generating broken code
>
>
> Key: HBASE-23860
> URL: https://issues.apache.org/jira/browse/HBASE-23860
> Project: HBase
> Issue Type: Bug
> Components: Thrift
>Affects Versions: 2.2.3
>Reporter: Hari Sekhon
>Priority: Major
>
> Generated perl thrift bindings are broken:
> {code:java}
> $ thrift --gen perl
> src/main/resources/org/apache/hadoop/hbase/thrift/Hbase.thrift
> $ cd gen-perl
> $ perl -I . -Tc Hbase/Hbase.pm
> Subroutine new redefined at /Library/Perl/5.18/Thrift/Exception.pm line 38.
> Bareword "Thrift::TMessageType::CALL" not allowed while "strict subs" in use
> at Hbase/Hbase.pm line 9897.
> BEGIN not safe after errors--compilation aborted at Hbase/Hbase.pm line 12163.
> {code}
>
> Tested from build from source of both HBase 2.1.2 and HBase 2.2.3 using both
> Thrift 0.12 and 0.13.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HBASE-23860) HBase Thrift bindings generating broken code
Hari Sekhon created HBASE-23860:
---
Summary: HBase Thrift bindings generating broken code
Key: HBASE-23860
URL: https://issues.apache.org/jira/browse/HBASE-23860
Project: HBase
Issue Type: Bug
Components: Thrift
Affects Versions: 2.2.3
Reporter: Hari Sekhon
Generated perl thrift bindings are broken:
{code:java}
$ thrift --gen perl
src/main/resources/org/apache/hadoop/hbase/thrift/Hbase.thrift
$ cd gen-perl
$ perl -I . -Tc Hbase/Hbase.pm
Subroutine new redefined at /Library/Perl/5.18/Thrift/Exception.pm line 38.
Bareword "Thrift::TMessageType::CALL" not allowed while "strict subs" in use at
Hbase/Hbase.pm line 9897.
BEGIN not safe after errors--compilation aborted at Hbase/Hbase.pm line 12163.
{code}
Tested from build from source of both HBase 2.1.2 and 2.2.3 using both Thrift
0.12 and 0.13.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-23844) Remove deprecated Scan(byte[], Filter) from Scan
[
https://issues.apache.org/jira/browse/HBASE-23844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038350#comment-17038350
]
Hudson commented on HBASE-23844:
Results for branch master
[build #1633 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/1633/]: (x)
*{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1633//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1633//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1633//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Remove deprecated Scan(byte[], Filter) from Scan
>
>
> Key: HBASE-23844
> URL: https://issues.apache.org/jira/browse/HBASE-23844
> Project: HBase
> Issue Type: Sub-task
>Affects Versions: 3.0.0
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
>
> {{Scan(byte[], Filter)}} in {{Scan}} was deprecated back in 2.0.0 and should
> be removed for 3.0.0.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-23855) Change bytes size to human readable size for Server Metrics of RegionServer Web UI
[
https://issues.apache.org/jira/browse/HBASE-23855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038351#comment-17038351
]
Hudson commented on HBASE-23855:
Results for branch master
[build #1633 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/1633/]: (x)
*{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1633//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1633//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1633//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Change bytes size to human readable size for Server Metrics of RegionServer
> Web UI
> --
>
> Key: HBASE-23855
> URL: https://issues.apache.org/jira/browse/HBASE-23855
> Project: HBase
> Issue Type: Improvement
>Affects Versions: master
>Reporter: Zhuoyue Huang
>Assignee: Zhuoyue Huang
>Priority: Trivial
> Fix For: 3.0.0, 2.3.0
>
> Attachments: image-2020-02-16-19-23-39-432.png,
> image-2020-02-16-19-28-23-449.png
>
>
> I found that the “BytesBufferAllocator Status” in RegionServer Web UI still
> using "Bytes" as a fixture unit. I think we should use "MB" or "GB" when the
> size is too large !image-2020-02-16-19-23-39-432.png!
>
> The Web UI after improvement:
> !image-2020-02-16-19-28-23-449.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] GeorryHuang opened a new pull request #1176: HBASE-23859:Modify "Block locality" of RegionServer Web UI to human r…
GeorryHuang opened a new pull request #1176: HBASE-23859:Modify "Block locality" of RegionServer Web UI to human r… URL: https://github.com/apache/hbase/pull/1176 …eadable percentage This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (HBASE-23859) Modify "Block locality" of RegionServer Web UI to human readable percentage
[ https://issues.apache.org/jira/browse/HBASE-23859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhuoyue Huang updated HBASE-23859: -- Summary: Modify "Block locality" of RegionServer Web UI to human readable percentage (was: Change "Block locality" of RegionServer Web UI to human readable percentage) > Modify "Block locality" of RegionServer Web UI to human readable percentage > --- > > Key: HBASE-23859 > URL: https://issues.apache.org/jira/browse/HBASE-23859 > Project: HBase > Issue Type: Improvement >Affects Versions: master >Reporter: Zhuoyue Huang >Assignee: Zhuoyue Huang >Priority: Trivial > Attachments: image-2020-02-17-20-36-50-084.png, > image-2020-02-17-20-38-52-990.png > > > The unit of "Block locality" in Web UI just like picture 1 > !image-2020-02-17-20-36-50-084.png! > I think we should change it to percentage unit like picture 2 > !image-2020-02-17-20-38-52-990.png! > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HBASE-23859) Change "Block locality" of RegionServer Web UI to human readable percentage
[ https://issues.apache.org/jira/browse/HBASE-23859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhuoyue Huang reassigned HBASE-23859: - Assignee: Zhuoyue Huang > Change "Block locality" of RegionServer Web UI to human readable percentage > --- > > Key: HBASE-23859 > URL: https://issues.apache.org/jira/browse/HBASE-23859 > Project: HBase > Issue Type: Improvement >Affects Versions: master >Reporter: Zhuoyue Huang >Assignee: Zhuoyue Huang >Priority: Trivial > Attachments: image-2020-02-17-20-36-50-084.png, > image-2020-02-17-20-38-52-990.png > > > The unit of "Block locality" in Web UI just like picture 1 > !image-2020-02-17-20-36-50-084.png! > I think we should change it to percentage unit like picture 2 > !image-2020-02-17-20-38-52-990.png! > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-23859) Change "Block locality" of RegionServer Web UI to human readable percentage
Zhuoyue Huang created HBASE-23859: - Summary: Change "Block locality" of RegionServer Web UI to human readable percentage Key: HBASE-23859 URL: https://issues.apache.org/jira/browse/HBASE-23859 Project: HBase Issue Type: Improvement Affects Versions: master Reporter: Zhuoyue Huang Attachments: image-2020-02-17-20-36-50-084.png, image-2020-02-17-20-38-52-990.png The unit of "Block locality" in Web UI just like picture 1 !image-2020-02-17-20-36-50-084.png! I think we should change it to percentage unit like picture 2 !image-2020-02-17-20-38-52-990.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Issue Comment Deleted] (HBASE-20383) [AMv2] AssignmentManager: Failed transition XYZ is not OPEN
[
https://issues.apache.org/jira/browse/HBASE-20383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Jeges updated HBASE-20383:
-
Comment: was deleted
(was: SAw this again:
https://jenkins.impala.io/job/parallel-all-tests-nightly/1120/
https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/9247/)
> [AMv2] AssignmentManager: Failed transition XYZ is not OPEN
> ---
>
> Key: HBASE-20383
> URL: https://issues.apache.org/jira/browse/HBASE-20383
> Project: HBase
> Issue Type: Bug
> Components: amv2
>Reporter: Michael Stack
>Priority: Major
> Attachments: HBASE-20383.master.001.patch
>
>
> Seeing a bunch of this testing 2.0.0:
> {code}
> 2018-04-10 13:57:09,430 WARN
> [RpcServer.default.FPBQ.Fifo.handler=46,queue=1,port=16000]
> assignment.AssignmentManager: Failed transition
>
>
> org.apache.hadoop.hbase.client.DoNotRetryRegionException:
> 19a2cd6f88abae0036415ee1ea041c2e is not OPEN
> at
> org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkOnline(AbstractStateMachineTableProcedure.java:193)
> at
> org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:112)
> at
> org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:769)
>
>
> at
> org.apache.hadoop.hbase.master.assignment.AssignmentManager.updateRegionSplitTransition(AssignmentManager.java:911)
>
>
> at
> org.apache.hadoop.hbase.master.assignment.AssignmentManager.reportRegionStateTransition(AssignmentManager.java:819)
> at
> org.apache.hadoop.hbase.master.MasterRpcServices.reportRegionStateTransition(MasterRpcServices.java:1538)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:11093)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
>
>
>at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> {code}
> Looks like report back from Master OK'ing a split to go ahead but the split
> is already running. Figure how to shut these down. They are noisy at least.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-20383) [AMv2] AssignmentManager: Failed transition XYZ is not OPEN
[
https://issues.apache.org/jira/browse/HBASE-20383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038225#comment-17038225
]
Attila Jeges commented on HBASE-20383:
--
SAw this again:
https://jenkins.impala.io/job/parallel-all-tests-nightly/1120/
https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/9247/
> [AMv2] AssignmentManager: Failed transition XYZ is not OPEN
> ---
>
> Key: HBASE-20383
> URL: https://issues.apache.org/jira/browse/HBASE-20383
> Project: HBase
> Issue Type: Bug
> Components: amv2
>Reporter: Michael Stack
>Priority: Major
> Attachments: HBASE-20383.master.001.patch
>
>
> Seeing a bunch of this testing 2.0.0:
> {code}
> 2018-04-10 13:57:09,430 WARN
> [RpcServer.default.FPBQ.Fifo.handler=46,queue=1,port=16000]
> assignment.AssignmentManager: Failed transition
>
>
> org.apache.hadoop.hbase.client.DoNotRetryRegionException:
> 19a2cd6f88abae0036415ee1ea041c2e is not OPEN
> at
> org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkOnline(AbstractStateMachineTableProcedure.java:193)
> at
> org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:112)
> at
> org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:769)
>
>
> at
> org.apache.hadoop.hbase.master.assignment.AssignmentManager.updateRegionSplitTransition(AssignmentManager.java:911)
>
>
> at
> org.apache.hadoop.hbase.master.assignment.AssignmentManager.reportRegionStateTransition(AssignmentManager.java:819)
> at
> org.apache.hadoop.hbase.master.MasterRpcServices.reportRegionStateTransition(MasterRpcServices.java:1538)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:11093)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
>
>
>at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> {code}
> Looks like report back from Master OK'ing a split to go ahead but the split
> is already running. Figure how to shut these down. They are noisy at least.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HBASE-23858) Set version as 2.1.10-SNAPSHOT in branch-2.1
Duo Zhang created HBASE-23858: - Summary: Set version as 2.1.10-SNAPSHOT in branch-2.1 Key: HBASE-23858 URL: https://issues.apache.org/jira/browse/HBASE-23858 Project: HBase Issue Type: Sub-task Reporter: Duo Zhang -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (HBASE-23856) Put up 2.1.9RC0
[ https://issues.apache.org/jira/browse/HBASE-23856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-23856. --- Assignee: Duo Zhang Resolution: Fixed > Put up 2.1.9RC0 > --- > > Key: HBASE-23856 > URL: https://issues.apache.org/jira/browse/HBASE-23856 > Project: HBase > Issue Type: Sub-task >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-23856) Put up 2.1.9RC0
Duo Zhang created HBASE-23856: - Summary: Put up 2.1.9RC0 Key: HBASE-23856 URL: https://issues.apache.org/jira/browse/HBASE-23856 Project: HBase Issue Type: Sub-task Reporter: Duo Zhang -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-23857) Add 2.1.9 to download page
Duo Zhang created HBASE-23857: - Summary: Add 2.1.9 to download page Key: HBASE-23857 URL: https://issues.apache.org/jira/browse/HBASE-23857 Project: HBase Issue Type: Sub-task Reporter: Duo Zhang -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on issue #754: HBASE-22978 : Online slow response log
Apache-HBase commented on issue #754: HBASE-22978 : Online slow response log URL: https://github.com/apache/hbase/pull/754#issuecomment-586876591 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 34s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +0 :ok: | prototool | 0m 0s | prototool was not available. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | +1 :green_heart: | test4tests | 0m 0s | The patch appears to include 6 new or modified test files. | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 39s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 5m 23s | master passed | | +1 :green_heart: | compile | 3m 7s | master passed | | +1 :green_heart: | checkstyle | 2m 24s | master passed | | +0 :ok: | refguide | 4m 45s | branch has no errors when building the reference guide. See footer for rendered docs, which you should manually inspect. | | +1 :green_heart: | shadedjars | 4m 35s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 5m 9s | master passed | | +0 :ok: | spotbugs | 1m 23s | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 :green_heart: | findbugs | 23m 30s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 15s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 5m 1s | the patch passed | | +1 :green_heart: | compile | 3m 4s | the patch passed | | +1 :green_heart: | cc | 3m 4s | the patch passed | | +1 :green_heart: | javac | 3m 4s | the patch passed | | +1 :green_heart: | checkstyle | 2m 21s | root: The patch generated 0 new + 448 unchanged - 2 fixed = 448 total (was 450) | | +1 :green_heart: | rubocop | 0m 9s | There were no new rubocop issues. | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 2s | The patch has no ill-formed XML file. | | +0 :ok: | refguide | 4m 43s | patch has no errors when building the reference guide. See footer for rendered docs, which you should manually inspect. | | +1 :green_heart: | shadedjars | 4m 44s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 16m 6s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. | | +1 :green_heart: | hbaseprotoc | 8m 31s | the patch passed | | +1 :green_heart: | javadoc | 5m 14s | the patch passed | | +1 :green_heart: | findbugs | 24m 45s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 70m 57s | root in the patch failed. | | +1 :green_heart: | asflicense | 4m 6s | The patch does not generate ASF License warnings. | | | | 208m 18s | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.hbase.replication.TestSyncReplicationStandBy | | | hadoop.hbase.replication.TestNamespaceReplicationWithBulkLoadedData | | | hadoop.hbase.replication.TestNamespaceReplication | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.6 Server=19.03.6 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-754/15/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/754 | | Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile refguide xml cc hbaseprotoc prototool rubocop | | uname | Linux 29d1791f43b5 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-754/out/precommit/personality/provided.sh | | git revision | master / e11dbf36a5 | | Default Java | 1.8.0_181 | | refguide | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-754/15/artifact/out/branch-site/book.html | | refguide | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-754/15/artifact/out/patch-site/book.html | | unit | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-754/15/artifact/out/patch-unit-root.txt | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-754/15/testReport/ | | Max. process+thread count | 9679 (vs. ulimit of 1) | | modules | C: hbase-protocol-shaded hbase-common hbase-client hbase-server
