[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16665115#comment-16665115 ] Hudson commented on HBASE-21380: Results for branch branch-2.0 [build #1016 on builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1016/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1016//General_Nightly_Build_Report/] (x) {color:red}-1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1016//JDK8_Nightly_Build_Report_(Hadoop2)/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1016//JDK8_Nightly_Build_Report_(Hadoop3)/] (/) {color:green}+1 source release artifact{color} -- See build output for details. > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > Attachments: HBASE-21380.branch-2.1.001.patch, > HBASE-21380.branch-2.1.002.patch, HBASE-21380.branch-2.1.003.patch, > HBASE-21380.branch-2.1.004.patch, HBASE-21380.master.001.patch, > HBASE-21380.master.002.patch > > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16665093#comment-16665093 ] Hudson commented on HBASE-21380: Results for branch branch-2.1 [build #535 on builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/535/]: (/) *{color:green}+1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/535//General_Nightly_Build_Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/535//JDK8_Nightly_Build_Report_(Hadoop2)/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/535//JDK8_Nightly_Build_Report_(Hadoop3)/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > Attachments: HBASE-21380.branch-2.1.001.patch, > HBASE-21380.branch-2.1.002.patch, HBASE-21380.branch-2.1.003.patch, > HBASE-21380.branch-2.1.004.patch, HBASE-21380.master.001.patch, > HBASE-21380.master.002.patch > > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664720#comment-16664720 ] Hadoop QA commented on HBASE-21380: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 0s{color} | {color:blue} Docker mode activated. {color} | | {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 6s{color} | {color:red} HBASE-21380 does not apply to branch-2.1. Rebase required? Wrong Branch? See https://yetus.apache.org/documentation/0.8.0/precommit-patchnames for help. {color} | \\ \\ || Subsystem || Report/Notes || | JIRA Issue | HBASE-21380 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12945699/HBASE-21380.branch-2.1.004.patch | | Console output | https://builds.apache.org/job/PreCommit-HBASE-Build/14869/console | | Powered by | Apache Yetus 0.8.0 http://yetus.apache.org | This message was automatically generated. > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > Attachments: HBASE-21380.branch-2.1.001.patch, > HBASE-21380.branch-2.1.002.patch, HBASE-21380.branch-2.1.003.patch, > HBASE-21380.branch-2.1.004.patch, HBASE-21380.master.001.patch, > HBASE-21380.master.002.patch > > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664604#comment-16664604 ] stack commented on HBASE-21380: --- I pushed .003 patch on branch-2.1 and started up some nightlies to see how it does overnight. Will push elsewhere if goes well. > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > Attachments: HBASE-21380.branch-2.1.001.patch, > HBASE-21380.branch-2.1.002.patch, HBASE-21380.branch-2.1.003.patch, > HBASE-21380.branch-2.1.004.patch, HBASE-21380.master.001.patch, > HBASE-21380.master.002.patch > > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664602#comment-16664602 ] stack commented on HBASE-21380: --- Pushed .001 but reverted it after [~mdrob] put up better fix on .003. > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > Attachments: HBASE-21380.branch-2.1.001.patch, > HBASE-21380.branch-2.1.002.patch, HBASE-21380.branch-2.1.003.patch, > HBASE-21380.branch-2.1.004.patch, HBASE-21380.master.001.patch, > HBASE-21380.master.002.patch > > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664550#comment-16664550 ] stack commented on HBASE-21380: --- Who put that errorprone crap in our build! (smile). It found a good one. Going w/ 001 for now so can put up a 2.1.1 since not an easy fix and I want to push the RC. > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > Attachments: HBASE-21380.branch-2.1.001.patch, > HBASE-21380.branch-2.1.002.patch, HBASE-21380.master.001.patch, > HBASE-21380.master.002.patch > > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664501#comment-16664501 ] Hadoop QA commented on HBASE-21380: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 18s{color} | {color:blue} Docker mode activated. {color} | || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m 0s{color} | {color:green} Patch does not have any anti-patterns. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | | {color:orange}-0{color} | {color:orange} test4tests {color} | {color:orange} 0m 0s{color} | {color:orange} The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color} | || || || || {color:brown} branch-2.1 Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m 28s{color} | {color:green} branch-2.1 passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 51s{color} | {color:green} branch-2.1 passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 18s{color} | {color:green} branch-2.1 passed {color} | | {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 3m 37s{color} | {color:green} branch has no errors when building our shaded downstream artifacts. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m 8s{color} | {color:green} branch-2.1 passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 32s{color} | {color:green} branch-2.1 passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m 15s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m 41s{color} | {color:red} hbase-server in the patch failed. {color} | | {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 41s{color} | {color:red} hbase-server in the patch failed. {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m 13s{color} | {color:red} hbase-server: The patch generated 1 new + 178 unchanged - 0 fixed = 179 total (was 178) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 3m 37s{color} | {color:green} patch has no errors when building our shaded downstream artifacts. {color} | | {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 8m 51s{color} | {color:green} Patch does not cause any errors with Hadoop 2.7.4 or 3.0.0. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m 15s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 31s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:red}-1{color} | {color:red} unit {color} | {color:red}208m 41s{color} | {color:red} hbase-server in the patch failed. {color} | | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 48s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black}245m 35s{color} | {color:black} {color} | \\ \\ || Reason || Tests || | Failed junit tests | hadoop.hbase.client.TestAsyncTableGetMultiThreaded | \\ \\ || Subsystem || Report/Notes || | Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:42ca976 | | JIRA Issue | HBASE-21380 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12945667/HBASE-21380.branch-2.1.002.patch | | Optional Tests | dupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile | | uname | Linux 1998553b7cd2 3.13.0-153-generic #203-Ubuntu SMP Thu Jun 14 08:52:28 UTC 2018 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh | | git revision | branch-2.1 / e71c05707e | | maven | version: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) | | Default Java | 1.8.0_181 | | findbugs | v3.1.0-RC3 | | compile |
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664338#comment-16664338 ] stack commented on HBASE-21380: --- At first I had a violent reaction to ServerManager having to now know about ServerCrashProcedure but being able to ask isFinished at the point of adding to DeadServers is nice addressing a concern I had about how a 'processing' server gets readded to the processing list. +1 from me. > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > Attachments: HBASE-21380.branch-2.1.001.patch, > HBASE-21380.branch-2.1.002.patch, HBASE-21380.master.001.patch, > HBASE-21380.master.002.patch > > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664296#comment-16664296 ] Mike Drob commented on HBASE-21380: --- [~stack] - found a not _too_ hacky way to propagate the information through. WDYT? > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > Attachments: HBASE-21380.branch-2.1.001.patch, > HBASE-21380.branch-2.1.002.patch, HBASE-21380.master.001.patch, > HBASE-21380.master.002.patch > > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664291#comment-16664291 ] Hadoop QA commented on HBASE-21380: --- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 14s{color} | {color:blue} Docker mode activated. {color} | || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m 0s{color} | {color:green} Patch does not have any anti-patterns. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | | {color:orange}-0{color} | {color:orange} test4tests {color} | {color:orange} 0m 0s{color} | {color:orange} The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m 28s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 48s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 15s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m 19s{color} | {color:green} branch has no errors when building our shaded downstream artifacts. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 58s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 32s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m 3s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 48s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 48s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 19s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m 23s{color} | {color:green} patch has no errors when building our shaded downstream artifacts. {color} | | {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 10m 55s{color} | {color:green} Patch does not cause any errors with Hadoop 2.7.4 or 3.0.0. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m 21s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 33s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} unit {color} | {color:green}133m 37s{color} | {color:green} hbase-server in the patch passed. {color} | | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 25s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black}176m 29s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b | | JIRA Issue | HBASE-21380 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12945625/HBASE-21380.master.001.patch | | Optional Tests | dupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile | | uname | Linux aa38e8cd26e8 3.13.0-143-generic #192-Ubuntu SMP Tue Feb 27 10:45:36 UTC 2018 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh | | git revision | master / 66469733ec | | maven | version: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) | | Default Java | 1.8.0_181 | | findbugs | v3.1.0-RC3 | | Test Results | https://builds.apache.org/job/PreCommit-HBASE-Build/14861/testReport/ | | Max. process+thread count | 5308 (vs. ulimit of 1) | | modules | C: hbase-server U: hbase-server | | Console output |
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664131#comment-16664131 ] Mike Drob commented on HBASE-21380: --- One concern here is that in addition to no longer adding servers to the {{processing}} list, we also don't add them to the {{deadServers}} set if they've already been through SCP. Which means that if that server comes back later... I don't actually know what it means. Maybe need to special case this, though? > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > Attachments: HBASE-21380.branch-2.1.001.patch, > HBASE-21380.master.001.patch > > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664063#comment-16664063 ] Mike Drob commented on HBASE-21380: --- Also posting a forward port to master > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > Attachments: HBASE-21380.branch-2.1.001.patch, > HBASE-21380.master.001.patch > > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663954#comment-16663954 ] Mike Drob commented on HBASE-21380: --- Continuing to look into this... Here's a snippet from my logs: {noformat} 2018-10-25 10:34:18,231 DEBUG [master/mdrob-mbp:0:becomeActiveMaster] procedure2.ProcedureExecutor(522): Completed pid=9, state=SUCCESS; ServerCrashProcedure server=mdrob-mbp.hsd1.tx.comcast.net,60040,1540481628186, splitWal=true, meta=true 2018-10-25 10:34:18,232 DEBUG [master/mdrob-mbp:0:becomeActiveMaster] procedure2.ProcedureExecutor(522): Completed pid=10, state=SUCCESS; ServerCrashProcedure server=mdrob-mbp.hsd1.tx.comcast.net,60037,1540481628106, splitWal=true, meta=false 2018-10-25 10:34:18,232 DEBUG [master/mdrob-mbp:0:becomeActiveMaster] procedure2.ProcedureExecutor(522): Completed pid=11, state=SUCCESS; ServerCrashProcedure server=mdrob-mbp.hsd1.tx.comcast.net,60111,1540481641705, splitWal=true, meta=false 2018-10-25 10:34:18,232 DEBUG [master/mdrob-mbp:0:becomeActiveMaster] procedure2.ProcedureExecutor(522): Completed pid=12, state=SUCCESS; ServerCrashProcedure server=mdrob-mbp.hsd1.tx.comcast.net,60034,1540481627993, splitWal=true, meta=false 2018-10-25 10:34:18,233 DEBUG [master/mdrob-mbp:0:becomeActiveMaster] procedure2.ProcedureExecutor(522): Completed pid=16, state=SUCCESS; CreateTableProcedure table=hbase:quota 2018-10-25 10:34:18,233 INFO [master/mdrob-mbp:0:becomeActiveMaster] procedure2.ProcedureExecutor(729): Loaded WALProcedureStore in 14msec 2018-10-25 10:34:18,233 INFO [master/mdrob-mbp:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(97): Instantiated, coreThreads=128 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2018-10-25 10:34:18,235 INFO [master/mdrob-mbp:0:becomeActiveMaster] master.RegionServerTracker(123): Starting RegionServerTracker; 4 have existing ServerCrashProcedures, 3 possibly 'live' servers, and 0 'splitting'. 2018-10-25 10:34:18,236 DEBUG [master/mdrob-mbp:0:becomeActiveMaster] master.DeadServer(136): Added mdrob-mbp.hsd1.tx.comcast.net,60040,1540481628186; numProcessing=1 java.lang.Exception: trace 2018-10-25 10:34:18,236 DEBUG [master/mdrob-mbp:0:becomeActiveMaster] master.DeadServer(139): Added mdrob-mbp.hsd1.tx.comcast.net,60037,1540481628106; numProcessing=2 2018-10-25 10:34:18,236 DEBUG [master/mdrob-mbp:0:becomeActiveMaster] master.DeadServer(139): Added mdrob-mbp.hsd1.tx.comcast.net,60111,1540481641705; numProcessing=3 2018-10-25 10:34:18,236 DEBUG [master/mdrob-mbp:0:becomeActiveMaster] master.DeadServer(139): Added mdrob-mbp.hsd1.tx.comcast.net,60034,1540481627993; numProcessing=4 2018-10-25 10:34:18,237 DEBUG [master/mdrob-mbp:0:becomeActiveMaster] master.DeadServer(139): Added mdrob-mbp.hsd1.tx.comcast.net,60145,1540481644975; numProcessing=5 {noformat} The line numbers for the DeadServer log messages are a bit off from what's in branch-2.1 because I added some additional checks around there. The trace for those calls is: {noformat} at org.apache.hadoop.hbase.master.DeadServer.add(DeadServer.java:137) at java.lang.Iterable.forEach(Iterable.java:75) at org.apache.hadoop.hbase.master.ServerManager.findDeadServersAndProcess(ServerManager.java:321) at org.apache.hadoop.hbase.master.RegionServerTracker.start(RegionServerTracker.java:145) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:904) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2254) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:583) at java.lang.Thread.run(Thread.java:748) {noformat} With the really interesting part being that the RegionServerTracker starts with a list of servers derived from the current set of SCPs. But if the SCPs are done then they'll never call finish() on the dead servers list and they'll never be removed from the "processing" list, and then even a user request won't clear them out of dead server space. > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663853#comment-16663853 ] stack commented on HBASE-21380: --- Thanks [~mdrob] > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663812#comment-16663812 ] Mike Drob commented on HBASE-21380: --- bq. Mind if I add @Ignore to TestRSGroups#testRSGroupsWithHBaseQuota in subtask so I can cut an RC Do what you need to get an RC going. :) > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663247#comment-16663247 ] stack commented on HBASE-21380: --- Failures over on https://builds.apache.org/job/PreCommit-HBASE-Build/14854/testReport/ are not the same as balancer-not-running. > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663237#comment-16663237 ] stack commented on HBASE-21380: --- [~mdrob] Mind if I add @Ignore to TestRSGroups#testRSGroupsWithHBaseQuota in subtask so I can cut an RC? It is the difference between branch-2.0 and branch-2.1 and the culprit that brings on the failures in TestRSGroups post HBASE-21266? Thanks. > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663228#comment-16663228 ] stack commented on HBASE-21380: --- Oh (Pardon my ants-in-my-pants...) > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663208#comment-16663208 ] Mike Drob commented on HBASE-21380: --- I already did that locally, but still had test failure > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663170#comment-16663170 ] stack commented on HBASE-21380: --- Reopened HBASE-21265 and put up a backport... > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662842#comment-16662842 ] Mike Drob commented on HBASE-21380: --- [~stack] suggested backporting HBASE-21265 to me. I'll try that and see if it helps. > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662831#comment-16662831 ] Mike Drob commented on HBASE-21380: --- {{testRSGroupsWithHBaseQuota}} does not exist in branch-2.0, so that's why we don't see this failure there. > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662810#comment-16662810 ] Mike Drob commented on HBASE-21380: --- In {{testRSGroupsWithHBaseQuota}} we restart the hbase cluster (twice!) causing some servers to be added to the DeadServer list. When they are restarted, because this is a test cluster running on a single node they new RS come back with different ports and aren't matched to the existing entries in the DeadServer list. And the presence of entries in the DeadServer list prevents the balancer from running, which impacts how the RSGroup feature works. Theoretically, if we clear the DeadServer list since we know those aren't coming back then this should fix the test? > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662532#comment-16662532 ] Mike Drob commented on HBASE-21380: --- The 2.1 forward port looks like it had issues. FYI [~stack] > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21380) TestRSGroups failing
[ https://issues.apache.org/jira/browse/HBASE-21380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662531#comment-16662531 ] Mike Drob commented on HBASE-21380: --- Bisect shows that this started failing after HBASE-21266 was committed. Will investigate further. > TestRSGroups failing > > > Key: HBASE-21380 > URL: https://issues.apache.org/jira/browse/HBASE-21380 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Sean Busbey >Assignee: Mike Drob >Priority: Major > > only failing on branch-2.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)