[jira] [Commented] (HBASE-22514) Move rsgroup feature into core of HBase
[
https://issues.apache.org/jira/browse/HBASE-22514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027264#comment-17027264
]
Hudson commented on HBASE-22514:
Results for branch HBASE-22514
[build #258 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22514/258/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22514/258//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22514/258//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22514/258//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Move rsgroup feature into core of HBase
> ---
>
> Key: HBASE-22514
> URL: https://issues.apache.org/jira/browse/HBASE-22514
> Project: HBase
> Issue Type: Umbrella
> Components: Admin, Client, rsgroup
>Reporter: Yechao Chen
>Assignee: Duo Zhang
>Priority: Major
> Attachments: HBASE-22514.master.001.patch,
> image-2019-05-31-18-25-38-217.png
>
>
> The class RSGroupAdminClient is not public
> we need to use java api RSGroupAdminClient to manager RSG
> so RSGroupAdminClient should be public
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on issue #1108: HBASE-23779 Up the default fork count; make count relative to CPU count
Apache-HBase commented on issue #1108: HBASE-23779 Up the default fork count; make count relative to CPU count URL: https://github.com/apache/hbase/pull/1108#issuecomment-580614560 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 29s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ branch-2 Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 54s | branch-2 passed | | +1 :green_heart: | compile | 3m 15s | branch-2 passed | | +0 :ok: | refguide | 11m 47s | branch has no errors when building the reference guide. See footer for rendered docs, which you should manually inspect. | | +1 :green_heart: | shadedjars | 4m 41s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 3m 2s | branch-2 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 48s | the patch passed | | +1 :green_heart: | compile | 3m 27s | the patch passed | | +1 :green_heart: | javac | 3m 27s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 2s | The patch has no ill-formed XML file. | | +0 :ok: | refguide | 7m 6s | patch has no errors when building the reference guide. See footer for rendered docs, which you should manually inspect. | | +1 :green_heart: | shadedjars | 4m 38s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 17m 10s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. | | +1 :green_heart: | javadoc | 2m 55s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 13m 19s | root in the patch failed. | | +1 :green_heart: | asflicense | 0m 19s | The patch does not generate ASF License warnings. | | | | 91m 43s | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.hbase.http.TestInfoServersACL | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1108/2/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1108 | | Optional Tests | dupname asflicense javac javadoc unit shadedjars hadoopcheck xml compile refguide | | uname | Linux 42c3b80b05a6 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1108/out/precommit/personality/provided.sh | | git revision | branch-2 / 76247aa21f | | Default Java | 1.8.0_181 | | refguide | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1108/2/artifact/out/branch-site/book.html | | refguide | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1108/2/artifact/out/patch-site/book.html | | unit | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1108/2/artifact/out/patch-unit-root.txt | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1108/2/testReport/ | | Max. process+thread count | 1721 (vs. ulimit of 1) | | modules | C: . U: . | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1108/2/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (HBASE-23350) Make compaction files cacheonWrite configurable based on threshold
[ https://issues.apache.org/jira/browse/HBASE-23350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhinaba Sarkar updated HBASE-23350: Release Note: This JIRA adds a new configuration - `hbase.rs.cachecompactedblocksonwrite.threshold`. This configuration is the maximum total size (in bytes) of the compacted files below which the configuration `hbase.rs.cachecompactedblocksonwrite` is honoured. If the total size of the compacted fies exceeds this threshold, even when `hbase.rs.cachecompactedblocksonwrite` is enabled, the data blocks are not cached. Caching index and bloom blocks is not affected by this configuration (user configuration is always honoured). Default value of this configuration is Long.MAX_VALUE. This means whatever the total size of the compacted files, it wil be cached. > Make compaction files cacheonWrite configurable based on threshold > -- > > Key: HBASE-23350 > URL: https://issues.apache.org/jira/browse/HBASE-23350 > Project: HBase > Issue Type: Sub-task > Components: Compaction >Reporter: ramkrishna.s.vasudevan >Assignee: Abhinaba Sarkar >Priority: Major > Fix For: 3.0.0 > > > As per comment from [~javaman_chen] in the parent JIRA > https://issues.apache.org/jira/browse/HBASE-23066?focusedCommentId=16937361=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16937361 > This is to introduce a config to identify if the resulting compacted file's > blocks should be added to the cache - while writing. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23761) The new cache entry can overflow the maxSize in CachedEntryQueue
[
https://issues.apache.org/jira/browse/HBASE-23761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027224#comment-17027224
]
HBase QA commented on HBASE-23761:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 1m
6s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:orange}-0{color} | {color:orange} test4tests {color} | {color:orange}
0m 0s{color} | {color:orange} The patch doesn't appear to include any new or
modified tests. Please justify why no new tests are needed for this patch. Also
please list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m
0s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
59s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
14s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 5m
5s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
38s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 4m
5s{color} | {color:blue} Used deprecated FindBugs config; considering switching
to SpotBugs. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
3s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
29s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
59s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
59s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
15s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 5m
9s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
17m 22s{color} | {color:green} Patch does not cause any errors with Hadoop
2.8.5 2.9.2 or 3.1.2. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
36s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
52s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 33m 20s{color}
| {color:red} hbase-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
16s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 95m 16s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hbase.io.hfile.TestCachedBlockQueue |
| | hadoop.hbase.io.hfile.TestLruBlockCache |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=19.03.5 Server=19.03.5 base:
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1110/2/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/hbase/pull/1110 |
| JIRA Issue | HBASE-23761 |
| Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs
shadedjars hadoopcheck hbaseanti checkstyle compile |
| uname | Linux 06c5a7ac2e54 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19
08:06:28 UTC 2019 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
[GitHub] [hbase] Apache-HBase commented on issue #1110: HBASE-23761: The new cache entry can overflow the maxSize in CachedEn…
Apache-HBase commented on issue #1110: HBASE-23761: The new cache entry can overflow the maxSize in CachedEn… URL: https://github.com/apache/hbase/pull/1110#issuecomment-580600688 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 6s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 6m 0s | master passed | | +1 :green_heart: | compile | 0m 59s | master passed | | +1 :green_heart: | checkstyle | 1m 14s | master passed | | +1 :green_heart: | shadedjars | 5m 5s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 38s | master passed | | +0 :ok: | spotbugs | 4m 5s | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 :green_heart: | findbugs | 4m 3s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 29s | the patch passed | | +1 :green_heart: | compile | 0m 59s | the patch passed | | +1 :green_heart: | javac | 0m 59s | the patch passed | | +1 :green_heart: | checkstyle | 1m 15s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | shadedjars | 5m 9s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 17m 22s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. | | +1 :green_heart: | javadoc | 0m 36s | the patch passed | | +1 :green_heart: | findbugs | 4m 52s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 33m 20s | hbase-server in the patch failed. | | +1 :green_heart: | asflicense | 0m 16s | The patch does not generate ASF License warnings. | | | | 95m 16s | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.hbase.io.hfile.TestCachedBlockQueue | | | hadoop.hbase.io.hfile.TestLruBlockCache | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1110/2/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1110 | | JIRA Issue | HBASE-23761 | | Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile | | uname | Linux 06c5a7ac2e54 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1110/out/precommit/personality/provided.sh | | git revision | master / 85b0c8e6bc | | Default Java | 1.8.0_181 | | unit | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1110/2/artifact/out/patch-unit-hbase-server.txt | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1110/2/testReport/ | | Max. process+thread count | 678 (vs. ulimit of 1) | | modules | C: hbase-server U: hbase-server | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1110/2/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (HBASE-23748) Include HBASE-21284 to branch-2.2
[ https://issues.apache.org/jira/browse/HBASE-23748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sakthi updated HBASE-23748: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Include HBASE-21284 to branch-2.2 > - > > Key: HBASE-23748 > URL: https://issues.apache.org/jira/browse/HBASE-23748 > Project: HBase > Issue Type: Sub-task >Reporter: Sakthi >Assignee: Sakthi >Priority: Major > Fix For: 2.2.3 > > Attachments: hbase-23748.branch-2.2.001.patch > > > HBASE-21284 was ought to be present in 2.2. But by the time the commit was > done, the branch had been cut already. Hence this Jira to track it's > inclusion. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23748) Include HBASE-21284 to branch-2.2
[ https://issues.apache.org/jira/browse/HBASE-23748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027205#comment-17027205 ] Sakthi commented on HBASE-23748: I thought I had resolved this one. The commit went in. Let me close this one. Thanks all > Include HBASE-21284 to branch-2.2 > - > > Key: HBASE-23748 > URL: https://issues.apache.org/jira/browse/HBASE-23748 > Project: HBase > Issue Type: Sub-task >Reporter: Sakthi >Assignee: Sakthi >Priority: Major > Fix For: 2.2.3 > > Attachments: hbase-23748.branch-2.2.001.patch > > > HBASE-21284 was ought to be present in 2.2. But by the time the commit was > done, the branch had been cut already. Hence this Jira to track it's > inclusion. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23748) Include HBASE-21284 to branch-2.2
[ https://issues.apache.org/jira/browse/HBASE-23748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027203#comment-17027203 ] Mingliang Liu commented on HBASE-23748: --- Yes, I see the patch is good. Shall we resolve this JIRA? > Include HBASE-21284 to branch-2.2 > - > > Key: HBASE-23748 > URL: https://issues.apache.org/jira/browse/HBASE-23748 > Project: HBase > Issue Type: Sub-task >Reporter: Sakthi >Assignee: Sakthi >Priority: Major > Fix For: 2.2.3 > > Attachments: hbase-23748.branch-2.2.001.patch > > > HBASE-21284 was ought to be present in 2.2. But by the time the commit was > done, the branch had been cut already. Hence this Jira to track it's > inclusion. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] bharathv commented on a change in pull request #1102: HBASE-23752: Fix remaining test failures from nightly runs
bharathv commented on a change in pull request #1102: HBASE-23752: Fix
remaining test failures from nightly runs
URL: https://github.com/apache/hbase/pull/1102#discussion_r373321931
##
File path:
hbase-server/src/test/java/org/apache/hadoop/hbase/security/provider/TestCustomSaslAuthenticationProvider.java
##
@@ -431,9 +431,13 @@ public static void setupCluster() throws Exception {
UTIL.getDataTestDir("keytab").toUri().getPath());
final MiniKdc kdc = UTIL.setupMiniKdc(KEYTAB_FILE);
-// Switch back to NIO for now.
+// Switch to blocking RPC impl.
CONF.set(RpcClientFactory.CUSTOM_RPC_CLIENT_IMPL_CONF_KEY,
BlockingRpcClient.class.getName());
CONF.set(RpcServerFactory.CUSTOM_RPC_SERVER_IMPL_CONF_KEY,
SimpleRpcServer.class.getName());
+// Set the connection registry to ZKConnectionRegistry since hedging is
not supported on
+// blocking rpc clients.
Review comment:
No worries, I parameterized it. Thanks for the quick response.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[jira] [Commented] (HBASE-23764) Flaky tests due to ZK client name resolution delays
[
https://issues.apache.org/jira/browse/HBASE-23764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027199#comment-17027199
]
HBase QA commented on HBASE-23764:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 2m
3s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
46s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
19s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 3m
2s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 2m
14s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} refguide {color} | {color:blue} 4m
45s{color} | {color:blue} branch has no errors when building the reference
guide. See footer for rendered docs, which you should manually inspect. {color}
|
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
40s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 3m
33s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 14m
0s{color} | {color:blue} Used deprecated FindBugs config; considering switching
to SpotBugs. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 15m
14s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
23s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
0s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 3m
0s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 3m
0s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 2m
8s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
3s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:blue}0{color} | {color:blue} refguide {color} | {color:blue} 4m
46s{color} | {color:blue} patch has no errors when building the reference
guide. See footer for rendered docs, which you should manually inspect. {color}
|
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
40s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
15m 45s{color} | {color:green} Patch does not cause any errors with Hadoop
2.8.5 2.9.2 or 3.1.2. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 3m
28s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 15m
28s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 12m 17s{color}
| {color:red} root in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
44s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}116m 21s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed
[GitHub] [hbase] Apache-HBase commented on issue #1106: HBASE-23764: Switch to IP address for ZK ensemble
Apache-HBase commented on issue #1106: HBASE-23764: Switch to IP address for ZK ensemble URL: https://github.com/apache/hbase/pull/1106#issuecomment-580587692 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 2m 3s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | +1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 46s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 5m 19s | master passed | | +1 :green_heart: | compile | 3m 2s | master passed | | +1 :green_heart: | checkstyle | 2m 14s | master passed | | +0 :ok: | refguide | 4m 45s | branch has no errors when building the reference guide. See footer for rendered docs, which you should manually inspect. | | +1 :green_heart: | shadedjars | 4m 40s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 3m 33s | master passed | | +0 :ok: | spotbugs | 14m 0s | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 :green_heart: | findbugs | 15m 14s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 23s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 5m 0s | the patch passed | | +1 :green_heart: | compile | 3m 0s | the patch passed | | +1 :green_heart: | javac | 3m 0s | the patch passed | | +1 :green_heart: | checkstyle | 2m 8s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 3s | The patch has no ill-formed XML file. | | +0 :ok: | refguide | 4m 46s | patch has no errors when building the reference guide. See footer for rendered docs, which you should manually inspect. | | +1 :green_heart: | shadedjars | 4m 40s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 15m 45s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. | | +1 :green_heart: | javadoc | 3m 28s | the patch passed | | +1 :green_heart: | findbugs | 15m 28s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 12m 17s | root in the patch failed. | | +1 :green_heart: | asflicense | 0m 44s | The patch does not generate ASF License warnings. | | | | 116m 21s | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.hbase.zookeeper.TestHQuorumPeer | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1106/3/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1106 | | JIRA Issue | HBASE-23764 | | Optional Tests | dupname asflicense javac javadoc unit refguide xml spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile | | uname | Linux eb6e542fb047 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1106/out/precommit/personality/provided.sh | | git revision | master / 85b0c8e6bc | | Default Java | 1.8.0_181 | | refguide | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1106/3/artifact/out/branch-site/book.html | | refguide | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1106/3/artifact/out/patch-site/book.html | | unit | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1106/3/artifact/out/patch-unit-root.txt | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1106/3/testReport/ | | Max. process+thread count | 334 (vs. ulimit of 1) | | modules | C: hbase-common hbase-zookeeper . U: . | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1106/3/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific
[GitHub] [hbase] Apache-HBase commented on issue #1109: HBASE-23780 Edit of test classifications
Apache-HBase commented on issue #1109: HBASE-23780 Edit of test classifications URL: https://github.com/apache/hbase/pull/1109#issuecomment-580586033 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 36s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 4s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | +1 :green_heart: | test4tests | 0m 0s | The patch appears to include 175 new or modified test files. | ||| _ branch-2 Compile Tests _ | | +0 :ok: | mvndep | 0m 14s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 5m 13s | branch-2 passed | | +1 :green_heart: | compile | 2m 53s | branch-2 passed | | +1 :green_heart: | checkstyle | 3m 21s | branch-2 passed | | +1 :green_heart: | shadedjars | 4m 18s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 2m 16s | branch-2 passed | | +0 :ok: | spotbugs | 0m 35s | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 :green_heart: | findbugs | 7m 4s | branch-2 passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 15s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 4m 53s | the patch passed | | +1 :green_heart: | compile | 2m 58s | the patch passed | | +1 :green_heart: | javac | 2m 58s | the patch passed | | -1 :x: | checkstyle | 0m 25s | hbase-common: The patch generated 7 new + 0 unchanged - 0 fixed = 7 total (was 0) | | -1 :x: | checkstyle | 0m 16s | hbase-procedure: The patch generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0) | | -1 :x: | checkstyle | 1m 31s | hbase-server: The patch generated 59 new + 819 unchanged - 1 fixed = 878 total (was 820) | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | shadedjars | 4m 15s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 15m 38s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. | | +1 :green_heart: | javadoc | 2m 15s | the patch passed | | +1 :green_heart: | findbugs | 7m 46s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 2m 49s | hbase-common in the patch passed. | | +1 :green_heart: | unit | 3m 45s | hbase-client in the patch passed. | | +1 :green_heart: | unit | 0m 54s | hbase-zookeeper in the patch passed. | | +1 :green_heart: | unit | 3m 11s | hbase-procedure in the patch passed. | | +1 :green_heart: | unit | 151m 10s | hbase-server in the patch passed. | | +1 :green_heart: | unit | 15m 59s | hbase-mapreduce in the patch passed. | | +1 :green_heart: | asflicense | 3m 44s | The patch does not generate ASF License warnings. | | | | 257m 15s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1109/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1109 | | Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile | | uname | Linux 0552d78b444a 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1109/out/precommit/personality/provided.sh | | git revision | branch-2 / 76247aa21f | | Default Java | 1.8.0_181 | | checkstyle | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1109/1/artifact/out/diff-checkstyle-hbase-common.txt | | checkstyle | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1109/1/artifact/out/diff-checkstyle-hbase-procedure.txt | | checkstyle | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1109/1/artifact/out/diff-checkstyle-hbase-server.txt | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1109/1/testReport/ | | Max. process+thread count | 5871 (vs. ulimit of 1) | | modules | C: hbase-common hbase-client hbase-zookeeper hbase-procedure hbase-server hbase-mapreduce U: . | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1109/1/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11 | | Powered by | Apache Yetus 0.11.1
[GitHub] [hbase] Apache-HBase commented on issue #1110: HBASE-23761: The new cache entry can overflow the maxSize in CachedEn…
Apache-HBase commented on issue #1110: HBASE-23761: The new cache entry can overflow the maxSize in CachedEn… URL: https://github.com/apache/hbase/pull/1110#issuecomment-580580134 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 6s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 55s | master passed | | +1 :green_heart: | compile | 0m 58s | master passed | | +1 :green_heart: | checkstyle | 1m 13s | master passed | | +1 :green_heart: | shadedjars | 5m 3s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 38s | master passed | | +0 :ok: | spotbugs | 4m 46s | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 :green_heart: | findbugs | 4m 44s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 37s | the patch passed | | +1 :green_heart: | compile | 0m 58s | the patch passed | | +1 :green_heart: | javac | 0m 58s | the patch passed | | +1 :green_heart: | checkstyle | 1m 12s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | shadedjars | 5m 8s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 17m 22s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. | | +1 :green_heart: | javadoc | 0m 37s | the patch passed | | +1 :green_heart: | findbugs | 4m 38s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 155m 48s | hbase-server in the patch passed. | | +1 :green_heart: | asflicense | 0m 28s | The patch does not generate ASF License warnings. | | | | 218m 19s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1110/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1110 | | JIRA Issue | HBASE-23761 | | Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile | | uname | Linux d58f3f64047e 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1110/out/precommit/personality/provided.sh | | git revision | master / 85b0c8e6bc | | Default Java | 1.8.0_181 | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1110/1/testReport/ | | Max. process+thread count | 4472 (vs. ulimit of 1) | | modules | C: hbase-server U: hbase-server | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1110/1/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (HBASE-23761) The new cache entry can overflow the maxSize in CachedEntryQueue
[
https://issues.apache.org/jira/browse/HBASE-23761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027187#comment-17027187
]
HBase QA commented on HBASE-23761:
--
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 1m
6s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:orange}-0{color} | {color:orange} test4tests {color} | {color:orange}
0m 0s{color} | {color:orange} The patch doesn't appear to include any new or
modified tests. Please justify why no new tests are needed for this patch. Also
please list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
55s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
58s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
13s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 5m
3s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
38s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 4m
46s{color} | {color:blue} Used deprecated FindBugs config; considering
switching to SpotBugs. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
44s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
37s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
58s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
58s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
12s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 5m
8s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
17m 22s{color} | {color:green} Patch does not cause any errors with Hadoop
2.8.5 2.9.2 or 3.1.2. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
37s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
38s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green}155m
48s{color} | {color:green} hbase-server in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
28s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}218m 19s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=19.03.5 Server=19.03.5 base:
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1110/1/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/hbase/pull/1110 |
| JIRA Issue | HBASE-23761 |
| Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs
shadedjars hadoopcheck hbaseanti checkstyle compile |
| uname | Linux d58f3f64047e 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19
08:06:28 UTC 2019 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1110/out/precommit/personality/provided.sh
|
| git revision | master / 85b0c8e6bc |
| Default Java | 1.8.0_181 |
| Test Results |
[GitHub] [hbase] YamasakiSS commented on a change in pull request #951: HBASE-23578 [UI] Master UI shows long stack traces when table is broken
YamasakiSS commented on a change in pull request #951: HBASE-23578 [UI] Master
UI shows long stack traces when table is broken
URL: https://github.com/apache/hbase/pull/951#discussion_r373290976
##
File path: hbase-server/src/main/resources/hbase-webapps/master/table.jsp
##
@@ -834,10 +844,22 @@ if (withReplica) {
<% }
-} catch(Exception ex) {
+} catch(Exception ex) { %>
+ Unknown Regions
Review comment:
Thanks for your comment.
I'll change the message to "Unknown issue with Regions"
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[jira] [Commented] (HBASE-21284) Forward port HBASE-21000 to branch-2
[
https://issues.apache.org/jira/browse/HBASE-21284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027137#comment-17027137
]
Hudson commented on HBASE-21284:
Results for branch branch-2.2
[build #770 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Forward port HBASE-21000 to branch-2
>
>
> Key: HBASE-21284
> URL: https://issues.apache.org/jira/browse/HBASE-21284
> Project: HBase
> Issue Type: Sub-task
>Reporter: Andrew Kyle Purtell
>Assignee: Mingliang Liu
>Priority: Major
> Fix For: 3.0.0, 2.3.0
>
> Attachments: HBASE-21284.001.patch, HBASE-21284.002.patch
>
>
> See parent for details.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-23773) Backport "HBASE-23601 OutputSink.WriterThread exception gets stuck and repeated indefinietly" to branch-2.2
[
https://issues.apache.org/jira/browse/HBASE-23773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027139#comment-17027139
]
Hudson commented on HBASE-23773:
Results for branch branch-2.2
[build #770 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Backport "HBASE-23601 OutputSink.WriterThread exception gets stuck and
> repeated indefinietly" to branch-2.2
> ---
>
> Key: HBASE-23773
> URL: https://issues.apache.org/jira/browse/HBASE-23773
> Project: HBase
> Issue Type: Sub-task
>Affects Versions: 2.2.4
>Reporter: Peter Somogyi
>Assignee: Peter Somogyi
>Priority: Major
> Fix For: 2.2.4
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-23748) Include HBASE-21284 to branch-2.2
[
https://issues.apache.org/jira/browse/HBASE-23748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027136#comment-17027136
]
Hudson commented on HBASE-23748:
Results for branch branch-2.2
[build #770 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Include HBASE-21284 to branch-2.2
> -
>
> Key: HBASE-23748
> URL: https://issues.apache.org/jira/browse/HBASE-23748
> Project: HBase
> Issue Type: Sub-task
>Reporter: Sakthi
>Assignee: Sakthi
>Priority: Major
> Fix For: 2.2.3
>
> Attachments: hbase-23748.branch-2.2.001.patch
>
>
> HBASE-21284 was ought to be present in 2.2. But by the time the commit was
> done, the branch had been cut already. Hence this Jira to track it's
> inclusion.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-17115) HMaster/HRegion Info Server does not honour admin.acl
[
https://issues.apache.org/jira/browse/HBASE-17115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027138#comment-17027138
]
Hudson commented on HBASE-17115:
Results for branch branch-2.2
[build #770 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> HMaster/HRegion Info Server does not honour admin.acl
> -
>
> Key: HBASE-17115
> URL: https://issues.apache.org/jira/browse/HBASE-17115
> Project: HBase
> Issue Type: Bug
>Reporter: Mohammad Arshad
>Assignee: Josh Elser
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 2.2.3, 2.1.9
>
>
> Currently there is no way to enable protected URLs like /jmx, /conf only
> for admins. This is applicable for both Master and RegionServer.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-23749) TestHFileWriterV3 should have tests for all data block encodings
[
https://issues.apache.org/jira/browse/HBASE-23749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027135#comment-17027135
]
Hudson commented on HBASE-23749:
Results for branch branch-2.2
[build #770 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.2/770//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> TestHFileWriterV3 should have tests for all data block encodings
>
>
> Key: HBASE-23749
> URL: https://issues.apache.org/jira/browse/HBASE-23749
> Project: HBase
> Issue Type: Test
>Affects Versions: 3.0.0, 2.3.0, 1.6.0
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 1.6.0, 2.2.3, 2.1.9
>
>
> TestHFileWriterV3 tests include writing and reading HFiles for default data
> blocks encoding. However, since this test has efficient way of testing by
> looping through encoded/un-encoded keys and values and keeping offsets
> updated etc, it would be really good to have such test for each encoded data
> blocks. For that, we should explore using respective seekers e.g.
> RowIndexV1Seeker for ROW_INDEX_V1 encoded data blocks etc.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-18095) Provide an option for clients to find the server hosting META that does not involve the ZooKeeper client
[
https://issues.apache.org/jira/browse/HBASE-18095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027134#comment-17027134
]
Hudson commented on HBASE-18095:
Results for branch HBASE-18095/client-locate-meta-no-zookeeper
[build #56 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-18095%252Fclient-locate-meta-no-zookeeper/56/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-18095%252Fclient-locate-meta-no-zookeeper/56//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-18095%252Fclient-locate-meta-no-zookeeper/56//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-18095%252Fclient-locate-meta-no-zookeeper/56//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(x) {color:red}-1 client integration test{color}
--Failed when running client tests on top of Hadoop 2. [see log for
details|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-18095%252Fclient-locate-meta-no-zookeeper/56//artifact/output-integration/hadoop-2.log].
(note that this means we didn't run on Hadoop 3)
> Provide an option for clients to find the server hosting META that does not
> involve the ZooKeeper client
>
>
> Key: HBASE-18095
> URL: https://issues.apache.org/jira/browse/HBASE-18095
> Project: HBase
> Issue Type: New Feature
> Components: Client
>Reporter: Andrew Kyle Purtell
>Assignee: Bharath Vissapragada
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 1.6.0
>
> Attachments: HBASE-18095.master-v1.patch, HBASE-18095.master-v2.patch
>
>
> Clients are required to connect to ZooKeeper to find the location of the
> regionserver hosting the meta table region. Site configuration provides the
> client a list of ZK quorum peers and the client uses an embedded ZK client to
> query meta location. Timeouts and retry behavior of this embedded ZK client
> are managed orthogonally to HBase layer settings and in some cases the ZK
> cannot manage what in theory the HBase client can, i.e. fail fast upon outage
> or network partition.
> We should consider new configuration settings that provide a list of
> well-known master and backup master locations, and with this information the
> client can contact any of the master processes directly. Any master in either
> active or passive state will track meta location and respond to requests for
> it with its cached last known location. If this location is stale, the client
> can ask again with a flag set that requests the master refresh its location
> cache and return the up-to-date location. Every client interaction with the
> cluster thus uses only HBase RPC as transport, with appropriate settings
> applied to the connection. The configuration toggle that enables this
> alternative meta location lookup should be false by default.
> This removes the requirement that HBase clients embed the ZK client and
> contact the ZK service directly at the beginning of the connection lifecycle.
> This has several benefits. ZK service need not be exposed to clients, and
> their potential abuse, yet no benefit ZK provides the HBase server cluster is
> compromised. Normalizing HBase client and ZK client timeout settings and
> retry behavior - in some cases, impossible, i.e. for fail-fast - is no longer
> necessary.
> And, from [~ghelmling]: There is an additional complication here for
> token-based authentication. When a delegation token is used for SASL
> authentication, the client uses the cluster ID obtained from Zookeeper to
> select the token identifier to use. So there would also need to be some
> Zookeeper-less, unauthenticated way to obtain the cluster ID as well.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on issue #1108: HBASE-23779 Up the default fork count; make count relative to CPU count
Apache-HBase commented on issue #1108: HBASE-23779 Up the default fork count; make count relative to CPU count URL: https://github.com/apache/hbase/pull/1108#issuecomment-580550517 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 38s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ branch-2 Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 29s | branch-2 passed | | +1 :green_heart: | compile | 2m 57s | branch-2 passed | | +0 :ok: | refguide | 11m 18s | branch has no errors when building the reference guide. See footer for rendered docs, which you should manually inspect. | | +1 :green_heart: | shadedjars | 4m 19s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 2m 46s | branch-2 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 56s | the patch passed | | +1 :green_heart: | compile | 3m 0s | the patch passed | | +1 :green_heart: | javac | 3m 0s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 2s | The patch has no ill-formed XML file. | | +0 :ok: | refguide | 6m 30s | patch has no errors when building the reference guide. See footer for rendered docs, which you should manually inspect. | | +1 :green_heart: | shadedjars | 4m 17s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 15m 29s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. | | +1 :green_heart: | javadoc | 2m 49s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 11m 1s | root in the patch failed. | | +1 :green_heart: | asflicense | 0m 22s | The patch does not generate ASF License warnings. | | | | 82m 9s | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.hbase.http.TestInfoServersACL | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1108/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1108 | | Optional Tests | dupname asflicense javac javadoc unit shadedjars hadoopcheck xml compile refguide | | uname | Linux 13ed9b53d64a 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1108/out/precommit/personality/provided.sh | | git revision | branch-2 / 76247aa21f | | Default Java | 1.8.0_181 | | refguide | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1108/1/artifact/out/branch-site/book.html | | refguide | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1108/1/artifact/out/patch-site/book.html | | unit | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1108/1/artifact/out/patch-unit-root.txt | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1108/1/testReport/ | | Max. process+thread count | 1555 (vs. ulimit of 1) | | modules | C: . U: . | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1108/1/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (HBASE-23761) The new cache entry can overflow the maxSize in CachedEntryQueue
[ https://issues.apache.org/jira/browse/HBASE-23761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027114#comment-17027114 ] Swaroopa Kadam commented on HBASE-23761: I just created the initial PR. I ll add the test for it in the following revision. Trying to find where to put the test. > The new cache entry can overflow the maxSize in CachedEntryQueue > > > Key: HBASE-23761 > URL: https://issues.apache.org/jira/browse/HBASE-23761 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.8 >Reporter: Swaroopa Kadam >Assignee: Swaroopa Kadam >Priority: Minor > > When we check whether the new entry should be added into > CachedEntryQueue#queue, we need to be sure that after adding the entry to the > queue, the cache size does not overflow maxSize. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] swaroopak opened a new pull request #1110: HBASE-23761: The new cache entry can overflow the maxSize in CachedEn…
swaroopak opened a new pull request #1110: HBASE-23761: The new cache entry can overflow the maxSize in CachedEn… URL: https://github.com/apache/hbase/pull/1110 …tryQueue This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Comment Edited] (HBASE-23761) The new cache entry can overflow the maxSize in CachedEntryQueue
[ https://issues.apache.org/jira/browse/HBASE-23761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027104#comment-17027104 ] Andrew Kyle Purtell edited comment on HBASE-23761 at 1/31/20 12:56 AM: --- Please consider attaching a patch or opening a PR. It's probably easier to discuss this looking at a proposed change. was (Author: apurtell): Please consider attaching a patch or opening a PR. It's probably to discuss this looking at a proposed change. > The new cache entry can overflow the maxSize in CachedEntryQueue > > > Key: HBASE-23761 > URL: https://issues.apache.org/jira/browse/HBASE-23761 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.8 >Reporter: Swaroopa Kadam >Assignee: Swaroopa Kadam >Priority: Minor > > When we check whether the new entry should be added into > CachedEntryQueue#queue, we need to be sure that after adding the entry to the > queue, the cache size does not overflow maxSize. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23761) The new cache entry can overflow the maxSize in CachedEntryQueue
[ https://issues.apache.org/jira/browse/HBASE-23761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027104#comment-17027104 ] Andrew Kyle Purtell commented on HBASE-23761: - Please consider attaching a patch or opening a PR. It's probably to discuss this looking at a proposed change. > The new cache entry can overflow the maxSize in CachedEntryQueue > > > Key: HBASE-23761 > URL: https://issues.apache.org/jira/browse/HBASE-23761 > Project: HBase > Issue Type: Bug >Affects Versions: 2.1.8 >Reporter: Swaroopa Kadam >Assignee: Swaroopa Kadam >Priority: Minor > > When we check whether the new entry should be added into > CachedEntryQueue#queue, we need to be sure that after adding the entry to the > queue, the cache size does not overflow maxSize. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23778) Region History Redo
[
https://issues.apache.org/jira/browse/HBASE-23778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027101#comment-17027101
]
Andrew Kyle Purtell commented on HBASE-23778:
-
[~stack] you might be interested in following this one
> Region History Redo
> ---
>
> Key: HBASE-23778
> URL: https://issues.apache.org/jira/browse/HBASE-23778
> Project: HBase
> Issue Type: Improvement
>Reporter: Swaroopa Kadam
>Assignee: Swaroopa Kadam
>Priority: Minor
>
> My initial thought is mainly to extend the HBase shell(gradually extend to
> CLI and UI) to allow the use of
> {code:java}
> where {code}
> to get the necessary information and allow passing history as an additional
> parameter to get the history. We can configure how many transitions we want
> to store so that anything (ZK or small data structure in the table region
> itself or maybe something else) that is used for state management is not
> exploded.
> As pointed by
> [~andrew.purt...@gmail.com] need to be watchful of mistakes done in the past:
> HBASE-533
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] saintstack opened a new pull request #1109: HBASE-23780 Edit of test classifications
saintstack opened a new pull request #1109: HBASE-23780 Edit of test classifications URL: https://github.com/apache/hbase/pull/1109 These classifications come of running at various fork counts.. A test may complete quick if low fork count but if it is accessing disk, it will run much slower if fork count is high. This edit accommodates some of this phenomenon. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (HBASE-23778) Region History Redo
[
https://issues.apache.org/jira/browse/HBASE-23778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Swaroopa Kadam updated HBASE-23778:
---
Summary: Region History Redo (was: Support for 'where ' in shell
to get the live and history of region location)
> Region History Redo
> ---
>
> Key: HBASE-23778
> URL: https://issues.apache.org/jira/browse/HBASE-23778
> Project: HBase
> Issue Type: Improvement
>Reporter: Swaroopa Kadam
>Assignee: Swaroopa Kadam
>Priority: Minor
>
> My initial thought is mainly to extend the HBase shell(gradually extend to
> CLI and UI) to allow the use of
> {code:java}
> where {code}
> to get the necessary information and allow passing history as an additional
> parameter to get the history. We can configure how many transitions we want
> to store so that anything (ZK or small data structure in the table region
> itself or maybe something else) that is used for state management is not
> exploded.
> As pointed by
> [~andrew.purt...@gmail.com] need to be watchful of mistakes done in the past:
> HBASE-533
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HBASE-23780) Edit of test classifications
Michael Stack created HBASE-23780: - Summary: Edit of test classifications Key: HBASE-23780 URL: https://issues.apache.org/jira/browse/HBASE-23780 Project: HBase Issue Type: Bug Components: test Reporter: Michael Stack Our test classifications have drifted. You can see for yourself running each of the small/medium and large test suites. See test complete times. See how even some large tests should be small and vice versa. The more small tests we can run inside the single JVM, the faster we'll get through the build. Tests that are Medium start their own JVM for each test. Tests that are Medium but only last a second or two are expensive and should be aggregated with other single, short tests to amortize the JVM startup. Anyways, let me edit the test categories and try and clean them up some. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] saintstack opened a new pull request #1108: HBASE-23779 Up the default fork count; make count relative to CPU count
saintstack opened a new pull request #1108: HBASE-23779 Up the default fork count; make count relative to CPU count URL: https://github.com/apache/hbase/pull/1108 Set the fork count for first and second parts to be 0.75C. Add a bit of doc too on this as well as some qualification on our test categories. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (HBASE-23779) Up the default fork count to make builds complete faster; make count relative to CPU count
[ https://issues.apache.org/jira/browse/HBASE-23779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Stack updated HBASE-23779: -- Summary: Up the default fork count to make builds complete faster; make count relative to CPU count (was: Up the default fork count; make count relative to CPU count) > Up the default fork count to make builds complete faster; make count relative > to CPU count > -- > > Key: HBASE-23779 > URL: https://issues.apache.org/jira/browse/HBASE-23779 > Project: HBase > Issue Type: Bug > Components: test >Reporter: Michael Stack >Priority: Major > > Tests take a long time. Our fork count running all tests are conservative -- > 1 (small) for first part and 5 for second part (medium and large). Rather > than hardcoding we should set the fork count to be relative to machine size. > Suggestion here is 0.75C where C is CPU count. This ups the CPU use on my box. > Looking up at jenkins, it seems like the boxes are 24 cores... at least going > by my random survey. The load reported on a few seems low though this not > representative (looking at machine/uptime). > More parallelism willl probably mean more test failure. Let me take a look > see. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-23779) Up the default fork count; make count relative to CPU count
Michael Stack created HBASE-23779: - Summary: Up the default fork count; make count relative to CPU count Key: HBASE-23779 URL: https://issues.apache.org/jira/browse/HBASE-23779 Project: HBase Issue Type: Bug Components: test Reporter: Michael Stack Tests take a long time. Our fork count running all tests are conservative -- 1 (small) for first part and 5 for second part (medium and large). Rather than hardcoding we should set the fork count to be relative to machine size. Suggestion here is 0.75C where C is CPU count. This ups the CPU use on my box. Looking up at jenkins, it seems like the boxes are 24 cores... at least going by my random survey. The load reported on a few seems low though this not representative (looking at machine/uptime). More parallelism willl probably mean more test failure. Let me take a look see. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23764) Flaky tests due to ZK client name resolution delays
[
https://issues.apache.org/jira/browse/HBASE-23764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027093#comment-17027093
]
HBase QA commented on HBASE-23764:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
33s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:orange}-0{color} | {color:orange} test4tests {color} | {color:orange}
0m 0s{color} | {color:orange} The patch doesn't appear to include any new or
modified tests. Please justify why no new tests are needed for this patch. Also
please list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
50s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
54s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 3m
30s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} refguide {color} | {color:blue} 5m
24s{color} | {color:blue} branch has no errors when building the reference
guide. See footer for rendered docs, which you should manually inspect. {color}
|
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 5m
12s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 3m
56s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
23s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
24s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 3m
15s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 3m
15s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
3s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:blue}0{color} | {color:blue} refguide {color} | {color:blue} 5m
24s{color} | {color:blue} patch has no errors when building the reference
guide. See footer for rendered docs, which you should manually inspect. {color}
|
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 5m
9s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
17m 8s{color} | {color:green} Patch does not cause any errors with Hadoop
2.8.5 2.9.2 or 3.1.2. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 3m
53s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 13m 13s{color}
| {color:red} root in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
31s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 87m 18s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hbase.zookeeper.TestZKMainServer |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=19.03.5 Server=19.03.5 base:
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1106/2/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/hbase/pull/1106 |
| JIRA Issue | HBASE-23764 |
| Optional Tests | dupname asflicense javac javadoc unit refguide xml
shadedjars hadoopcheck compile |
| uname | Linux ab75816dae79 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22
16:55:30 UTC 2019 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1106/out/precommit/personality/provided.sh
|
| git revision | master /
[GitHub] [hbase] Apache-HBase commented on issue #1106: HBASE-23764: Switch to IP address for ZK ensemble
Apache-HBase commented on issue #1106: HBASE-23764: Switch to IP address for ZK ensemble URL: https://github.com/apache/hbase/pull/1106#issuecomment-580523268 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 33s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 50s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 5m 54s | master passed | | +1 :green_heart: | compile | 3m 30s | master passed | | +0 :ok: | refguide | 5m 24s | branch has no errors when building the reference guide. See footer for rendered docs, which you should manually inspect. | | +1 :green_heart: | shadedjars | 5m 12s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 3m 56s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 23s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 5m 24s | the patch passed | | +1 :green_heart: | compile | 3m 15s | the patch passed | | +1 :green_heart: | javac | 3m 15s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 3s | The patch has no ill-formed XML file. | | +0 :ok: | refguide | 5m 24s | patch has no errors when building the reference guide. See footer for rendered docs, which you should manually inspect. | | +1 :green_heart: | shadedjars | 5m 9s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 17m 8s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. | | +1 :green_heart: | javadoc | 3m 53s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 13m 13s | root in the patch failed. | | +1 :green_heart: | asflicense | 0m 31s | The patch does not generate ASF License warnings. | | | | 87m 18s | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.hbase.zookeeper.TestZKMainServer | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1106/2/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1106 | | JIRA Issue | HBASE-23764 | | Optional Tests | dupname asflicense javac javadoc unit refguide xml shadedjars hadoopcheck compile | | uname | Linux ab75816dae79 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1106/out/precommit/personality/provided.sh | | git revision | master / 85b0c8e6bc | | Default Java | 1.8.0_181 | | refguide | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1106/2/artifact/out/branch-site/book.html | | refguide | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1106/2/artifact/out/patch-site/book.html | | unit | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1106/2/artifact/out/patch-unit-root.txt | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1106/2/testReport/ | | Max. process+thread count | 311 (vs. ulimit of 1) | | modules | C: hbase-common . U: . | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1106/2/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (HBASE-23774) Announce user-zh list
[
https://issues.apache.org/jira/browse/HBASE-23774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027077#comment-17027077
]
HBase QA commented on HBASE-23774:
--
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
29s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:orange}-0{color} | {color:orange} test4tests {color} | {color:orange}
0m 0s{color} | {color:orange} The patch doesn't appear to include any new or
modified tests. Please justify why no new tests are needed for this patch. Also
please list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
45s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 3m
17s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} refguide {color} | {color:blue} 5m
29s{color} | {color:blue} branch has no errors when building the reference
guide. See footer for rendered docs, which you should manually inspect. {color}
|
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 5m
6s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m
49s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 3m
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 3m
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
1s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:blue}0{color} | {color:blue} refguide {color} | {color:blue} 5m
18s{color} | {color:blue} patch has no errors when building the reference
guide. See footer for rendered docs, which you should manually inspect. {color}
|
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 5m
2s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
17m 13s{color} | {color:green} Patch does not cause any errors with Hadoop
2.8.5 2.9.2 or 3.1.2. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m
49s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green}232m
10s{color} | {color:green} root in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
35s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}300m 50s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=19.03.4 Server=19.03.4 base:
https://builds.apache.org/job/PreCommit-HBASE-Build/1117/artifact/patchprocess/Dockerfile
|
| JIRA Issue | HBASE-23774 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12992262/HBASE-23774.001.patch
|
| Optional Tests | dupname asflicense javac javadoc unit shadedjars hadoopcheck
xml compile refguide |
| uname | Linux 4613dd8b5349 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19
08:06:28 UTC 2019 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/hbase-personality.sh |
| git revision | master / 85b0c8e6bc |
| Default Java | 1.8.0_181 |
| refguide |
https://builds.apache.org/job/PreCommit-HBASE-Build/1117/artifact/patchprocess/branch-site/book.html
|
| refguide |
https://builds.apache.org/job/PreCommit-HBASE-Build/1117/artifact/patchprocess/patch-site/book.html
|
| Test Results |
https://builds.apache.org/job/PreCommit-HBASE-Build/1117/testReport/ |
| Max. process+thread count | 5189 (vs. ulimit of
[GitHub] [hbase] Apache-HBase commented on issue #1107: HBASE-23772 Removed deprecated getTimeStampOfLastShippedOp from MetricsSource
Apache-HBase commented on issue #1107: HBASE-23772 Removed deprecated getTimeStampOfLastShippedOp from MetricsSource URL: https://github.com/apache/hbase/pull/1107#issuecomment-580498636 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 11s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 6m 27s | master passed | | +1 :green_heart: | compile | 1m 9s | master passed | | +1 :green_heart: | checkstyle | 1m 24s | master passed | | +1 :green_heart: | shadedjars | 5m 18s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 40s | master passed | | +0 :ok: | spotbugs | 5m 2s | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 :green_heart: | findbugs | 5m 0s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 46s | the patch passed | | +1 :green_heart: | compile | 1m 3s | the patch passed | | +1 :green_heart: | javac | 1m 3s | the patch passed | | +1 :green_heart: | checkstyle | 1m 16s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | shadedjars | 5m 14s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 18m 11s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. | | +1 :green_heart: | javadoc | 0m 49s | the patch passed | | +1 :green_heart: | findbugs | 6m 11s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 191m 26s | hbase-server in the patch passed. | | +1 :green_heart: | asflicense | 0m 28s | The patch does not generate ASF License warnings. | | | | 258m 47s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1107/3/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1107 | | Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile | | uname | Linux 850b3df3ef5f 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1107/out/precommit/personality/provided.sh | | git revision | master / 85b0c8e6bc | | Default Java | 1.8.0_181 | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1107/3/testReport/ | | Max. process+thread count | 5222 (vs. ulimit of 1) | | modules | C: hbase-server U: hbase-server | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1107/3/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (HBASE-23770) [Flakey Tests] TestRegionReplicasWithRestartScenarios#testWhenRestart
[
https://issues.apache.org/jira/browse/HBASE-23770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027053#comment-17027053
]
Hudson commented on HBASE-23770:
Results for branch branch-2
[build #2440 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2440/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2440//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2440//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2440//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> [Flakey Tests] TestRegionReplicasWithRestartScenarios#testWhenRestart
> -
>
> Key: HBASE-23770
> URL: https://issues.apache.org/jira/browse/HBASE-23770
> Project: HBase
> Issue Type: Bug
> Components: flakies
>Reporter: Michael Stack
>Priority: Major
> Fix For: 3.0.0, 2.3.0
>
> Attachments:
> 0001-HBASE-23770-Flakey-Tests-TestRegionReplicasWithResta.patch, Screen Shot
> 2020-01-29 at 9.45.58 PM.png
>
>
> Fails about 35% of the time in the GCE build. Let me attach a picture from
> current flakies dashboard for branch-2.
> The test starts a cluster of three RS w/ 3 region replicas. It then stops a
> server, starts a new one, and then expects that the remaining three nodes do
> not have instances where two region replicas have landed on a single server.
> It fails sporadically (reproducible locally) because when the SCP runs its
> assign, sometimes timing has it so Master knows of two servers only. Making
> the new start before the old one is stopped (instead of other way around)
> seems to fix the test -- there'll be three servers up when SCP runs.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-17115) HMaster/HRegion Info Server does not honour admin.acl
[
https://issues.apache.org/jira/browse/HBASE-17115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027052#comment-17027052
]
Hudson commented on HBASE-17115:
Results for branch branch-2
[build #2440 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2440/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2440//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2440//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2440//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> HMaster/HRegion Info Server does not honour admin.acl
> -
>
> Key: HBASE-17115
> URL: https://issues.apache.org/jira/browse/HBASE-17115
> Project: HBase
> Issue Type: Bug
>Reporter: Mohammad Arshad
>Assignee: Josh Elser
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 2.2.3, 2.1.9
>
>
> Currently there is no way to enable protected URLs like /jmx, /conf only
> for admins. This is applicable for both Master and RegionServer.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-23771) [Flakey Tests] Test TestSplitTransactionOnCluster Again
[
https://issues.apache.org/jira/browse/HBASE-23771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027054#comment-17027054
]
Hudson commented on HBASE-23771:
Results for branch branch-2
[build #2440 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2440/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2440//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2440//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2440//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> [Flakey Tests] Test TestSplitTransactionOnCluster Again
> ---
>
> Key: HBASE-23771
> URL: https://issues.apache.org/jira/browse/HBASE-23771
> Project: HBase
> Issue Type: Sub-task
>Reporter: Michael Stack
>Priority: Major
> Attachments:
> 0001-HBASE-23771-Flakey-Tests-Test-TestSplitTransactionOn.patch
>
>
> Parent fix had the test failures in GCE go from 35% to 4%. Let me see if can
> clear the remaining fails.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-23778) Support for 'where ' in shell to get the live and history of region location
[
https://issues.apache.org/jira/browse/HBASE-23778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027032#comment-17027032
]
Andrew Kyle Purtell commented on HBASE-23778:
-
[~swaroopa] please think about retitling this issue "Region History Redo", that
should attract the appropriate level of interest.
> Support for 'where ' in shell to get the live and history of region
> location
> --
>
> Key: HBASE-23778
> URL: https://issues.apache.org/jira/browse/HBASE-23778
> Project: HBase
> Issue Type: Improvement
>Reporter: Swaroopa Kadam
>Assignee: Swaroopa Kadam
>Priority: Minor
>
> My initial thought is mainly to extend the HBase shell(gradually extend to
> CLI and UI) to allow the use of
> {code:java}
> where {code}
> to get the necessary information and allow passing history as an additional
> parameter to get the history. We can configure how many transitions we want
> to store so that anything (ZK or small data structure in the table region
> itself or maybe something else) that is used for state management is not
> exploded.
> As pointed by
> [~andrew.purt...@gmail.com] need to be watchful of mistakes done in the past:
> HBASE-533
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HBASE-23778) Support for 'where ' in shell to get the live and history of region location
Swaroopa Kadam created HBASE-23778:
--
Summary: Support for 'where ' in shell to get the live
and history of region location
Key: HBASE-23778
URL: https://issues.apache.org/jira/browse/HBASE-23778
Project: HBase
Issue Type: Improvement
Reporter: Swaroopa Kadam
Assignee: Swaroopa Kadam
My initial thought is mainly to extend the HBase shell(gradually extend to CLI
and UI) to allow the use of
{code:java}
where {code}
to get the necessary information and allow passing history as an additional
parameter to get the history. We can configure how many transitions we want to
store so that anything (ZK or small data structure in the table region itself
or maybe something else) that is used for state management is not exploded.
As pointed by
[~andrew.purt...@gmail.com] need to be watchful of mistakes done in the past:
HBASE-533
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-23774) Announce user-zh list
[ https://issues.apache.org/jira/browse/HBASE-23774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026969#comment-17026969 ] Josh Elser commented on HBASE-23774: Yep, all the leg work is done already. Just getting the website updated before I send out a note. > Announce user-zh list > - > > Key: HBASE-23774 > URL: https://issues.apache.org/jira/browse/HBASE-23774 > Project: HBase > Issue Type: Task > Components: website >Reporter: Josh Elser >Assignee: Josh Elser >Priority: Trivial > Attachments: HBASE-23774.001.patch > > > Let folks know about the new user-zh list that is dedicated for user > questions in chinese (as opposed to the norm of english on user) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23774) Announce user-zh list
[ https://issues.apache.org/jira/browse/HBASE-23774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026968#comment-17026968 ] Xu Cang commented on HBASE-23774: - good idea. [~elserj] +1 Has this email been setup? > Announce user-zh list > - > > Key: HBASE-23774 > URL: https://issues.apache.org/jira/browse/HBASE-23774 > Project: HBase > Issue Type: Task > Components: website >Reporter: Josh Elser >Assignee: Josh Elser >Priority: Trivial > Attachments: HBASE-23774.001.patch > > > Let folks know about the new user-zh list that is dedicated for user > questions in chinese (as opposed to the norm of english on user) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-23777) Remove deprecated createTableDescriptor(String, int, int, int, KeepDeletedCells) from HBaseTestingUtility
Jan Hentschel created HBASE-23777:
-
Summary: Remove deprecated createTableDescriptor(String, int, int,
int, KeepDeletedCells) from HBaseTestingUtility
Key: HBASE-23777
URL: https://issues.apache.org/jira/browse/HBASE-23777
Project: HBase
Issue Type: Sub-task
Affects Versions: 3.0.0
Reporter: Jan Hentschel
Assignee: Jan Hentschel
{{createTableDescriptor(String, int, int, int, KeepDeletedCells)}} in
{{HBaseTestingUtility}} was deprecated back in 2.0.0 and should be removed for
3.0.0.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work started] (HBASE-23777) Remove deprecated createTableDescriptor(String, int, int, int, KeepDeletedCells) from HBaseTestingUtility
[
https://issues.apache.org/jira/browse/HBASE-23777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HBASE-23777 started by Jan Hentschel.
-
> Remove deprecated createTableDescriptor(String, int, int, int,
> KeepDeletedCells) from HBaseTestingUtility
> -
>
> Key: HBASE-23777
> URL: https://issues.apache.org/jira/browse/HBASE-23777
> Project: HBase
> Issue Type: Sub-task
>Affects Versions: 3.0.0
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
>
> {{createTableDescriptor(String, int, int, int, KeepDeletedCells)}} in
> {{HBaseTestingUtility}} was deprecated back in 2.0.0 and should be removed
> for 3.0.0.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HBASE-23776) Remove deprecated createLocalHTU from HBaseTestingUtility
Jan Hentschel created HBASE-23776:
-
Summary: Remove deprecated createLocalHTU from HBaseTestingUtility
Key: HBASE-23776
URL: https://issues.apache.org/jira/browse/HBASE-23776
Project: HBase
Issue Type: Sub-task
Affects Versions: 3.0.0
Reporter: Jan Hentschel
Assignee: Jan Hentschel
{{createLocalHTU()}} in {{HBaseTestingUtility}} was deprecated back in 2.0.0
and should be removed for 3.0.0.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work started] (HBASE-23776) Remove deprecated createLocalHTU from HBaseTestingUtility
[
https://issues.apache.org/jira/browse/HBASE-23776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HBASE-23776 started by Jan Hentschel.
-
> Remove deprecated createLocalHTU from HBaseTestingUtility
> -
>
> Key: HBASE-23776
> URL: https://issues.apache.org/jira/browse/HBASE-23776
> Project: HBase
> Issue Type: Sub-task
>Affects Versions: 3.0.0
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
>
> {{createLocalHTU()}} in {{HBaseTestingUtility}} was deprecated back in 2.0.0
> and should be removed for 3.0.0.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work started] (HBASE-23775) Remove deprecated createLocalHTU(Configuration) from HBaseTestingUtility
[
https://issues.apache.org/jira/browse/HBASE-23775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HBASE-23775 started by Jan Hentschel.
-
> Remove deprecated createLocalHTU(Configuration) from HBaseTestingUtility
>
>
> Key: HBASE-23775
> URL: https://issues.apache.org/jira/browse/HBASE-23775
> Project: HBase
> Issue Type: Sub-task
>Affects Versions: 3.0.0
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
>
> {{createLocalHTU(Configuration)}} in {{HBaseTestingUtility}} was deprecated
> back in 2.0.0 and should be removed for 3.0.0.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HBASE-23775) Remove deprecated createLocalHTU(Configuration) from HBaseTestingUtility
Jan Hentschel created HBASE-23775:
-
Summary: Remove deprecated createLocalHTU(Configuration) from
HBaseTestingUtility
Key: HBASE-23775
URL: https://issues.apache.org/jira/browse/HBASE-23775
Project: HBase
Issue Type: Sub-task
Affects Versions: 3.0.0
Reporter: Jan Hentschel
Assignee: Jan Hentschel
{{createLocalHTU(Configuration)}} in {{HBaseTestingUtility}} was deprecated
back in 2.0.0 and should be removed for 3.0.0.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work started] (HBASE-22827) Expose multi-region merge in shell and Admin API
[ https://issues.apache.org/jira/browse/HBASE-22827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-22827 started by Sakthi. -- > Expose multi-region merge in shell and Admin API > > > Key: HBASE-22827 > URL: https://issues.apache.org/jira/browse/HBASE-22827 > Project: HBase > Issue Type: Improvement > Components: Admin, shell >Reporter: Michael Stack >Assignee: Sakthi >Priority: Major > > HBASE-22777 adds being able to merge more than two regions at once. It is > only available internally currently for use by hbck2 doing fixup of overlaps > in hbase:meta. This issue is about exposing it via the Admin Interface and in > turn, via the shell. Probably best if old two region merge method is > deprecated. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-22827) Expose multi-region merge in shell and Admin API
[ https://issues.apache.org/jira/browse/HBASE-22827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026906#comment-17026906 ] Sakthi commented on HBASE-22827: Starting to work on this. > Expose multi-region merge in shell and Admin API > > > Key: HBASE-22827 > URL: https://issues.apache.org/jira/browse/HBASE-22827 > Project: HBase > Issue Type: Improvement > Components: Admin, shell >Reporter: Michael Stack >Assignee: Sakthi >Priority: Major > > HBASE-22777 adds being able to merge more than two regions at once. It is > only available internally currently for use by hbck2 doing fixup of overlaps > in hbase:meta. This issue is about exposing it via the Admin Interface and in > turn, via the shell. Probably best if old two region merge method is > deprecated. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-23774) Announce user-zh list
[ https://issues.apache.org/jira/browse/HBASE-23774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated HBASE-23774: --- Environment: (was: A) > Announce user-zh list > - > > Key: HBASE-23774 > URL: https://issues.apache.org/jira/browse/HBASE-23774 > Project: HBase > Issue Type: Task > Components: website >Reporter: Josh Elser >Assignee: Josh Elser >Priority: Trivial > Attachments: HBASE-23774.001.patch > > > Let folks know about the new user-zh list that is dedicated for user > questions in chinese (as opposed to the norm of english on user) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-23774) Announce user-zh list
[ https://issues.apache.org/jira/browse/HBASE-23774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated HBASE-23774: --- Attachment: HBASE-23774.001.patch > Announce user-zh list > - > > Key: HBASE-23774 > URL: https://issues.apache.org/jira/browse/HBASE-23774 > Project: HBase > Issue Type: Task > Components: website > Environment: A >Reporter: Josh Elser >Assignee: Josh Elser >Priority: Trivial > Attachments: HBASE-23774.001.patch > > > Let folks know about the new user-zh list that is dedicated for user > questions in chinese (as opposed to the norm of english on user) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-23774) Announce user-zh list
[ https://issues.apache.org/jira/browse/HBASE-23774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated HBASE-23774: --- Status: Patch Available (was: Open) > Announce user-zh list > - > > Key: HBASE-23774 > URL: https://issues.apache.org/jira/browse/HBASE-23774 > Project: HBase > Issue Type: Task > Components: website > Environment: A >Reporter: Josh Elser >Assignee: Josh Elser >Priority: Trivial > Attachments: HBASE-23774.001.patch > > > Let folks know about the new user-zh list that is dedicated for user > questions in chinese (as opposed to the norm of english on user) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-23774) Announce user-zh list
Josh Elser created HBASE-23774: -- Summary: Announce user-zh list Key: HBASE-23774 URL: https://issues.apache.org/jira/browse/HBASE-23774 Project: HBase Issue Type: Task Components: website Environment: A Reporter: Josh Elser Assignee: Josh Elser Let folks know about the new user-zh list that is dedicated for user questions in chinese (as opposed to the norm of english on user) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] bharathv commented on issue #1106: HBASE-23764: Switch to IP address for ZK ensemble
bharathv commented on issue #1106: HBASE-23764: Switch to IP address for ZK ensemble URL: https://github.com/apache/hbase/pull/1106#issuecomment-580374052 > Have you tried to dump the jstack result when mini cluster is hang? @Apache9 Yes. I attached the jstacks to the jira. My investigation with jstacks was inconclusive and I was not able to do a mixed-mode jstack (jstack -m) due to some JDK bugs on mac. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (HBASE-23764) Flaky tests due to ZK client name resolution delays
[
https://issues.apache.org/jira/browse/HBASE-23764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026883#comment-17026883
]
Bharath Vissapragada commented on HBASE-23764:
--
Attached 5 jstacks of the test runner 1s apart when the client connections are
hung. Zookeeper is running on port {{58711}}, so grep for it to see the server
and client side threads. I couldn't find many hints from the jstacks and I was
not able to do a mixed-mode jstack (jstack -m) to see what the threads were
doing on the native side because my JDK version has a bug and it crashes
immediately after I run "jstack -m". Did I miss anything obvious from the
regular jstacks?
> Flaky tests due to ZK client name resolution delays
> ---
>
> Key: HBASE-23764
> URL: https://issues.apache.org/jira/browse/HBASE-23764
> Project: HBase
> Issue Type: Bug
> Components: test
>Affects Versions: 3.0.0
>Reporter: Bharath Vissapragada
>Assignee: Bharath Vissapragada
>Priority: Major
> Attachments: sample-jstacks.zip
>
>
> [~ndimiduk] and I ran into this issue (separately) and we noticed that there
> are some performance issues with name resolution in the Zookeeper client.
> Since we use ZK heavily in the unit tests, this often manifests as the
> following issues
> 1. Test time outs starting the mini cluster (Master failed to start)
> 2. InterruptedException (because the tests timeout)
> 3. Flaky tests because a subset of the cluster fails to start for whatever
> reason (replication tests especially because they spawn multiple clusters).
> 4. ConnectionLoss to znode /hbase/xyzz.. JVM pause?
> I have strong feeling that this is a possible cause for many of our flaky
> tests in Jenkins. Luckily, it looks like the following workaround to switch
> to an IP address instead of hostname makes it much quicker. There are some
> related discussions in the ZK community (ZOOKEEPER-1666 and related jiras).
> {code:java}
> --- a/hbase-common/src/main/resources/hbase-default.xml
> +++ b/hbase-common/src/main/resources/hbase-default.xml
> @@ -72,7 +72,7 @@ possible configurations would overwhelm and obscure the
> important.
>
>
> hbase.zookeeper.quorum
> -localhost
> +127.0.0.1
> Comma separated list of servers in the ZooKeeper ensemble
> (This config. should have been named hbase.zookeeper.ensemble).
> For example, "host1.mydomain.com,host2.mydomain.com,host3.mydomain.com".
> {code}
> Until we figure out the actual root cause and a dependency upgrade (if
> needed), we should consider making this hostname to IP switch for more stable
> builds.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HBASE-23764) Flaky tests due to ZK client name resolution delays
[
https://issues.apache.org/jira/browse/HBASE-23764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bharath Vissapragada updated HBASE-23764:
-
Attachment: sample-jstacks.zip
> Flaky tests due to ZK client name resolution delays
> ---
>
> Key: HBASE-23764
> URL: https://issues.apache.org/jira/browse/HBASE-23764
> Project: HBase
> Issue Type: Bug
> Components: test
>Affects Versions: 3.0.0
>Reporter: Bharath Vissapragada
>Assignee: Bharath Vissapragada
>Priority: Major
> Attachments: sample-jstacks.zip
>
>
> [~ndimiduk] and I ran into this issue (separately) and we noticed that there
> are some performance issues with name resolution in the Zookeeper client.
> Since we use ZK heavily in the unit tests, this often manifests as the
> following issues
> 1. Test time outs starting the mini cluster (Master failed to start)
> 2. InterruptedException (because the tests timeout)
> 3. Flaky tests because a subset of the cluster fails to start for whatever
> reason (replication tests especially because they spawn multiple clusters).
> 4. ConnectionLoss to znode /hbase/xyzz.. JVM pause?
> I have strong feeling that this is a possible cause for many of our flaky
> tests in Jenkins. Luckily, it looks like the following workaround to switch
> to an IP address instead of hostname makes it much quicker. There are some
> related discussions in the ZK community (ZOOKEEPER-1666 and related jiras).
> {code:java}
> --- a/hbase-common/src/main/resources/hbase-default.xml
> +++ b/hbase-common/src/main/resources/hbase-default.xml
> @@ -72,7 +72,7 @@ possible configurations would overwhelm and obscure the
> important.
>
>
> hbase.zookeeper.quorum
> -localhost
> +127.0.0.1
> Comma separated list of servers in the ZooKeeper ensemble
> (This config. should have been named hbase.zookeeper.ensemble).
> For example, "host1.mydomain.com,host2.mydomain.com,host3.mydomain.com".
> {code}
> Until we figure out the actual root cause and a dependency upgrade (if
> needed), we should consider making this hostname to IP switch for more stable
> builds.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] ndimiduk merged pull request #1104: HBASE-23763 Add 'new on release line report' for git/jira audit tool
ndimiduk merged pull request #1104: HBASE-23763 Add 'new on release line report' for git/jira audit tool URL: https://github.com/apache/hbase/pull/1104 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [hbase] ramkrish86 commented on issue #1074: HBASE-23350 Make compaction files cacheonWrite configurable based on threshold
ramkrish86 commented on issue #1074: HBASE-23350 Make compaction files cacheonWrite configurable based on threshold URL: https://github.com/apache/hbase/pull/1074#issuecomment-580364100 Will commit tihs unless objections. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (HBASE-22587) Add a REST server integration test that uses a cluster for simple operations
[ https://issues.apache.org/jira/browse/HBASE-22587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk updated HBASE-22587: - Summary: Add a REST server integration test that uses a cluster for simple operations (was: Add a REST server to the nightly test that uses a cluster for simple operations) > Add a REST server integration test that uses a cluster for simple operations > > > Key: HBASE-22587 > URL: https://issues.apache.org/jira/browse/HBASE-22587 > Project: HBase > Issue Type: Test > Components: integration tests, REST, test >Reporter: Sakthi >Priority: Major > Labels: jdk11 > > Let's add rest server to the nightly test that uses a cluster for simple > operations to catch any possible rest server issues related to dependencies, > cnfe, npe etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-22587) Add a REST server to the nightly test that uses a cluster for simple operations
[ https://issues.apache.org/jira/browse/HBASE-22587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk updated HBASE-22587: - Parent: (was: HBASE-22972) Issue Type: Test (was: Sub-task) > Add a REST server to the nightly test that uses a cluster for simple > operations > --- > > Key: HBASE-22587 > URL: https://issues.apache.org/jira/browse/HBASE-22587 > Project: HBase > Issue Type: Test > Components: REST, test >Reporter: Sakthi >Priority: Major > Labels: jdk11 > > Let's add rest server to the nightly test that uses a cluster for simple > operations to catch any possible rest server issues related to dependencies, > cnfe, npe etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-22587) Add a REST server to the nightly test that uses a cluster for simple operations
[ https://issues.apache.org/jira/browse/HBASE-22587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk updated HBASE-22587: - Component/s: integration tests > Add a REST server to the nightly test that uses a cluster for simple > operations > --- > > Key: HBASE-22587 > URL: https://issues.apache.org/jira/browse/HBASE-22587 > Project: HBase > Issue Type: Test > Components: integration tests, REST, test >Reporter: Sakthi >Priority: Major > Labels: jdk11 > > Let's add rest server to the nightly test that uses a cluster for simple > operations to catch any possible rest server issues related to dependencies, > cnfe, npe etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on issue #1107: HBASE-23772 Removed deprecated getTimeStampOfLastShippedOp from MetricsSource
Apache-HBase commented on issue #1107: HBASE-23772 Removed deprecated getTimeStampOfLastShippedOp from MetricsSource URL: https://github.com/apache/hbase/pull/1107#issuecomment-580350232 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 4s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 31s | master passed | | +1 :green_heart: | compile | 0m 56s | master passed | | +1 :green_heart: | checkstyle | 1m 10s | master passed | | +1 :green_heart: | shadedjars | 4m 46s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 39s | master passed | | +0 :ok: | spotbugs | 4m 23s | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 :green_heart: | findbugs | 4m 20s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 0s | the patch passed | | +1 :green_heart: | compile | 0m 56s | the patch passed | | +1 :green_heart: | javac | 0m 56s | the patch passed | | +1 :green_heart: | checkstyle | 1m 6s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | shadedjars | 4m 40s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 15m 47s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. | | +1 :green_heart: | javadoc | 0m 37s | the patch passed | | +1 :green_heart: | findbugs | 4m 22s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 164m 3s | hbase-server in the patch failed. | | +1 :green_heart: | asflicense | 0m 35s | The patch does not generate ASF License warnings. | | | | 222m 0s | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.hbase.io.hfile.bucket.TestBucketCache | | | hadoop.hbase.replication.TestReplicationStatus | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1107/2/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1107 | | Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile | | uname | Linux 96bbc1e733fd 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1107/out/precommit/personality/provided.sh | | git revision | master / 8b00f9f0b1 | | Default Java | 1.8.0_181 | | unit | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1107/2/artifact/out/patch-unit-hbase-server.txt | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1107/2/testReport/ | | Max. process+thread count | 4982 (vs. ulimit of 1) | | modules | C: hbase-server U: hbase-server | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1107/2/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (HBASE-23769) TestSecureRESTServer fails due to hostname mismatch
[
https://issues.apache.org/jira/browse/HBASE-23769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026810#comment-17026810
]
Josh Elser commented on HBASE-23769:
Also, send me the box if you can and the command you're running, and I'll try
to take a look rather than debug-over-async ;)
> TestSecureRESTServer fails due to hostname mismatch
> ---
>
> Key: HBASE-23769
> URL: https://issues.apache.org/jira/browse/HBASE-23769
> Project: HBase
> Issue Type: Test
> Components: REST, test
>Affects Versions: 3.0.0, 2.3.0
>Reporter: Nick Dimiduk
>Priority: Minor
>
> Above test fails reliably in a simpleVagrant/VirtualBox Ubuntu vm.
> {noformat}
> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.005 s <<<
> FAILURE! - in org.apache.hadoop.hbase.rest.TestSecureRESTServer
> org.apache.hadoop.hbase.rest.TestSecureRESTServer Time elapsed: 0.001 s <<<
> ERROR!
> java.io.IOException: Failed on local exception: java.io.IOException: Couldn't
> setup connection for hbase/localh...@example.com to
> localhost/127.0.0.1:45719; Host Details : local host is: "bionic/10.0.2.15";
> destination host is: "localhost":45719;
> at
> org.apache.hadoop.hbase.rest.TestSecureRESTServer.setupServer(TestSecureRESTServer.java:193)
> Caused by: java.io.IOException: Couldn't setup connection for
> hbase/localh...@example.com to localhost/127.0.0.1:45719
> at
> org.apache.hadoop.hbase.rest.TestSecureRESTServer.setupServer(TestSecureRESTServer.java:193)
> Caused by: javax.security.sasl.SaslException: GSS initiate failed
> at
> org.apache.hadoop.hbase.rest.TestSecureRESTServer.setupServer(TestSecureRESTServer.java:193)
> Caused by: org.ietf.jgss.GSSException: No valid credentials provided
> (Mechanism level: Message stream modified (41) - Message stream modified)
> at
> org.apache.hadoop.hbase.rest.TestSecureRESTServer.setupServer(TestSecureRESTServer.java:193)
> Caused by: sun.security.krb5.KrbException: Message stream modified (41) -
> Message stream modified
> at
> org.apache.hadoop.hbase.rest.TestSecureRESTServer.setupServer(TestSecureRESTServer.java:193)
> Caused by: sun.security.krb5.Asn1Exception: Identifier doesn't match expected
> value (906)
> at
> org.apache.hadoop.hbase.rest.TestSecureRESTServer.setupServer(TestSecureRESTServer.java:193)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] joshelser commented on a change in pull request #1102: HBASE-23752: Fix remaining test failures from nightly runs
joshelser commented on a change in pull request #1102: HBASE-23752: Fix
remaining test failures from nightly runs
URL: https://github.com/apache/hbase/pull/1102#discussion_r373065101
##
File path:
hbase-server/src/test/java/org/apache/hadoop/hbase/security/provider/TestCustomSaslAuthenticationProvider.java
##
@@ -431,9 +431,13 @@ public static void setupCluster() throws Exception {
UTIL.getDataTestDir("keytab").toUri().getPath());
final MiniKdc kdc = UTIL.setupMiniKdc(KEYTAB_FILE);
-// Switch back to NIO for now.
+// Switch to blocking RPC impl.
CONF.set(RpcClientFactory.CUSTOM_RPC_CLIENT_IMPL_CONF_KEY,
BlockingRpcClient.class.getName());
CONF.set(RpcServerFactory.CUSTOM_RPC_SERVER_IMPL_CONF_KEY,
SimpleRpcServer.class.getName());
+// Set the connection registry to ZKConnectionRegistry since hedging is
not supported on
+// blocking rpc clients.
Review comment:
> Why is this test forced onto the blocking rpc client? Can/Should it be
parameterized over both implementations?
Oversight on my part! Like Nick says -- we should use both via
parameterization. There's another test which does this TestSecureIPC!
Do you want to add that parameterization as a part of this PR? Or I can open
up an issue and fix this test (as the negligent author ;)). LMK!
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[GitHub] [hbase] Apache-HBase commented on issue #1074: HBASE-23350 Make compaction files cacheonWrite configurable based on threshold
Apache-HBase commented on issue #1074: HBASE-23350 Make compaction files cacheonWrite configurable based on threshold URL: https://github.com/apache/hbase/pull/1074#issuecomment-580267234 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 30s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | +1 :green_heart: | test4tests | 0m 0s | The patch appears to include 5 new or modified test files. | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 33s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 5m 50s | master passed | | +1 :green_heart: | compile | 1m 10s | master passed | | +1 :green_heart: | checkstyle | 2m 31s | master passed | | +1 :green_heart: | shadedjars | 5m 3s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 49s | master passed | | +0 :ok: | spotbugs | 4m 34s | Used deprecated FindBugs config; considering switching to SpotBugs. | | +0 :ok: | findbugs | 0m 15s | branch/hbase-checkstyle no findbugs output file (findbugsXml.xml) | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 14s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 5m 28s | the patch passed | | +1 :green_heart: | compile | 1m 10s | the patch passed | | +1 :green_heart: | javac | 1m 10s | the patch passed | | +1 :green_heart: | checkstyle | 2m 32s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 2s | The patch has no ill-formed XML file. | | +1 :green_heart: | shadedjars | 5m 8s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 17m 7s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. | | +1 :green_heart: | javadoc | 0m 46s | the patch passed | | +0 :ok: | findbugs | 0m 11s | hbase-checkstyle has no data from findbugs | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 11s | hbase-checkstyle in the patch passed. | | -1 :x: | unit | 155m 24s | hbase-server in the patch failed. | | +1 :green_heart: | asflicense | 0m 50s | The patch does not generate ASF License warnings. | | | | 222m 5s | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.hbase.security.access.TestAccessController3 | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.4 Server=19.03.4 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1074/6/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1074 | | Optional Tests | dupname asflicense checkstyle javac javadoc unit xml spotbugs findbugs shadedjars hadoopcheck hbaseanti compile | | uname | Linux 7d5f7f2ab430 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1074/out/precommit/personality/provided.sh | | git revision | master / 8b00f9f0b1 | | Default Java | 1.8.0_181 | | unit | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1074/6/artifact/out/patch-unit-hbase-server.txt | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1074/6/testReport/ | | Max. process+thread count | 5208 (vs. ulimit of 1) | | modules | C: hbase-checkstyle hbase-server U: . | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1074/6/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (HBASE-23749) TestHFileWriterV3 should have tests for all data block encodings
[
https://issues.apache.org/jira/browse/HBASE-23749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026704#comment-17026704
]
Hudson commented on HBASE-23749:
Results for branch master
[build #1613 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/1613/]: (/)
*{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1613//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1613//JDK8_Nightly_Build_Report_(Hadoop2)/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1613//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> TestHFileWriterV3 should have tests for all data block encodings
>
>
> Key: HBASE-23749
> URL: https://issues.apache.org/jira/browse/HBASE-23749
> Project: HBase
> Issue Type: Test
>Affects Versions: 3.0.0, 2.3.0, 1.6.0
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 1.6.0, 2.2.3, 2.1.9
>
>
> TestHFileWriterV3 tests include writing and reading HFiles for default data
> blocks encoding. However, since this test has efficient way of testing by
> looping through encoded/un-encoded keys and values and keeping offsets
> updated etc, it would be really good to have such test for each encoded data
> blocks. For that, we should explore using respective seekers e.g.
> RowIndexV1Seeker for ROW_INDEX_V1 encoded data blocks etc.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-23736) Remove deprecated getTimeStampOfLastAppliedOp from MetricsSink
[
https://issues.apache.org/jira/browse/HBASE-23736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026703#comment-17026703
]
Hudson commented on HBASE-23736:
Results for branch master
[build #1613 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/1613/]: (/)
*{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1613//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1613//JDK8_Nightly_Build_Report_(Hadoop2)/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1613//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Remove deprecated getTimeStampOfLastAppliedOp from MetricsSink
> --
>
> Key: HBASE-23736
> URL: https://issues.apache.org/jira/browse/HBASE-23736
> Project: HBase
> Issue Type: Task
>Affects Versions: 3.0.0
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
>
> {{MetricsSink}} defines the deprecated method
> {{getTimeStampOfLastAppliedOp}}, which should be removed for 3.0.0.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-17115) HMaster/HRegion Info Server does not honour admin.acl
[
https://issues.apache.org/jira/browse/HBASE-17115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026705#comment-17026705
]
Hudson commented on HBASE-17115:
Results for branch master
[build #1613 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/1613/]: (/)
*{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1613//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1613//JDK8_Nightly_Build_Report_(Hadoop2)/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1613//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> HMaster/HRegion Info Server does not honour admin.acl
> -
>
> Key: HBASE-17115
> URL: https://issues.apache.org/jira/browse/HBASE-17115
> Project: HBase
> Issue Type: Bug
>Reporter: Mohammad Arshad
>Assignee: Josh Elser
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 2.2.3, 2.1.9
>
>
> Currently there is no way to enable protected URLs like /jmx, /conf only
> for admins. This is applicable for both Master and RegionServer.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-22972) [JDK11] Support JDK11 LTS in HBase
[ https://issues.apache.org/jira/browse/HBASE-22972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026689#comment-17026689 ] Duo Zhang commented on HBASE-22972: --- Maybe a new profile? If you enable jdk11, then you must depend on hadoop-3.3.x. > [JDK11] Support JDK11 LTS in HBase > -- > > Key: HBASE-22972 > URL: https://issues.apache.org/jira/browse/HBASE-22972 > Project: HBase > Issue Type: Umbrella >Reporter: Duo Zhang >Priority: Blocker > Labels: jdk11 > Fix For: 3.0.0, 2.3.0 > > > This is an umbrella issue for tracking all the problems for JDK11 in HBase. > And we also rely on hadoop. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache9 commented on issue #1106: HBASE-23764: Switch to IP address for ZK ensemble
Apache9 commented on issue #1106: HBASE-23764: Switch to IP address for ZK ensemble URL: https://github.com/apache/hbase/pull/1106#issuecomment-580253850 Interesting. Have you tried to dump the jstack result when mini cluster is hang? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (HBASE-23633) Find a way to handle the corrupt recovered hfiles
[
https://issues.apache.org/jira/browse/HBASE-23633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026669#comment-17026669
]
Pankaj Kumar commented on HBASE-23633:
--
In my test scenario all corrupted hfiles were of zero length. We should check &
delete zero length file during recovered hfile bulkload, the same way how it
handled while replaying edits,
{code}
private long loadRecoveredHFilesIfAny(Collection stores) throws
IOException {
Path regionDir = getWALRegionDir();
long maxSeqId = -1;
for (HStore store : stores) {
String familyName = store.getColumnFamilyName();
FileStatus[] files =
WALSplitUtil.getRecoveredHFiles(fs.getFileSystem(), regionDir,
familyName);
if (files != null && files.length != 0) {
for (FileStatus file : files) {
// Check and delete the zero length file
if (isZeroLengthThenDelete(fs.getFileSystem(), file.getPath())) {
continue;
}
store.assertBulkLoadHFileOk(file.getPath());
{code}
> Find a way to handle the corrupt recovered hfiles
> -
>
> Key: HBASE-23633
> URL: https://issues.apache.org/jira/browse/HBASE-23633
> Project: HBase
> Issue Type: Sub-task
>Reporter: Guanghao Zhang
>Priority: Major
>
> Copy the comment from PR review.
>
> If the file is a corrupt HFile, an exception will be thrown here, which will
> cause the region to fail to open.
> Maybe we can add a new parameter to control whether to skip the exception,
> similar to recover edits which has a parameter
> "hbase.hregion.edits.replay.skip.errors";
>
> Regions that can't be opened because of detached References or corrupt hfiles
> are a fact-of-life. We need work on this issue. This will be a new variant on
> the problem -- i.e. bad recovered hfiles.
> On adding a config to ignore bad files and just open, thats a bit dangerous
> as per @infraio as it could mean silent data loss.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on issue #1107: HBASE-23772 Removed deprecated getTimeStampOfLastShippedOp from MetricsSource
Apache-HBase commented on issue #1107: HBASE-23772 Removed deprecated getTimeStampOfLastShippedOp from MetricsSource URL: https://github.com/apache/hbase/pull/1107#issuecomment-580241991 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 8s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 56s | master passed | | +1 :green_heart: | compile | 0m 59s | master passed | | +1 :green_heart: | checkstyle | 1m 15s | master passed | | +1 :green_heart: | shadedjars | 5m 10s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 37s | master passed | | +0 :ok: | spotbugs | 4m 45s | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 :green_heart: | findbugs | 4m 42s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 53s | the patch passed | | +1 :green_heart: | compile | 1m 1s | the patch passed | | +1 :green_heart: | javac | 1m 1s | the patch passed | | +1 :green_heart: | checkstyle | 1m 12s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | shadedjars | 5m 18s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 18m 27s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. | | +1 :green_heart: | javadoc | 0m 39s | the patch passed | | +1 :green_heart: | findbugs | 5m 4s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 196m 29s | hbase-server in the patch failed. | | +1 :green_heart: | asflicense | 0m 38s | The patch does not generate ASF License warnings. | | | | 261m 40s | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.hbase.replication.TestReplicationDroppedTables | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1107/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/1107 | | Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile | | uname | Linux 7671f55df93c 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1107/out/precommit/personality/provided.sh | | git revision | master / 8b00f9f0b1 | | Default Java | 1.8.0_181 | | unit | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1107/1/artifact/out/patch-unit-hbase-server.txt | | Test Results | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1107/1/testReport/ | | Max. process+thread count | 5698 (vs. ulimit of 1) | | modules | C: hbase-server U: hbase-server | | Console output | https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1107/1/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (HBASE-23601) OutputSink.WriterThread exception gets stuck and repeated indefinietly
[
https://issues.apache.org/jira/browse/HBASE-23601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026640#comment-17026640
]
Peter Somogyi commented on HBASE-23601:
---
Backported the commit (the originally reverted commit ce7c559083) to branch-2.2
with updated commit message in a subtask.
> OutputSink.WriterThread exception gets stuck and repeated indefinietly
> --
>
> Key: HBASE-23601
> URL: https://issues.apache.org/jira/browse/HBASE-23601
> Project: HBase
> Issue Type: Bug
> Components: read replicas
>Affects Versions: 2.2.2
>Reporter: Szabolcs Bukros
>Assignee: Szabolcs Bukros
>Priority: Major
> Fix For: 3.0.0, 2.3.0
>
>
> When a WriterThread runs into an exception (ie: NotServingRegionException),
> the exception is stored in the controller. It is never removed and can not be
> overwritten either.
>
> {code:java}
> public void run() {
> try {
> doRun();
> } catch (Throwable t) {
> LOG.error("Exiting thread", t);
> controller.writerThreadError(t);
> }
> }{code}
> Thanks to this every time PipelineController.checkForErrors() is called the
> same old exception is rethrown.
>
> For example in RegionReplicaReplicationEndpoint.replicate there is a while
> loop that does the actual replicating. Every time it loops, it calls
> checkForErrors(), catches the rethrown exception, logs it but does nothing
> about it. This results in ~2GB log files in ~5min in my experience.
>
> My proposal would be to clean up the stored exception when it reaches
> RegionReplicaReplicationEndpoint.replicate and make sure we restart the
> WriterThread that died throwing it.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (HBASE-23773) Backport "HBASE-23601 OutputSink.WriterThread exception gets stuck and repeated indefinietly" to branch-2.2
[ https://issues.apache.org/jira/browse/HBASE-23773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Somogyi resolved HBASE-23773. --- Fix Version/s: 2.2.4 Resolution: Fixed Pushed to branch-2.2. Thanks for the investigation on this issue [~bszabolcs]! > Backport "HBASE-23601 OutputSink.WriterThread exception gets stuck and > repeated indefinietly" to branch-2.2 > --- > > Key: HBASE-23773 > URL: https://issues.apache.org/jira/browse/HBASE-23773 > Project: HBase > Issue Type: Sub-task >Affects Versions: 2.2.4 >Reporter: Peter Somogyi >Assignee: Peter Somogyi >Priority: Major > Fix For: 2.2.4 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23742) Mob Data, threshold crossed data is considering as normal data.
[ https://issues.apache.org/jira/browse/HBASE-23742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026633#comment-17026633 ] Pankaj Kumar commented on HBASE-23742: -- It will become more complex if BoundedRecoveredHFilesOutputSink write MOB to MOB-Hfile and create reference file to table store and bulk load the reference file during region open. IMO current implementation is okay, for the time being data will be written under the table path and during next compaction it will be moved to MOB path. > Mob Data, threshold crossed data is considering as normal data. > --- > > Key: HBASE-23742 > URL: https://issues.apache.org/jira/browse/HBASE-23742 > Project: HBase > Issue Type: Sub-task > Components: MTTR >Affects Versions: 3.0.0, 2.3.0 >Reporter: Y. SREENIVASULU REDDY >Priority: Minor > > Steps to reproduce this issue. > 1. create a table with 1 region, and mob enabled, keep threshold value to 5. > 2. Load data into the table, keep the value size should be more than 5. > 3. flush the table. > 4. observe the mobdir and data dir, hfiles should be there. > 5. load data again with different data set, keep the value size is greater > than 5. > 6. Kill -9 RS where table region is online > 7. Start RS > check the mob dir and data dir, both should have 2 hfiles each. > But data dir only have 2 hfiles, that means mob threshold crossed data is > considered as normal data. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-23773) Backport "HBASE-23601 OutputSink.WriterThread exception gets stuck and repeated indefinietly" to branch-2.2
Peter Somogyi created HBASE-23773: - Summary: Backport "HBASE-23601 OutputSink.WriterThread exception gets stuck and repeated indefinietly" to branch-2.2 Key: HBASE-23773 URL: https://issues.apache.org/jira/browse/HBASE-23773 Project: HBase Issue Type: Sub-task Affects Versions: 2.2.4 Reporter: Peter Somogyi Assignee: Peter Somogyi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23045) currentPath may be stitched in a loop in replication source code.
[
https://issues.apache.org/jira/browse/HBASE-23045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026611#comment-17026611
]
Hudson commented on HBASE-23045:
Results for branch branch-1
[build #1216 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1216/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1216//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk7 checks{color}
-- For more information [see jdk7
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1216//JDK7_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1216//JDK8_Nightly_Build_Report_(Hadoop2)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
> currentPath may be stitched in a loop in replication source code.
> --
>
> Key: HBASE-23045
> URL: https://issues.apache.org/jira/browse/HBASE-23045
> Project: HBase
> Issue Type: Bug
> Components: Replication
>Affects Versions: 1.2.6.1
>Reporter: kangkang.guo
>Assignee: kangkang.guo
>Priority: Critical
> Fix For: 1.2.6.1, 1.6.0
>
> Attachments: HBASE-23045.branch-1.000.patch,
> HBASE-23045.branch-1.000.patch, HBASE-23045.branch-1.2.0001.patch
>
>
> When the openReader encounters a FileNotFoundException, we may go to all
> possible directories to find the current hlog. When found, the path may be
> wrong, and it is looped together.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-23749) TestHFileWriterV3 should have tests for all data block encodings
[
https://issues.apache.org/jira/browse/HBASE-23749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026610#comment-17026610
]
Hudson commented on HBASE-23749:
Results for branch branch-1
[build #1216 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1216/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1216//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk7 checks{color}
-- For more information [see jdk7
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1216//JDK7_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1216//JDK8_Nightly_Build_Report_(Hadoop2)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
> TestHFileWriterV3 should have tests for all data block encodings
>
>
> Key: HBASE-23749
> URL: https://issues.apache.org/jira/browse/HBASE-23749
> Project: HBase
> Issue Type: Test
>Affects Versions: 3.0.0, 2.3.0, 1.6.0
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 1.6.0, 2.2.3, 2.1.9
>
>
> TestHFileWriterV3 tests include writing and reading HFiles for default data
> blocks encoding. However, since this test has efficient way of testing by
> looping through encoded/un-encoded keys and values and keeping offsets
> updated etc, it would be really good to have such test for each encoded data
> blocks. For that, we should explore using respective seekers e.g.
> RowIndexV1Seeker for ROW_INDEX_V1 encoded data blocks etc.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-22514) Move rsgroup feature into core of HBase
[
https://issues.apache.org/jira/browse/HBASE-22514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026538#comment-17026538
]
Hudson commented on HBASE-22514:
Results for branch HBASE-22514
[build #257 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22514/257/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22514/257//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22514/257//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-22514/257//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Move rsgroup feature into core of HBase
> ---
>
> Key: HBASE-22514
> URL: https://issues.apache.org/jira/browse/HBASE-22514
> Project: HBase
> Issue Type: Umbrella
> Components: Admin, Client, rsgroup
>Reporter: Yechao Chen
>Assignee: Duo Zhang
>Priority: Major
> Attachments: HBASE-22514.master.001.patch,
> image-2019-05-31-18-25-38-217.png
>
>
> The class RSGroupAdminClient is not public
> we need to use java api RSGroupAdminClient to manager RSG
> so RSGroupAdminClient should be public
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] HorizonNet opened a new pull request #1107: HBASE-23772 Removed deprecated getTimeStampOfLastShippedOp from MetricsSource
HorizonNet opened a new pull request #1107: HBASE-23772 Removed deprecated getTimeStampOfLastShippedOp from MetricsSource URL: https://github.com/apache/hbase/pull/1107 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (HBASE-23772) Remove deprecated getTimeStampOfLastShippedOp from MetricsSource
[
https://issues.apache.org/jira/browse/HBASE-23772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jan Hentschel updated HBASE-23772:
--
Status: Patch Available (was: In Progress)
> Remove deprecated getTimeStampOfLastShippedOp from MetricsSource
>
>
> Key: HBASE-23772
> URL: https://issues.apache.org/jira/browse/HBASE-23772
> Project: HBase
> Issue Type: Task
>Affects Versions: 3.0.0
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
>
> {{MetricsSource}} defines the deprecated method
> {{getTimeStampOfLastShippedOp}}, which should be removed for 3.0.0.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work started] (HBASE-23772) Remove deprecated getTimeStampOfLastShippedOp from MetricsSource
[
https://issues.apache.org/jira/browse/HBASE-23772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HBASE-23772 started by Jan Hentschel.
-
> Remove deprecated getTimeStampOfLastShippedOp from MetricsSource
>
>
> Key: HBASE-23772
> URL: https://issues.apache.org/jira/browse/HBASE-23772
> Project: HBase
> Issue Type: Task
>Affects Versions: 3.0.0
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
>
> {{MetricsSource}} defines the deprecated method
> {{getTimeStampOfLastShippedOp}}, which should be removed for 3.0.0.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HBASE-23772) Remove deprecated getTimeStampOfLastShippedOp from MetricsSource
Jan Hentschel created HBASE-23772:
-
Summary: Remove deprecated getTimeStampOfLastShippedOp from
MetricsSource
Key: HBASE-23772
URL: https://issues.apache.org/jira/browse/HBASE-23772
Project: HBase
Issue Type: Task
Affects Versions: 3.0.0
Reporter: Jan Hentschel
Assignee: Jan Hentschel
{{MetricsSource}} defines the deprecated method
{{getTimeStampOfLastShippedOp}}, which should be removed for 3.0.0.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
