[GitHub] [hbase] Apache-HBase commented on pull request #4891: HBASE-27483 Expose table and region storefiles accessed days and size to the metrics
Apache-HBase commented on PR #4891: URL: https://github.com/apache/hbase/pull/4891#issuecomment-1549080381 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 55s | Docker mode activated. | | -0 :warning: | yetus | 0m 4s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 10s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 1s | master passed | | +1 :green_heart: | compile | 0m 52s | master passed | | +1 :green_heart: | shadedjars | 4m 22s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 38s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 50s | the patch passed | | +1 :green_heart: | compile | 0m 53s | the patch passed | | +1 :green_heart: | javac | 0m 53s | the patch passed | | +1 :green_heart: | shadedjars | 4m 20s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 34s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 39s | hbase-hadoop-compat in the patch passed. | | +1 :green_heart: | unit | 221m 35s | hbase-server in the patch passed. | | | | 245m 27s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4891/5/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4891 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux d1ecf4fd9d1e 5.4.0-144-generic #161-Ubuntu SMP Fri Feb 3 14:49:04 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 93ddd7060d | | Default Java | Temurin-1.8.0_352-b08 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4891/5/testReport/ | | Max. process+thread count | 4165 (vs. ulimit of 3) | | modules | C: hbase-hadoop-compat hbase-server U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4891/5/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4891: HBASE-27483 Expose table and region storefiles accessed days and size to the metrics
Apache-HBase commented on PR #4891: URL: https://github.com/apache/hbase/pull/4891#issuecomment-1549072134 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 29s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 13s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 43s | master passed | | +1 :green_heart: | compile | 0m 54s | master passed | | +1 :green_heart: | shadedjars | 4m 46s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 34s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 3m 21s | the patch passed | | +1 :green_heart: | compile | 0m 55s | the patch passed | | +1 :green_heart: | javac | 0m 55s | the patch passed | | +1 :green_heart: | shadedjars | 4m 39s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 32s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 35s | hbase-hadoop-compat in the patch passed. | | -1 :x: | unit | 211m 45s | hbase-server in the patch failed. | | | | 236m 32s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4891/5/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4891 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 242752cd3bd1 5.4.0-1099-aws #107~18.04.1-Ubuntu SMP Fri Mar 17 16:49:05 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 93ddd7060d | | Default Java | Eclipse Adoptium-11.0.17+8 | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4891/5/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4891/5/testReport/ | | Max. process+thread count | 4675 (vs. ulimit of 3) | | modules | C: hbase-hadoop-compat hbase-server U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4891/5/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-27864) Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge
[
https://issues.apache.org/jira/browse/HBASE-27864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722996#comment-17722996
]
Hudson commented on HBASE-27864:
Results for branch branch-2
[build #812 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/812/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/812/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/812/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/812/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/812/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge
> --
>
> Key: HBASE-27864
> URL: https://issues.apache.org/jira/browse/HBASE-27864
> Project: HBase
> Issue Type: Task
> Components: test
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5, 2.4.18
>
>
> It also timed out on master branch.
> https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/839/
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27863) Add hadoop 3.3.5 check in our personality script
[
https://issues.apache.org/jira/browse/HBASE-27863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722994#comment-17722994
]
Hudson commented on HBASE-27863:
Results for branch branch-2
[build #812 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/812/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/812/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/812/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/812/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/812/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Add hadoop 3.3.5 check in our personality script
>
>
> Key: HBASE-27863
> URL: https://issues.apache.org/jira/browse/HBASE-27863
> Project: HBase
> Issue Type: Task
> Components: jenkins, scripts
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5, 2.4.18
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27865) TestThriftServerCmdLine fails with org.apache.hadoop.hbase.SystemExitRule$SystemExitInTestException
[
https://issues.apache.org/jira/browse/HBASE-27865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722995#comment-17722995
]
Hudson commented on HBASE-27865:
Results for branch branch-2
[build #812 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/812/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/812/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/812/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/812/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/812/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> TestThriftServerCmdLine fails with
> org.apache.hadoop.hbase.SystemExitRule$SystemExitInTestException
> ---
>
> Key: HBASE-27865
> URL: https://issues.apache.org/jira/browse/HBASE-27865
> Project: HBase
> Issue Type: Bug
> Components: test, Thrift
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5, 2.4.18
>
>
> https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/839/testReport/junit/org.apache.hadoop.hbase.thrift/TestThriftServerCmdLine/health_checks___yetus_jdk11_hadoop3_checks___testRunThriftServer_13_/
> {noformat}
> org.apache.hadoop.hbase.SystemExitRule$SystemExitInTestException
> at
> org.apache.hadoop.hbase.TestSecurityManager.checkExit(TestSecurityManager.java:32)
> at java.base/java.lang.Runtime.exit(Runtime.java:114)
> at java.base/java.lang.System.exit(System.java:1752)
> at
> org.apache.hadoop.hbase.thrift.ThriftServer$2.run(ThriftServer.java:850)
> at java.base/java.security.AccessController.doPrivileged(Native Method)
> at java.base/javax.security.auth.Subject.doAs(Subject.java:361)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1742)
> at
> org.apache.hadoop.hbase.thrift.ThriftServer.run(ThriftServer.java:836)
> at
> org.apache.hadoop.hbase.thrift.ThriftServerRunner.run(ThriftServerRunner.java:54)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27863) Add hadoop 3.3.5 check in our personality script
[
https://issues.apache.org/jira/browse/HBASE-27863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722978#comment-17722978
]
Hudson commented on HBASE-27863:
Results for branch branch-2.4
[build #559 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/559/]:
(/) *{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/559/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/559/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/559/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/559/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Add hadoop 3.3.5 check in our personality script
>
>
> Key: HBASE-27863
> URL: https://issues.apache.org/jira/browse/HBASE-27863
> Project: HBase
> Issue Type: Task
> Components: jenkins, scripts
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5, 2.4.18
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27864) Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge
[
https://issues.apache.org/jira/browse/HBASE-27864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722980#comment-17722980
]
Hudson commented on HBASE-27864:
Results for branch branch-2.4
[build #559 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/559/]:
(/) *{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/559/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/559/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/559/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/559/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge
> --
>
> Key: HBASE-27864
> URL: https://issues.apache.org/jira/browse/HBASE-27864
> Project: HBase
> Issue Type: Task
> Components: test
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5, 2.4.18
>
>
> It also timed out on master branch.
> https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/839/
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27865) TestThriftServerCmdLine fails with org.apache.hadoop.hbase.SystemExitRule$SystemExitInTestException
[
https://issues.apache.org/jira/browse/HBASE-27865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722979#comment-17722979
]
Hudson commented on HBASE-27865:
Results for branch branch-2.4
[build #559 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/559/]:
(/) *{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/559/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/559/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/559/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/559/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> TestThriftServerCmdLine fails with
> org.apache.hadoop.hbase.SystemExitRule$SystemExitInTestException
> ---
>
> Key: HBASE-27865
> URL: https://issues.apache.org/jira/browse/HBASE-27865
> Project: HBase
> Issue Type: Bug
> Components: test, Thrift
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5, 2.4.18
>
>
> https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/839/testReport/junit/org.apache.hadoop.hbase.thrift/TestThriftServerCmdLine/health_checks___yetus_jdk11_hadoop3_checks___testRunThriftServer_13_/
> {noformat}
> org.apache.hadoop.hbase.SystemExitRule$SystemExitInTestException
> at
> org.apache.hadoop.hbase.TestSecurityManager.checkExit(TestSecurityManager.java:32)
> at java.base/java.lang.Runtime.exit(Runtime.java:114)
> at java.base/java.lang.System.exit(System.java:1752)
> at
> org.apache.hadoop.hbase.thrift.ThriftServer$2.run(ThriftServer.java:850)
> at java.base/java.security.AccessController.doPrivileged(Native Method)
> at java.base/javax.security.auth.Subject.doAs(Subject.java:361)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1742)
> at
> org.apache.hadoop.hbase.thrift.ThriftServer.run(ThriftServer.java:836)
> at
> org.apache.hadoop.hbase.thrift.ThriftServerRunner.run(ThriftServerRunner.java:54)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[GitHub] [hbase] Apache-HBase commented on pull request #4891: HBASE-27483 Expose table and region storefiles accessed days and size to the metrics
Apache-HBase commented on PR #4891: URL: https://github.com/apache/hbase/pull/4891#issuecomment-1548920691 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 25s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 18s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 25s | master passed | | +1 :green_heart: | compile | 2m 42s | master passed | | +1 :green_heart: | checkstyle | 0m 40s | master passed | | +1 :green_heart: | spotless | 0m 40s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 45s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 10s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 3m 22s | the patch passed | | +1 :green_heart: | compile | 2m 42s | the patch passed | | +1 :green_heart: | javac | 2m 42s | the patch passed | | +1 :green_heart: | checkstyle | 0m 41s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 13m 14s | Patch does not cause any errors with Hadoop 3.2.4 3.3.5. | | +1 :green_heart: | spotless | 0m 40s | patch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 2m 5s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 15s | The patch does not generate ASF License warnings. | | | | 40m 50s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4891/5/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4891 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux b422b054b1d8 5.4.0-1097-aws #105~18.04.1-Ubuntu SMP Mon Feb 13 17:50:57 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 93ddd7060d | | Default Java | Eclipse Adoptium-11.0.17+8 | | Max. process+thread count | 85 (vs. ulimit of 3) | | modules | C: hbase-hadoop-compat hbase-server U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4891/5/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] 2005hithlj commented on a diff in pull request #4891: HBASE-27483 Expose table and region storefiles accessed days and size to the metrics
2005hithlj commented on code in PR #4891:
URL: https://github.com/apache/hbase/pull/4891#discussion_r1194541848
##
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsTableWrapperAggregateImpl.java:
##
@@ -115,10 +134,23 @@ public void run() {
// accumulate the count
mt.perStoreMemstoreOnlyReadCount.put(tempKey, memstoreReadCount);
mt.perStoreMixedReadCount.put(tempKey, mixedReadCount);
+Map> sfAccessTimeAndSizeMap =
+ store.getStoreFilesAccessTimeAndSize();
+Long now = EnvironmentEdgeManager.currentTime();
+for (Pair pair : sfAccessTimeAndSizeMap.values()) {
+ Long accessTime = pair.getFirst();
+ Long size = pair.getSecond();
+ for (int threshold : storeFilesAccessedDaysThresholds) {
+Long sumSize = mt.storeFilesAccessedDaysAndSize.get(threshold);
+if ((now - accessTime) >= threshold * ONE_DAY_MS) {
Review Comment:
Ok, sir.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hbase] Apache9 commented on a diff in pull request #4891: HBASE-27483 Expose table and region storefiles accessed days and size to the metrics
Apache9 commented on code in PR #4891:
URL: https://github.com/apache/hbase/pull/4891#discussion_r1194536872
##
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsTableWrapperAggregateImpl.java:
##
@@ -115,10 +134,23 @@ public void run() {
// accumulate the count
mt.perStoreMemstoreOnlyReadCount.put(tempKey, memstoreReadCount);
mt.perStoreMixedReadCount.put(tempKey, mixedReadCount);
+Map> sfAccessTimeAndSizeMap =
+ store.getStoreFilesAccessTimeAndSize();
+Long now = EnvironmentEdgeManager.currentTime();
+for (Pair pair : sfAccessTimeAndSizeMap.values()) {
+ Long accessTime = pair.getFirst();
+ Long size = pair.getSecond();
+ for (int threshold : storeFilesAccessedDaysThresholds) {
+Long sumSize = mt.storeFilesAccessedDaysAndSize.get(threshold);
+if ((now - accessTime) >= threshold * ONE_DAY_MS) {
Review Comment:
OK, so the metric here is 'the number if store files which are not accessed
by at least xx days'? Then I think we;d better have a better name for it?
Looking at 'storeFilesAccessedDays', I can not get the meaning unless you
explain it...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Commented] (HBASE-27451) Setup nightly job for s390x node
[ https://issues.apache.org/jira/browse/HBASE-27451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722971#comment-17722971 ] Duo Zhang commented on HBASE-27451: --- https://ci-hbase.apache.org/job/HBase-Nightly-s390x/50 > Setup nightly job for s390x node > > > Key: HBASE-27451 > URL: https://issues.apache.org/jira/browse/HBASE-27451 > Project: HBase > Issue Type: Sub-task > Components: community, jenkins >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-27451) Setup nightly job for s390x node
[ https://issues.apache.org/jira/browse/HBASE-27451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722970#comment-17722970 ] Duo Zhang commented on HBASE-27451: --- Let me try. > Setup nightly job for s390x node > > > Key: HBASE-27451 > URL: https://issues.apache.org/jira/browse/HBASE-27451 > Project: HBase > Issue Type: Sub-task > Components: community, jenkins >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[GitHub] [hbase] 2005hithlj commented on a diff in pull request #4891: HBASE-27483 Expose table and region storefiles accessed days and size to the metrics
2005hithlj commented on code in PR #4891:
URL: https://github.com/apache/hbase/pull/4891#discussion_r1057235274
##
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java:
##
@@ -1780,6 +1781,29 @@ public OptionalDouble getAvgStoreFileAge() {
return getStoreFileAgeStream().average();
}
+ @Override
+ public Map> getStoreFilesAccessTimeAndSize() {
+Collection storeFiles =
this.storeEngine.getStoreFileManager().getStorefiles();
+Map> sfAccessTimeAndSizeMap = new HashMap<>();
+for (HStoreFile sf : storeFiles) {
+ if (sf.getReader() == null) {
+continue;
+ }
+ FileStatus fileStatus;
+ try {
+fileStatus = sf.getFileInfo().getFileStatus();
Review Comment:
@Apache9 sir.
Yes, this is really a serious problem.
Can we solve this problem by periodically accessing NN randomly, for
example, accessing it every hour or more to get fileStatus, so as to reduce
the pressure on the NN?
##
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsTableWrapperAggregateImpl.java:
##
@@ -115,10 +134,23 @@ public void run() {
// accumulate the count
mt.perStoreMemstoreOnlyReadCount.put(tempKey, memstoreReadCount);
mt.perStoreMixedReadCount.put(tempKey, mixedReadCount);
+Map> sfAccessTimeAndSizeMap =
+ store.getStoreFilesAccessTimeAndSize();
+Long now = EnvironmentEdgeManager.currentTime();
+for (Pair pair : sfAccessTimeAndSizeMap.values()) {
+ Long accessTime = pair.getFirst();
+ Long size = pair.getSecond();
+ for (int threshold : storeFilesAccessedDaysThresholds) {
+Long sumSize = mt.storeFilesAccessedDaysAndSize.get(threshold);
+if ((now - accessTime) >= threshold * ONE_DAY_MS) {
Review Comment:
@Apache9 sir.
Yes, this is by design. For instance, if an HFile has not been accessed for
90 days, it is certain that it has also not been accessed for 30 and 7 days.
And what is your suggestion?
##
hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionSource.java:
##
@@ -56,6 +56,8 @@ public interface MetricsRegionSource extends
Comparable {
String ROW_READS_ONLY_ON_MEMSTORE_DESC = "Row reads happening completely out
of memstore";
String MIXED_ROW_READS = "mixedRowReadsCount";
String MIXED_ROW_READS_ON_STORE_DESC = "Row reads happening out of files and
memstore on store";
+ String STOREFILES_ACCESSED_DAYS_AND_SIZE = "storeFilesAccessed%sDaysSize";
Review Comment:
OK, sir
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #5239: HBASE-27867 Close the L1 victim handler race
Apache-HBase commented on PR #5239: URL: https://github.com/apache/hbase/pull/5239#issuecomment-1548877623 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 35s | Docker mode activated. | | -0 :warning: | yetus | 0m 2s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 40s | master passed | | +1 :green_heart: | compile | 0m 51s | master passed | | +1 :green_heart: | shadedjars | 5m 17s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 29s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 21s | the patch passed | | +1 :green_heart: | compile | 0m 46s | the patch passed | | +1 :green_heart: | javac | 0m 46s | the patch passed | | +1 :green_heart: | shadedjars | 5m 4s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 26s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 262m 12s | hbase-server in the patch failed. | | | | 288m 41s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5239/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5239 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 7a2c55fabd40 5.4.0-144-generic #161-Ubuntu SMP Fri Feb 3 14:49:04 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 93ddd7060d | | Default Java | Temurin-1.8.0_352-b08 | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5239/1/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5239/1/testReport/ | | Max. process+thread count | 4460 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5239/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #5240: HBASE-27843 If moveAndClose fails HFileArchiver should delete any incomplete archive side changes
Apache-HBase commented on PR #5240: URL: https://github.com/apache/hbase/pull/5240#issuecomment-1548867091 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 54s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 4s | master passed | | +1 :green_heart: | compile | 0m 39s | master passed | | +1 :green_heart: | shadedjars | 4m 19s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 25s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 54s | the patch passed | | +1 :green_heart: | compile | 0m 40s | the patch passed | | +1 :green_heart: | javac | 0m 40s | the patch passed | | +1 :green_heart: | shadedjars | 4m 20s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 23s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 222m 18s | hbase-server in the patch failed. | | | | 244m 24s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5240/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5240 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 30a8ecabb091 5.4.0-144-generic #161-Ubuntu SMP Fri Feb 3 14:49:04 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 93ddd7060d | | Default Java | Temurin-1.8.0_352-b08 | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5240/1/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5240/1/testReport/ | | Max. process+thread count | 4437 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5240/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #5240: HBASE-27843 If moveAndClose fails HFileArchiver should delete any incomplete archive side changes
Apache-HBase commented on PR #5240: URL: https://github.com/apache/hbase/pull/5240#issuecomment-1548865107 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 36s | Docker mode activated. | | -0 :warning: | yetus | 0m 2s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 52s | master passed | | +1 :green_heart: | compile | 1m 3s | master passed | | +1 :green_heart: | shadedjars | 5m 34s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 35s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 9s | the patch passed | | +1 :green_heart: | compile | 0m 53s | the patch passed | | +1 :green_heart: | javac | 0m 53s | the patch passed | | +1 :green_heart: | shadedjars | 5m 30s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 27s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 211m 21s | hbase-server in the patch passed. | | | | 240m 58s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5240/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5240 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux c62d7b445b30 5.4.0-1099-aws #107~18.04.1-Ubuntu SMP Fri Mar 17 16:49:05 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 93ddd7060d | | Default Java | Eclipse Adoptium-11.0.17+8 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5240/1/testReport/ | | Max. process+thread count | 4654 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5240/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #5239: HBASE-27867 Close the L1 victim handler race
Apache-HBase commented on PR #5239: URL: https://github.com/apache/hbase/pull/5239#issuecomment-1548841271 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 15s | Docker mode activated. | | -0 :warning: | yetus | 0m 2s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 38s | master passed | | +1 :green_heart: | compile | 0m 48s | master passed | | +1 :green_heart: | shadedjars | 4m 25s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 28s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 30s | the patch passed | | +1 :green_heart: | compile | 0m 46s | the patch passed | | +1 :green_heart: | javac | 0m 47s | the patch passed | | +1 :green_heart: | shadedjars | 4m 28s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 25s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 215m 33s | hbase-server in the patch passed. | | | | 238m 45s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5239/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5239 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux cb057cd2526a 5.4.0-144-generic #161-Ubuntu SMP Fri Feb 3 14:49:04 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 93ddd7060d | | Default Java | Eclipse Adoptium-11.0.17+8 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5239/1/testReport/ | | Max. process+thread count | 4355 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5239/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Comment Edited] (HBASE-27451) Setup nightly job for s390x node
[
https://issues.apache.org/jira/browse/HBASE-27451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722945#comment-17722945
]
Jonathan Albrecht edited comment on HBASE-27451 at 5/15/23 11:16 PM:
-
I was able to get a VM similar to the s390x Jenkins nodes and have been working
on the why the builds have been hanging. I was able to reproduce the behavior
and with two of the PRs that were recently merged I haven't seen the builds
hanging in my local testing on s390x.
[~zhangduo], could I get you to add or update a MAVEN_OPTS env var in the s390x
nightly build script like:
{{export MAVEN_OPTS='-Xmx3100M'}}
and also add the --batch-mode option to the mvn command lines?
Then I think it should be safe to re-enable the nightly s390x build.
Refs:
[https://github.com/apache/hbase/pull/5231]
[https://github.com/apache/hbase/pull/5234]
was (Author: jonathan.albrecht):
I was able to get a VM similar to the s390x Jenkins nodes and have been working
on the why the builds have been hanging. I was able to reproduce the behavior
and with two of the PRs that were recently merged I haven't seen the builds
hanging in my local testing on s390x.
[~zhangduo], could I get you to add or update a MAVEN_OPTS env var in the s390x
nightly build script like:
{{}}
{{export MAVEN_OPTS='-Xmx3100M'}}
and also add the --batch-mode option to the mvn command lines?
Then I think it should be safe to re-enable the nightly s390x build.
Refs:
[https://github.com/apache/hbase/pull/5231]
[https://github.com/apache/hbase/pull/5234]
> Setup nightly job for s390x node
>
>
> Key: HBASE-27451
> URL: https://issues.apache.org/jira/browse/HBASE-27451
> Project: HBase
> Issue Type: Sub-task
> Components: community, jenkins
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27451) Setup nightly job for s390x node
[
https://issues.apache.org/jira/browse/HBASE-27451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722945#comment-17722945
]
Jonathan Albrecht commented on HBASE-27451:
---
I was able to get a VM similar to the s390x Jenkins nodes and have been working
on the why the builds have been hanging. I was able to reproduce the behavior
and with two of the PRs that were recently merged I haven't seen the builds
hanging in my local testing on s390x.
[~zhangduo], could I get you to add or update a MAVEN_OPTS env var in the s390x
nightly build script like:
{{}}
{{export MAVEN_OPTS='-Xmx3100M'}}
and also add the --batch-mode option to the mvn command lines?
Then I think it should be safe to re-enable the nightly s390x build.
Refs:
[https://github.com/apache/hbase/pull/5231]
[https://github.com/apache/hbase/pull/5234]
> Setup nightly job for s390x node
>
>
> Key: HBASE-27451
> URL: https://issues.apache.org/jira/browse/HBASE-27451
> Project: HBase
> Issue Type: Sub-task
> Components: community, jenkins
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[GitHub] [hbase] Apache-HBase commented on pull request #5240: HBASE-27843 If moveAndClose fails HFileArchiver should delete any incomplete archive side changes
Apache-HBase commented on PR #5240: URL: https://github.com/apache/hbase/pull/5240#issuecomment-1548734182 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 34s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 50s | master passed | | +1 :green_heart: | compile | 3m 12s | master passed | | +1 :green_heart: | checkstyle | 0m 38s | master passed | | +1 :green_heart: | spotless | 0m 50s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 42s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 14s | the patch passed | | +1 :green_heart: | compile | 2m 58s | the patch passed | | +1 :green_heart: | javac | 2m 58s | the patch passed | | +1 :green_heart: | checkstyle | 0m 36s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 20m 33s | Patch does not cause any errors with Hadoop 3.2.4 3.3.5. | | +1 :green_heart: | spotless | 0m 49s | patch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 50s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 12s | The patch does not generate ASF License warnings. | | | | 56m 35s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5240/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5240 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux 3181392950a6 5.4.0-1099-aws #107~18.04.1-Ubuntu SMP Fri Mar 17 16:49:05 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 93ddd7060d | | Default Java | Eclipse Adoptium-11.0.17+8 | | Max. process+thread count | 85 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5240/1/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #5239: HBASE-27867 Close the L1 victim handler race
Apache-HBase commented on PR #5239: URL: https://github.com/apache/hbase/pull/5239#issuecomment-1548698471 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 4s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 0s | master passed | | +1 :green_heart: | compile | 2m 45s | master passed | | +1 :green_heart: | checkstyle | 0m 41s | master passed | | -1 :x: | spotless | 0m 52s | branch has 1 errors when running spotless:check, run spotless:apply to fix. | | +1 :green_heart: | spotbugs | 1m 58s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 15s | the patch passed | | +1 :green_heart: | compile | 2m 59s | the patch passed | | +1 :green_heart: | javac | 2m 59s | the patch passed | | +1 :green_heart: | checkstyle | 0m 45s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 15m 4s | Patch does not cause any errors with Hadoop 3.2.4 3.3.5. | | +1 :green_heart: | spotless | 0m 48s | patch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 2m 11s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 10s | The patch does not generate ASF License warnings. | | | | 46m 40s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5239/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5239 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux 9467bcfc65f6 5.4.0-144-generic #161-Ubuntu SMP Fri Feb 3 14:49:04 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 93ddd7060d | | Default Java | Eclipse Adoptium-11.0.17+8 | | spotless | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5239/1/artifact/yetus-general-check/output/branch-spotless.txt | | Max. process+thread count | 86 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5239/1/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-27843) If moveAndClose fails HFileArchiver should delete any incomplete archive side changes
[ https://issues.apache.org/jira/browse/HBASE-27843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-27843: Fix Version/s: 2.6.0 3.0.0-alpha-4 2.5.5 Assignee: Andrew Kyle Purtell Status: Patch Available (was: Open) > If moveAndClose fails HFileArchiver should delete any incomplete archive side > changes > - > > Key: HBASE-27843 > URL: https://issues.apache.org/jira/browse/HBASE-27843 > Project: HBase > Issue Type: Sub-task >Affects Versions: 2.5.4 >Reporter: Andrew Kyle Purtell >Assignee: Andrew Kyle Purtell >Priority: Major > Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5 > > > See parent for motivation. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[GitHub] [hbase] apurtell opened a new pull request, #5240: HBASE-27843 If moveAndClose fails HFileArchiver should delete any incomplete archive side changes
apurtell opened a new pull request, #5240: URL: https://github.com/apache/hbase/pull/5240 When HFiles are placed on a filesystem other than HDFS a rename operation can be a non-atomic file copy operation. It can take a long time to copy a large hfile and if interrupted there may be a partially copied file present at the destination. If we fail to “rename” the files into the archive we will continue to fail indefinitely. Before larger changes are considered, perhaps to StoreFileTracker, we should mitigate this problem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-27867) Close the L1 victim handler race
[ https://issues.apache.org/jira/browse/HBASE-27867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-27867: Status: Patch Available (was: Open) > Close the L1 victim handler race > > > Key: HBASE-27867 > URL: https://issues.apache.org/jira/browse/HBASE-27867 > Project: HBase > Issue Type: Bug > Components: BlockCache >Affects Versions: 2.5.4 >Reporter: Andrew Kyle Purtell >Assignee: Andrew Kyle Purtell >Priority: Minor > Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5 > > > When we evict a block from L1 and move it to L2 there is a brief window of > time where we have removed the block from the L1 map and yet the victim > handler has not completed execution. Some read-your-write use cases can be > significantly impacted even though the window is small. Imagine a use case > where PRELOAD_DATA_ON_OPEN and CACHE_DATA_ON_WRITE are both enabled to warm > cache ahead of access and any miss can be problematic. Perhaps a particularly > latency sensitive case with HFiles backed by S3. > Victim handling can be made atomic with respect to the unmapping operation > with ConcurrentHashMap#computeIfPresent. The upside is there will be no L1+L2 > misses during the transition. The downside is if the victim handler takes a > long time to execute -- currently they are all very fast, so only a > theoretical risk -- then other removals or insertions in L1 can block until > it completes. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-27867) Close the L1 victim handler race
[ https://issues.apache.org/jira/browse/HBASE-27867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-27867: Priority: Minor (was: Major) > Close the L1 victim handler race > > > Key: HBASE-27867 > URL: https://issues.apache.org/jira/browse/HBASE-27867 > Project: HBase > Issue Type: Bug > Components: BlockCache >Affects Versions: 2.5.4 >Reporter: Andrew Kyle Purtell >Assignee: Andrew Kyle Purtell >Priority: Minor > Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5 > > > When we evict a block from L1 and move it to L2 there is a brief window of > time where we have removed the block from the L1 map and yet the victim > handler has not completed execution. Some read-your-write use cases can be > significantly impacted even though the window is small. Imagine a use case > where PRELOAD_DATA_ON_OPEN and CACHE_DATA_ON_WRITE are both enabled to warm > cache ahead of access and any miss can be problematic. Perhaps a particularly > latency sensitive case with HFiles backed by S3. > Victim handling can be made atomic with respect to the unmapping operation > with ConcurrentHashMap#computeIfPresent. The upside is there will be no L1+L2 > misses during the transition. The downside is if the victim handler takes a > long time to execute -- currently they are all very fast, so only a > theoretical risk -- then other removals or insertions in L1 can block until > it completes. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HBASE-27867) Close the L1 victim handler race
Andrew Kyle Purtell created HBASE-27867: --- Summary: Close the L1 victim handler race Key: HBASE-27867 URL: https://issues.apache.org/jira/browse/HBASE-27867 Project: HBase Issue Type: Bug Components: BlockCache Affects Versions: 2.5.4 Reporter: Andrew Kyle Purtell Assignee: Andrew Kyle Purtell Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5 When we evict a block from L1 and move it to L2 there is a brief window of time where we have removed the block from the L1 map and yet the victim handler has not completed execution. Some read-your-write use cases can be significantly impacted even though the window is small. Imagine a use case where PRELOAD_DATA_ON_OPEN and CACHE_DATA_ON_WRITE are both enabled to warm cache ahead of access and any miss can be problematic. Perhaps a particularly latency sensitive case with HFiles backed by S3. Victim handling can be made atomic with respect to the unmapping operation with ConcurrentHashMap#computeIfPresent. The upside is there will be no L1+L2 misses during the transition. The downside is if the victim handler takes a long time to execute -- currently they are all very fast, so only a theoretical risk -- then other removals or insertions in L1 can block until it completes. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-27865) TestThriftServerCmdLine fails with org.apache.hadoop.hbase.SystemExitRule$SystemExitInTestException
[
https://issues.apache.org/jira/browse/HBASE-27865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722917#comment-17722917
]
Hudson commented on HBASE-27865:
Results for branch branch-2.5
[build #352 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/352/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/352/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/352/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/352/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/352/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> TestThriftServerCmdLine fails with
> org.apache.hadoop.hbase.SystemExitRule$SystemExitInTestException
> ---
>
> Key: HBASE-27865
> URL: https://issues.apache.org/jira/browse/HBASE-27865
> Project: HBase
> Issue Type: Bug
> Components: test, Thrift
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5, 2.4.18
>
>
> https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/839/testReport/junit/org.apache.hadoop.hbase.thrift/TestThriftServerCmdLine/health_checks___yetus_jdk11_hadoop3_checks___testRunThriftServer_13_/
> {noformat}
> org.apache.hadoop.hbase.SystemExitRule$SystemExitInTestException
> at
> org.apache.hadoop.hbase.TestSecurityManager.checkExit(TestSecurityManager.java:32)
> at java.base/java.lang.Runtime.exit(Runtime.java:114)
> at java.base/java.lang.System.exit(System.java:1752)
> at
> org.apache.hadoop.hbase.thrift.ThriftServer$2.run(ThriftServer.java:850)
> at java.base/java.security.AccessController.doPrivileged(Native Method)
> at java.base/javax.security.auth.Subject.doAs(Subject.java:361)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1742)
> at
> org.apache.hadoop.hbase.thrift.ThriftServer.run(ThriftServer.java:836)
> at
> org.apache.hadoop.hbase.thrift.ThriftServerRunner.run(ThriftServerRunner.java:54)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27864) Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge
[
https://issues.apache.org/jira/browse/HBASE-27864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722918#comment-17722918
]
Hudson commented on HBASE-27864:
Results for branch branch-2.5
[build #352 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/352/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/352/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/352/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/352/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/352/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge
> --
>
> Key: HBASE-27864
> URL: https://issues.apache.org/jira/browse/HBASE-27864
> Project: HBase
> Issue Type: Task
> Components: test
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5, 2.4.18
>
>
> It also timed out on master branch.
> https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/839/
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27863) Add hadoop 3.3.5 check in our personality script
[
https://issues.apache.org/jira/browse/HBASE-27863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722916#comment-17722916
]
Hudson commented on HBASE-27863:
Results for branch branch-2.5
[build #352 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/352/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/352/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/352/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/352/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/352/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Add hadoop 3.3.5 check in our personality script
>
>
> Key: HBASE-27863
> URL: https://issues.apache.org/jira/browse/HBASE-27863
> Project: HBase
> Issue Type: Task
> Components: jenkins, scripts
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5, 2.4.18
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27865) TestThriftServerCmdLine fails with org.apache.hadoop.hbase.SystemExitRule$SystemExitInTestException
[
https://issues.apache.org/jira/browse/HBASE-27865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722912#comment-17722912
]
Hudson commented on HBASE-27865:
Results for branch master
[build #841 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/841/]:
(/) *{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/841/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/841/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/841/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> TestThriftServerCmdLine fails with
> org.apache.hadoop.hbase.SystemExitRule$SystemExitInTestException
> ---
>
> Key: HBASE-27865
> URL: https://issues.apache.org/jira/browse/HBASE-27865
> Project: HBase
> Issue Type: Bug
> Components: test, Thrift
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5, 2.4.18
>
>
> https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/839/testReport/junit/org.apache.hadoop.hbase.thrift/TestThriftServerCmdLine/health_checks___yetus_jdk11_hadoop3_checks___testRunThriftServer_13_/
> {noformat}
> org.apache.hadoop.hbase.SystemExitRule$SystemExitInTestException
> at
> org.apache.hadoop.hbase.TestSecurityManager.checkExit(TestSecurityManager.java:32)
> at java.base/java.lang.Runtime.exit(Runtime.java:114)
> at java.base/java.lang.System.exit(System.java:1752)
> at
> org.apache.hadoop.hbase.thrift.ThriftServer$2.run(ThriftServer.java:850)
> at java.base/java.security.AccessController.doPrivileged(Native Method)
> at java.base/javax.security.auth.Subject.doAs(Subject.java:361)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1742)
> at
> org.apache.hadoop.hbase.thrift.ThriftServer.run(ThriftServer.java:836)
> at
> org.apache.hadoop.hbase.thrift.ThriftServerRunner.run(ThriftServerRunner.java:54)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27863) Add hadoop 3.3.5 check in our personality script
[
https://issues.apache.org/jira/browse/HBASE-27863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722911#comment-17722911
]
Hudson commented on HBASE-27863:
Results for branch master
[build #841 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/841/]:
(/) *{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/841/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/841/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/841/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Add hadoop 3.3.5 check in our personality script
>
>
> Key: HBASE-27863
> URL: https://issues.apache.org/jira/browse/HBASE-27863
> Project: HBase
> Issue Type: Task
> Components: jenkins, scripts
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5, 2.4.18
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27864) Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge
[
https://issues.apache.org/jira/browse/HBASE-27864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722913#comment-17722913
]
Hudson commented on HBASE-27864:
Results for branch master
[build #841 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/841/]:
(/) *{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/841/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/841/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/841/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge
> --
>
> Key: HBASE-27864
> URL: https://issues.apache.org/jira/browse/HBASE-27864
> Project: HBase
> Issue Type: Task
> Components: test
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.5, 2.4.18
>
>
> It also timed out on master branch.
> https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/839/
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[GitHub] [hbase] Apache-HBase commented on pull request #5229: HBASE-27793 Make HBCK be able to report unknown servers
Apache-HBase commented on PR #5229: URL: https://github.com/apache/hbase/pull/5229#issuecomment-1548127816 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 23s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 27s | master passed | | +1 :green_heart: | compile | 1m 1s | master passed | | +1 :green_heart: | shadedjars | 5m 14s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 41s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 47s | the patch passed | | +1 :green_heart: | compile | 0m 58s | the patch passed | | +1 :green_heart: | javac | 0m 58s | the patch passed | | +1 :green_heart: | shadedjars | 5m 18s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 38s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 222m 1s | hbase-server in the patch failed. | | | | 251m 50s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5229/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5229 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 6a6499dbcee2 5.4.0-144-generic #161-Ubuntu SMP Fri Feb 3 14:49:04 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 8b8c684bcc | | Default Java | Eclipse Adoptium-11.0.17+8 | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5229/2/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5229/2/testReport/ | | Max. process+thread count | 4602 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5229/2/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Assigned] (HBASE-20448) update ref guide to expressly use shaded clients for examples
[ https://issues.apache.org/jira/browse/HBASE-20448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey reassigned HBASE-20448: --- Assignee: (was: Sean Busbey) > update ref guide to expressly use shaded clients for examples > - > > Key: HBASE-20448 > URL: https://issues.apache.org/jira/browse/HBASE-20448 > Project: HBase > Issue Type: Improvement > Components: Client, documentation, mapreduce >Reporter: Sean Busbey >Priority: Blocker > Fix For: 3.0.0-alpha-4 > > > the whole mapreduce section, especially, should be using the shaded version. > Specifically include an example of running the ITBLL we ship -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (HBASE-20650) Revisit the HBaseTestingUtility related classes
[ https://issues.apache.org/jira/browse/HBASE-20650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-20650. --- Fix Version/s: (was: 3.0.0-alpha-4) Resolution: Duplicate Resolve as duplicated. > Revisit the HBaseTestingUtility related classes > --- > > Key: HBASE-20650 > URL: https://issues.apache.org/jira/browse/HBASE-20650 > Project: HBase > Issue Type: Umbrella >Reporter: Duo Zhang >Priority: Major > > They are marked as IA.Public because lots of users use them to write UTs. The > problem here is that, they are classes, not interfaces, so it will be a bit > hard for us to keep compatibility. And also, MiniHBaseCluster is marked as > IA.Public, and it is a class instead of a interface, and another strange > thing is that, its parent class, HBaseCluster, is marked as IA.Private. > We need to revisit the design here to make it clean... -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HBASE-26080) Implement a new mini cluster class for end users
[ https://issues.apache.org/jira/browse/HBASE-26080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang reassigned HBASE-26080: - Assignee: Duo Zhang (was: Tao Li) > Implement a new mini cluster class for end users > > > Key: HBASE-26080 > URL: https://issues.apache.org/jira/browse/HBASE-26080 > Project: HBase > Issue Type: Sub-task > Components: API, test >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Fix For: 2.5.0, 3.0.0-alpha-2 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (HBASE-20779) Server version is not right when enable TABLES_ON_MASTER
[ https://issues.apache.org/jira/browse/HBASE-20779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-20779. --- Resolution: Not A Problem Resolve as we do not want master to carry regions now. > Server version is not right when enable TABLES_ON_MASTER > > > Key: HBASE-20779 > URL: https://issues.apache.org/jira/browse/HBASE-20779 > Project: HBase > Issue Type: Bug >Reporter: Guanghao Zhang >Priority: Major > > When enable TABLES_ON_MASTER, master will be a region server to carry > regions. So it will report to itself, too. And we get server version from rpc > call. But master report to itself will skip rpc call. Then ServerManager will > record a wrong version 0. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (HBASE-19831) Regions on the Master Redux
[ https://issues.apache.org/jira/browse/HBASE-19831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-19831. --- Fix Version/s: (was: 3.0.0-alpha-4) Resolution: Won't Fix Resolve as we do not want master to carry regions now. > Regions on the Master Redux > --- > > Key: HBASE-19831 > URL: https://issues.apache.org/jira/browse/HBASE-19831 > Project: HBase > Issue Type: Sub-task >Reporter: Michael Stack >Priority: Major > > HBASE-10569 made it so Master could host Regions. It was done a long time ago > (before hbase-1.0.0). This option was used in a few instances. > Come hbase-2.0.0, we've found that master-as-regionserver has problems. This > is an umbrella issue to address problems found. Meantime, > master-as-regionserver is broke. > In particular, the startup sequence needs redo – the bit where the Master > checks in as a RegionServer in time to be factored as a Server when the > balancer first runs. Then there is what to do about changing state in AMv2. > Region state is locked when changed. Currently it can involve an RPC to > hbase:meta. If problem contacting other Server, the lock on region state can > last a long time shutting out Master function. What should we do w/ backup > Masters? They should host regions too. And so on. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (HBASE-19785) System Regions on the Master is broken
[ https://issues.apache.org/jira/browse/HBASE-19785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-19785. --- Assignee: (was: Michael Stack) Resolution: Not A Problem We do not allow regions on master now. Resolve as not a problem. > System Regions on the Master is broken > -- > > Key: HBASE-19785 > URL: https://issues.apache.org/jira/browse/HBASE-19785 > Project: HBase > Issue Type: Sub-task >Reporter: Michael Stack >Priority: Major > > The parent issue broke our being able to host system regions only on the > Master. > This broke a few tests that depend on this ability. Two of the below actually > enable system regions on the Master for the test run. The remainder is the > test that make sure this works. > TestMultiParallel > TestRegionsOnMasterOptions > TestRegionServerReadRequestMetrics > Parent changed the startup order. System regions and Master-as-a-RegionServer > are having issues because we wait for regionservers to check in before > completing Master startup which gets interesting when Master is supposed to > act like a RegionServer. Previously, Master startup was off in a background > thread. > Needs more thought but not required for beta-1. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (HBASE-18334) Remove sync client implementation and wrap async client under sync client interface
[ https://issues.apache.org/jira/browse/HBASE-18334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-18334. --- Fix Version/s: (was: 3.0.0-alpha-4) Resolution: Duplicate Already down via HBASE-21512. > Remove sync client implementation and wrap async client under sync client > interface > --- > > Key: HBASE-18334 > URL: https://issues.apache.org/jira/browse/HBASE-18334 > Project: HBase > Issue Type: Task >Reporter: Phil Yang >Priority: Major > > Since 2.0 we have async client, now we have two client implementations. We > can implement an sync client (Table interface) by using async client, getting > a CompletableFuture and then waiting it done directly. This can reduce the > maintenance work at client side in the future. > Async client is done, we tested the performance and it showed it has same > performance with sync client. In branch-2 we can keep old sync client > implementations and remove it in master branch (since 3.0). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (HBASE-15154) Master puts up a blockcache instance
[ https://issues.apache.org/jira/browse/HBASE-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-15154. --- Resolution: Not A Problem Resolve as not a problem as now we have a master local region at master side so we need a blockcache instance on master. > Master puts up a blockcache instance > > > Key: HBASE-15154 > URL: https://issues.apache.org/jira/browse/HBASE-15154 > Project: HBase > Issue Type: Bug >Reporter: Michael Stack >Priority: Major > > Master is putting up a blockcache instance. It shouldn't. This issue comes of > the unification of Master and RegionServer where Master is a subclass of > RegionServer. Our [~jmspaggi] found out the hard way today when he tried to > bring up a cluster with a large offheap cache only the master member had been > given less memory. > Marking critical rather than blocker because there is a means of configuring > your way out of this little entanglement; set hbase.bucketcache.size to zero > in the master config only. > If you want to set direct memory for regionservers only and not on the > master, you should do the following: > Set HBASE_OFFHEAPSIZE=0G > ... and then turn it on for RegionServers only: > HBASE_REGIONSERVER_OPTS="HBASE_REGIONSERVER_OPTS > -XX:MaxDirectMemorySize=XXXG" where XXX is size of the direct memory you want > to allocate. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-15154) Master puts up a blockcache instance
[ https://issues.apache.org/jira/browse/HBASE-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15154: -- Fix Version/s: (was: 3.0.0-alpha-4) > Master puts up a blockcache instance > > > Key: HBASE-15154 > URL: https://issues.apache.org/jira/browse/HBASE-15154 > Project: HBase > Issue Type: Bug >Reporter: Michael Stack >Priority: Major > > Master is putting up a blockcache instance. It shouldn't. This issue comes of > the unification of Master and RegionServer where Master is a subclass of > RegionServer. Our [~jmspaggi] found out the hard way today when he tried to > bring up a cluster with a large offheap cache only the master member had been > given less memory. > Marking critical rather than blocker because there is a means of configuring > your way out of this little entanglement; set hbase.bucketcache.size to zero > in the master config only. > If you want to set direct memory for regionservers only and not on the > master, you should do the following: > Set HBASE_OFFHEAPSIZE=0G > ... and then turn it on for RegionServers only: > HBASE_REGIONSERVER_OPTS="HBASE_REGIONSERVER_OPTS > -XX:MaxDirectMemorySize=XXXG" where XXX is size of the direct memory you want > to allocate. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-20448) update ref guide to expressly use shaded clients for examples
[ https://issues.apache.org/jira/browse/HBASE-20448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722813#comment-17722813 ] Duo Zhang commented on HBASE-20448: --- Any updates here? > update ref guide to expressly use shaded clients for examples > - > > Key: HBASE-20448 > URL: https://issues.apache.org/jira/browse/HBASE-20448 > Project: HBase > Issue Type: Improvement > Components: Client, documentation, mapreduce >Reporter: Sean Busbey >Assignee: Sean Busbey >Priority: Blocker > Fix For: 3.0.0-alpha-4 > > > the whole mapreduce section, especially, should be using the shaded version. > Specifically include an example of running the ITBLL we ship -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-14498) Master stuck in infinite loop when all Zookeeper servers are unreachable (and RS may run after losing its znode)
[
https://issues.apache.org/jira/browse/HBASE-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722812#comment-17722812
]
Duo Zhang commented on HBASE-14498:
---
Any updates here? Do we still have the problem on the current release branches?
> Master stuck in infinite loop when all Zookeeper servers are unreachable (and
> RS may run after losing its znode)
>
>
> Key: HBASE-14498
> URL: https://issues.apache.org/jira/browse/HBASE-14498
> Project: HBase
> Issue Type: Bug
> Components: master
>Affects Versions: 3.0.0-alpha-1, 1.5.0, 2.0.0, 2.2.0
>Reporter: Y. SREENIVASULU REDDY
>Assignee: Pankaj Kumar
>Priority: Blocker
> Fix For: 3.0.0-alpha-4
>
> Attachments: HBASE-14498-V2.patch, HBASE-14498-V3.patch,
> HBASE-14498-V4.patch, HBASE-14498-V5.patch, HBASE-14498-V6.patch,
> HBASE-14498-V6.patch, HBASE-14498-addendum.patch,
> HBASE-14498-branch-1.2.patch, HBASE-14498-branch-1.3-V2.patch,
> HBASE-14498-branch-1.3.patch, HBASE-14498-branch-1.4.patch,
> HBASE-14498-branch-1.patch, HBASE-14498.007.patch, HBASE-14498.008.patch,
> HBASE-14498.009.patch, HBASE-14498.009.patch, HBASE-14498.master.001.patch,
> HBASE-14498.master.002.patch, HBASE-14498.patch
>
>
> We met a weird scenario in our production environment.
> In a HA cluster,
> > Active Master (HM1) is not able to connect to any Zookeeper server (due to
> > N/w breakdown on master machine network with Zookeeper servers).
> {code}
> 2015-09-26 15:24:47,508 INFO
> [HM1-Host:16000.activeMasterManager-SendThread(ZK-Host:2181)]
> zookeeper.ClientCnxn: Client session timed out, have not heard from server in
> 33463ms for sessionid 0x104576b8dda0002, closing socket connection and
> attempting reconnect
> 2015-09-26 15:24:47,877 INFO
> [HM1-Host:16000.activeMasterManager-SendThread(ZK-Host1:2181)]
> client.FourLetterWordMain: connecting to ZK-Host1 2181
> 2015-09-26 15:24:48,236 INFO [main-SendThread(ZK-Host1:2181)]
> client.FourLetterWordMain: connecting to ZK-Host1 2181
> 2015-09-26 15:24:49,879 WARN
> [HM1-Host:16000.activeMasterManager-SendThread(ZK-Host1:2181)]
> zookeeper.ClientCnxn: Can not get the principle name from server ZK-Host1
> 2015-09-26 15:24:49,879 INFO
> [HM1-Host:16000.activeMasterManager-SendThread(ZK-Host1:2181)]
> zookeeper.ClientCnxn: Opening socket connection to server
> ZK-Host1/ZK-IP1:2181. Will not attempt to authenticate using SASL (unknown
> error)
> 2015-09-26 15:24:50,238 WARN [main-SendThread(ZK-Host1:2181)]
> zookeeper.ClientCnxn: Can not get the principle name from server ZK-Host1
> 2015-09-26 15:24:50,238 INFO [main-SendThread(ZK-Host1:2181)]
> zookeeper.ClientCnxn: Opening socket connection to server
> ZK-Host1/ZK-Host1:2181. Will not attempt to authenticate using SASL (unknown
> error)
> 2015-09-26 15:25:17,470 INFO [main-SendThread(ZK-Host1:2181)]
> zookeeper.ClientCnxn: Client session timed out, have not heard from server in
> 30023ms for sessionid 0x2045762cc710006, closing socket connection and
> attempting reconnect
> 2015-09-26 15:25:17,571 WARN [master/HM1-Host/HM1-IP:16000]
> zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper,
> quorum=ZK-Host:2181,ZK-Host1:2181,ZK-Host2:2181,
> exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
> KeeperErrorCode = ConnectionLoss for /hbase/master
> 2015-09-26 15:25:17,872 INFO [main-SendThread(ZK-Host:2181)]
> client.FourLetterWordMain: connecting to ZK-Host 2181
> 2015-09-26 15:25:19,874 WARN [main-SendThread(ZK-Host:2181)]
> zookeeper.ClientCnxn: Can not get the principle name from server ZK-Host
> 2015-09-26 15:25:19,874 INFO [main-SendThread(ZK-Host:2181)]
> zookeeper.ClientCnxn: Opening socket connection to server ZK-Host/ZK-IP:2181.
> Will not attempt to authenticate using SASL (unknown error)
> {code}
> > Since HM1 was not able to connect to any ZK, so session timeout didnt
> > happen at Zookeeper server side and HM1 didnt abort.
> > On Zookeeper session timeout standby master (HM2) registered himself as an
> > active master.
> > HM2 is keep on waiting for region server to report him as part of active
> > master intialization.
> {noformat}
> 2015-09-26 15:24:44,928 | INFO | HM2-Host:21300.activeMasterManager | Waiting
> for region servers count to settle; currently checked in 0, slept for 0 ms,
> expecting minimum of 1, maximum of 2147483647, timeout of 4500 ms, interval
> of 1500 ms. |
> org.apache.hadoop.hbase.master.ServerManager.waitForRegionServers(ServerManager.java:1011)
> ---
> ---
> 2015-09-26 15:32:50,841 | INFO | HM2-Host:21300.activeMasterManager | Waiting
> for region servers count to settle; currently checked in 0, slept for 483913
> ms, expecting minimum of 1, maximum of
[GitHub] [hbase-operator-tools] Apache-HBase commented on pull request #118: HBASE-27829 Introduce build for `kuttl` image, basis for dev/test environment
Apache-HBase commented on PR #118: URL: https://github.com/apache/hbase-operator-tools/pull/118#issuecomment-1548042466 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 59s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +0 :ok: | markdownlint | 0m 0s | markdownlint was not available. | | +0 :ok: | shelldocs | 0m 0s | Shelldocs was not available. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ HBASE-27827-kubernetes-deployment Compile Tests _ | | +1 :green_heart: | mvninstall | 0m 48s | HBASE-27827-kubernetes-deployment passed | | +1 :green_heart: | compile | 0m 11s | HBASE-27827-kubernetes-deployment passed | | +1 :green_heart: | javadoc | 0m 8s | HBASE-27827-kubernetes-deployment passed | | -0 :warning: | patch | 0m 11s | Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary. | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 8s | Maven dependency ordering for patch | | -1 :x: | mvninstall | 0m 4s | hbase-kubernetes-testing-image in the patch failed. | | +1 :green_heart: | compile | 0m 19s | the patch passed | | +1 :green_heart: | javac | 0m 19s | the patch passed | | -1 :x: | hadolint | 0m 0s | The patch generated 27 new + 0 unchanged - 0 fixed = 27 total (was 0) | | +1 :green_heart: | shellcheck | 0m 0s | There were no new shellcheck issues. | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 2s | The patch has no ill-formed XML file. | | +1 :green_heart: | javadoc | 0m 14s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 4s | hbase-kubernetes-deployment in the patch passed. | | +1 :green_heart: | unit | 5m 57s | root in the patch passed. | | +1 :green_heart: | unit | 0m 5s | hbase-kubernetes-testing-image in the patch passed. | | +1 :green_heart: | asflicense | 0m 14s | The patch does not generate ASF License warnings. | | | | 9m 46s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-Operator-Tools-PreCommit/job/PR-118/3/artifact/yetus-precommit-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase-operator-tools/pull/118 | | Optional Tests | dupname asflicense markdownlint javac javadoc unit xml compile hadolint shellcheck shelldocs | | uname | Linux e2d99c0a2720 5.4.0-1099-aws #107~18.04.1-Ubuntu SMP Fri Mar 17 16:49:05 UTC 2023 x86_64 GNU/Linux | | Build tool | maven | | git revision | HBASE-27827-kubernetes-deployment / efa1916 | | Default Java | Oracle Corporation-1.8.0_342-b07 | | mvninstall | https://ci-hbase.apache.org/job/HBase-Operator-Tools-PreCommit/job/PR-118/3/artifact/yetus-precommit-check/output/patch-mvninstall-hbase-kubernetes-deployment_hbase-kubernetes-testing-image.txt | | hadolint | https://ci-hbase.apache.org/job/HBase-Operator-Tools-PreCommit/job/PR-118/3/artifact/yetus-precommit-check/output/diff-patch-hadolint.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-Operator-Tools-PreCommit/job/PR-118/3/testReport/ | | Max. process+thread count | 1250 (vs. ulimit of 5000) | | modules | C: hbase-kubernetes-deployment . hbase-kubernetes-deployment/hbase-kubernetes-testing-image U: . | | Console output | https://ci-hbase.apache.org/job/HBase-Operator-Tools-PreCommit/job/PR-118/3/console | | versions | git=2.30.2 maven=3.8.6 shellcheck=0.7.1 hadolint=Haskell Dockerfile Linter 2.12.1 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-23634) Enable "Split WAL to HFile" by default
[ https://issues.apache.org/jira/browse/HBASE-23634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-23634: -- Priority: Major (was: Blocker) > Enable "Split WAL to HFile" by default > -- > > Key: HBASE-23634 > URL: https://issues.apache.org/jira/browse/HBASE-23634 > Project: HBase > Issue Type: Task >Affects Versions: 3.0.0-alpha-1, 2.3.0 >Reporter: Guanghao Zhang >Priority: Major > Fix For: 3.0.0-alpha-4 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[GitHub] [hbase-operator-tools] Apache-HBase commented on pull request #117: HBASE-27828 Introduce hbase-kubernetes-deployment module
Apache-HBase commented on PR #117: URL: https://github.com/apache/hbase-operator-tools/pull/117#issuecomment-1548038027 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 46s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +0 :ok: | markdownlint | 0m 0s | markdownlint was not available. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ HBASE-27827-kubernetes-deployment Compile Tests _ | | +1 :green_heart: | mvninstall | 0m 44s | HBASE-27827-kubernetes-deployment passed | | +1 :green_heart: | compile | 0m 11s | HBASE-27827-kubernetes-deployment passed | | +1 :green_heart: | javadoc | 0m 7s | HBASE-27827-kubernetes-deployment passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 7s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 0m 23s | the patch passed | | +1 :green_heart: | compile | 0m 15s | the patch passed | | +1 :green_heart: | javac | 0m 15s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 1s | The patch has no ill-formed XML file. | | +1 :green_heart: | javadoc | 0m 11s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 4s | hbase-kubernetes-deployment in the patch passed. | | +1 :green_heart: | unit | 5m 49s | root in the patch passed. | | +1 :green_heart: | asflicense | 0m 10s | The patch does not generate ASF License warnings. | | | | 9m 0s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-Operator-Tools-PreCommit/job/PR-117/4/artifact/yetus-precommit-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase-operator-tools/pull/117 | | Optional Tests | dupname asflicense markdownlint javac javadoc unit xml compile | | uname | Linux 2f60fdbc50dd 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 x86_64 GNU/Linux | | Build tool | maven | | git revision | HBASE-27827-kubernetes-deployment / efa1916 | | Default Java | Oracle Corporation-1.8.0_342-b07 | | Test Results | https://ci-hbase.apache.org/job/HBase-Operator-Tools-PreCommit/job/PR-117/4/testReport/ | | Max. process+thread count | 1249 (vs. ulimit of 5000) | | modules | C: hbase-kubernetes-deployment . U: . | | Console output | https://ci-hbase.apache.org/job/HBase-Operator-Tools-PreCommit/job/PR-117/4/console | | versions | git=2.30.2 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-15867) Move HBase replication tracking from ZooKeeper to HBase
[ https://issues.apache.org/jira/browse/HBASE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722810#comment-17722810 ] Duo Zhang commented on HBASE-15867: --- HBASE-27109 and HBASE-27110 are both resolved. If no objections, I will close all the sub tasks are won't fix, and resolve this issue as implemented. Thanks. > Move HBase replication tracking from ZooKeeper to HBase > --- > > Key: HBASE-15867 > URL: https://issues.apache.org/jira/browse/HBASE-15867 > Project: HBase > Issue Type: New Feature > Components: Replication >Affects Versions: 2.1.0 >Reporter: Joseph >Assignee: Zheng Hu >Priority: Major > > Move the WAL file and offset tracking out of ZooKeeper and into an HBase > table called hbase:replication. > The largest three new changes will be two classes ReplicationTableBase, > TableBasedReplicationQueues, and TableBasedReplicationQueuesClient. As of now > ReplicationPeers and HFileRef's tracking will not be implemented. Subtasks > have been filed for these two jobs. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (HBASE-27109) Move replication queue storage from zookeeper to a separated HBase table
[ https://issues.apache.org/jira/browse/HBASE-27109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-27109. --- Fix Version/s: 3.0.0-alpha-4 Hadoop Flags: Reviewed Resolution: Fixed Merged the feature branch to master. Thanks all for helping! > Move replication queue storage from zookeeper to a separated HBase table > > > Key: HBASE-27109 > URL: https://issues.apache.org/jira/browse/HBASE-27109 > Project: HBase > Issue Type: New Feature > Components: Replication >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Fix For: 3.0.0-alpha-4 > > > This is a more specific issue based on the works which are already done in > HBASE-15867. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[GitHub] [hbase] Apache9 merged pull request #5202: HBASE-27109 Move replication queue storage from zookeeper to a separated HBase table
Apache9 merged PR #5202: URL: https://github.com/apache/hbase/pull/5202 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache9 commented on a diff in pull request #4891: HBASE-27483 Expose table and region storefiles accessed days and size to the metrics
Apache9 commented on code in PR #4891:
URL: https://github.com/apache/hbase/pull/4891#discussion_r1193961037
##
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsTableWrapperAggregateImpl.java:
##
@@ -115,10 +134,23 @@ public void run() {
// accumulate the count
mt.perStoreMemstoreOnlyReadCount.put(tempKey, memstoreReadCount);
mt.perStoreMixedReadCount.put(tempKey, mixedReadCount);
+Map> sfAccessTimeAndSizeMap =
+ store.getStoreFilesAccessTimeAndSize();
+Long now = EnvironmentEdgeManager.currentTime();
+for (Pair pair : sfAccessTimeAndSizeMap.values()) {
+ Long accessTime = pair.getFirst();
+ Long size = pair.getSecond();
+ for (int threshold : storeFilesAccessedDaysThresholds) {
+Long sumSize = mt.storeFilesAccessedDaysAndSize.get(threshold);
+if ((now - accessTime) >= threshold * ONE_DAY_MS) {
Review Comment:
So here if the accessTime is very old, we will increase the sumSize for all
the thresholds? Is this by design? Seems a bit strange...
##
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsTableWrapperAggregateImpl.java:
##
@@ -115,10 +134,23 @@ public void run() {
// accumulate the count
mt.perStoreMemstoreOnlyReadCount.put(tempKey, memstoreReadCount);
mt.perStoreMixedReadCount.put(tempKey, mixedReadCount);
+Map> sfAccessTimeAndSizeMap =
+ store.getStoreFilesAccessTimeAndSize();
+Long now = EnvironmentEdgeManager.currentTime();
Review Comment:
Just use long instead of Long?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hbase] jonathan-albrecht-ibm commented on pull request #5234: HBASE-27858 Update surefire version to 3.1.0 and use SurefireForkNodeFactory
jonathan-albrecht-ibm commented on PR #5234: URL: https://github.com/apache/hbase/pull/5234#issuecomment-1547949567 Thanks for reviewing and merging @Apache9! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] jonathan-albrecht-ibm commented on pull request #5231: HBASE-27857 Fix timeout exception handling in HBaseClassTestRule
jonathan-albrecht-ibm commented on PR #5231: URL: https://github.com/apache/hbase/pull/5231#issuecomment-1547949058 Thanks for reviewing and merging @Apache9! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #5229: HBASE-27793 Make HBCK be able to report unknown servers
Apache-HBase commented on PR #5229: URL: https://github.com/apache/hbase/pull/5229#issuecomment-1547770862 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 24s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 39s | master passed | | +1 :green_heart: | compile | 0m 49s | master passed | | +1 :green_heart: | shadedjars | 5m 10s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 26s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 14s | the patch passed | | +1 :green_heart: | compile | 1m 0s | the patch passed | | +1 :green_heart: | javac | 1m 0s | the patch passed | | +1 :green_heart: | shadedjars | 5m 13s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 26s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 16m 22s | hbase-server in the patch failed. | | | | 41m 35s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5229/2/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5229 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 4bb553b6b933 5.4.0-144-generic #161-Ubuntu SMP Fri Feb 3 14:49:04 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 8b8c684bcc | | Default Java | Temurin-1.8.0_352-b08 | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5229/2/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5229/2/testReport/ | | Max. process+thread count | 1525 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5229/2/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #5229: HBASE-27793 Make HBCK be able to report unknown servers
Apache-HBase commented on PR #5229: URL: https://github.com/apache/hbase/pull/5229#issuecomment-1547766334 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 13s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 25s | master passed | | +1 :green_heart: | compile | 2m 27s | master passed | | +1 :green_heart: | checkstyle | 0m 36s | master passed | | +1 :green_heart: | spotless | 0m 40s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 25s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 19s | the patch passed | | +1 :green_heart: | compile | 2m 22s | the patch passed | | -0 :warning: | javac | 2m 22s | hbase-server generated 1 new + 194 unchanged - 1 fixed = 195 total (was 195) | | +1 :green_heart: | checkstyle | 0m 36s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 12m 28s | Patch does not cause any errors with Hadoop 3.2.4 3.3.5. | | +1 :green_heart: | spotless | 0m 38s | patch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 38s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 10s | The patch does not generate ASF License warnings. | | | | 38m 25s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5229/2/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5229 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux 389a64323567 5.4.0-144-generic #161-Ubuntu SMP Fri Feb 3 14:49:04 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 8b8c684bcc | | Default Java | Eclipse Adoptium-11.0.17+8 | | javac | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5229/2/artifact/yetus-general-check/output/diff-compile-javac-hbase-server.txt | | Max. process+thread count | 83 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5229/2/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-27793) Make HBCK be able to report unknown servers
[ https://issues.apache.org/jira/browse/HBASE-27793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajeshbabu Chintaguntla updated HBASE-27793: Summary: Make HBCK be able to report unknown servers (was: hbck can report unknown servers as inconsistencies) > Make HBCK be able to report unknown servers > --- > > Key: HBASE-27793 > URL: https://issues.apache.org/jira/browse/HBASE-27793 > Project: HBase > Issue Type: Bug > Components: hbck >Reporter: Rajeshbabu Chintaguntla >Assignee: Rajeshbabu Chintaguntla >Priority: Major > > Currently hbck is not reporting unknown servers it would be helpful to report > those as inconsistencies so that directly hbck2 schedulerecoveries option > can be used to recover on unknown servers otherwise the taking the action for > inconsistencies reported due to unknown servers may corrupt if not done > properly. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HBASE-27866) hbase regionserver with phoenix process is java crash.
Jepson created HBASE-27866:
--
Summary: hbase regionserver with phoenix process is java crash.
Key: HBASE-27866
URL: https://issues.apache.org/jira/browse/HBASE-27866
Project: HBase
Issue Type: Bug
Components: regionserver
Affects Versions: 2.2.2
Reporter: Jepson
hbase regionserver with phoenix process is java crash.
[hbase@hadoop62 ~]$ *more hs_err_pid97203.log*
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x7fc60858ad3e, pid=97203, tid=0x7fbd8291a700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_241-b07) (build
1.8.0_241-b07)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.241-b07 mixed mode
linux-amd64 )
# Problematic frame:
{color:#ff8b00}*# V [libjvm.so+0x7ddd3e]*{color}
#
# Failed to write core dump. Core dumps have been disabled. To enable core
dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
# [http://bugreport.java.com/bugreport/crash.jsp]
#
--- T H R E A D ---
Current thread (0x7fc60329a000): JavaThread
"RpcServer.default.RWQ.Fifo.write.handler=72,queue=0,port=16020" daemon
[_thread_in_vm, id=98
127, stack(0x7fbd8281a000,0x7fbd8291b000)]
siginfo: si_signo: 11 (SIGSEGV), si_code: 2 (SEGV_ACCERR), si_addr:
0x7fbcc3a9
Registers:
RAX=0x7fbcc3ad11de, RBX=0x7fc60329a000, RCX=0x7fbe36e17c40,
RDX=0x7dc4
RSP=0x7fbd82918f88, RBP=0x7fbd82918fd0, RSI=0x,
RDI=0x7fbcc39d11e6
R8 =0x0008, R9 =0x00f00018, R10=0x7fc5f16d63a7,
R11=0x7fc5f16d6358
R12=0x0010, R13=0x7fbd82919000, R14=0x00f00018,
R15=0x
RIP=0x7fc60858ad3e, EFLAGS=0x00010282, CSGSFS=0x0033,
ERR=0x0004
TRAPNO=0x000e
0x7fc60858ad2e: f0 48 89 74 d1 f0 48 8b 74 d0 f8 48 89 74 d1 f8
0x7fc60858ad3e: 48 8b 34 d0 48 89 34 d1 48 83 c2 04 7e d4 48 83
0x7fc60858ad4e: ea 04 7c 93 eb a1 49 f7 c0 01 00 00 00 74 0c 66
Register to memory mapping:
RAX=0x7fbcc3ad11de is pointing into the stack for thread: 0x7fc603d65000
RBX=0x7fc60329a000 is a thread
RCX=
[error occurred during error reporting (printing register info), id 0xb]
Stack: [0x7fbd8281a000,0x7fbd8291b000], sp=0x7fbd82918f88, free
space=1019k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x7ddd3e]
J 3060
sun.misc.Unsafe.{*}{color:#ff8b00}copyMemory{color}{*}(Ljava/lang/Object;JLjava/lang/Object;JJ)V
(0 bytes) @ 0x7fc5f16d6421 [0x7fc5f16d6340+0xe1]
j
org.apache.hadoop.hbase.util.UnsafeAccess.unsafeCopy(Ljava/lang/Object;JLjava/lang/Object;JJ)V+36
j
org.apache.hadoop.hbase.util.UnsafeAccess.copy(Ljava/nio/ByteBuffer;I[BII)V+69
J 20259 C2
org.apache.phoenix.coprocessor.GlobalIndexRegionScanner.apply(Lorg/apache/hadoop/hbase/client/Put;Lorg/apache/hadoop/hbase/client/P
ut;)V (95 bytes) @ 0x7fc5f4539414 [0x7fc5f4538d00+0x714]
J 32073 C2
org.apache.phoenix.hbase.index.IndexRegionObserver.preBatchMutate(Lorg/apache/hadoop/hbase/coprocessor/ObserverContext;Lorg/apache/
hadoop/hbase/regionserver/MiniBatchOperationInProgress;)V (31 bytes) @
0x7fc5f5e8c8ac [0x7fc5f5e8a6e0+0x21cc]
J 31164 C2
org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutate(Lorg/apache/hadoop/hbase/regionserver/HRegion$BatchOperation;)V
(500
bytes) @ 0x7fc5f4ec0e58 [0x7fc5f4ec0640+0x818]
J 31154 C2
org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(Lorg/apache/hadoop/hbase/regionserver/HRegion$BatchOperation;)[Lorg/apache
/hadoop/hbase/regionserver/OperationStatus; (171 bytes) @ 0x7fc5f5968218
[0x7fc5f5967ea0+0x378]
J 31155 C2
org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(Lorg/apache/hadoop/hbase/shaded/protobuf/generated/ClientProtos$Region
ActionResult$Builder;Lorg/apache/hadoop/hbase/regionserver/HRegion;Lorg/apache/hadoop/hbase/quotas/OperationQuota;Ljava/util/List;Lorg/apache/
hadoop/hbase/CellScanner;Lorg/apache/hadoop/hbase/quotas/ActivePolicyEnforcement;Z)V
(646 bytes) @ 0x7fc5f53fa1d4 [0x7fc5f53f9620+0xbb
4]
J 20397 C2
org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(Lorg/apache/hadoop/hbase/regionserver/HRegion;Lorg/apa
che/hadoop/hbase/quotas/OperationQuota;Lorg/apache/hadoop/hbase/shaded/protobuf/generated/ClientProtos$RegionAction;Lorg/apache/hadoop/hbase/C
ellScanner;Lorg/apache/hadoop/hbase/shaded/protobuf/generated/ClientProtos$RegionActionResult$Builder;Ljava/util/List;JLorg/apache/hadoop/hbas
e/regionserver/RSRpcServices$RegionScannersCloseCallBack;Lorg/apache/hadoop/hbase/ipc/RpcCallContext;Lorg/apache/hadoop/hbase/quotas/ActivePol
icyEnforcement;)Ljava/util/List; (905
[jira] [Updated] (HBASE-27856) Add hadolint binary to operator-tools yetus environment
[ https://issues.apache.org/jira/browse/HBASE-27856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk updated HBASE-27856: - Resolution: Fixed Status: Resolved (was: Patch Available) > Add hadolint binary to operator-tools yetus environment > --- > > Key: HBASE-27856 > URL: https://issues.apache.org/jira/browse/HBASE-27856 > Project: HBase > Issue Type: Task > Components: build >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk >Priority: Major > Fix For: hbase-operator-tools-1.3.0 > > > Since we're adding dockerfiles via HBASE-27827, let's also have a pre-commit > check for them. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[GitHub] [hbase-operator-tools] ndimiduk commented on pull request #127: HBASE-27856 Add hadolint binary to operator-tools yetus environment
ndimiduk commented on PR #127: URL: https://github.com/apache/hbase-operator-tools/pull/127#issuecomment-1547464616 Thanks @petersomogyi -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase-operator-tools] ndimiduk merged pull request #127: HBASE-27856 Add hadolint binary to operator-tools yetus environment
ndimiduk merged PR #127: URL: https://github.com/apache/hbase-operator-tools/pull/127 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-27109) Move replication queue storage from zookeeper to a separated HBase table
[
https://issues.apache.org/jira/browse/HBASE-27109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722708#comment-17722708
]
Hudson commented on HBASE-27109:
Results for branch HBASE-27109/table_based_rqs
[build #76 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/HBASE-27109%252Ftable_based_rqs/76/]:
(/) *{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/HBASE-27109%252Ftable_based_rqs/76/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/HBASE-27109%252Ftable_based_rqs/76/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/HBASE-27109%252Ftable_based_rqs/76/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Move replication queue storage from zookeeper to a separated HBase table
>
>
> Key: HBASE-27109
> URL: https://issues.apache.org/jira/browse/HBASE-27109
> Project: HBase
> Issue Type: New Feature
> Components: Replication
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
>
> This is a more specific issue based on the works which are already done in
> HBASE-15867.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
