[GitHub] [hbase] Apache-HBase commented on pull request #4981: Revert "Backport HBASE-27557 to branch-2"
Apache-HBase commented on PR #4981: URL: https://github.com/apache/hbase/pull/4981#issuecomment-1386629623 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 1s | Docker mode activated. | | -0 :warning: | yetus | 0m 5s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ branch-2 Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 43s | branch-2 passed | | +1 :green_heart: | compile | 0m 55s | branch-2 passed | | +1 :green_heart: | shadedjars | 4m 0s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 24s | branch-2 passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 18s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 44s | the patch passed | | +1 :green_heart: | compile | 0m 55s | the patch passed | | +1 :green_heart: | javac | 0m 55s | the patch passed | | +1 :green_heart: | shadedjars | 4m 1s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 23s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 35s | hbase-protocol-shaded in the patch passed. | | +1 :green_heart: | unit | 0m 42s | hbase-shaded in the patch passed. | | | | 20m 14s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4981/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4981 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 279af5918216 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | branch-2 / 28da1546e2 | | Default Java | Eclipse Adoptium-11.0.17+8 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4981/1/testReport/ | | Max. process+thread count | 426 (vs. ulimit of 3) | | modules | C: hbase-protocol-shaded hbase-shaded U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4981/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4981: Revert "Backport HBASE-27557 to branch-2"
Apache-HBase commented on PR #4981: URL: https://github.com/apache/hbase/pull/4981#issuecomment-1386627470 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 56s | Docker mode activated. | | -0 :warning: | yetus | 0m 5s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ branch-2 Compile Tests _ | | +0 :ok: | mvndep | 0m 13s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 22s | branch-2 passed | | +1 :green_heart: | compile | 0m 37s | branch-2 passed | | +1 :green_heart: | shadedjars | 3m 57s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 18s | branch-2 passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 12s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 5s | the patch passed | | +1 :green_heart: | compile | 0m 38s | the patch passed | | +1 :green_heart: | javac | 0m 38s | the patch passed | | +1 :green_heart: | shadedjars | 3m 57s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 16s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 22s | hbase-protocol-shaded in the patch passed. | | +1 :green_heart: | unit | 0m 44s | hbase-shaded in the patch passed. | | | | 17m 55s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4981/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4981 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 7cacae3bdd3e 5.4.0-1088-aws #96~18.04.1-Ubuntu SMP Mon Oct 17 02:57:48 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | branch-2 / 28da1546e2 | | Default Java | Temurin-1.8.0_352-b08 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4981/1/testReport/ | | Max. process+thread count | 397 (vs. ulimit of 3) | | modules | C: hbase-protocol-shaded hbase-shaded U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4981/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-27557) [JDK17] Update shade plugin version
[ https://issues.apache.org/jira/browse/HBASE-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678115#comment-17678115 ] Reid Chan commented on HBASE-27557: --- mine, oversight.. > [JDK17] Update shade plugin version > --- > > Key: HBASE-27557 > URL: https://issues.apache.org/jira/browse/HBASE-27557 > Project: HBase > Issue Type: Sub-task >Reporter: tianhang tang >Assignee: tianhang tang >Priority: Minor > Attachments: image-2023-01-06-18-54-09-703.png > > > maven-shade-plugin:3.2.4 cannot support JDK17, if build HBase with > releaseTarget=17 will meet this error: > !image-2023-01-06-18-54-09-703.png! > So need to update it's version. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[GitHub] [hbase] thangTang commented on pull request #4981: Revert "Backport HBASE-27557 to branch-2"
thangTang commented on PR #4981: URL: https://github.com/apache/hbase/pull/4981#issuecomment-1386616004 To change the commit title as @ndimiduk said. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] thangTang opened a new pull request, #4981: Revert "Backport HBASE-27557 to branch-2"
thangTang opened a new pull request, #4981: URL: https://github.com/apache/hbase/pull/4981 Reverts apache/hbase#4969 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4945: HBASE-27551 Add config options to delay assignment to retain last region location
Apache-HBase commented on PR #4945: URL: https://github.com/apache/hbase/pull/4945#issuecomment-1386588377 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 4s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 11s | master passed | | +1 :green_heart: | compile | 0m 38s | master passed | | +1 :green_heart: | shadedjars | 3m 46s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 23s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 11s | the patch passed | | +1 :green_heart: | compile | 0m 39s | the patch passed | | +1 :green_heart: | javac | 0m 39s | the patch passed | | +1 :green_heart: | shadedjars | 3m 44s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 23s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 214m 22s | hbase-server in the patch passed. | | | | 233m 20s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4945/9/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4945 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux c727e9f7c153 5.4.0-135-generic #152-Ubuntu SMP Wed Nov 23 20:19:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / d799c3c3c3 | | Default Java | Temurin-1.8.0_352-b08 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4945/9/testReport/ | | Max. process+thread count | 2341 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4945/9/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4945: HBASE-27551 Add config options to delay assignment to retain last region location
Apache-HBase commented on PR #4945: URL: https://github.com/apache/hbase/pull/4945#issuecomment-1386575765 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 35s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 1s | master passed | | +1 :green_heart: | compile | 0m 42s | master passed | | +1 :green_heart: | shadedjars | 3m 58s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 23s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 24s | the patch passed | | +1 :green_heart: | compile | 0m 42s | the patch passed | | +1 :green_heart: | javac | 0m 42s | the patch passed | | +1 :green_heart: | shadedjars | 3m 59s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 22s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 199m 36s | hbase-server in the patch passed. | | | | 219m 43s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4945/9/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4945 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 3957729656ff 5.4.0-1093-aws #102~18.04.2-Ubuntu SMP Wed Dec 7 00:31:59 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / d799c3c3c3 | | Default Java | Eclipse Adoptium-11.0.17+8 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4945/9/testReport/ | | Max. process+thread count | 2691 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4945/9/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-27568) ChaosMonkey add support for JournalNodes
[
https://issues.apache.org/jira/browse/HBASE-27568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678067#comment-17678067
]
Hudson commented on HBASE-27568:
Results for branch branch-2
[build #721 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/721/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/721/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/721/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/721/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/721/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> ChaosMonkey add support for JournalNodes
>
>
> Key: HBASE-27568
> URL: https://issues.apache.org/jira/browse/HBASE-27568
> Project: HBase
> Issue Type: Task
> Components: integration tests
>Affects Versions: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3
>
>
> Looks like our ChaosMonkey knowledge of HDFS topology is stale. Add the
> concept of a Journal Node to ClusterManager et al.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27568) ChaosMonkey add support for JournalNodes
[
https://issues.apache.org/jira/browse/HBASE-27568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678066#comment-17678066
]
Hudson commented on HBASE-27568:
Results for branch branch-2.4
[build #495 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/495/]:
(/) *{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/495/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/495/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/495/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/495/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> ChaosMonkey add support for JournalNodes
>
>
> Key: HBASE-27568
> URL: https://issues.apache.org/jira/browse/HBASE-27568
> Project: HBase
> Issue Type: Task
> Components: integration tests
>Affects Versions: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3
>
>
> Looks like our ChaosMonkey knowledge of HDFS topology is stale. Add the
> concept of a Journal Node to ClusterManager et al.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[GitHub] [hbase] Apache-HBase commented on pull request #4945: HBASE-27551 Add config options to delay assignment to retain last region location
Apache-HBase commented on PR #4945: URL: https://github.com/apache/hbase/pull/4945#issuecomment-1386443940 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 9s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 42s | master passed | | +1 :green_heart: | compile | 2m 23s | master passed | | +1 :green_heart: | checkstyle | 0m 35s | master passed | | +1 :green_heart: | spotless | 0m 42s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 27s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 26s | the patch passed | | +1 :green_heart: | compile | 2m 21s | the patch passed | | +1 :green_heart: | javac | 2m 21s | the patch passed | | +1 :green_heart: | checkstyle | 0m 33s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 8m 42s | Patch does not cause any errors with Hadoop 3.2.4 3.3.4. | | +1 :green_heart: | spotless | 0m 40s | patch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 35s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 11s | The patch does not generate ASF License warnings. | | | | 30m 50s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4945/9/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4945 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux 5a7d160f7c64 5.4.0-135-generic #152-Ubuntu SMP Wed Nov 23 20:19:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / d799c3c3c3 | | Default Java | Eclipse Adoptium-11.0.17+8 | | Max. process+thread count | 79 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4945/9/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-27573) [hbase-thirdparty] Bump dependency versions
[ https://issues.apache.org/jira/browse/HBASE-27573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-27573: -- Release Note: protobuf 3.21.9 -> 3.21.12 netty 4.1.86.Final -> 4.1.87.Final error prone 2.16 -> 2.18.0 gson 2.10 -> 2.10.1 jetty 9.4.49.v20220914 -> 9.4.50.v20221201 jersey 2,37 -> 2.38 jackson 2.14.0 ->2.14.1 was: protobuf 3.21.9 -> 3.21.12 netty 4.1.86.Final -> 4.1.87.Final error prone 2.16 -> 2.18.0 gson 2.10 -> 2.10.1 jetty 9.4.49.v20220914 -> 9.4.50.v20221201 jersey 2,37 -> 2.38 jackson 2.14.0 ->2.14.1 > [hbase-thirdparty] Bump dependency versions > --- > > Key: HBASE-27573 > URL: https://issues.apache.org/jira/browse/HBASE-27573 > Project: HBase > Issue Type: Task > Components: dependencies, thirdparty >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Fix For: thirdparty-4.1.4 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HBASE-27578) Upgrade hbase-thirdparty to 4.1.4
Duo Zhang created HBASE-27578: - Summary: Upgrade hbase-thirdparty to 4.1.4 Key: HBASE-27578 URL: https://issues.apache.org/jira/browse/HBASE-27578 Project: HBase Issue Type: Task Components: dependencies, security Reporter: Duo Zhang Assignee: Duo Zhang Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3 There are some security fixes, and also, HBASE-27505 is an important change which fixed the 'broken' pom in thirdparty 4.1.3. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HBASE-27577) [hbase-thirdparty] Put up hbase-thirdparty 4.1.4RC0
Duo Zhang created HBASE-27577: - Summary: [hbase-thirdparty] Put up hbase-thirdparty 4.1.4RC0 Key: HBASE-27577 URL: https://issues.apache.org/jira/browse/HBASE-27577 Project: HBase Issue Type: Sub-task Components: community, thirdparty Reporter: Duo Zhang Assignee: Duo Zhang -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HBASE-27576) [hbase-thirdparty] Release hbase-thirdparty 4.1.4
Duo Zhang created HBASE-27576: - Summary: [hbase-thirdparty] Release hbase-thirdparty 4.1.4 Key: HBASE-27576 URL: https://issues.apache.org/jira/browse/HBASE-27576 Project: HBase Issue Type: Umbrella Components: community, thirdparty Reporter: Duo Zhang Assignee: Duo Zhang -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (HBASE-27573) [hbase-thirdparty] Bump dependency versions
[ https://issues.apache.org/jira/browse/HBASE-27573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-27573. --- Hadoop Flags: Reviewed Release Note: protobuf 3.21.9 -> 3.21.12 netty 4.1.86.Final -> 4.1.87.Final error prone 2.16 -> 2.18.0 gson 2.10 -> 2.10.1 jetty 9.4.49.v20220914 -> 9.4.50.v20221201 jersey 2,37 -> 2.38 jackson 2.14.0 ->2.14.1 Resolution: Fixed Merged to master. Thanks [~ndimiduk] for reviewing! > [hbase-thirdparty] Bump dependency versions > --- > > Key: HBASE-27573 > URL: https://issues.apache.org/jira/browse/HBASE-27573 > Project: HBase > Issue Type: Task > Components: dependencies, thirdparty >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Fix For: thirdparty-4.1.4 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[GitHub] [hbase-thirdparty] Apache9 merged pull request #99: HBASE-27573 [hbase-thirdparty] Bump dependency versions
Apache9 merged PR #99: URL: https://github.com/apache/hbase-thirdparty/pull/99 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (HBASE-27541) Backups should be able to be restored to a separate filesystem
[ https://issues.apache.org/jira/browse/HBASE-27541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Beaudreault resolved HBASE-27541. --- Fix Version/s: 3.0.0-alpha-4 Release Note: Adds a new withRestoreRootDir method to RestoreRequest. When specified, the bulk output will be sent to that directory rather than the value of hbase.fs.tmp.dir (which defaults to current user's home dir on current FS). You can pass a fully qualified URI to withRestoreRootDir, which allows the RestoreJob to save the output to a remote cluster if you've loaded the job's Configuration with the appropriate hdfs configs to connect to that cluster. Resolution: Fixed Thanks [~jlee] ! > Backups should be able to be restored to a separate filesystem > -- > > Key: HBASE-27541 > URL: https://issues.apache.org/jira/browse/HBASE-27541 > Project: HBase > Issue Type: Improvement > Components: backuprestore >Affects Versions: 3.0.0-alpha-3 >Reporter: Jarryd Lee >Priority: Minor > Fix For: 3.0.0-alpha-4 > > > Currently it's not possible to set the hfile output path for a given restore > job. This prevents us from running restore jobs in external yarn clusters. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[GitHub] [hbase] bbeaudreault merged pull request #4933: HBASE-27541 Add support for defining restore hfile output path
bbeaudreault merged PR #4933: URL: https://github.com/apache/hbase/pull/4933 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-27568) ChaosMonkey add support for JournalNodes
[
https://issues.apache.org/jira/browse/HBASE-27568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678019#comment-17678019
]
Hudson commented on HBASE-27568:
Results for branch master
[build #756 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/756/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/756/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/756/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/756/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> ChaosMonkey add support for JournalNodes
>
>
> Key: HBASE-27568
> URL: https://issues.apache.org/jira/browse/HBASE-27568
> Project: HBase
> Issue Type: Task
> Components: integration tests
>Affects Versions: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3
>
>
> Looks like our ChaosMonkey knowledge of HDFS topology is stale. Add the
> concept of a Journal Node to ClusterManager et al.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27529) Provide RS coproc ability to attach WAL extended attributes to mutations at replication sink
[
https://issues.apache.org/jira/browse/HBASE-27529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678018#comment-17678018
]
Hudson commented on HBASE-27529:
Results for branch master
[build #756 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/756/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/756/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/756/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/756/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Provide RS coproc ability to attach WAL extended attributes to mutations at
> replication sink
>
>
> Key: HBASE-27529
> URL: https://issues.apache.org/jira/browse/HBASE-27529
> Project: HBase
> Issue Type: Improvement
> Components: Coprocessors, Replication
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3
>
>
> HBase provides coproc ability to enhance WALKey attributes (a.k.a. WAL
> annotations) in order for the replication sink cluster to build required
> metadata with the mutations. The endpoint is preWALAppend(). This ability was
> provided by HBASE-22622. The map of extended attributes is optional and hence
> not directly used by hbase internally.
> For any hbase downstreamers to build CDC (Change Data Capture) like
> functionality, it might required additional metadata in addition to the ones
> being used by hbase already (replication scope, list of cluster ids, seq id,
> table name, region id etc). For instance, Phoenix uses many additional
> attributes like tenant id, schema name, table type etc.
> We already have this extended map of attributes available in WAL protobuf, to
> provide us the capability to (de)serialize it. While creating new
> ReplicateWALEntryRequest from the list of WAL entires, we are able to
> serialize the additional attributes. Similarly, at the replication sink side,
> the deserialized WALEntry has the extended attributes available.
> At the sink cluster, we should be able to attach the deserialized extended
> attributes to the newly generated mutations so that the peer cluster can
> utilize the mutation attributes to re-build required metadata.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27567) Introduce ChaosMonkey Action to print HDFS Cluster status
[
https://issues.apache.org/jira/browse/HBASE-27567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678017#comment-17678017
]
Hudson commented on HBASE-27567:
Results for branch master
[build #756 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/756/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/756/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/756/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/756/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Introduce ChaosMonkey Action to print HDFS Cluster status
> -
>
> Key: HBASE-27567
> URL: https://issues.apache.org/jira/browse/HBASE-27567
> Project: HBase
> Issue Type: Task
> Components: integration tests
>Affects Versions: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
>Priority: Minor
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3
>
>
> We have ChaosMonkey actions for perturbing HDFS components, but we lack a
> means to periodically display status/health. Introduce a "dump" action
> similar to the one we have for HBase.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[GitHub] [hbase] apurtell commented on pull request #4980: Bump future from 0.18.2 to 0.18.3 in /dev-support
apurtell commented on PR #4980: URL: https://github.com/apache/hbase/pull/4980#issuecomment-1386164027 Will merge tomorrow unless objection. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4980: Bump future from 0.18.2 to 0.18.3 in /dev-support
Apache-HBase commented on PR #4980: URL: https://github.com/apache/hbase/pull/4980#issuecomment-1386158717 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 55s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 12s | Maven dependency ordering for branch | | +1 :green_heart: | spotless | 0m 40s | branch has no errors when running spotless:check. | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 4s | Maven dependency ordering for patch | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | spotless | 0m 37s | patch has no errors when running spotless:check. | ||| _ Other Tests _ | | +0 :ok: | asflicense | 0m 1s | ASF License check generated no output? | | | | 3m 25s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4980/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4980 | | Optional Tests | dupname asflicense spotless | | uname | Linux cf2412ea1faa 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 71d0862d84 | | Max. process+thread count | 44 (vs. ulimit of 3) | | modules | C: U: | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4980/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4980: Bump future from 0.18.2 to 0.18.3 in /dev-support
Apache-HBase commented on PR #4980: URL: https://github.com/apache/hbase/pull/4980#issuecomment-1386157203 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 59s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for branch | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 4s | Maven dependency ordering for patch | ||| _ Other Tests _ | | | | 2m 9s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4980/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4980 | | Optional Tests | | | uname | Linux 26725f4e953c 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 71d0862d84 | | Max. process+thread count | 38 (vs. ulimit of 3) | | modules | C: U: | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4980/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4980: Bump future from 0.18.2 to 0.18.3 in /dev-support
Apache-HBase commented on PR #4980: URL: https://github.com/apache/hbase/pull/4980#issuecomment-1386157012 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 40s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 12s | Maven dependency ordering for branch | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 3s | Maven dependency ordering for patch | ||| _ Other Tests _ | | | | 1m 51s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4980/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4980 | | Optional Tests | | | uname | Linux 19dcd4408008 5.4.0-1092-aws #100~18.04.2-Ubuntu SMP Tue Nov 29 08:39:52 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 71d0862d84 | | Max. process+thread count | 31 (vs. ulimit of 3) | | modules | C: U: | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4980/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-27575) Bump future from 0.18.2 to 0.18.3 in dev-support
[ https://issues.apache.org/jira/browse/HBASE-27575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-27575: Fix Version/s: 2.6.0 3.0.0-alpha-4 Affects Version/s: (was: 2.6.0) (was: 3.0.0-alpha-3) Status: Patch Available (was: Open) > Bump future from 0.18.2 to 0.18.3 in dev-support > > > Key: HBASE-27575 > URL: https://issues.apache.org/jira/browse/HBASE-27575 > Project: HBase > Issue Type: Task >Affects Versions: 2.5.2, 2.4.15 >Reporter: Andrew Kyle Purtell >Assignee: Andrew Kyle Purtell >Priority: Minor > Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3 > > > Bump future from 0.18.2 to 0.18.3 in /dev-support. > Dependabot PR: https://github.com/apache/hbase/pull/4980 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HBASE-27575) Bump future from 0.18.2 to 0.18.3 in dev-support
Andrew Kyle Purtell created HBASE-27575: --- Summary: Bump future from 0.18.2 to 0.18.3 in dev-support Key: HBASE-27575 URL: https://issues.apache.org/jira/browse/HBASE-27575 Project: HBase Issue Type: Task Affects Versions: 2.5.2, 2.4.15, 3.0.0-alpha-3, 2.6.0 Reporter: Andrew Kyle Purtell Assignee: Andrew Kyle Purtell Fix For: 2.4.16, 2.5.3 Bump future from 0.18.2 to 0.18.3 in /dev-support. Dependabot PR: https://github.com/apache/hbase/pull/4980 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-25709) Close region may stuck when region is compacting and skipped most cells read
[ https://issues.apache.org/jira/browse/HBASE-25709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-25709: Fix Version/s: 2.5.4 (was: 2.5.3) > Close region may stuck when region is compacting and skipped most cells read > > > Key: HBASE-25709 > URL: https://issues.apache.org/jira/browse/HBASE-25709 > Project: HBase > Issue Type: Bug > Components: Compaction >Affects Versions: 1.7.1, 3.0.0-alpha-2, 2.4.10 >Reporter: Xiaolin Ha >Assignee: Xiaolin Ha >Priority: Major > Fix For: 2.6.0, 2.4.11, 3.0.0-alpha-4, 2.5.4 > > Attachments: Master-UI-RIT.png, RS-region-state.png > > > We found in our cluster about stop region stuck. The region is compacting, > and its store files has many TTL expired cells. Close region state > marker(HRegion#writestate.writesEnabled) is not checked in compaction, > because most cells were skipped. > !RS-region-state.png|width=698,height=310! > > !Master-UI-RIT.png|width=693,height=157! > > HBASE-23968 has encountered similar problem, but the solution in it is outer > the method > InternalScanner#next(List result, ScannerContext scannerContext), which > will not return if there are many skipped cells, for current compaction > scanner context. As a result, we need to return in time in the next method, > and then check the stop marker. > > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-26958) Improve the comments and test coverage for compaction progress implementation
[ https://issues.apache.org/jira/browse/HBASE-26958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-26958: Fix Version/s: 2.5.4 (was: 2.5.3) > Improve the comments and test coverage for compaction progress implementation > - > > Key: HBASE-26958 > URL: https://issues.apache.org/jira/browse/HBASE-26958 > Project: HBase > Issue Type: Improvement > Components: Compaction >Reporter: Duo Zhang >Priority: Major > Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.4 > > > When fixing HBASE-26938, we also found the root cause that why sometimes we > will get broken compaction progress value, i.e, a negative or more than 100%, > it is because multiple compaction can happen at the same time but only use > one compaction prorgress, which is not thread safe to track them all. > We have fixed this problem in HBASE-26938, but it is suggested to improve the > test coverage of this ares so we will not make a mistake in the future again. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HBASE-27073) TestReplicationValueCompressedWAL.testMultiplePuts is flaky
[ https://issues.apache.org/jira/browse/HBASE-27073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell reassigned HBASE-27073: --- Assignee: (was: Andrew Kyle Purtell) > TestReplicationValueCompressedWAL.testMultiplePuts is flaky > --- > > Key: HBASE-27073 > URL: https://issues.apache.org/jira/browse/HBASE-27073 > Project: HBase > Issue Type: Bug >Affects Versions: 2.5.0 > Environment: Java version: 1.8.0_322 > OS name: "linux", version: "5.10.0-13-arm64", arch: "aarch64", family: "unix" >Reporter: Andrew Kyle Purtell >Priority: Minor > Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.3 > > > org.apache.hadoop.hbase.replication.regionserver.TestReplicationValueCompressedWAL.testMultiplePuts > Run 1: TestReplicationValueCompressedWAL.testMultiplePuts:56 Waited too > much time for replication > Run 2: PASS -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-27073) TestReplicationValueCompressedWAL.testMultiplePuts is flaky
[ https://issues.apache.org/jira/browse/HBASE-27073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-27073: Fix Version/s: 2.5.4 (was: 2.5.3) > TestReplicationValueCompressedWAL.testMultiplePuts is flaky > --- > > Key: HBASE-27073 > URL: https://issues.apache.org/jira/browse/HBASE-27073 > Project: HBase > Issue Type: Bug >Affects Versions: 2.5.0 > Environment: Java version: 1.8.0_322 > OS name: "linux", version: "5.10.0-13-arm64", arch: "aarch64", family: "unix" >Reporter: Andrew Kyle Purtell >Priority: Minor > Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.4 > > > org.apache.hadoop.hbase.replication.regionserver.TestReplicationValueCompressedWAL.testMultiplePuts > Run 1: TestReplicationValueCompressedWAL.testMultiplePuts:56 Waited too > much time for replication > Run 2: PASS -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-27022) SFT seems to apparently tracking invalid/malformed store files
[
https://issues.apache.org/jira/browse/HBASE-27022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Kyle Purtell updated HBASE-27022:
Fix Version/s: 2.5.4
(was: 2.5.3)
> SFT seems to apparently tracking invalid/malformed store files
> --
>
> Key: HBASE-27022
> URL: https://issues.apache.org/jira/browse/HBASE-27022
> Project: HBase
> Issue Type: Sub-task
>Reporter: Wellington Chevreuil
>Priority: Minor
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.4
>
>
> Opening this on behalf of [~apurtell] , who first reported this issue on
> HBASE-26999: When running scale tests using ITLCC, the following errors were
> observed:
> {noformat}
> [00]2022-05-05 15:59:52,280 WARN [region-location-0]
> regionserver.StoreFileInfo:
> Skipping
> hdfs://ip-172-31-58-47.us-west-2.compute.internal:8020/hbase/data/default/IntegrationTestLoadCommonCrawl/9eafc10e1b5a25532a4f0adf550828fc/c/9d07757144a7404fac02e161b5bd035e
> because it is empty. HBASE-646 DATA LOSS?
> ...
> [00]2022-05-05 15:59:52,320 WARN [region-location-2]
> regionserver.StoreFileInfo:
> Skipping
> hdfs://ip-172-31-58-47.us-west-2.compute.internal:8020/hbase/data/default/IntegrationTestLoadCommonCrawl/5322c54b9a899eae03cb16e956a836d5/c/184b4f55ab1a4dbc813e77aeae1343ae
>
> because it is empty. HBASE-646 DATA LOSS? {noformat}
>
> From some discussions in HBASE-26999, it seems that SFT has wrongly tracked
> an incomplete/unfinished store file.
> For further context, follow the [comments thread on
> HBASE-26999|https://issues.apache.org/jira/browse/HBASE-26999?focusedCommentId=17533508=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17533508].
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (HBASE-26844) Fix flaky TestBasicWALEntryStreamFSHLog.testSizeOfLogQueue
[ https://issues.apache.org/jira/browse/HBASE-26844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-26844: Fix Version/s: 2.5.4 (was: 2.5.3) > Fix flaky TestBasicWALEntryStreamFSHLog.testSizeOfLogQueue > -- > > Key: HBASE-26844 > URL: https://issues.apache.org/jira/browse/HBASE-26844 > Project: HBase > Issue Type: Bug >Affects Versions: 2.5.0, 2.4.12 >Reporter: Xiaolin Ha >Assignee: Xiaolin Ha >Priority: Minor > Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.4 > > > The failed info is described in HBASE-26843. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-27127) Should use FileStatus to archive expired MOB files instead of construct HStoreFile object
[ https://issues.apache.org/jira/browse/HBASE-27127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-27127: Fix Version/s: 2.5.4 (was: 2.5.3) > Should use FileStatus to archive expired MOB files instead of construct > HStoreFile object > - > > Key: HBASE-27127 > URL: https://issues.apache.org/jira/browse/HBASE-27127 > Project: HBase > Issue Type: Improvement > Components: mob >Affects Versions: 2.4.12 >Reporter: Xiaolin Ha >Assignee: Xiaolin Ha >Priority: Major > Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.4 > > > The MobUtils#removeMobFiles reused codes in HFileArchiver#archiveStoreFiles, > which is used to archive compacted files on RSes under normal conditions. In > HFileArchiver#archiveStoreFiles, store files are closed and removed, while > MOB cleaner should only rename the expired files and no need to build new > HStoreFile object before archive and close it after removed. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-27382) Cluster completely down due to WAL splitting failing for hbase:meta table.
[
https://issues.apache.org/jira/browse/HBASE-27382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Kyle Purtell updated HBASE-27382:
Fix Version/s: 2.5.4
(was: 2.5.3)
> Cluster completely down due to WAL splitting failing for hbase:meta table.
> --
>
> Key: HBASE-27382
> URL: https://issues.apache.org/jira/browse/HBASE-27382
> Project: HBase
> Issue Type: Bug
>Affects Versions: 2.5.0, 1.7.2, 2.4.14
>Reporter: Rushabh Shah
>Assignee: Rushabh Shah
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.17, 2.5.4
>
>
> We are running some version of 1.7.2 in our production environment. We
> encountered this issue recently.
> We colocate namenode and region server holding hbase:meta table on a set of 5
> master nodes. Co-incidentally active namenode and region server holding meta
> table were on the same physical node and that node went down due to hardware
> issue. We have sub optimal hdfs level timeouts configured so whenever active
> namenode goes down, it takes around 12-15 minutes for hdfs client within
> hbase to connect to new active namenode. So all the region servers were
> having problems for about 15 minutes to connect to new active namenode.
> Below are the sequence of events:
> 1. Host running active namenode and hbase:meta went down at +2022-09-09
> 16:56:56,878+
> 2. HMaster started running ServerCrashProcedure at +2022-09-09 16:59:05,696+
> {noformat}
> 2022-09-09 16:59:05,696 DEBUG [t-processor-pool2-t1]
> procedure2.ProcedureExecutor - Procedure ServerCrashProcedure
> serverName=,61020,1662714013670, shouldSplitWal=true,
> carryingMeta=true id=1 owner=dummy state=RUNNABLE:SERVER_CRASH_START added to
> the store.
> 2022-09-09 16:59:05,702 DEBUG [t-processor-pool2-t1] master.ServerManager -
> Added=,61020,1662714013670 to dead servers, submitted shutdown
> handler to be executed meta=true
> 2022-09-09 16:59:05,707 DEBUG [ProcedureExecutor-0] master.DeadServer -
> Started processing ,61020,1662714013670; numProcessing=1
> 2022-09-09 16:59:05,712 INFO [ProcedureExecutor-0]
> procedure.ServerCrashProcedure - Start processing crashed
> ,61020,1662714013670
> {noformat}
> 3. SplitLogManager created 2 split log tasks in zookeeper.
> {noformat}
> 2022-09-09 16:59:06,049 INFO [ProcedureExecutor-1] master.SplitLogManager -
> Started splitting 2 logs in
> [hdfs:///hbase/WALs/,61020,1662714013670-splitting]
> for [,61020,1662714013670]
> 2022-09-09 16:59:06,081 DEBUG [main-EventThread]
> coordination.SplitLogManagerCoordination - put up splitlog task at znode
> /hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662735651285.meta
> 2022-09-09 16:59:06,093 DEBUG [main-EventThread]
> coordination.SplitLogManagerCoordination - put up splitlog task at znode
> /hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662739251611.meta
> {noformat}
> 4. The first split log task is more interesting:
> +/hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662735651285.meta+
> 5. Since all the region servers were having problems connecting to active
> namenode, SplitLogManager tried total of 4 times to assign this task (3
> resubmits, configured by hbase.splitlog.max.resubmit) and then finally gave
> up.
> {noformat}
> -- try 1 -
> 2022-09-09 16:59:06,205 INFO [main-EventThread]
> coordination.SplitLogManagerCoordination - task
> /hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662735651285.meta
> acquired by ,61020,1662540522069
> -- try 2 -
> 2022-09-09 17:01:06,642 INFO [ager__ChoreService_1]
> coordination.SplitLogManagerCoordination - resubmitting task
> /hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662735651285.meta
> 2022-09-09 17:01:06,666 DEBUG [main-EventThread]
> coordination.SplitLogManagerCoordination - task not yet acquired
> /hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662735651285.meta
> ver = 2
> 2022-09-09 17:01:06,715 INFO [main-EventThread]
> coordination.SplitLogManagerCoordination - task
> /hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662735651285.meta
> acquired by ,61020,1662530684713
> -- try 3 -
> 2022-09-09 17:03:07,643 INFO [ager__ChoreService_1]
> coordination.SplitLogManagerCoordination - resubmitting task
> /hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662735651285.meta
> 2022-09-09 17:03:07,687 DEBUG [main-EventThread]
[jira] [Updated] (HBASE-27243) Fix TestQuotaThrottle after HBASE-27046
[ https://issues.apache.org/jira/browse/HBASE-27243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-27243: Fix Version/s: 2.5.4 (was: 2.5.3) > Fix TestQuotaThrottle after HBASE-27046 > --- > > Key: HBASE-27243 > URL: https://issues.apache.org/jira/browse/HBASE-27243 > Project: HBase > Issue Type: Test >Reporter: Andrew Kyle Purtell >Priority: Major > Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.17, 2.5.4 > > > TestQuotaThrottle breaks monotonic WAL numbering after HBASE-20746 because of > how it manipulates the EnvironmentEdge and was disabled by HBASE-27087. Fix > the test. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-27333) Abort RS when the hostname is different from master seen
[
https://issues.apache.org/jira/browse/HBASE-27333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Kyle Purtell updated HBASE-27333:
Fix Version/s: 2.5.4
(was: 2.5.3)
> Abort RS when the hostname is different from master seen
>
>
> Key: HBASE-27333
> URL: https://issues.apache.org/jira/browse/HBASE-27333
> Project: HBase
> Issue Type: Bug
> Components: regionserver
>Affects Versions: 3.0.0-alpha-3, 2.4.13
>Reporter: Xiaolin Ha
>Assignee: Xiaolin Ha
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.4
>
>
> For HRegionServer#handleReportForDutyResponse, when the hostname is different
> from the regionserver and master side, both the two conditions should abort
> RS.
> {code:java}
> if (
> !StringUtils.isBlank(useThisHostnameInstead)
> && !hostnameFromMasterPOV.equals(useThisHostnameInstead)
> ) {
> String msg = "Master passed us a different hostname to use; was="
> + this.useThisHostnameInstead + ", but now=" + hostnameFromMasterPOV;
> LOG.error(msg);
> throw new IOException(msg);
> }
> if (
> StringUtils.isBlank(useThisHostnameInstead)
> &&
> !hostnameFromMasterPOV.equals(rpcServices.getSocketAddress().getHostName())
> ) {
> String msg = "Master passed us a different hostname to use; was="
> + rpcServices.getSocketAddress().getHostName() + ", but now=" +
> hostnameFromMasterPOV;
> LOG.error(msg);
> } {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (HBASE-27380) RitDuration histogram metric is broken
[ https://issues.apache.org/jira/browse/HBASE-27380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-27380: Fix Version/s: 2.5.4 (was: 2.5.3) > RitDuration histogram metric is broken > -- > > Key: HBASE-27380 > URL: https://issues.apache.org/jira/browse/HBASE-27380 > Project: HBase > Issue Type: Bug >Reporter: Bryan Beaudreault >Priority: Minor > Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.4 > > > Looks like the method which updates it in MetricsAssignmentManager, > updateRitDuration, got broken somewhere along the way. It's no longer used. > We should wire this back up. > https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetricsAssignmentManager.java#L82 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-27543) May be miss data when use mob
[ https://issues.apache.org/jira/browse/HBASE-27543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-27543: Status: Patch Available (was: Open) > May be miss data when use mob > - > > Key: HBASE-27543 > URL: https://issues.apache.org/jira/browse/HBASE-27543 > Project: HBase > Issue Type: Bug > Components: mob >Affects Versions: 2.5.2, 3.0.0-alpha-3, 1.7.2 >Reporter: wenfeiyi666 >Assignee: wenfeiyi666 >Priority: Major > Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.4, 1.7.2 > > > After bulkload data into mob table or alter MOB_THRESHOLD, due to > FileDetails.latestPutTs err in compcation, may result in premature deletion > of data -- This message was sent by Atlassian Jira (v8.20.10#820010)
[GitHub] [hbase] dependabot[bot] opened a new pull request, #4980: Bump future from 0.18.2 to 0.18.3 in /dev-support
dependabot[bot] opened a new pull request, #4980: URL: https://github.com/apache/hbase/pull/4980 Bumps [future](https://github.com/PythonCharmers/python-future) from 0.18.2 to 0.18.3. Release notes Sourced from https://github.com/PythonCharmers/python-future/releases;>future's releases. v0.18.3 This is a minor bug-fix release containing a number of fixes: Backport fix for bpo-38804 (c91d70b) Fix bug in fix_print.py fixer (dffc579) Fix bug in fix_raise.py fixer (3401099) Fix newint bool in py3 (fe645ba) Fix bug in super() with metaclasses (6e27aac) docs: fix simple typo, reqest - request (974eb1f) Correct eq (c780bf5) Pass if lint fails (2abe00d) Update docker image and parcel out to constant variable. Add comment to update version constant (45cf382) fix order (f96a219) Add flake8 to image (046ff18) Make lint.sh executable (58cc984) Add docker push to optimize CI (01e8440) Build System (42b3025) Add docs build status badge to README.md (3f40bd7) Use same docs requirements in tox (18ecc5a) Add docs/requirements.txt (5f9893f) Add PY37_PLUS, PY38_PLUS, and PY39_PLUS (bee0247) fix 2.6 test, better comment (ddedcb9) fix 2.6 test (3f1ff7e) remove nan test (4dbded1) include list test values (e3f1a12) fix other python2 test issues (c051026) fix missing subTest (f006cad) import from old imp library on older python versions (fc84fa8) replace fstrings with format for python 3.4,3.5 (4a687ea) minor style/spelling fixes (8302d8c) improve cmp function, add unittest (0d95a40) Pin typing==3.7.4.1 for Python 3.3 compatiblity (1a48f1b) Fix various py26 unit test failures (9ca5a14) Add initial contributing guide with docs build instruction (e55f915) Add docs building to tox.ini (3ee9e7f) Support NumPy's specialized int types in builtins.round (b4b54f0) Added r to the docstring to avoid warnings in python3 (5f94572) Add subclasscheck for past.types.basestring (c9bc0ff) Correct example in README (681e78c) Add simple documentation (6c6e3ae) Add pre-commit hooks (a9c6a37) Handling of next and next by future.utils.get_next was reversed (52b0ff9) Add a test for our fix (461d77e) Compare headers to correct definition of str (3eaa8fd) https://github-redirect.dependabot.com/PythonCharmers/python-future/issues/322;>#322 Add support for negative ndigits in round; additionally, fixing a bug so that it handles passing in Decimal properly (a4911b9) Add tkFileDialog to future.movers.tkinter (f6a6549) Sort before comparing dicts in TestChainMap (6126997) Fix typo (4dfa099) Fix formatting in What's new (1663dfa) Fix typo (4236061) ... (truncated) Commits https://github.com/PythonCharmers/python-future/commit/af1db970b0879b59e7aeb798c27a623144561cff;>af1db97 Merge pull request https://github-redirect.dependabot.com/PythonCharmers/python-future/issues/613;>#613 from PythonCharmers/lwan/0.18.3-release https://github.com/PythonCharmers/python-future/commit/079ee9b75441d36447cec9981fa1b0032862f64d;>079ee9b Prepare for 0.18.3 release https://github.com/PythonCharmers/python-future/commit/02f7a8143d5b68f50a1cca44d8f5a58c1925a515;>02f7a81 Merge pull request https://github-redirect.dependabot.com/PythonCharmers/python-future/issues/610;>#610 from wshanks/wshanks-patch-1 https://github.com/PythonCharmers/python-future/commit/c91d70b34ef0402aef3e9d04364ba98509dca76f;>c91d70b Backport fix for bpo-38804 https://github.com/PythonCharmers/python-future/commit/80523f383fbba1c6de0551e19d0277e73e69573c;>80523f3 Merge pull request https://github-redirect.dependabot.com/PythonCharmers/python-future/issues/569;>#569 from jmadler/master https://github.com/PythonCharmers/python-future/commit/5e5af71549c7a7fa0e28f881046e081e231e455d;>5e5af71 Merge pull request https://github-redirect.dependabot.com/PythonCharmers/python-future/issues/582;>#582 from r3m0t/patch-6 https://github.com/PythonCharmers/python-future/commit/17e4bbd7c676a9a8efd20601e51675c95f74b330;>17e4bbd Merge pull request https://github-redirect.dependabot.com/PythonCharmers/python-future/issues/596;>#596 from abjonnes/fix-print-trailing-comma https://github.com/PythonCharmers/python-future/commit/1b427ba70191927706282840835e31ae0733ee7e;>1b427ba Merge branch 'xZise-official-count' into master https://github.com/PythonCharmers/python-future/commit/c8eb497336c76d300c6753b47c7f5de505660d7a;>c8eb497 Merge branch 'official-count' of https://github.com/xZise/python-future;>https://github.com/xZise/python-future into ... https://github.com/PythonCharmers/python-future/commit/dffc579dbb7c882fc01fa0c0dfa6b59acef7827d;>dffc579 Fix bug in fix_print.py fixer Additional commits viewable in https://github.com/PythonCharmers/python-future/compare/v0.18.2...v0.18.3;>compare view [![Dependabot compatibility
[jira] [Updated] (HBASE-27543) May be miss data when use mob
[ https://issues.apache.org/jira/browse/HBASE-27543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-27543: Fix Version/s: 2.5.4 2.6.0 (was: 2.5.3) > May be miss data when use mob > - > > Key: HBASE-27543 > URL: https://issues.apache.org/jira/browse/HBASE-27543 > Project: HBase > Issue Type: Bug > Components: mob >Affects Versions: 1.7.2, 3.0.0-alpha-3, 2.5.2 >Reporter: wenfeiyi666 >Assignee: wenfeiyi666 >Priority: Major > Fix For: 1.7.2, 2.6.0, 3.0.0-alpha-4, 2.5.4 > > > After bulkload data into mob table or alter MOB_THRESHOLD, due to > FileDetails.latestPutTs err in compcation, may result in premature deletion > of data -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-27561) hbase.master.port is ignored in processing of hbase.masters
[ https://issues.apache.org/jira/browse/HBASE-27561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-27561: Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was: Patch Available) > hbase.master.port is ignored in processing of hbase.masters > > > Key: HBASE-27561 > URL: https://issues.apache.org/jira/browse/HBASE-27561 > Project: HBase > Issue Type: Bug > Components: Client >Affects Versions: 2.5.2 >Reporter: Andrew Kyle Purtell >Assignee: Andrew Kyle Purtell >Priority: Minor > Fix For: 3.0.0-alpha-4, 2.4.16, 2.5.3 > > > Setting of hbase.master.port is ignored in default processing of > hbase.masters. > For example, > hbase.masters=localhost > hbase.master.port=8100 > "Server at localhost:16000" is in the failed servers list" > hbase.masters=localhost:8100 > hbase.master.port=8100 > and all is well. This is confusing and a minor configuration handling bug. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-27243) Fix TestQuotaThrottle after HBASE-27046
[ https://issues.apache.org/jira/browse/HBASE-27243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-27243: Fix Version/s: 2.4.17 (was: 2.4.16) > Fix TestQuotaThrottle after HBASE-27046 > --- > > Key: HBASE-27243 > URL: https://issues.apache.org/jira/browse/HBASE-27243 > Project: HBase > Issue Type: Test >Reporter: Andrew Kyle Purtell >Priority: Major > Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.3, 2.4.17 > > > TestQuotaThrottle breaks monotonic WAL numbering after HBASE-20746 because of > how it manipulates the EnvironmentEdge and was disabled by HBASE-27087. Fix > the test. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-27382) Cluster completely down due to WAL splitting failing for hbase:meta table.
[
https://issues.apache.org/jira/browse/HBASE-27382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Kyle Purtell updated HBASE-27382:
Fix Version/s: 2.4.17
(was: 2.4.16)
> Cluster completely down due to WAL splitting failing for hbase:meta table.
> --
>
> Key: HBASE-27382
> URL: https://issues.apache.org/jira/browse/HBASE-27382
> Project: HBase
> Issue Type: Bug
>Affects Versions: 2.5.0, 1.7.2, 2.4.14
>Reporter: Rushabh Shah
>Assignee: Rushabh Shah
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.5.3, 2.4.17
>
>
> We are running some version of 1.7.2 in our production environment. We
> encountered this issue recently.
> We colocate namenode and region server holding hbase:meta table on a set of 5
> master nodes. Co-incidentally active namenode and region server holding meta
> table were on the same physical node and that node went down due to hardware
> issue. We have sub optimal hdfs level timeouts configured so whenever active
> namenode goes down, it takes around 12-15 minutes for hdfs client within
> hbase to connect to new active namenode. So all the region servers were
> having problems for about 15 minutes to connect to new active namenode.
> Below are the sequence of events:
> 1. Host running active namenode and hbase:meta went down at +2022-09-09
> 16:56:56,878+
> 2. HMaster started running ServerCrashProcedure at +2022-09-09 16:59:05,696+
> {noformat}
> 2022-09-09 16:59:05,696 DEBUG [t-processor-pool2-t1]
> procedure2.ProcedureExecutor - Procedure ServerCrashProcedure
> serverName=,61020,1662714013670, shouldSplitWal=true,
> carryingMeta=true id=1 owner=dummy state=RUNNABLE:SERVER_CRASH_START added to
> the store.
> 2022-09-09 16:59:05,702 DEBUG [t-processor-pool2-t1] master.ServerManager -
> Added=,61020,1662714013670 to dead servers, submitted shutdown
> handler to be executed meta=true
> 2022-09-09 16:59:05,707 DEBUG [ProcedureExecutor-0] master.DeadServer -
> Started processing ,61020,1662714013670; numProcessing=1
> 2022-09-09 16:59:05,712 INFO [ProcedureExecutor-0]
> procedure.ServerCrashProcedure - Start processing crashed
> ,61020,1662714013670
> {noformat}
> 3. SplitLogManager created 2 split log tasks in zookeeper.
> {noformat}
> 2022-09-09 16:59:06,049 INFO [ProcedureExecutor-1] master.SplitLogManager -
> Started splitting 2 logs in
> [hdfs:///hbase/WALs/,61020,1662714013670-splitting]
> for [,61020,1662714013670]
> 2022-09-09 16:59:06,081 DEBUG [main-EventThread]
> coordination.SplitLogManagerCoordination - put up splitlog task at znode
> /hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662735651285.meta
> 2022-09-09 16:59:06,093 DEBUG [main-EventThread]
> coordination.SplitLogManagerCoordination - put up splitlog task at znode
> /hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662739251611.meta
> {noformat}
> 4. The first split log task is more interesting:
> +/hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662735651285.meta+
> 5. Since all the region servers were having problems connecting to active
> namenode, SplitLogManager tried total of 4 times to assign this task (3
> resubmits, configured by hbase.splitlog.max.resubmit) and then finally gave
> up.
> {noformat}
> -- try 1 -
> 2022-09-09 16:59:06,205 INFO [main-EventThread]
> coordination.SplitLogManagerCoordination - task
> /hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662735651285.meta
> acquired by ,61020,1662540522069
> -- try 2 -
> 2022-09-09 17:01:06,642 INFO [ager__ChoreService_1]
> coordination.SplitLogManagerCoordination - resubmitting task
> /hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662735651285.meta
> 2022-09-09 17:01:06,666 DEBUG [main-EventThread]
> coordination.SplitLogManagerCoordination - task not yet acquired
> /hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662735651285.meta
> ver = 2
> 2022-09-09 17:01:06,715 INFO [main-EventThread]
> coordination.SplitLogManagerCoordination - task
> /hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662735651285.meta
> acquired by ,61020,1662530684713
> -- try 3 -
> 2022-09-09 17:03:07,643 INFO [ager__ChoreService_1]
> coordination.SplitLogManagerCoordination - resubmitting task
> /hbase/splitWAL/WALs%2F%2C61020%2C1662714013670-splitting%2F%252C61020%252C1662714013670.meta.1662735651285.meta
> 2022-09-09 17:03:07,687 DEBUG
[GitHub] [hbase] apurtell merged pull request #4952: HBASE-27561 hbase.master.port is ignored in processing of hbase.masters
apurtell merged PR #4952: URL: https://github.com/apache/hbase/pull/4952 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4945: HBASE-27551 Add config options to delay assignment to retain last region location
Apache-HBase commented on PR #4945: URL: https://github.com/apache/hbase/pull/4945#issuecomment-1386052349 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 58s | Docker mode activated. | | -0 :warning: | yetus | 0m 2s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 48s | master passed | | +1 :green_heart: | compile | 0m 47s | master passed | | +1 :green_heart: | shadedjars | 3m 48s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 27s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 33s | the patch passed | | +1 :green_heart: | compile | 0m 46s | the patch passed | | +1 :green_heart: | javac | 0m 46s | the patch passed | | +1 :green_heart: | shadedjars | 3m 46s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 25s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 211m 35s | hbase-server in the patch passed. | | | | 231m 56s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4945/8/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4945 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux de762b811003 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / da261344cc | | Default Java | Eclipse Adoptium-11.0.17+8 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4945/8/testReport/ | | Max. process+thread count | 2426 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4945/8/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4945: HBASE-27551 Add config options to delay assignment to retain last region location
Apache-HBase commented on PR #4945: URL: https://github.com/apache/hbase/pull/4945#issuecomment-1385813002 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 2m 52s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 19s | master passed | | +1 :green_heart: | compile | 2m 59s | master passed | | +1 :green_heart: | checkstyle | 0m 39s | master passed | | +1 :green_heart: | spotless | 0m 50s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 48s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 6s | the patch passed | | +1 :green_heart: | compile | 2m 57s | the patch passed | | +1 :green_heart: | javac | 2m 57s | the patch passed | | +1 :green_heart: | checkstyle | 0m 38s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 10m 59s | Patch does not cause any errors with Hadoop 3.2.4 3.3.4. | | +1 :green_heart: | spotless | 0m 49s | patch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 2m 1s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 9s | The patch does not generate ASF License warnings. | | | | 39m 54s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4945/8/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4945 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux 77c12a52a449 5.4.0-135-generic #152-Ubuntu SMP Wed Nov 23 20:19:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / da261344cc | | Default Java | Eclipse Adoptium-11.0.17+8 | | Max. process+thread count | 86 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4945/8/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4933: HBASE-27541 Add support for defining restore hfile output path
Apache-HBase commented on PR #4933: URL: https://github.com/apache/hbase/pull/4933#issuecomment-1385794267 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 3s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 24s | master passed | | +1 :green_heart: | compile | 0m 28s | master passed | | +1 :green_heart: | checkstyle | 0m 9s | master passed | | +1 :green_heart: | spotless | 0m 49s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 0m 34s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 57s | the patch passed | | +1 :green_heart: | compile | 0m 25s | the patch passed | | +1 :green_heart: | javac | 0m 25s | the patch passed | | +1 :green_heart: | checkstyle | 0m 9s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 10m 45s | Patch does not cause any errors with Hadoop 3.2.4 3.3.4. | | +1 :green_heart: | spotless | 0m 50s | patch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 0m 42s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 8s | The patch does not generate ASF License warnings. | | | | 28m 58s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4933/15/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4933 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux d1f30c40da89 5.4.0-1093-aws #102~18.04.2-Ubuntu SMP Wed Dec 7 00:31:59 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / da261344cc | | Default Java | Eclipse Adoptium-11.0.17+8 | | Max. process+thread count | 75 (vs. ulimit of 3) | | modules | C: hbase-backup U: hbase-backup | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4933/15/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4933: HBASE-27541 Add support for defining restore hfile output path
Apache-HBase commented on PR #4933: URL: https://github.com/apache/hbase/pull/4933#issuecomment-1385790671 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 1s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 16s | master passed | | +1 :green_heart: | compile | 0m 16s | master passed | | +1 :green_heart: | shadedjars | 3m 49s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 13s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 15s | the patch passed | | +1 :green_heart: | compile | 0m 16s | the patch passed | | +1 :green_heart: | javac | 0m 16s | the patch passed | | +1 :green_heart: | shadedjars | 3m 51s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 13s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 11m 10s | hbase-backup in the patch passed. | | | | 26m 8s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4933/15/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4933 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 5ebb16049800 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / da261344cc | | Default Java | Temurin-1.8.0_352-b08 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4933/15/testReport/ | | Max. process+thread count | 3167 (vs. ulimit of 3) | | modules | C: hbase-backup U: hbase-backup | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4933/15/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4933: HBASE-27541 Add support for defining restore hfile output path
Apache-HBase commented on PR #4933: URL: https://github.com/apache/hbase/pull/4933#issuecomment-1385789010 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 45s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 27s | master passed | | +1 :green_heart: | compile | 0m 13s | master passed | | +1 :green_heart: | shadedjars | 3m 53s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 11s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 19s | the patch passed | | +1 :green_heart: | compile | 0m 15s | the patch passed | | +1 :green_heart: | javac | 0m 15s | the patch passed | | +1 :green_heart: | shadedjars | 3m 56s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 11s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 9m 25s | hbase-backup in the patch passed. | | | | 24m 32s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4933/15/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4933 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux ae6baf119e96 5.4.0-1092-aws #100~18.04.2-Ubuntu SMP Tue Nov 29 08:39:52 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / da261344cc | | Default Java | Eclipse Adoptium-11.0.17+8 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4933/15/testReport/ | | Max. process+thread count | 3593 (vs. ulimit of 3) | | modules | C: hbase-backup U: hbase-backup | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4933/15/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-27568) ChaosMonkey add support for JournalNodes
[ https://issues.apache.org/jira/browse/HBASE-27568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk updated HBASE-27568: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the review [~reidchan]. > ChaosMonkey add support for JournalNodes > > > Key: HBASE-27568 > URL: https://issues.apache.org/jira/browse/HBASE-27568 > Project: HBase > Issue Type: Task > Components: integration tests >Affects Versions: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk >Priority: Major > Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3 > > > Looks like our ChaosMonkey knowledge of HDFS topology is stale. Add the > concept of a Journal Node to ClusterManager et al. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-27568) ChaosMonkey add support for JournalNodes
[ https://issues.apache.org/jira/browse/HBASE-27568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk updated HBASE-27568: - Fix Version/s: 2.6.0 2.4.16 2.5.3 > ChaosMonkey add support for JournalNodes > > > Key: HBASE-27568 > URL: https://issues.apache.org/jira/browse/HBASE-27568 > Project: HBase > Issue Type: Task > Components: integration tests >Affects Versions: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk >Priority: Major > Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3 > > > Looks like our ChaosMonkey knowledge of HDFS topology is stale. Add the > concept of a Journal Node to ClusterManager et al. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[GitHub] [hbase] ndimiduk merged pull request #4978: Backport "HBASE-27568 ChaosMonkey add support for JournalNodes" to branch-2.4
ndimiduk merged PR #4978: URL: https://github.com/apache/hbase/pull/4978 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] ndimiduk merged pull request #4977: Backport "HBASE-27568 ChaosMonkey add support for JournalNodes" to branch-2.5
ndimiduk merged PR #4977: URL: https://github.com/apache/hbase/pull/4977 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] ndimiduk merged pull request #4976: Backport "HBASE-27568 ChaosMonkey add support for JournalNodes" to branch-2
ndimiduk merged PR #4976: URL: https://github.com/apache/hbase/pull/4976 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-27557) [JDK17] Update shade plugin version
[
https://issues.apache.org/jira/browse/HBASE-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677859#comment-17677859
]
Hudson commented on HBASE-27557:
Results for branch branch-2.5
[build #280 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/280/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/280/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/280/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/280/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/280/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> [JDK17] Update shade plugin version
> ---
>
> Key: HBASE-27557
> URL: https://issues.apache.org/jira/browse/HBASE-27557
> Project: HBase
> Issue Type: Sub-task
>Reporter: tianhang tang
>Assignee: tianhang tang
>Priority: Minor
> Attachments: image-2023-01-06-18-54-09-703.png
>
>
> maven-shade-plugin:3.2.4 cannot support JDK17, if build HBase with
> releaseTarget=17 will meet this error:
> !image-2023-01-06-18-54-09-703.png!
> So need to update it's version.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27529) Provide RS coproc ability to attach WAL extended attributes to mutations at replication sink
[
https://issues.apache.org/jira/browse/HBASE-27529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677858#comment-17677858
]
Hudson commented on HBASE-27529:
Results for branch branch-2.5
[build #280 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/280/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/280/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/280/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/280/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/280/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Provide RS coproc ability to attach WAL extended attributes to mutations at
> replication sink
>
>
> Key: HBASE-27529
> URL: https://issues.apache.org/jira/browse/HBASE-27529
> Project: HBase
> Issue Type: Improvement
> Components: Coprocessors, Replication
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3
>
>
> HBase provides coproc ability to enhance WALKey attributes (a.k.a. WAL
> annotations) in order for the replication sink cluster to build required
> metadata with the mutations. The endpoint is preWALAppend(). This ability was
> provided by HBASE-22622. The map of extended attributes is optional and hence
> not directly used by hbase internally.
> For any hbase downstreamers to build CDC (Change Data Capture) like
> functionality, it might required additional metadata in addition to the ones
> being used by hbase already (replication scope, list of cluster ids, seq id,
> table name, region id etc). For instance, Phoenix uses many additional
> attributes like tenant id, schema name, table type etc.
> We already have this extended map of attributes available in WAL protobuf, to
> provide us the capability to (de)serialize it. While creating new
> ReplicateWALEntryRequest from the list of WAL entires, we are able to
> serialize the additional attributes. Similarly, at the replication sink side,
> the deserialized WALEntry has the extended attributes available.
> At the sink cluster, we should be able to attach the deserialized extended
> attributes to the newly generated mutations so that the peer cluster can
> utilize the mutation attributes to re-build required metadata.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27567) Introduce ChaosMonkey Action to print HDFS Cluster status
[
https://issues.apache.org/jira/browse/HBASE-27567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677857#comment-17677857
]
Hudson commented on HBASE-27567:
Results for branch branch-2.5
[build #280 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/280/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/280/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/280/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/280/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/280/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Introduce ChaosMonkey Action to print HDFS Cluster status
> -
>
> Key: HBASE-27567
> URL: https://issues.apache.org/jira/browse/HBASE-27567
> Project: HBase
> Issue Type: Task
> Components: integration tests
>Affects Versions: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
>Priority: Minor
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3
>
>
> We have ChaosMonkey actions for perturbing HDFS components, but we lack a
> means to periodically display status/health. Introduce a "dump" action
> similar to the one we have for HBase.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27557) [JDK17] Update shade plugin version
[
https://issues.apache.org/jira/browse/HBASE-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677850#comment-17677850
]
Hudson commented on HBASE-27557:
Results for branch branch-2
[build #720 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/720/]:
(/) *{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/720/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/720/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/720/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/720/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> [JDK17] Update shade plugin version
> ---
>
> Key: HBASE-27557
> URL: https://issues.apache.org/jira/browse/HBASE-27557
> Project: HBase
> Issue Type: Sub-task
>Reporter: tianhang tang
>Assignee: tianhang tang
>Priority: Minor
> Attachments: image-2023-01-06-18-54-09-703.png
>
>
> maven-shade-plugin:3.2.4 cannot support JDK17, if build HBase with
> releaseTarget=17 will meet this error:
> !image-2023-01-06-18-54-09-703.png!
> So need to update it's version.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[GitHub] [hbase] Apache-HBase commented on pull request #4978: Backport "HBASE-27568 ChaosMonkey add support for JournalNodes" to branch-2.4
Apache-HBase commented on PR #4978: URL: https://github.com/apache/hbase/pull/4978#issuecomment-1385753970 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 2m 20s | Docker mode activated. | | -0 :warning: | yetus | 0m 5s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ branch-2.4 Compile Tests _ | | +0 :ok: | mvndep | 0m 14s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 3s | branch-2.4 passed | | +1 :green_heart: | compile | 1m 9s | branch-2.4 passed | | +1 :green_heart: | shadedjars | 5m 28s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 43s | branch-2.4 passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 17s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 3m 32s | the patch passed | | +1 :green_heart: | compile | 1m 9s | the patch passed | | +1 :green_heart: | javac | 1m 9s | the patch passed | | +1 :green_heart: | shadedjars | 5m 27s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 37s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 185m 24s | hbase-server in the patch passed. | | +1 :green_heart: | unit | 1m 11s | hbase-it in the patch passed. | | | | 215m 1s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4978/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4978 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 9ab6c72b606c 5.4.0-1088-aws #96~18.04.1-Ubuntu SMP Mon Oct 17 02:57:48 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | branch-2.4 / 6d2064d443 | | Default Java | Eclipse Adoptium-11.0.17+8 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4978/1/testReport/ | | Max. process+thread count | 2948 (vs. ulimit of 3) | | modules | C: hbase-server hbase-it U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4978/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4976: Backport "HBASE-27568 ChaosMonkey add support for JournalNodes" to branch-2
Apache-HBase commented on PR #4976: URL: https://github.com/apache/hbase/pull/4976#issuecomment-1385753647 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 32s | Docker mode activated. | | -0 :warning: | yetus | 0m 5s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ branch-2 Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 23s | branch-2 passed | | +1 :green_heart: | compile | 1m 19s | branch-2 passed | | +1 :green_heart: | shadedjars | 4m 39s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 47s | branch-2 passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 16s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 3m 26s | the patch passed | | +1 :green_heart: | compile | 1m 22s | the patch passed | | +1 :green_heart: | javac | 1m 22s | the patch passed | | +1 :green_heart: | shadedjars | 4m 25s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 40s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 238m 53s | hbase-server in the patch passed. | | +1 :green_heart: | unit | 1m 29s | hbase-it in the patch passed. | | | | 265m 44s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4976/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4976 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 35ce930a1ac4 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | branch-2 / 3a7c732f69 | | Default Java | Eclipse Adoptium-11.0.17+8 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4976/1/testReport/ | | Max. process+thread count | 2371 (vs. ulimit of 3) | | modules | C: hbase-server hbase-it U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4976/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4978: Backport "HBASE-27568 ChaosMonkey add support for JournalNodes" to branch-2.4
Apache-HBase commented on PR #4978: URL: https://github.com/apache/hbase/pull/4978#issuecomment-1385742315 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 20s | Docker mode activated. | | -0 :warning: | yetus | 0m 6s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ branch-2.4 Compile Tests _ | | +0 :ok: | mvndep | 0m 13s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 50s | branch-2.4 passed | | +1 :green_heart: | compile | 1m 16s | branch-2.4 passed | | +1 :green_heart: | shadedjars | 5m 8s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 37s | branch-2.4 passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 12s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 23s | the patch passed | | +1 :green_heart: | compile | 1m 1s | the patch passed | | +1 :green_heart: | javac | 1m 1s | the patch passed | | +1 :green_heart: | shadedjars | 4m 37s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 38s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 181m 15s | hbase-server in the patch passed. | | +1 :green_heart: | unit | 1m 1s | hbase-it in the patch passed. | | | | 206m 34s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4978/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4978 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux e370e03fd09d 5.4.0-1088-aws #96~18.04.1-Ubuntu SMP Mon Oct 17 02:57:48 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | branch-2.4 / 6d2064d443 | | Default Java | Temurin-1.8.0_352-b08 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4978/1/testReport/ | | Max. process+thread count | 2609 (vs. ulimit of 3) | | modules | C: hbase-server hbase-it U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4978/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] wchevreuil commented on pull request #4945: HBASE-27551 Add config options to delay assignment to retain last region location
wchevreuil commented on PR #4945: URL: https://github.com/apache/hbase/pull/4945#issuecomment-1385730903 Hi @Apache9 @petersomogyi @taklwu , any other comments/suggestions? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4977: Backport "HBASE-27568 ChaosMonkey add support for JournalNodes" to branch-2.5
Apache-HBase commented on PR #4977: URL: https://github.com/apache/hbase/pull/4977#issuecomment-1385720784 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 25s | Docker mode activated. | | -0 :warning: | yetus | 0m 6s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ branch-2.5 Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 46s | branch-2.5 passed | | +1 :green_heart: | compile | 1m 7s | branch-2.5 passed | | +1 :green_heart: | shadedjars | 4m 11s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 35s | branch-2.5 passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 13s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 23s | the patch passed | | +1 :green_heart: | compile | 1m 18s | the patch passed | | +1 :green_heart: | javac | 1m 18s | the patch passed | | +1 :green_heart: | shadedjars | 3m 50s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 36s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 220m 35s | hbase-server in the patch passed. | | +1 :green_heart: | unit | 1m 10s | hbase-it in the patch passed. | | | | 244m 40s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4977/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4977 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux ebda5716e9cb 5.4.0-135-generic #152-Ubuntu SMP Wed Nov 23 20:19:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | branch-2.5 / c1e551a466 | | Default Java | Temurin-1.8.0_352-b08 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4977/1/testReport/ | | Max. process+thread count | 2626 (vs. ulimit of 3) | | modules | C: hbase-server hbase-it U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4977/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-27109) Move replication queue storage from zookeeper to a separated HBase table
[
https://issues.apache.org/jira/browse/HBASE-27109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677840#comment-17677840
]
Hudson commented on HBASE-27109:
Results for branch HBASE-27109/table_based_rqs
[build #44 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/HBASE-27109%252Ftable_based_rqs/44/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/HBASE-27109%252Ftable_based_rqs/44/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/HBASE-27109%252Ftable_based_rqs/44/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/HBASE-27109%252Ftable_based_rqs/44/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Move replication queue storage from zookeeper to a separated HBase table
>
>
> Key: HBASE-27109
> URL: https://issues.apache.org/jira/browse/HBASE-27109
> Project: HBase
> Issue Type: New Feature
> Components: Replication
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
>
> This is a more specific issue based on the works which are already done in
> HBASE-15867.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[GitHub] [hbase] Apache-HBase commented on pull request #4976: Backport "HBASE-27568 ChaosMonkey add support for JournalNodes" to branch-2
Apache-HBase commented on PR #4976: URL: https://github.com/apache/hbase/pull/4976#issuecomment-1385715948 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 6m 14s | Docker mode activated. | | -0 :warning: | yetus | 0m 5s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ branch-2 Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 20s | branch-2 passed | | +1 :green_heart: | compile | 0m 58s | branch-2 passed | | +1 :green_heart: | shadedjars | 3m 41s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 37s | branch-2 passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 13s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 10s | the patch passed | | +1 :green_heart: | compile | 0m 57s | the patch passed | | +1 :green_heart: | javac | 0m 57s | the patch passed | | +1 :green_heart: | shadedjars | 3m 44s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 37s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 213m 52s | hbase-server in the patch failed. | | +1 :green_heart: | unit | 1m 11s | hbase-it in the patch passed. | | | | 241m 9s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4976/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4976 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 1377011ee069 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | branch-2 / 3a7c732f69 | | Default Java | Temurin-1.8.0_352-b08 | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4976/1/artifact/yetus-jdk8-hadoop2-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4976/1/testReport/ | | Max. process+thread count | 2054 (vs. ulimit of 3) | | modules | C: hbase-server hbase-it U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4976/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4979: HBASE-27574 Implement ClusterManager interface for Kubernetes
Apache-HBase commented on PR #4979: URL: https://github.com/apache/hbase/pull/4979#issuecomment-1385712897 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 35s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 43s | master passed | | +1 :green_heart: | compile | 0m 24s | master passed | | +1 :green_heart: | checkstyle | 0m 10s | master passed | | +1 :green_heart: | spotless | 0m 41s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 0m 23s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 23s | the patch passed | | +1 :green_heart: | compile | 0m 24s | the patch passed | | +1 :green_heart: | javac | 0m 24s | the patch passed | | +1 :green_heart: | checkstyle | 0m 8s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 1s | The patch has no ill-formed XML file. | | +1 :green_heart: | hadoopcheck | 9m 4s | Patch does not cause any errors with Hadoop 3.2.4 3.3.4. | | +1 :green_heart: | spotless | 0m 37s | patch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 0m 28s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 9s | The patch does not generate ASF License warnings. | | | | 23m 50s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4979/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4979 | | Optional Tests | dupname asflicense javac hadoopcheck spotless xml compile spotbugs hbaseanti checkstyle | | uname | Linux a1ff09085b00 5.4.0-1093-aws #102~18.04.2-Ubuntu SMP Wed Dec 7 00:31:59 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / da261344cc | | Default Java | Eclipse Adoptium-11.0.17+8 | | Max. process+thread count | 80 (vs. ulimit of 3) | | modules | C: hbase-it U: hbase-it | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4979/1/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4979: HBASE-27574 Implement ClusterManager interface for Kubernetes
Apache-HBase commented on PR #4979: URL: https://github.com/apache/hbase/pull/4979#issuecomment-1385703720 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 4s | Docker mode activated. | | -0 :warning: | yetus | 0m 4s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 48s | master passed | | +1 :green_heart: | compile | 0m 19s | master passed | | +1 :green_heart: | shadedjars | 3m 53s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 14s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 33s | the patch passed | | +1 :green_heart: | compile | 0m 20s | the patch passed | | +1 :green_heart: | javac | 0m 20s | the patch passed | | +1 :green_heart: | shadedjars | 3m 49s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 13s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 42s | hbase-it in the patch passed. | | | | 16m 50s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4979/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4979 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 1eab1961a285 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / da261344cc | | Default Java | Eclipse Adoptium-11.0.17+8 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4979/1/testReport/ | | Max. process+thread count | 591 (vs. ulimit of 3) | | modules | C: hbase-it U: hbase-it | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4979/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4979: HBASE-27574 Implement ClusterManager interface for Kubernetes
Apache-HBase commented on PR #4979: URL: https://github.com/apache/hbase/pull/4979#issuecomment-1385701941 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 33s | Docker mode activated. | | -0 :warning: | yetus | 0m 2s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 27s | master passed | | +1 :green_heart: | compile | 0m 15s | master passed | | +1 :green_heart: | shadedjars | 4m 3s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 11s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 6s | the patch passed | | +1 :green_heart: | compile | 0m 16s | the patch passed | | +1 :green_heart: | javac | 0m 16s | the patch passed | | +1 :green_heart: | shadedjars | 4m 2s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 9s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 36s | hbase-it in the patch passed. | | | | 15m 48s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4979/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4979 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux b92ac772cc91 5.4.0-1093-aws #102~18.04.2-Ubuntu SMP Wed Dec 7 00:31:59 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / da261344cc | | Default Java | Temurin-1.8.0_352-b08 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4979/1/testReport/ | | Max. process+thread count | 554 (vs. ulimit of 3) | | modules | C: hbase-it U: hbase-it | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4979/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] ndimiduk commented on pull request #4979: HBASE-27574 Implement ClusterManager interface for Kubernetes
ndimiduk commented on PR #4979: URL: https://github.com/apache/hbase/pull/4979#issuecomment-1385665239 Transitive hull of the new dependencies. Should we be shading these? ``` [INFO] +- io.kubernetes:client-java:jar:17.0.0:test [INFO] | +- io.prometheus:simpleclient:jar:0.15.0:test [INFO] | | +- io.prometheus:simpleclient_tracer_otel:jar:0.15.0:test [INFO] | | | \- io.prometheus:simpleclient_tracer_common:jar:0.15.0:test [INFO] | | \- io.prometheus:simpleclient_tracer_otel_agent:jar:0.15.0:test [INFO] | +- io.prometheus:simpleclient_httpserver:jar:0.15.0:test [INFO] | | \- io.prometheus:simpleclient_common:jar:0.15.0:test [INFO] | +- io.kubernetes:client-java-proto:jar:17.0.0:test [INFO] | +- org.yaml:snakeyaml:jar:1.33:test [INFO] | +- org.apache.commons:commons-compress:jar:1.22:compile [INFO] | +- org.bouncycastle:bcpkix-jdk18on:jar:1.72:test [INFO] | | +- org.bouncycastle:bcprov-jdk18on:jar:1.72:test [INFO] | | \- org.bouncycastle:bcutil-jdk18on:jar:1.72:test [INFO] | +- com.google.protobuf:protobuf-java:jar:3.21.10:compile [INFO] | +- org.apache.commons:commons-collections4:jar:4.4:test [INFO] | \- org.bitbucket.b_c:jose4j:jar:0.9.2:test [INFO] +- io.kubernetes:client-java-api:jar:17.0.0:test [INFO] | +- io.swagger:swagger-annotations:jar:1.6.9:test [INFO] | +- com.squareup.okhttp3:okhttp:jar:4.10.0:test [INFO] | | +- com.squareup.okio:okio-jvm:jar:3.0.0:test [INFO] | | | \- org.jetbrains.kotlin:kotlin-stdlib-common:jar:1.5.31:test [INFO] | | \- org.jetbrains.kotlin:kotlin-stdlib:jar:1.6.20:test [INFO] | | \- org.jetbrains:annotations:jar:13.0:test [INFO] | +- com.squareup.okhttp3:logging-interceptor:jar:4.10.0:test [INFO] | | \- org.jetbrains.kotlin:kotlin-stdlib-jdk8:jar:1.6.10:test [INFO] | | \- org.jetbrains.kotlin:kotlin-stdlib-jdk7:jar:1.6.10:test [INFO] | +- com.google.code.gson:gson:jar:2.10:compile [INFO] | \- io.gsonfire:gson-fire:jar:1.8.5:test ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4977: Backport "HBASE-27568 ChaosMonkey add support for JournalNodes" to branch-2.5
Apache-HBase commented on PR #4977: URL: https://github.com/apache/hbase/pull/4977#issuecomment-1385664926 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 57s | Docker mode activated. | | -0 :warning: | yetus | 0m 6s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ branch-2.5 Compile Tests _ | | +0 :ok: | mvndep | 0m 12s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 40s | branch-2.5 passed | | +1 :green_heart: | compile | 0m 58s | branch-2.5 passed | | +1 :green_heart: | shadedjars | 4m 4s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 33s | branch-2.5 passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 15s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 21s | the patch passed | | +1 :green_heart: | compile | 0m 59s | the patch passed | | +1 :green_heart: | javac | 0m 59s | the patch passed | | +1 :green_heart: | shadedjars | 4m 0s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 32s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 183m 13s | hbase-server in the patch passed. | | +1 :green_heart: | unit | 0m 58s | hbase-it in the patch passed. | | | | 205m 28s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4977/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4977 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux e976b58a3dc4 5.4.0-1088-aws #96~18.04.1-Ubuntu SMP Mon Oct 17 02:57:48 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | branch-2.5 / c1e551a466 | | Default Java | Eclipse Adoptium-11.0.17+8 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4977/1/testReport/ | | Max. process+thread count | 2614 (vs. ulimit of 3) | | modules | C: hbase-server hbase-it U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4977/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-27574) Implement ClusterManager interface for Kubernetes
[
https://issues.apache.org/jira/browse/HBASE-27574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nick Dimiduk updated HBASE-27574:
-
Status: Patch Available (was: Open)
> Implement ClusterManager interface for Kubernetes
> -
>
> Key: HBASE-27574
> URL: https://issues.apache.org/jira/browse/HBASE-27574
> Project: HBase
> Issue Type: Improvement
> Components: integration tests
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
>Priority: Major
>
> Implement the {{ClusterManager}} interface enough such that we can run the
> ChaosMonkey against a deployment on Kubernetes.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[GitHub] [hbase] ndimiduk opened a new pull request, #4979: HBASE-27574 Implement ClusterManager interface for Kubernetes
ndimiduk opened a new pull request, #4979: URL: https://github.com/apache/hbase/pull/4979 A basic implementation that supports taking destructive actions. Assume that services are running behind a resilient `Deployment` of some kind, and that the cluster will handle starting up replacement processes. Requires specification of a scoping namespace. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-27574) Implement ClusterManager interface for Kubernetes
[
https://issues.apache.org/jira/browse/HBASE-27574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nick Dimiduk updated HBASE-27574:
-
Summary: Implement ClusterManager interface for Kubernetes (was: Implement
ClusterManage interface for Kubernetes)
> Implement ClusterManager interface for Kubernetes
> -
>
> Key: HBASE-27574
> URL: https://issues.apache.org/jira/browse/HBASE-27574
> Project: HBase
> Issue Type: Improvement
> Components: integration tests
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
>Priority: Major
>
> Implement the {{ClusterManager}} interface enough such that we can run the
> ChaosMonkey against a deployment on Kubernetes.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (HBASE-27572) resource leak for store flush during high load
[
https://issues.apache.org/jira/browse/HBASE-27572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677819#comment-17677819
]
Mariusz Szpatuśko commented on HBASE-27572:
---
2023-01-17 10:04:01,710 WARN
[RpcServer.default.RWQ.Fifo.read.handler=42,queue=5,port=16020] ipc.RpcServer:
(responseTooSlow):
\{"call":"Scan(org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ScanRequest)","starttimems":"1673949830565","responsesize":"24530","method":"Scan","param":"region
{ type: REGION_NAME value:
\"","processingtimems":11144,"client":"xxx","queuetimems":0,"class":"HRegionServer","scandetails":"table:
xxx region: "}
2023-01-17 10:04:27,246 ERROR
[RpcServer.default.RWQ.Fifo.read.handler=39,queue=13,port=16020]
util.ResourceLeakDetector: ver.HStore.flushCache(HStore.java:992)
org.apache.hadoop.hbase.regionserver.HStore$StoreFlusherImpl.flushCache(HStore.java:2358)
org.apache.hadoop.hbase.regionserver.HRegion.internalFlushCacheAndCommit(HRegion.java:2837)
org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2579)
org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2551)
org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2542)
org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1614)
org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1553)
org.apache.hadoop.hbase.regionserver.handler.UnassignRegionHandler.process(UnassignRegionHandler.java:118)
org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:98)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:748)
2023-01-17 00:56:45,392 ERROR
[regionserver/tks-prod-dar-storage-3:16020-shortCompactions-0]
util.ResourceLeakDetector:
nserver.HRegion.replayRecoveredEditsIfAny(HRegion.java:5155)
org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:996)
org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:937)
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7895)
org.apache.hadoop.hbase.regionserver.HRegion.openHRegionFromTableDir(HRegion.java:7852)
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7828)
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7787)
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7743)
org.apache.hadoop.hbase.regionserver.handler.AssignRegionHandler.process(AssignRegionHandler.java:147)
org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:98)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:748)
> resource leak for store flush during high load
> --
>
> Key: HBASE-27572
> URL: https://issues.apache.org/jira/browse/HBASE-27572
> Project: HBase
> Issue Type: Bug
> Components: regionserver
>Affects Versions: 2.4.15
>Reporter: Mariusz Szpatuśko
>Priority: Blocker
>
> 2023-01-17 14:01:00,294 WARN [Close-WAL-Writer-3]
> asyncfs.FanOutOneBlockAsyncDFSOutputHelper: complete file
> /hbase/WALs/prod-storage-4,16020,1673962204907/prod-storage-4%2C16020%2C1673962204907.1673964006883
> not finished, retry = 0
> 2023-01-17 14:08:02,681 ERROR
> [regionserver/prod-storage-4:16020-shortCompactions-0]
> util.ResourceLeakDetector: iter(StoreFlusher.java:68)
>
> org.apache.hadoop.hbase.regionserver.DefaultStoreFlusher.flushSnapshot(DefaultStoreFlusher.java:75)
> org.apache.hadoop.hbase.regionserver.HStore.flushCache(HStore.java:992)
>
> org.apache.hadoop.hbase.regionserver.HStore$StoreFlusherImpl.flushCache(HStore.java:2358)
>
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushCacheAndCommit(HRegion.java:2837)
>
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2579)
>
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2551)
> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:2421)
>
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:588)
>
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:558)
>
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.access$1000(MemStoreFlusher.java:64)
>
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher$FlushHandler.run(MemStoreFlusher.java:340)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (HBASE-27574) Implement ClusterManage interface for Kubernetes
Nick Dimiduk created HBASE-27574:
Summary: Implement ClusterManage interface for Kubernetes
Key: HBASE-27574
URL: https://issues.apache.org/jira/browse/HBASE-27574
Project: HBase
Issue Type: Improvement
Components: integration tests
Reporter: Nick Dimiduk
Assignee: Nick Dimiduk
Implement the {{ClusterManager}} interface enough such that we can run the
ChaosMonkey against a deployment on Kubernetes.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[GitHub] [hbase-thirdparty] Apache-HBase commented on pull request #99: HBASE-27573 [hbase-thirdparty] Bump dependency versions
Apache-HBase commented on PR #99: URL: https://github.com/apache/hbase-thirdparty/pull/99#issuecomment-1385612906 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 2m 8s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 1m 2s | master passed | | +1 :green_heart: | compile | 0m 20s | master passed | | +1 :green_heart: | javadoc | 0m 11s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 0m 36s | the patch passed | | +1 :green_heart: | compile | 0m 16s | the patch passed | | +1 :green_heart: | javac | 0m 16s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 1s | The patch has no ill-formed XML file. | | +1 :green_heart: | javadoc | 0m 6s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 39s | root in the patch passed. | | +1 :green_heart: | asflicense | 0m 6s | The patch does not generate ASF License warnings. | | | | 5m 34s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-Thirdparty-PreCommit/job/PR-99/1/artifact/yetus-precommit-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase-thirdparty/pull/99 | | Optional Tests | dupname asflicense javac javadoc unit xml compile | | uname | Linux 9c77ddafbc7a 5.4.0-135-generic #152-Ubuntu SMP Wed Nov 23 20:19:22 UTC 2022 x86_64 GNU/Linux | | Build tool | maven | | git revision | master / 4fd6341 | | Default Java | Oracle Corporation-1.8.0_282-b08 | | Test Results | https://ci-hbase.apache.org/job/HBase-Thirdparty-PreCommit/job/PR-99/1/testReport/ | | Max. process+thread count | 395 (vs. ulimit of 1000) | | modules | C: . U: . | | Console output | https://ci-hbase.apache.org/job/HBase-Thirdparty-PreCommit/job/PR-99/1/console | | versions | git=2.20.1 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (HBASE-27573) [hbase-thirdparty] Bump dependency versions
Duo Zhang created HBASE-27573: - Summary: [hbase-thirdparty] Bump dependency versions Key: HBASE-27573 URL: https://issues.apache.org/jira/browse/HBASE-27573 Project: HBase Issue Type: Task Components: dependencies, thirdparty Reporter: Duo Zhang Assignee: Duo Zhang Fix For: thirdparty-4.1.4 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HBASE-27572) resource leak for store flush during high load
Mariusz Szpatuśko created HBASE-27572: - Summary: resource leak for store flush during high load Key: HBASE-27572 URL: https://issues.apache.org/jira/browse/HBASE-27572 Project: HBase Issue Type: Bug Components: regionserver Affects Versions: 2.4.15 Reporter: Mariusz Szpatuśko 2023-01-17 14:01:00,294 WARN [Close-WAL-Writer-3] asyncfs.FanOutOneBlockAsyncDFSOutputHelper: complete file /hbase/WALs/prod-storage-4,16020,1673962204907/prod-storage-4%2C16020%2C1673962204907.1673964006883 not finished, retry = 0 2023-01-17 14:08:02,681 ERROR [regionserver/prod-storage-4:16020-shortCompactions-0] util.ResourceLeakDetector: iter(StoreFlusher.java:68) org.apache.hadoop.hbase.regionserver.DefaultStoreFlusher.flushSnapshot(DefaultStoreFlusher.java:75) org.apache.hadoop.hbase.regionserver.HStore.flushCache(HStore.java:992) org.apache.hadoop.hbase.regionserver.HStore$StoreFlusherImpl.flushCache(HStore.java:2358) org.apache.hadoop.hbase.regionserver.HRegion.internalFlushCacheAndCommit(HRegion.java:2837) org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2579) org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2551) org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:2421) org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:588) org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:558) org.apache.hadoop.hbase.regionserver.MemStoreFlusher.access$1000(MemStoreFlusher.java:64) org.apache.hadoop.hbase.regionserver.MemStoreFlusher$FlushHandler.run(MemStoreFlusher.java:340) -- This message was sent by Atlassian Jira (v8.20.10#820010)
[GitHub] [hbase] Apache-HBase commented on pull request #4978: Backport "HBASE-27568 ChaosMonkey add support for JournalNodes" to branch-2.4
Apache-HBase commented on PR #4978: URL: https://github.com/apache/hbase/pull/4978#issuecomment-1385498118 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 2m 44s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ branch-2.4 Compile Tests _ | | +0 :ok: | mvndep | 0m 10s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 4s | branch-2.4 passed | | +1 :green_heart: | compile | 3m 12s | branch-2.4 passed | | +1 :green_heart: | checkstyle | 0m 47s | branch-2.4 passed | | +1 :green_heart: | spotless | 0m 45s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 2m 8s | branch-2.4 passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 57s | the patch passed | | +1 :green_heart: | compile | 3m 3s | the patch passed | | +1 :green_heart: | javac | 3m 3s | the patch passed | | +1 :green_heart: | checkstyle | 0m 44s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 17m 22s | Patch does not cause any errors with Hadoop 2.10.2 or 3.1.4 3.2.4 3.3.4. | | +1 :green_heart: | spotless | 0m 42s | patch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 2m 21s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 17s | The patch does not generate ASF License warnings. | | | | 42m 29s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4978/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4978 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux 6301a20902d1 5.4.0-135-generic #152-Ubuntu SMP Wed Nov 23 20:19:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | branch-2.4 / 6d2064d443 | | Default Java | Eclipse Adoptium-11.0.17+8 | | Max. process+thread count | 81 (vs. ulimit of 3) | | modules | C: hbase-server hbase-it U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4978/1/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4977: Backport "HBASE-27568 ChaosMonkey add support for JournalNodes" to branch-2.5
Apache-HBase commented on PR #4977: URL: https://github.com/apache/hbase/pull/4977#issuecomment-1385412276 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 52s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ branch-2.5 Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 42s | branch-2.5 passed | | +1 :green_heart: | compile | 2m 48s | branch-2.5 passed | | +1 :green_heart: | checkstyle | 0m 41s | branch-2.5 passed | | +1 :green_heart: | spotless | 0m 40s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 41s | branch-2.5 passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 14s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 24s | the patch passed | | +1 :green_heart: | compile | 2m 44s | the patch passed | | +1 :green_heart: | javac | 2m 44s | the patch passed | | +1 :green_heart: | checkstyle | 0m 40s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 12m 57s | Patch does not cause any errors with Hadoop 2.10.2 or 3.2.4 3.3.4. | | +1 :green_heart: | spotless | 0m 43s | patch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 57s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 16s | The patch does not generate ASF License warnings. | | | | 33m 3s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4977/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4977 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux ca902c25b2ab 5.4.0-1088-aws #96~18.04.1-Ubuntu SMP Mon Oct 17 02:57:48 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | branch-2.5 / c1e551a466 | | Default Java | Eclipse Adoptium-11.0.17+8 | | Max. process+thread count | 82 (vs. ulimit of 3) | | modules | C: hbase-server hbase-it U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4977/1/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4976: Backport "HBASE-27568 ChaosMonkey add support for JournalNodes" to branch-2
Apache-HBase commented on PR #4976: URL: https://github.com/apache/hbase/pull/4976#issuecomment-1385412226 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 50s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ branch-2 Compile Tests _ | | +0 :ok: | mvndep | 0m 12s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 42s | branch-2 passed | | +1 :green_heart: | compile | 2m 50s | branch-2 passed | | +1 :green_heart: | checkstyle | 0m 42s | branch-2 passed | | +1 :green_heart: | spotless | 0m 40s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 42s | branch-2 passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 14s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 25s | the patch passed | | +1 :green_heart: | compile | 2m 49s | the patch passed | | +1 :green_heart: | javac | 2m 49s | the patch passed | | +1 :green_heart: | checkstyle | 0m 41s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 12m 53s | Patch does not cause any errors with Hadoop 2.10.2 or 3.2.4 3.3.4. | | +1 :green_heart: | spotless | 0m 38s | patch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 56s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 15s | The patch does not generate ASF License warnings. | | | | 33m 5s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4976/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4976 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux 6046341fc5f6 5.4.0-1093-aws #102~18.04.2-Ubuntu SMP Wed Dec 7 00:31:59 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | branch-2 / 3a7c732f69 | | Default Java | Eclipse Adoptium-11.0.17+8 | | Max. process+thread count | 82 (vs. ulimit of 3) | | modules | C: hbase-server hbase-it U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4976/1/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] ndimiduk opened a new pull request, #4978: Backport "HBASE-27568 ChaosMonkey add support for JournalNodes" to branch-2.4
ndimiduk opened a new pull request, #4978: URL: https://github.com/apache/hbase/pull/4978 Signed-off-by: Reid Chan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] ndimiduk opened a new pull request, #4977: Backport "HBASE-27568 ChaosMonkey add support for JournalNodes" to branch-2.5
ndimiduk opened a new pull request, #4977: URL: https://github.com/apache/hbase/pull/4977 Signed-off-by: Reid Chan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] ndimiduk opened a new pull request, #4976: Backport "HBASE-27568 ChaosMonkey add support for JournalNodes" to branch-2
ndimiduk opened a new pull request, #4976: URL: https://github.com/apache/hbase/pull/4976 Signed-off-by: Reid Chan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-27557) [JDK17] Update shade plugin version
[ https://issues.apache.org/jira/browse/HBASE-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677734#comment-17677734 ] Nick Dimiduk commented on HBASE-27557: -- Whomever committed the backport for this patch, at least on branch-2, your commit title does not follow the necessary conventions. Please revert the commit, update the title text, and reapply. > [JDK17] Update shade plugin version > --- > > Key: HBASE-27557 > URL: https://issues.apache.org/jira/browse/HBASE-27557 > Project: HBase > Issue Type: Sub-task >Reporter: tianhang tang >Assignee: tianhang tang >Priority: Minor > Attachments: image-2023-01-06-18-54-09-703.png > > > maven-shade-plugin:3.2.4 cannot support JDK17, if build HBase with > releaseTarget=17 will meet this error: > !image-2023-01-06-18-54-09-703.png! > So need to update it's version. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-27568) ChaosMonkey add support for JournalNodes
[ https://issues.apache.org/jira/browse/HBASE-27568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk updated HBASE-27568: - Fix Version/s: 3.0.0-alpha-4 > ChaosMonkey add support for JournalNodes > > > Key: HBASE-27568 > URL: https://issues.apache.org/jira/browse/HBASE-27568 > Project: HBase > Issue Type: Task > Components: integration tests >Affects Versions: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk >Priority: Major > Fix For: 3.0.0-alpha-4 > > > Looks like our ChaosMonkey knowledge of HDFS topology is stale. Add the > concept of a Journal Node to ClusterManager et al. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[GitHub] [hbase] ndimiduk commented on pull request #4963: HBASE-27568 ChaosMonkey add support for JournalNodes
ndimiduk commented on PR #4963: URL: https://github.com/apache/hbase/pull/4963#issuecomment-1385345049 Thanks @Reidd -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4788: HBASE-21521 Expose master startup status via web UI
Apache-HBase commented on PR #4788: URL: https://github.com/apache/hbase/pull/4788#issuecomment-1385167227 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 57s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 24s | master passed | | +1 :green_heart: | compile | 0m 40s | master passed | | +1 :green_heart: | shadedjars | 3m 46s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 25s | master passed | | -0 :warning: | patch | 4m 19s | Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary. | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 10s | the patch passed | | +1 :green_heart: | compile | 0m 39s | the patch passed | | +1 :green_heart: | javac | 0m 39s | the patch passed | | +1 :green_heart: | shadedjars | 3m 45s | patch has no errors when building our shaded downstream artifacts. | | -0 :warning: | javadoc | 0m 23s | hbase-server generated 1 new + 23 unchanged - 0 fixed = 24 total (was 23) | ||| _ Other Tests _ | | +1 :green_heart: | unit | 214m 29s | hbase-server in the patch passed. | | | | 233m 57s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4788/7/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4788 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux c5aa4675696a 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / da261344cc | | Default Java | Temurin-1.8.0_352-b08 | | javadoc | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4788/7/artifact/yetus-jdk8-hadoop3-check/output/diff-javadoc-javadoc-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4788/7/testReport/ | | Max. process+thread count | 2416 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4788/7/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #4788: HBASE-21521 Expose master startup status via web UI
Apache-HBase commented on PR #4788: URL: https://github.com/apache/hbase/pull/4788#issuecomment-1385147632 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 36s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 49s | master passed | | +1 :green_heart: | compile | 0m 42s | master passed | | +1 :green_heart: | shadedjars | 3m 57s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 24s | master passed | | -0 :warning: | patch | 4m 28s | Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary. | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 24s | the patch passed | | +1 :green_heart: | compile | 0m 42s | the patch passed | | +1 :green_heart: | javac | 0m 42s | the patch passed | | +1 :green_heart: | shadedjars | 3m 56s | patch has no errors when building our shaded downstream artifacts. | | -0 :warning: | javadoc | 0m 22s | hbase-server generated 1 new + 96 unchanged - 0 fixed = 97 total (was 96) | ||| _ Other Tests _ | | +1 :green_heart: | unit | 200m 40s | hbase-server in the patch passed. | | | | 220m 27s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4788/7/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4788 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux e648bfd4a533 5.4.0-1093-aws #102~18.04.2-Ubuntu SMP Wed Dec 7 00:31:59 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / da261344cc | | Default Java | Eclipse Adoptium-11.0.17+8 | | javadoc | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4788/7/artifact/yetus-jdk11-hadoop3-check/output/diff-javadoc-javadoc-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4788/7/testReport/ | | Max. process+thread count | 2716 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4788/7/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-27571) Get supports RAW
[ https://issues.apache.org/jira/browse/HBASE-27571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677684#comment-17677684 ] Bo Cui commented on HBASE-27571: hi [~zhangduo] we may push down this limit to RawScanQueryMatcher or remove it ? > Get supports RAW > > > Key: HBASE-27571 > URL: https://issues.apache.org/jira/browse/HBASE-27571 > Project: HBase > Issue Type: Improvement >Reporter: Bo Cui >Priority: Major > > [https://github.com/apache/hbase/blob/da261344cc55e7812dfe22d86d5fa88c93ed79b9/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java#L234] > > I used the `Get` to query all put and delete in a column, but I got this error > *Cannot specify any column for a raw scan.* > Why add this restriction? -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-27571) Get supports RAW
[ https://issues.apache.org/jira/browse/HBASE-27571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677680#comment-17677680 ] Bo Cui commented on HBASE-27571: and then I removed the `if (columns != null && scan.isRaw())` logic and got the correct answer. My guess is that it is not sure if the family has delete operation (`delete 't1','r1','f1',1673945640117`). but if the consumer determines that the family has not delete operation, we should allow such `Get`. > Get supports RAW > > > Key: HBASE-27571 > URL: https://issues.apache.org/jira/browse/HBASE-27571 > Project: HBase > Issue Type: Improvement >Reporter: Bo Cui >Priority: Major > > [https://github.com/apache/hbase/blob/da261344cc55e7812dfe22d86d5fa88c93ed79b9/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java#L234] > > I used the `Get` to query all put and delete in a column, but I got this error > *Cannot specify any column for a raw scan.* > Why add this restriction? -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-27571) Get supports RAW
[ https://issues.apache.org/jira/browse/HBASE-27571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677678#comment-17677678 ] Duo Zhang commented on HBASE-27571: --- IIRC this is for simplify the implementation for ScanQueryMatcher. > Get supports RAW > > > Key: HBASE-27571 > URL: https://issues.apache.org/jira/browse/HBASE-27571 > Project: HBase > Issue Type: Improvement >Reporter: Bo Cui >Priority: Major > > [https://github.com/apache/hbase/blob/da261344cc55e7812dfe22d86d5fa88c93ed79b9/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java#L234] > > I used the `Get` to query all put and delete in a column, but I got this error > *Cannot specify any column for a raw scan.* > Why add this restriction? -- This message was sent by Atlassian Jira (v8.20.10#820010)
