[jira] [Commented] (HBASE-26351) Implement a table-based region grouping strategy for RegionGroupingProvider
[ https://issues.apache.org/jira/browse/HBASE-26351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427452#comment-17427452 ] Duo Zhang commented on HBASE-26351: --- [~fengxianjing] HBase now uses github PR for reviewing patch, so please create a github PR for your patch? And please make the patch against master branch, every patch should be landed on master first, unless it is only a bug for a specific branch. Thanks. > Implement a table-based region grouping strategy for RegionGroupingProvider > --- > > Key: HBASE-26351 > URL: https://issues.apache.org/jira/browse/HBASE-26351 > Project: HBase > Issue Type: New Feature >Reporter: fengxianjing >Priority: Major > > In our company, we create only one namespace for each RegionServer group, but > we have about 1000 region per regionserver. Neither _identity_ nor _bounded > are good choices, So we need to a_ WAL grouping strategy based on table name -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-26351) Implement a table-based region grouping strategy for RegionGroupingProvider
[ https://issues.apache.org/jira/browse/HBASE-26351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengxianjing updated HBASE-26351: - Description: In our company, we create only one namespace for each RegionServer group, but we have about 1000 region per regionserver. Neither _identity_ nor _bounded are good choices, So we need to a_ WAL grouping strategy based on table name (was: In our company, we create only one namespace for each RegionServer group, bu web have about 1000 region per regionserver. Neither _identity_ nor _bounded are good choices, So we need to a_ WAL grouping strategy based on table name) > Implement a table-based region grouping strategy for RegionGroupingProvider > --- > > Key: HBASE-26351 > URL: https://issues.apache.org/jira/browse/HBASE-26351 > Project: HBase > Issue Type: New Feature >Reporter: fengxianjing >Priority: Major > > In our company, we create only one namespace for each RegionServer group, but > we have about 1000 region per regionserver. Neither _identity_ nor _bounded > are good choices, So we need to a_ WAL grouping strategy based on table name -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-26351) Implement a table-based region grouping strategy for RegionGroupingProvider
[ https://issues.apache.org/jira/browse/HBASE-26351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengxianjing updated HBASE-26351: - External issue URL: https://reviews.apache.org/r/73648 > Implement a table-based region grouping strategy for RegionGroupingProvider > --- > > Key: HBASE-26351 > URL: https://issues.apache.org/jira/browse/HBASE-26351 > Project: HBase > Issue Type: New Feature >Reporter: fengxianjing >Priority: Major > > In our company, we create only one namespace for each RegionServer group, bu > web have about 1000 region per regionserver. Neither _identity_ nor _bounded > are good choices, So we need to a_ WAL grouping strategy based on table name -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-26351) Implement a table-based region grouping strategy for RegionGroupingProvider
fengxianjing created HBASE-26351: Summary: Implement a table-based region grouping strategy for RegionGroupingProvider Key: HBASE-26351 URL: https://issues.apache.org/jira/browse/HBASE-26351 Project: HBase Issue Type: New Feature Reporter: fengxianjing In our company, we create only one namespace for each RegionServer group, bu web have about 1000 region per regionserver. Neither _identity_ nor _bounded are good choices, So we need to a_ WAL grouping strategy based on table name -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-26347) Support detect and exclude slow DNs in fan-out of WAL
[ https://issues.apache.org/jira/browse/HBASE-26347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427413#comment-17427413 ] Xiaolin Ha commented on HBASE-26347: Hi, [~zhangduo], we don't maintain exclude DNs in RS or WAL, currently only exclude bad DNs in the retry logic of addBlock(). I have implemented a preliminary version of this idea, and the test result is good. I'll upload a detailed design doc recently. Thanks for attention. > Support detect and exclude slow DNs in fan-out of WAL > - > > Key: HBASE-26347 > URL: https://issues.apache.org/jira/browse/HBASE-26347 > Project: HBase > Issue Type: New Feature > Components: wal >Affects Versions: 2.0.0, 3.0.0-alpha-2 >Reporter: Xiaolin Ha >Assignee: Xiaolin Ha >Priority: Major > > We all knows the WAL sync performance directly affects the RPC process time. > And we use self-designed FanOutOneBlockAsyncDFSOutput to sync WAL entries, > which connect straightly to all the block located DNs. But when even one DN > of the locations is slow, e.g. some disk hardware failures, the WAL syncs > slow. And what's more, the hardware failure detected by the lower layer HDFS > system is not so sensitive. > We can detect slow DNs by the ACK time of packets in > FanOutOneBlockAsyncDFSOutput, and exclude them when add new blocks after log > rolled(rolling log can also be triggered by slow syncs). And shows this info > in UI. We can also invalid these excluded DN cache after a duration, to aware > the recovery of those DNs. > I think this idea can quickly reduce the influence of slow DNs, and improve > the service availability. > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #3744: HBASE-26349 Improve recent change to IntegrationTestLoadCommonCrawl
Apache-HBase commented on pull request #3744: URL: https://github.com/apache/hbase/pull/3744#issuecomment-940596744 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 4s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 33s | master passed | | +1 :green_heart: | compile | 0m 41s | master passed | | +1 :green_heart: | checkstyle | 0m 18s | master passed | | +1 :green_heart: | spotbugs | 0m 36s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 14s | the patch passed | | +1 :green_heart: | compile | 0m 40s | the patch passed | | +1 :green_heart: | javac | 0m 40s | the patch passed | | +1 :green_heart: | checkstyle | 0m 16s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 21m 34s | Patch does not cause any errors with Hadoop 3.1.2 3.2.1 3.3.0. | | +1 :green_heart: | spotbugs | 0m 44s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 12s | The patch does not generate ASF License warnings. | | | | 43m 45s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/2/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3744 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile | | uname | Linux e6346db93ae2 4.15.0-153-generic #160-Ubuntu SMP Thu Jul 29 06:54:29 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / ce44e16939 | | Default Java | AdoptOpenJDK-1.8.0_282-b08 | | Max. process+thread count | 86 (vs. ulimit of 3) | | modules | C: hbase-it U: hbase-it | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/2/console | | versions | git=2.17.1 maven=3.6.3 spotbugs=4.2.2 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-26349) Improve recent change to IntegrationTestLoadCommonCrawl
[ https://issues.apache.org/jira/browse/HBASE-26349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-26349: Summary: Improve recent change to IntegrationTestLoadCommonCrawl (was: Revert and improve recent change to IntegrationTestLoadCommonCrawl) > Improve recent change to IntegrationTestLoadCommonCrawl > --- > > Key: HBASE-26349 > URL: https://issues.apache.org/jira/browse/HBASE-26349 > Project: HBase > Issue Type: Test > Components: integration tests, test >Reporter: Andrew Kyle Purtell >Assignee: Andrew Kyle Purtell >Priority: Minor > Fix For: 2.5.0, 3.0.0-alpha-2 > > > Using BufferedMutator wasn't a good idea because we assign client timestamps, > and the store loop is fast enough that on rare occasion two temporally > adjacent URLs in the set of WARCs are equivalent and the timestamp does not > advance, leading later to a rare false positive CORRUPT finding. > While making changes, support direct S3N paths as input paths on the command > line. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-26047) [JDK17] Track JDK17 unit test failures
[
https://issues.apache.org/jira/browse/HBASE-26047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427411#comment-17427411
]
Wei-Chiu Chuang commented on HBASE-26047:
-
Thanks. I got sidetracked by other projects.
It would be great to understand the failure in TestHeapSize. The heap size
estimate is quite involved and I am not confident i can address them. IIRC
TestThreadLocalPoolMap is similar.
TestSecureExportSnapshot
TestMobSecureExportSnapshot
TestVerifyReplicationCrossDiffHdfs
--> they all failed for some error inside distcp/MapReduce. To troubleshoot
them we need to enable logging for HDFS/YARN in the UT.
> [JDK17] Track JDK17 unit test failures
> --
>
> Key: HBASE-26047
> URL: https://issues.apache.org/jira/browse/HBASE-26047
> Project: HBase
> Issue Type: Sub-task
>Reporter: Wei-Chiu Chuang
>Priority: Major
>
> As of now, there are still two failed unit tests after exporting JDK internal
> modules and the modifier access hack.
> {noformat}
> [ERROR] Tests run: 7, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 0.217
> s <<< FAILURE! - in org.apache.hadoop.hbase.io.TestHeapSize
> [ERROR] org.apache.hadoop.hbase.io.TestHeapSize.testSizes Time elapsed:
> 0.041 s <<< FAILURE!
> java.lang.AssertionError: expected:<160> but was:<152>
> at
> org.apache.hadoop.hbase.io.TestHeapSize.testSizes(TestHeapSize.java:335)
> [ERROR] org.apache.hadoop.hbase.io.TestHeapSize.testNativeSizes Time
> elapsed: 0.01 s <<< FAILURE!
> java.lang.AssertionError: expected:<72> but was:<64>
> at
> org.apache.hadoop.hbase.io.TestHeapSize.testNativeSizes(TestHeapSize.java:134)
> [INFO] Running org.apache.hadoop.hbase.io.Tes
> [ERROR] Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.697
> s <<< FAILURE! - in org.apache.hadoop.hbase.ipc.TestBufferChain
> [ERROR] org.apache.hadoop.hbase.ipc.TestBufferChain.testWithSpy Time
> elapsed: 0.537 s <<< ERROR!
> java.lang.NullPointerException: Cannot enter synchronized block because
> "this.closeLock" is null
> at
> org.apache.hadoop.hbase.ipc.TestBufferChain.testWithSpy(TestBufferChain.java:119)
> {noformat}
> It appears that JDK17 makes the heap size estimate different than before. Not
> sure why.
> TestBufferChain.testWithSpy failure might be because of yet another
> unexported module.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #3744: HBASE-26349 Revert and improve recent change to IntegrationTestLoadCommonCrawl
Apache-HBase commented on pull request #3744: URL: https://github.com/apache/hbase/pull/3744#issuecomment-940592551 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 42s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 20s | master passed | | +1 :green_heart: | compile | 0m 28s | master passed | | +1 :green_heart: | shadedjars | 9m 23s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 17s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 36s | the patch passed | | +1 :green_heart: | compile | 0m 30s | the patch passed | | +1 :green_heart: | javac | 0m 30s | the patch passed | | +1 :green_heart: | shadedjars | 9m 27s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 16s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 1m 3s | hbase-it in the patch passed. | | | | 33m 16s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/2/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3744 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 63462a2f3f99 4.15.0-143-generic #147-Ubuntu SMP Wed Apr 14 16:10:11 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / ce44e16939 | | Default Java | AdoptOpenJDK-1.8.0_282-b08 | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/2/testReport/ | | Max. process+thread count | 638 (vs. ulimit of 3) | | modules | C: hbase-it U: hbase-it | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/2/console | | versions | git=2.17.1 maven=3.6.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #3744: HBASE-26349 Revert and improve recent change to IntegrationTestLoadCommonCrawl
Apache-HBase commented on pull request #3744: URL: https://github.com/apache/hbase/pull/3744#issuecomment-940592129 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 9s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 2s | master passed | | +1 :green_heart: | compile | 0m 33s | master passed | | +1 :green_heart: | shadedjars | 8m 45s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 23s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 38s | the patch passed | | +1 :green_heart: | compile | 0m 30s | the patch passed | | +1 :green_heart: | javac | 0m 30s | the patch passed | | +1 :green_heart: | shadedjars | 8m 32s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 20s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 58s | hbase-it in the patch passed. | | | | 32m 7s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3744 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux c2c7b3b2f44b 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / ce44e16939 | | Default Java | AdoptOpenJDK-11.0.10+9 | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/2/testReport/ | | Max. process+thread count | 683 (vs. ulimit of 3) | | modules | C: hbase-it U: hbase-it | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/2/console | | versions | git=2.17.1 maven=3.6.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #3712: HBASE-26320 Implement a separate thread pool for the LogCleaner
Apache-HBase commented on pull request #3712: URL: https://github.com/apache/hbase/pull/3712#issuecomment-940580281 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 57s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 20s | master passed | | +1 :green_heart: | compile | 1m 4s | master passed | | +1 :green_heart: | shadedjars | 9m 3s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 38s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 19s | the patch passed | | +1 :green_heart: | compile | 1m 4s | the patch passed | | +1 :green_heart: | javac | 1m 4s | the patch passed | | +1 :green_heart: | shadedjars | 9m 8s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 37s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 214m 29s | hbase-server in the patch passed. | | | | 247m 33s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3712/4/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3712 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux ceae46f8e371 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / ce44e16939 | | Default Java | AdoptOpenJDK-1.8.0_282-b08 | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3712/4/testReport/ | | Max. process+thread count | 3528 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3712/4/console | | versions | git=2.17.1 maven=3.6.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #3712: HBASE-26320 Implement a separate thread pool for the LogCleaner
Apache-HBase commented on pull request #3712: URL: https://github.com/apache/hbase/pull/3712#issuecomment-940545134 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 25s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 47s | master passed | | +1 :green_heart: | compile | 1m 14s | master passed | | +1 :green_heart: | shadedjars | 8m 17s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 42s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 28s | the patch passed | | +1 :green_heart: | compile | 1m 12s | the patch passed | | +1 :green_heart: | javac | 1m 12s | the patch passed | | +1 :green_heart: | shadedjars | 8m 17s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 40s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 138m 56s | hbase-server in the patch failed. | | | | 171m 19s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3712/4/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3712 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux e5669ef06256 4.15.0-156-generic #163-Ubuntu SMP Thu Aug 19 23:31:58 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / ce44e16939 | | Default Java | AdoptOpenJDK-11.0.10+9 | | unit | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3712/4/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3712/4/testReport/ | | Max. process+thread count | 4793 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3712/4/console | | versions | git=2.17.1 maven=3.6.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #3743: HBASE-26350 Add a DEBUG when we fail the SASL handshake
Apache-HBase commented on pull request #3743: URL: https://github.com/apache/hbase/pull/3743#issuecomment-940536599 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 25s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 12s | master passed | | +1 :green_heart: | compile | 1m 1s | master passed | | +1 :green_heart: | shadedjars | 8m 20s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 40s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 50s | the patch passed | | +1 :green_heart: | compile | 1m 0s | the patch passed | | +1 :green_heart: | javac | 1m 0s | the patch passed | | +1 :green_heart: | shadedjars | 8m 15s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 39s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 146m 48s | hbase-server in the patch passed. | | | | 177m 31s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3743/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3743 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 786593b17141 4.15.0-156-generic #163-Ubuntu SMP Thu Aug 19 23:31:58 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / ce44e16939 | | Default Java | AdoptOpenJDK-1.8.0_282-b08 | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3743/1/testReport/ | | Max. process+thread count | 4805 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3743/1/console | | versions | git=2.17.1 maven=3.6.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #3743: HBASE-26350 Add a DEBUG when we fail the SASL handshake
Apache-HBase commented on pull request #3743: URL: https://github.com/apache/hbase/pull/3743#issuecomment-940529802 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 26s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 44s | master passed | | +1 :green_heart: | compile | 1m 13s | master passed | | +1 :green_heart: | shadedjars | 8m 13s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 43s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 25s | the patch passed | | +1 :green_heart: | compile | 1m 12s | the patch passed | | +1 :green_heart: | javac | 1m 12s | the patch passed | | +1 :green_heart: | shadedjars | 8m 15s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 43s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 140m 22s | hbase-server in the patch passed. | | | | 172m 37s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3743/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3743 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux ad945b9aeebc 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / ce44e16939 | | Default Java | AdoptOpenJDK-11.0.10+9 | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3743/1/testReport/ | | Max. process+thread count | 4407 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3743/1/console | | versions | git=2.17.1 maven=3.6.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] GeorryHuang commented on pull request #3700: HBASE-26263 [Rolling Upgrading] Persist the StoreFileTracker configur…
GeorryHuang commented on pull request #3700: URL: https://github.com/apache/hbase/pull/3700#issuecomment-940519827 > In general I like the approach to introduce a chore for upgrading and also a new procedure for updating the procedure. > > But the problem here is the inheritance hierarchy of the procedures. We have a lot of states for ModifyTableProcedure, which are not needed for the upgrading procedure, and also, it will be safer if we do the check on whether we still need to update the descriptor in the procedure. > > So let me 'steal' part of your work here, to reimplement the migrating of rs group on master branch, and then do a rebase so you could make use of the code to implement this PR cleaner. > > WDYT? > > Thanks. I agree with you. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-26349) Revert and improve recent change to IntegrationTestLoadCommonCrawl
[ https://issues.apache.org/jira/browse/HBASE-26349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-26349: Status: Patch Available (was: Open) > Revert and improve recent change to IntegrationTestLoadCommonCrawl > -- > > Key: HBASE-26349 > URL: https://issues.apache.org/jira/browse/HBASE-26349 > Project: HBase > Issue Type: Test > Components: integration tests, test >Reporter: Andrew Kyle Purtell >Assignee: Andrew Kyle Purtell >Priority: Minor > Fix For: 2.5.0, 3.0.0-alpha-2 > > > Using BufferedMutator wasn't a good idea because we assign client timestamps, > and the store loop is fast enough that on rare occasion two temporally > adjacent URLs in the set of WARCs are equivalent and the timestamp does not > advance, leading later to a rare false positive CORRUPT finding. > While making changes, support direct S3N paths as input paths on the command > line. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #3744: HBASE-26349 Revert and improve recent change to IntegrationTestLoadCommonCrawl
Apache-HBase commented on pull request #3744: URL: https://github.com/apache/hbase/pull/3744#issuecomment-940508720 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 20s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 7s | master passed | | +1 :green_heart: | compile | 0m 52s | master passed | | +1 :green_heart: | checkstyle | 0m 21s | master passed | | +1 :green_heart: | spotbugs | 0m 43s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 52s | the patch passed | | +1 :green_heart: | compile | 0m 47s | the patch passed | | -0 :warning: | javac | 0m 47s | hbase-it generated 4 new + 99 unchanged - 4 fixed = 103 total (was 103) | | +1 :green_heart: | checkstyle | 0m 19s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 25m 42s | Patch does not cause any errors with Hadoop 3.1.2 3.2.1 3.3.0. | | +1 :green_heart: | spotbugs | 0m 54s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 14s | The patch does not generate ASF License warnings. | | | | 51m 0s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3744 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile | | uname | Linux 56772de24ec3 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / ce44e16939 | | Default Java | AdoptOpenJDK-1.8.0_282-b08 | | javac | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/1/artifact/yetus-general-check/output/diff-compile-javac-hbase-it.txt | | Max. process+thread count | 86 (vs. ulimit of 3) | | modules | C: hbase-it U: hbase-it | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/1/console | | versions | git=2.17.1 maven=3.6.3 spotbugs=4.2.2 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #3744: HBASE-26349 Revert and improve recent change to IntegrationTestLoadCommonCrawl
Apache-HBase commented on pull request #3744: URL: https://github.com/apache/hbase/pull/3744#issuecomment-940500979 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 29s | Docker mode activated. | | -0 :warning: | yetus | 0m 4s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 59s | master passed | | +1 :green_heart: | compile | 0m 31s | master passed | | +1 :green_heart: | shadedjars | 9m 42s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 19s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 41s | the patch passed | | +1 :green_heart: | compile | 0m 28s | the patch passed | | +1 :green_heart: | javac | 0m 28s | the patch passed | | +1 :green_heart: | shadedjars | 9m 14s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 15s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 58s | hbase-it in the patch passed. | | | | 33m 49s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3744 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 697c2e930c14 4.15.0-143-generic #147-Ubuntu SMP Wed Apr 14 16:10:11 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / ce44e16939 | | Default Java | AdoptOpenJDK-1.8.0_282-b08 | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/1/testReport/ | | Max. process+thread count | 626 (vs. ulimit of 3) | | modules | C: hbase-it U: hbase-it | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/1/console | | versions | git=2.17.1 maven=3.6.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #3744: HBASE-26349 Revert and improve recent change to IntegrationTestLoadCommonCrawl
Apache-HBase commented on pull request #3744: URL: https://github.com/apache/hbase/pull/3744#issuecomment-940499776 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 3s | Docker mode activated. | | -0 :warning: | yetus | 0m 4s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 49s | master passed | | +1 :green_heart: | compile | 0m 30s | master passed | | +1 :green_heart: | shadedjars | 8m 15s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 22s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 25s | the patch passed | | +1 :green_heart: | compile | 0m 30s | the patch passed | | +1 :green_heart: | javac | 0m 30s | the patch passed | | +1 :green_heart: | shadedjars | 8m 10s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 18s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 57s | hbase-it in the patch passed. | | | | 30m 37s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3744 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 1a23e73d3dd9 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / ce44e16939 | | Default Java | AdoptOpenJDK-11.0.10+9 | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/1/testReport/ | | Max. process+thread count | 692 (vs. ulimit of 3) | | modules | C: hbase-it U: hbase-it | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3744/1/console | | versions | git=2.17.1 maven=3.6.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] taklwu commented on a change in pull request #3743: HBASE-26350 Add a DEBUG when we fail the SASL handshake
taklwu commented on a change in pull request #3743:
URL: https://github.com/apache/hbase/pull/3743#discussion_r726610515
##
File path:
hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/ServerRpcConnection.java
##
@@ -372,6 +372,7 @@ public void saslReadAndProcess(ByteBuff saslToken) throws
IOException,
replyToken = saslServer.evaluateResponse(saslToken.hasArray()?
saslToken.array() : saslToken.toBytes());
} catch (IOException e) {
+RpcServer.LOG.debug("Failed to execute SASL handshake", e);
Review comment:
[nit] do you think we need to use `isDebugEnabled` , tho I don't think
this will happen a lot or print a large message.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #3730: HBASE-26316 Per-table or per-CF compression codec setting overrides
Apache-HBase commented on pull request #3730: URL: https://github.com/apache/hbase/pull/3730#issuecomment-940490726 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 6m 14s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 26s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 4m 58s | master passed | | +1 :green_heart: | compile | 3m 29s | master passed | | +1 :green_heart: | shadedjars | 9m 5s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 2m 27s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 15s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 5m 3s | the patch passed | | +1 :green_heart: | compile | 3m 32s | the patch passed | | +1 :green_heart: | javac | 3m 32s | the patch passed | | +1 :green_heart: | shadedjars | 9m 23s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 2m 31s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 2m 39s | hbase-common in the patch passed. | | +1 :green_heart: | unit | 240m 19s | hbase-server in the patch passed. | | +1 :green_heart: | unit | 1m 24s | hbase-compression-aircompressor in the patch passed. | | +1 :green_heart: | unit | 0m 54s | hbase-compression-lz4 in the patch passed. | | +1 :green_heart: | unit | 0m 56s | hbase-compression-snappy in the patch passed. | | +1 :green_heart: | unit | 1m 40s | hbase-compression-xz in the patch passed. | | +1 :green_heart: | unit | 0m 58s | hbase-compression-zstd in the patch passed. | | | | 299m 4s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3730/7/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3730 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 474cac89ee64 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / ce44e16939 | | Default Java | AdoptOpenJDK-11.0.10+9 | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3730/7/testReport/ | | Max. process+thread count | 3080 (vs. ulimit of 3) | | modules | C: hbase-common hbase-server hbase-compression/hbase-compression-aircompressor hbase-compression/hbase-compression-lz4 hbase-compression/hbase-compression-snappy hbase-compression/hbase-compression-xz hbase-compression/hbase-compression-zstd U: . | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3730/7/console | | versions | git=2.17.1 maven=3.6.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] apurtell opened a new pull request #3744: HBASE-26349 Revert and improve recent change to IntegrationTestLoadCommonCrawl
apurtell opened a new pull request #3744: URL: https://github.com/apache/hbase/pull/3744 Using BufferedMutator was not a good idea because we assign client timestamps, and the store loop is fast enough that on rare occasion two temporally adjacent URLs in the set of WARCs are equivalent and the timestamp does not advance, leading later to a rare false positive CORRUPT finding. While making changes, make timestamp collision even less likely, and support direct S3N paths as input paths on the command line. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #3712: HBASE-26320 Implement a separate thread pool for the LogCleaner
Apache-HBase commented on pull request #3712: URL: https://github.com/apache/hbase/pull/3712#issuecomment-940485690 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 27s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 13s | master passed | | +1 :green_heart: | compile | 3m 11s | master passed | | +1 :green_heart: | checkstyle | 1m 9s | master passed | | +1 :green_heart: | spotbugs | 2m 4s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 0s | the patch passed | | +1 :green_heart: | compile | 3m 16s | the patch passed | | +1 :green_heart: | javac | 3m 16s | the patch passed | | -0 :warning: | checkstyle | 1m 5s | hbase-server: The patch generated 1 new + 95 unchanged - 1 fixed = 96 total (was 96) | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 20m 40s | Patch does not cause any errors with Hadoop 3.1.2 3.2.1 3.3.0. | | +1 :green_heart: | spotbugs | 2m 16s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 16s | The patch does not generate ASF License warnings. | | | | 50m 58s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3712/4/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3712 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile | | uname | Linux 3d608f7b8300 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / ce44e16939 | | Default Java | AdoptOpenJDK-1.8.0_282-b08 | | checkstyle | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3712/4/artifact/yetus-general-check/output/diff-checkstyle-hbase-server.txt | | Max. process+thread count | 95 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3712/4/console | | versions | git=2.17.1 maven=3.6.3 spotbugs=4.2.2 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #3743: HBASE-26350 Add a DEBUG when we fail the SASL handshake
Apache-HBase commented on pull request #3743: URL: https://github.com/apache/hbase/pull/3743#issuecomment-940475157 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 29s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 14s | master passed | | +1 :green_heart: | compile | 3m 11s | master passed | | +1 :green_heart: | checkstyle | 1m 4s | master passed | | +1 :green_heart: | spotbugs | 2m 8s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 49s | the patch passed | | +1 :green_heart: | compile | 3m 7s | the patch passed | | +1 :green_heart: | javac | 3m 7s | the patch passed | | +1 :green_heart: | checkstyle | 1m 3s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 19m 14s | Patch does not cause any errors with Hadoop 3.1.2 3.2.1 3.3.0. | | +1 :green_heart: | spotbugs | 2m 16s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 16s | The patch does not generate ASF License warnings. | | | | 48m 58s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3743/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3743 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile | | uname | Linux 128528f609c3 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / ce44e16939 | | Default Java | AdoptOpenJDK-1.8.0_282-b08 | | Max. process+thread count | 96 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3743/1/console | | versions | git=2.17.1 maven=3.6.3 spotbugs=4.2.2 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] z-york commented on a change in pull request #3712: HBASE-26320 Implement a separate thread pool for the LogCleaner
z-york commented on a change in pull request #3712:
URL: https://github.com/apache/hbase/pull/3712#discussion_r726576814
##
File path:
hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/DirScanPool.java
##
@@ -109,11 +131,19 @@ synchronized void tryUpdatePoolSize(long timeout) {
break;
}
}
-LOG.info("Update chore's pool size from {} to {}", pool.getPoolSize(),
size);
+LOG.info("Update {} chore's pool size from {} to {}", name,
pool.getPoolSize(), size);
pool.setCorePoolSize(size);
}
public int getSize() {
return size;
}
+
+ public static DirScanPool getHFileScanPool(Configuration conf) {
Review comment:
Done.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Commented] (HBASE-26350) Missing server side debugging on failed SASL handshake
[ https://issues.apache.org/jira/browse/HBASE-26350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427365#comment-17427365 ] Josh Elser commented on HBASE-26350: I know this looks like a silly/stupid change (how simple it is), but it goes a long way in figuring out what went wrong server side. I need to look at the raw SASL reply we do to see if the exception is actually getting propagated back to the client properly (before the SASL handshake completes). Because replication was in the mix for me, it's just as tough to get the client exception as it is the server exception. At least I can make one of those much easier ;) > Missing server side debugging on failed SASL handshake > -- > > Key: HBASE-26350 > URL: https://issues.apache.org/jira/browse/HBASE-26350 > Project: HBase > Issue Type: Bug >Reporter: Josh Elser >Assignee: Josh Elser >Priority: Minor > Fix For: 2.5.0, 3.0.0-alpha-2, 2.3.7, 2.4.8 > > > In trying to debug some problems with the pluggable authentication, I noticed > that we are eating the IOException without logging it (at any level) in > ServerRpcConnection. > This makes it super hard to debug when that pluggable interface has a problem > because the context gets lost (clients just get a pretty useless DNRIOE). -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-26350) Missing server side debugging on failed SASL handshake
[ https://issues.apache.org/jira/browse/HBASE-26350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated HBASE-26350: --- Status: Patch Available (was: Open) > Missing server side debugging on failed SASL handshake > -- > > Key: HBASE-26350 > URL: https://issues.apache.org/jira/browse/HBASE-26350 > Project: HBase > Issue Type: Bug >Reporter: Josh Elser >Assignee: Josh Elser >Priority: Minor > Fix For: 2.5.0, 3.0.0-alpha-2, 2.3.7, 2.4.8 > > > In trying to debug some problems with the pluggable authentication, I noticed > that we are eating the IOException without logging it (at any level) in > ServerRpcConnection. > This makes it super hard to debug when that pluggable interface has a problem > because the context gets lost (clients just get a pretty useless DNRIOE). -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-26350) Missing server side debugging on failed SASL handshake
Josh Elser created HBASE-26350: -- Summary: Missing server side debugging on failed SASL handshake Key: HBASE-26350 URL: https://issues.apache.org/jira/browse/HBASE-26350 Project: HBase Issue Type: Bug Reporter: Josh Elser Assignee: Josh Elser Fix For: 2.5.0, 3.0.0-alpha-2, 2.3.7, 2.4.8 In trying to debug some problems with the pluggable authentication, I noticed that we are eating the IOException without logging it (at any level) in ServerRpcConnection. This makes it super hard to debug when that pluggable interface has a problem because the context gets lost (clients just get a pretty useless DNRIOE). -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #3730: HBASE-26316 Per-table or per-CF compression codec setting overrides
Apache-HBase commented on pull request #3730: URL: https://github.com/apache/hbase/pull/3730#issuecomment-940434701 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 26s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 29s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 45s | master passed | | +1 :green_heart: | compile | 3m 4s | master passed | | +1 :green_heart: | shadedjars | 8m 25s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 2m 21s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 17s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 3m 51s | the patch passed | | +1 :green_heart: | compile | 3m 21s | the patch passed | | +1 :green_heart: | javac | 3m 21s | the patch passed | | +1 :green_heart: | shadedjars | 8m 41s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 2m 29s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 1m 58s | hbase-common in the patch passed. | | +1 :green_heart: | unit | 159m 8s | hbase-server in the patch passed. | | +1 :green_heart: | unit | 1m 19s | hbase-compression-aircompressor in the patch passed. | | +1 :green_heart: | unit | 1m 3s | hbase-compression-lz4 in the patch passed. | | +1 :green_heart: | unit | 1m 4s | hbase-compression-snappy in the patch passed. | | +1 :green_heart: | unit | 1m 44s | hbase-compression-xz in the patch passed. | | +1 :green_heart: | unit | 1m 5s | hbase-compression-zstd in the patch passed. | | | | 207m 52s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3730/7/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3730 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 7f1c1482e811 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / ce44e16939 | | Default Java | AdoptOpenJDK-1.8.0_282-b08 | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3730/7/testReport/ | | Max. process+thread count | 3930 (vs. ulimit of 3) | | modules | C: hbase-common hbase-server hbase-compression/hbase-compression-aircompressor hbase-compression/hbase-compression-lz4 hbase-compression/hbase-compression-snappy hbase-compression/hbase-compression-xz hbase-compression/hbase-compression-zstd U: . | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3730/7/console | | versions | git=2.17.1 maven=3.6.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (HBASE-26338) hbck2 setRegionState cannot set replica region state
[ https://issues.apache.org/jira/browse/HBASE-26338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxiang Sun resolved HBASE-26338. -- Fix Version/s: hbase-operator-tools-1.2.0 Release Note: To set the replica region's state, it needs the primary region's encoded regionname and replica id, the command will be "setRegionState , ". Resolution: Fixed > hbck2 setRegionState cannot set replica region state > > > Key: HBASE-26338 > URL: https://issues.apache.org/jira/browse/HBASE-26338 > Project: HBase > Issue Type: Bug > Components: hbck2 >Affects Versions: hbase-operator-tools-1.1.0 >Reporter: Huaxiang Sun >Assignee: Huaxiang Sun >Priority: Major > Fix For: hbase-operator-tools-1.2.0 > > > Currently, there is no way to use hbck2 setRegionState to set a replica > region's state, which makes hard to fix inconsistency related with replica > regions. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase-operator-tools] huaxiangsun merged pull request #94: HBASE-26338 hbck2 setRegionState cannot set replica region state
huaxiangsun merged pull request #94: URL: https://github.com/apache/hbase-operator-tools/pull/94 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-26349) Revert and improve recent change to IntegrationTestLoadCommonCrawl
[ https://issues.apache.org/jira/browse/HBASE-26349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-26349: Description: Using BufferedMutator wasn't a good idea because we assign client timestamps, and the store loop is fast enough that on rare occasion two temporally adjacent URLs in the set of WARCs are equivalent and the timestamp does not advance, leading later to a rare false positive CORRUPT finding. While making changes, support direct S3N paths as input paths on the command line. was: Using BufferedMutator wasn't a good idea because we assign client timestamps, and the store loop is fast enough that on rare occasion two adjacent URLs in a WARC are equivalent and the timestamp does not advance, leading later to a rare false positive CORRUPT finding. While making changes, support direct S3N paths as input paths on the command line. > Revert and improve recent change to IntegrationTestLoadCommonCrawl > -- > > Key: HBASE-26349 > URL: https://issues.apache.org/jira/browse/HBASE-26349 > Project: HBase > Issue Type: Test > Components: integration tests, test >Reporter: Andrew Kyle Purtell >Assignee: Andrew Kyle Purtell >Priority: Minor > Fix For: 2.5.0, 3.0.0-alpha-2 > > > Using BufferedMutator wasn't a good idea because we assign client timestamps, > and the store loop is fast enough that on rare occasion two temporally > adjacent URLs in the set of WARCs are equivalent and the timestamp does not > advance, leading later to a rare false positive CORRUPT finding. > While making changes, support direct S3N paths as input paths on the command > line. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] joshelser commented on pull request #3667: HBASE-21521 Expose master startup status via web UI
joshelser commented on pull request #3667: URL: https://github.com/apache/hbase/pull/3667#issuecomment-940414966 > It's tricky to find out which StatusJournalEntry are the same. How about we keep the last 500 status in memory and evict the older ones ? That's acceptable to start. I think this is not ideal as, if the system is stuck in this situation where we are waiting on regionservers (or similar), we will eventually lose all of the "good" status updates prior to this. That said, we should also make sure "perfect" isn't the enemy of "good" :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-26349) Revert and improve recent change to IntegrationTestLoadCommonCrawl
[ https://issues.apache.org/jira/browse/HBASE-26349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-26349: Affects Version/s: (was: 2.5.0) > Revert and improve recent change to IntegrationTestLoadCommonCrawl > -- > > Key: HBASE-26349 > URL: https://issues.apache.org/jira/browse/HBASE-26349 > Project: HBase > Issue Type: Test > Components: integration tests, test >Reporter: Andrew Kyle Purtell >Assignee: Andrew Kyle Purtell >Priority: Minor > Fix For: 2.5.0, 3.0.0-alpha-2 > > > Using BufferedMutator wasn't a good idea because we assign client timestamps, > and the store loop is fast enough that on rare occasion two adjacent URLs in > a WARC are equivalent and the timestamp does not advance, leading later to a > rare false positive CORRUPT finding. > While making changes, support direct S3N paths as input paths on the command > line. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-26349) Revert and improve recent change to IntegrationTestLoadCommonCrawl
[ https://issues.apache.org/jira/browse/HBASE-26349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-26349: Fix Version/s: 2.5.0 > Revert and improve recent change to IntegrationTestLoadCommonCrawl > -- > > Key: HBASE-26349 > URL: https://issues.apache.org/jira/browse/HBASE-26349 > Project: HBase > Issue Type: Test > Components: integration tests, test >Affects Versions: 2.5.0 >Reporter: Andrew Kyle Purtell >Assignee: Andrew Kyle Purtell >Priority: Minor > Fix For: 2.5.0, 3.0.0-alpha-2 > > > Using BufferedMutator wasn't a good idea because we assign client timestamps, > and the store loop is fast enough that on rare occasion two adjacent URLs in > a WARC are equivalent and the timestamp does not advance, leading later to a > rare false positive CORRUPT finding. > While making changes, support direct S3N paths as input paths on the command > line. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-26349) Revert and improve recent change to IntegrationTestLoadCommonCrawl
Andrew Kyle Purtell created HBASE-26349: --- Summary: Revert and improve recent change to IntegrationTestLoadCommonCrawl Key: HBASE-26349 URL: https://issues.apache.org/jira/browse/HBASE-26349 Project: HBase Issue Type: Test Components: integration tests, test Affects Versions: 2.5.0 Reporter: Andrew Kyle Purtell Assignee: Andrew Kyle Purtell Fix For: 3.0.0-alpha-2 Using BufferedMutator wasn't a good idea because we assign client timestamps, and the store loop is fast enough that on rare occasion two adjacent URLs in a WARC are equivalent and the timestamp does not advance, leading later to a rare false positive CORRUPT finding. While making changes, support direct S3N paths as input paths on the command line. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] shahrs87 commented on pull request #3667: HBASE-21521 Expose master startup status via web UI
shahrs87 commented on pull request #3667: URL: https://github.com/apache/hbase/pull/3667#issuecomment-940398346 > What do you think about one more extension to MonitoredTask/StatusJournal such that if we publish the same StatusJournalEntry multiple times, @joshelser It's tricky to find out which StatusJournalEntry are the same. How about we keep the last 500 status in memory and evict the older ones ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-26318) Publish test logs for flaky jobs to nightlies
[
https://issues.apache.org/jira/browse/HBASE-26318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427328#comment-17427328
]
Hudson commented on HBASE-26318:
Results for branch HBASE-26318
[build #5 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/HBASE-26318/5/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/HBASE-26318/5/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/HBASE-26318/5/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/HBASE-26318/5/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Publish test logs for flaky jobs to nightlies
> -
>
> Key: HBASE-26318
> URL: https://issues.apache.org/jira/browse/HBASE-26318
> Project: HBase
> Issue Type: Sub-task
> Components: flakies, jenkins
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 1.4.14, 2.5.0, 3.0.0-alpha-2, 1.7.2, 2.3.7, 2.4.7
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #3721: HBASE-26326 CreateTableProcedure fails when FileBasedStoreFileTracker…
Apache-HBase commented on pull request #3721: URL: https://github.com/apache/hbase/pull/3721#issuecomment-940360052 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 13s | Docker mode activated. | | -0 :warning: | yetus | 0m 4s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ HBASE-26067 Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 27s | HBASE-26067 passed | | +1 :green_heart: | compile | 1m 5s | HBASE-26067 passed | | +1 :green_heart: | shadedjars | 9m 6s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 38s | HBASE-26067 passed | | -0 :warning: | patch | 9m 54s | Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary. | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 8s | the patch passed | | +1 :green_heart: | compile | 1m 4s | the patch passed | | +1 :green_heart: | javac | 1m 4s | the patch passed | | +1 :green_heart: | shadedjars | 9m 20s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 37s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 227m 41s | hbase-server in the patch passed. | | | | 261m 2s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3721/15/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3721 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux d616149105d2 4.15.0-143-generic #147-Ubuntu SMP Wed Apr 14 16:10:11 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | HBASE-26067 / c4d7d28911 | | Default Java | AdoptOpenJDK-1.8.0_282-b08 | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3721/15/testReport/ | | Max. process+thread count | 3356 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3721/15/console | | versions | git=2.17.1 maven=3.6.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-26220) Use P2P communicate between region servers to sync the list for bootstrap node
[
https://issues.apache.org/jira/browse/HBASE-26220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427315#comment-17427315
]
Hudson commented on HBASE-26220:
Results for branch branch-2
[build #363 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/363/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(x) {color:red}-1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/363/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/363/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/363/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/363/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Use P2P communicate between region servers to sync the list for bootstrap node
> --
>
> Key: HBASE-26220
> URL: https://issues.apache.org/jira/browse/HBASE-26220
> Project: HBase
> Issue Type: Sub-task
> Components: master, regionserver
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0-alpha-2
>
>
> For returning bootstrap nodes to client, we do not need to always track
> exactly the current live region server. But now, we just set a watcher on
> zookeeper to watch all the live region servers, on every region server, for
> large cluster, it will be a big pressure for zookeeper.
> So here I think, we could let region servers to communicate with each other
> to sync the available bootstrap node, like a P2P network.
> Will put a simple design doc soon.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-26306) Backport "HBASE-26220 Use P2P communicate between region servers to sync the list for bootstrap node" to branch-2
[
https://issues.apache.org/jira/browse/HBASE-26306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427314#comment-17427314
]
Hudson commented on HBASE-26306:
Results for branch branch-2
[build #363 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/363/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(x) {color:red}-1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/363/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/363/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/363/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/363/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Backport "HBASE-26220 Use P2P communicate between region servers to sync the
> list for bootstrap node" to branch-2
> -
>
> Key: HBASE-26306
> URL: https://issues.apache.org/jira/browse/HBASE-26306
> Project: HBase
> Issue Type: Sub-task
> Components: master, regionserver
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 2.5.0
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #3730: HBASE-26316 Per-table or per-CF compression codec setting overrides
Apache-HBase commented on pull request #3730: URL: https://github.com/apache/hbase/pull/3730#issuecomment-940357345 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 27s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 1s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 16s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 4m 6s | master passed | | +1 :green_heart: | compile | 6m 9s | master passed | | +1 :green_heart: | checkstyle | 2m 31s | master passed | | +1 :green_heart: | spotbugs | 5m 10s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 15s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 3m 48s | the patch passed | | +1 :green_heart: | compile | 6m 28s | the patch passed | | +1 :green_heart: | javac | 6m 28s | the patch passed | | +1 :green_heart: | checkstyle | 0m 26s | The patch passed checkstyle in hbase-common | | +1 :green_heart: | checkstyle | 1m 5s | hbase-server: The patch generated 0 new + 38 unchanged - 2 fixed = 38 total (was 40) | | +1 :green_heart: | checkstyle | 0m 13s | The patch passed checkstyle in hbase-compression-aircompressor | | +1 :green_heart: | checkstyle | 0m 12s | The patch passed checkstyle in hbase-compression-lz4 | | +1 :green_heart: | checkstyle | 0m 13s | The patch passed checkstyle in hbase-compression-snappy | | +1 :green_heart: | checkstyle | 0m 12s | The patch passed checkstyle in hbase-compression-xz | | +1 :green_heart: | checkstyle | 0m 11s | The patch passed checkstyle in hbase-compression-zstd | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 24m 2s | Patch does not cause any errors with Hadoop 3.1.2 3.2.1 3.3.0. | | +1 :green_heart: | spotbugs | 7m 26s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 1m 24s | The patch does not generate ASF License warnings. | | | | 75m 58s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3730/7/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3730 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile | | uname | Linux cb06d7134194 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / ce44e16939 | | Default Java | AdoptOpenJDK-1.8.0_282-b08 | | Max. process+thread count | 96 (vs. ulimit of 3) | | modules | C: hbase-common hbase-server hbase-compression/hbase-compression-aircompressor hbase-compression/hbase-compression-lz4 hbase-compression/hbase-compression-snappy hbase-compression/hbase-compression-xz hbase-compression/hbase-compression-zstd U: . | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3730/7/console | | versions | git=2.17.1 maven=3.6.3 spotbugs=4.2.2 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-26345) Design doc for HBase NamedQueue framework
[ https://issues.apache.org/jira/browse/HBASE-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HBASE-26345: - Fix Version/s: 3.0.0-alpha-2 > Design doc for HBase NamedQueue framework > - > > Key: HBASE-26345 > URL: https://issues.apache.org/jira/browse/HBASE-26345 > Project: HBase > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Fix For: 3.0.0-alpha-2 > > Attachments: Online NamedQueue framework with optional persistence > layer.pdf > > > We have a couple of usecases already being served by the NamedQueue > framework. It would be good to also provide a design doc to provide the high > level system components view and let other usecases be onboarded with ease. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-26345) Design doc for HBase NamedQueue framework
[ https://issues.apache.org/jira/browse/HBASE-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427289#comment-17427289 ] Andrew Kyle Purtell commented on HBASE-26345: - [~vjasani] This is well written. The doc is missing a minor point about ring buffers in that it is ok and expected to begin overwriting entries after a wrap-around, this is how they re-use the oldest entries for storing the newest, but it can be inferred. If I didn't know anything about this feature and I was reading the doc, I would wonder if the slow log persistence stuff can be reused for another NQ and how I might go about doing that. I can see that it is more than just configuration, some coding is required, would be useful to explain/diagram this, but not required. I didn't double check the API details with the code but did read them to check that it all makes sense. +1 from me, looks great > Design doc for HBase NamedQueue framework > - > > Key: HBASE-26345 > URL: https://issues.apache.org/jira/browse/HBASE-26345 > Project: HBase > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Attachments: Online NamedQueue framework with optional persistence > layer.pdf > > > We have a couple of usecases already being served by the NamedQueue > framework. It would be good to also provide a design doc to provide the high > level system components view and let other usecases be onboarded with ease. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-26329) Upgrade commons-io to 2.11.0
[
https://issues.apache.org/jira/browse/HBASE-26329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427269#comment-17427269
]
Hudson commented on HBASE-26329:
Results for branch branch-2.3
[build #305 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.3/305/]:
(/) *{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.3/305/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.3/305/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.3/305/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.3/305/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Upgrade commons-io to 2.11.0
>
>
> Key: HBASE-26329
> URL: https://issues.apache.org/jira/browse/HBASE-26329
> Project: HBase
> Issue Type: Task
> Components: dependencies
>Reporter: Peter Somogyi
>Assignee: Peter Somogyi
>Priority: Major
> Fix For: 2.5.0, 3.0.0-alpha-2, 2.3.7, 2.4.8
>
>
> The 2.11.0 version got released from commons-io.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-26047) [JDK17] Track JDK17 unit test failures
[
https://issues.apache.org/jira/browse/HBASE-26047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427249#comment-17427249
]
Huaxiang Sun commented on HBASE-26047:
--
Hi [~weichiu], I can help to look at some failures here. Let me know which ones
I need to look at first, thanks.
> [JDK17] Track JDK17 unit test failures
> --
>
> Key: HBASE-26047
> URL: https://issues.apache.org/jira/browse/HBASE-26047
> Project: HBase
> Issue Type: Sub-task
>Reporter: Wei-Chiu Chuang
>Priority: Major
>
> As of now, there are still two failed unit tests after exporting JDK internal
> modules and the modifier access hack.
> {noformat}
> [ERROR] Tests run: 7, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 0.217
> s <<< FAILURE! - in org.apache.hadoop.hbase.io.TestHeapSize
> [ERROR] org.apache.hadoop.hbase.io.TestHeapSize.testSizes Time elapsed:
> 0.041 s <<< FAILURE!
> java.lang.AssertionError: expected:<160> but was:<152>
> at
> org.apache.hadoop.hbase.io.TestHeapSize.testSizes(TestHeapSize.java:335)
> [ERROR] org.apache.hadoop.hbase.io.TestHeapSize.testNativeSizes Time
> elapsed: 0.01 s <<< FAILURE!
> java.lang.AssertionError: expected:<72> but was:<64>
> at
> org.apache.hadoop.hbase.io.TestHeapSize.testNativeSizes(TestHeapSize.java:134)
> [INFO] Running org.apache.hadoop.hbase.io.Tes
> [ERROR] Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.697
> s <<< FAILURE! - in org.apache.hadoop.hbase.ipc.TestBufferChain
> [ERROR] org.apache.hadoop.hbase.ipc.TestBufferChain.testWithSpy Time
> elapsed: 0.537 s <<< ERROR!
> java.lang.NullPointerException: Cannot enter synchronized block because
> "this.closeLock" is null
> at
> org.apache.hadoop.hbase.ipc.TestBufferChain.testWithSpy(TestBufferChain.java:119)
> {noformat}
> It appears that JDK17 makes the heap size estimate different than before. Not
> sure why.
> TestBufferChain.testWithSpy failure might be because of yet another
> unexported module.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase-operator-tools] Apache-HBase commented on pull request #94: HBASE-26338 hbck2 setRegionState cannot set replica region state
Apache-HBase commented on pull request #94: URL: https://github.com/apache/hbase-operator-tools/pull/94#issuecomment-940191875 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 11s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +0 :ok: | spotbugs | 0m 0s | spotbugs executables are not available. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | +1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 0m 53s | master passed | | +1 :green_heart: | compile | 0m 10s | master passed | | +1 :green_heart: | checkstyle | 0m 7s | master passed | | +1 :green_heart: | javadoc | 0m 7s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 0m 11s | the patch passed | | +1 :green_heart: | compile | 0m 10s | the patch passed | | +1 :green_heart: | javac | 0m 10s | the patch passed | | +1 :green_heart: | checkstyle | 0m 4s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | javadoc | 0m 5s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 3m 1s | hbase-hbck2 in the patch passed. | | +1 :green_heart: | asflicense | 0m 6s | The patch does not generate ASF License warnings. | | | | 6m 15s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-Operator-Tools-PreCommit/job/PR-94/3/artifact/yetus-precommit-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase-operator-tools/pull/94 | | Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile | | uname | Linux 0e7d152a7560 5.4.0-1047-aws #49~18.04.1-Ubuntu SMP Wed Apr 28 23:08:58 UTC 2021 x86_64 GNU/Linux | | Build tool | maven | | git revision | master / d3ad075 | | Default Java | Oracle Corporation-1.8.0_282-b08 | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-Operator-Tools-PreCommit/job/PR-94/3/testReport/ | | Max. process+thread count | 1197 (vs. ulimit of 5000) | | modules | C: hbase-hbck2 U: hbase-hbck2 | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-Operator-Tools-PreCommit/job/PR-94/3/console | | versions | git=2.20.1 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache9 commented on a change in pull request #3679: HBASE-26267 Don't try to recover WALs from a WAL dir which doesn't exist
Apache9 commented on a change in pull request #3679:
URL: https://github.com/apache/hbase/pull/3679#discussion_r726241962
##
File path:
hbase-server/src/main/java/org/apache/hadoop/hbase/master/region/MasterRegion.java
##
@@ -227,7 +227,31 @@ private static HRegion open(Configuration conf,
TableDescriptor td, FileSystem f
if (!walFs.exists(replayEditsDir) && !walFs.mkdirs(replayEditsDir)) {
throw new IOException("Failed to create replay directory: " +
replayEditsDir);
}
+
+// Replay any WALs for the Master Region before opening it.
Path walsDir = new Path(walRootDir, HREGION_LOGDIR_NAME);
+// In open(...), we expect that the WAL directory for the MasterRegion to
already exist.
+// This is in contrast to bootstrap() where we create the MasterRegion
data and WAL dir.
+// However, it's possible that users directly remove the WAL directory. We
expect walsDir
+// to always exist in normal situations, but we should guard against users
changing the
+// filesystem outside of HBase's line of sight.
+if (walFs.exists(walsDir)) {
+ replayWALs(conf, walFs, walRootDir, walsDir, regionInfo, serverName,
replayEditsDir);
+} else {
+ LOG.warn("UNEXPECTED: WAL directory for MasterRegion is missing."
Review comment:
Better use LOG.error here and say it may cause data loss? In general,
removing directories directly outside the HBase control is a dangerous
operation...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Commented] (HBASE-26267) Master initialization fails if Master Region WAL dir is missing
[
https://issues.apache.org/jira/browse/HBASE-26267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427210#comment-17427210
]
Sergey Soldatov commented on HBASE-26267:
-
[~zhangduo] [~zyork] do you have any other concerns regarding Josh's PR? Could
we get it in?
> Master initialization fails if Master Region WAL dir is missing
> ---
>
> Key: HBASE-26267
> URL: https://issues.apache.org/jira/browse/HBASE-26267
> Project: HBase
> Issue Type: Improvement
> Components: master
>Affects Versions: 2.4.6
>Reporter: Josh Elser
>Assignee: Josh Elser
>Priority: Major
> Fix For: 2.5.0, 3.0.0-alpha-2, 2.4.8
>
>
> From a recent branch-2.4 build:
> {noformat}
> 2021-09-07 19:31:19,666 ERROR [master/localhost:16000:becomeActiveMaster]
> master.HMaster(159): * ABORTING master localhost,16000,1631057476442:
> Unhandled exception. Starting shutdown. *
> java.io.FileNotFoundException: File
> hdfs://localhost:8020/hbase-2.4-wals/MasterData/WALs does not exist.
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:1059)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.access$1000(DistributedFileSystem.java:131)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$24.doCall(DistributedFileSystem.java:1119)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$24.doCall(DistributedFileSystem.java:1116)
> at
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:1126)
> at
> org.apache.hadoop.hbase.master.region.MasterRegion.open(MasterRegion.java:226)
> at
> org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:303)
> at
> org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104)
> at
> org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:839)
> at
> org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2189)
> at
> org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:512)
> at java.lang.Thread.run(Thread.java:748)
> {noformat}
> If the WAL directory is missing but the Master Region already exists, we will
> try to list the contents of the Master Region's WAL directory which may or
> may not exist. If we simply check to make sure the directory exists and then
> the rest of the initialization code works as expected.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work started] (HBASE-26348) Implement a special procedure to migrate rs group information when upgrading
[ https://issues.apache.org/jira/browse/HBASE-26348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-26348 started by Duo Zhang. - > Implement a special procedure to migrate rs group information when upgrading > > > Key: HBASE-26348 > URL: https://issues.apache.org/jira/browse/HBASE-26348 > Project: HBase > Issue Type: Improvement > Components: proc-v2, rsgroup >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Fix For: 3.0.0-alpha-2 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-26348) Implement a special procedure to migrate rs group information when upgrading
Duo Zhang created HBASE-26348: - Summary: Implement a special procedure to migrate rs group information when upgrading Key: HBASE-26348 URL: https://issues.apache.org/jira/browse/HBASE-26348 Project: HBase Issue Type: Improvement Components: proc-v2, rsgroup Reporter: Duo Zhang Assignee: Duo Zhang Fix For: 3.0.0-alpha-2 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #3721: HBASE-26326 CreateTableProcedure fails when FileBasedStoreFileTracker…
Apache-HBase commented on pull request #3721: URL: https://github.com/apache/hbase/pull/3721#issuecomment-940125540 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 3m 54s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ HBASE-26067 Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 43s | HBASE-26067 passed | | +1 :green_heart: | compile | 3m 11s | HBASE-26067 passed | | +1 :green_heart: | checkstyle | 1m 2s | HBASE-26067 passed | | +1 :green_heart: | spotbugs | 2m 3s | HBASE-26067 passed | | -0 :warning: | patch | 2m 11s | Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary. | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 42s | the patch passed | | +1 :green_heart: | compile | 3m 9s | the patch passed | | +1 :green_heart: | javac | 3m 9s | the patch passed | | +1 :green_heart: | checkstyle | 1m 3s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 18m 19s | Patch does not cause any errors with Hadoop 3.1.2 3.2.1 3.3.0. | | +1 :green_heart: | spotbugs | 2m 17s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 13s | The patch does not generate ASF License warnings. | | | | 50m 8s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3721/15/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3721 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile | | uname | Linux 72ff5314fb51 4.15.0-156-generic #163-Ubuntu SMP Thu Aug 19 23:31:58 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | HBASE-26067 / c4d7d28911 | | Default Java | AdoptOpenJDK-1.8.0_282-b08 | | Max. process+thread count | 95 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3721/15/console | | versions | git=2.17.1 maven=3.6.3 spotbugs=4.2.2 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache9 commented on a change in pull request #3721: HBASE-26326 CreateTableProcedure fails when FileBasedStoreFileTracker…
Apache9 commented on a change in pull request #3721:
URL: https://github.com/apache/hbase/pull/3721#discussion_r726131755
##
File path:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/storefiletracker/MigrationStoreFileTracker.java
##
@@ -89,14 +90,16 @@ void set(List files) {
}
@Override
- public void persistConfiguration(TableDescriptorBuilder builder) {
-super.persistConfiguration(builder);
-if (StringUtils.isEmpty(builder.getValue(SRC_IMPL))) {
+ public TableDescriptor updateWithTrackerConfigs(TableDescriptor descriptor) {
Review comment:
If we need this there, we could change it back in the PR for HBASE-26328
I think. Maybe in the PR for HBASE-26328 we need to modify these methods again
since we have new requirements, but anyway, let's keep it simple for now. WDYT?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hbase] wchevreuil commented on a change in pull request #3721: HBASE-26326 CreateTableProcedure fails when FileBasedStoreFileTracker…
wchevreuil commented on a change in pull request #3721:
URL: https://github.com/apache/hbase/pull/3721#discussion_r726129797
##
File path:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/storefiletracker/StoreFileTrackerFactory.java
##
@@ -158,12 +158,12 @@ static StoreFileTrackerBase
createForMigration(Configuration conf, String config
return ReflectionUtils.newInstance(tracker, conf, isPrimaryReplica, ctx);
}
- public static void persistTrackerConfig(Configuration conf,
TableDescriptorBuilder builder) {
-TableDescriptor tableDescriptor = builder.build();
-ColumnFamilyDescriptor cfDesc = tableDescriptor.getColumnFamilies()[0];
-StoreContext context =
StoreContext.getBuilder().withColumnFamilyDescriptor(cfDesc).build();
-StoreFileTracker tracker = StoreFileTrackerFactory.create(conf, true,
context);
-tracker.persistConfiguration(builder);
+ public static TableDescriptor updateDescriptor(Configuration conf,
TableDescriptor descriptor) {
Review comment:
Ack
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hbase] wchevreuil commented on a change in pull request #3721: HBASE-26326 CreateTableProcedure fails when FileBasedStoreFileTracker…
wchevreuil commented on a change in pull request #3721:
URL: https://github.com/apache/hbase/pull/3721#discussion_r726129081
##
File path:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/storefiletracker/MigrationStoreFileTracker.java
##
@@ -89,14 +90,16 @@ void set(List files) {
}
@Override
- public void persistConfiguration(TableDescriptorBuilder builder) {
-super.persistConfiguration(builder);
-if (StringUtils.isEmpty(builder.getValue(SRC_IMPL))) {
+ public TableDescriptor updateWithTrackerConfigs(TableDescriptor descriptor) {
Review comment:
Right. Is it not worth having it here, case we need to call this from
elsewhere, other than table creation? I was planning to extend
MigrationStoreFileTracker for the snapshot issue I'm working on HBASE-26328, so
that I have a snapshot sft as source, and whatever is the SFT impl defined as
target. Ain't sure now if this method would be required from there, though.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hbase] Apache9 commented on a change in pull request #3721: HBASE-26326 CreateTableProcedure fails when FileBasedStoreFileTracker…
Apache9 commented on a change in pull request #3721:
URL: https://github.com/apache/hbase/pull/3721#discussion_r726098183
##
File path:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/storefiletracker/StoreFileTrackerBase.java
##
@@ -83,10 +84,13 @@ public final void replace(Collection
compactedFiles,
}
@Override
- public void persistConfiguration(TableDescriptorBuilder builder) {
-if (StringUtils.isEmpty(builder.getValue(TRACKER_IMPL))) {
+ public TableDescriptor updateWithTrackerConfigs(TableDescriptor descriptor) {
Review comment:
I think here we could pass in the TableDescriptorBuilder?
##
File path:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/storefiletracker/StoreFileTrackerFactory.java
##
@@ -158,12 +158,12 @@ static StoreFileTrackerBase
createForMigration(Configuration conf, String config
return ReflectionUtils.newInstance(tracker, conf, isPrimaryReplica, ctx);
}
- public static void persistTrackerConfig(Configuration conf,
TableDescriptorBuilder builder) {
-TableDescriptor tableDescriptor = builder.build();
-ColumnFamilyDescriptor cfDesc = tableDescriptor.getColumnFamilies()[0];
-StoreContext context =
StoreContext.getBuilder().withColumnFamilyDescriptor(cfDesc).build();
-StoreFileTracker tracker = StoreFileTrackerFactory.create(conf, true,
context);
-tracker.persistConfiguration(builder);
+ public static TableDescriptor updateDescriptor(Configuration conf,
TableDescriptor descriptor) {
+//CreateTableProcedure needs to instantiate the configured SFT impl, in
order to update table
+//descriptors with the SFT impl specific configs. By the time this
happens, the table has no
+//regions nor stores yet, so it can't create a proper StoreContext.
+StoreFileTracker tracker = StoreFileTrackerFactory.create(conf, true,
null);
Review comment:
I think here we could just check whether the TableDescriptor already has
TRACKER_IMPL set, if so just return to original TableDescriptor, otherwise, we
initialize the store file tracker, and call its updateWithTrackerConfigs method.
##
File path:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/storefiletracker/StoreFileTrackerFactory.java
##
@@ -158,12 +158,12 @@ static StoreFileTrackerBase
createForMigration(Configuration conf, String config
return ReflectionUtils.newInstance(tracker, conf, isPrimaryReplica, ctx);
}
- public static void persistTrackerConfig(Configuration conf,
TableDescriptorBuilder builder) {
-TableDescriptor tableDescriptor = builder.build();
-ColumnFamilyDescriptor cfDesc = tableDescriptor.getColumnFamilies()[0];
-StoreContext context =
StoreContext.getBuilder().withColumnFamilyDescriptor(cfDesc).build();
-StoreFileTracker tracker = StoreFileTrackerFactory.create(conf, true,
context);
-tracker.persistConfiguration(builder);
+ public static TableDescriptor updateDescriptor(Configuration conf,
TableDescriptor descriptor) {
Review comment:
Let's also name this method updateWIthTrackerConfigs?
##
File path:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/storefiletracker/MigrationStoreFileTracker.java
##
@@ -89,14 +90,16 @@ void set(List files) {
}
@Override
- public void persistConfiguration(TableDescriptorBuilder builder) {
-super.persistConfiguration(builder);
-if (StringUtils.isEmpty(builder.getValue(SRC_IMPL))) {
+ public TableDescriptor updateWithTrackerConfigs(TableDescriptor descriptor) {
Review comment:
Oh, I just realized that, we do not need to implement this method for
MigrationStoreFileTracker...
Please see HBASE-26264, we do not allow a new table to use
MigrationStoreFileTracker, so here we could just throw a
UnsupportOperationException.
##
File path:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/storefiletracker/StoreFileTrackerBase.java
##
@@ -83,10 +84,13 @@ public final void replace(Collection
compactedFiles,
}
@Override
- public void persistConfiguration(TableDescriptorBuilder builder) {
-if (StringUtils.isEmpty(builder.getValue(TRACKER_IMPL))) {
+ public TableDescriptor updateWithTrackerConfigs(TableDescriptor descriptor) {
+if (StringUtils.isEmpty(descriptor.getValue(TRACKER_IMPL))) {
Review comment:
And we could do this check in StoreFileTrackerFactory, before caclling
this method.
##
File path:
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/CreateTableProcedure.java
##
@@ -291,8 +291,9 @@ private void preCreate(final MasterProcedureEnv env)
}
TableDescriptorBuilder builder =
TableDescriptorBuilder.newBuilder(tableDescriptor);
-StoreFileTrackerFactory.persistTrackerConfig(env.getMasterConfiguration(),
builder);
-tableDescriptor = builder.build();
+tableDescriptor =
[jira] [Commented] (HBASE-26347) Support detect and exclude slow DNs in fan-out of WAL
[ https://issues.apache.org/jira/browse/HBASE-26347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427105#comment-17427105 ] Duo Zhang commented on HBASE-26347: --- IIRC the old design is to set a smaller timeout so for a slow DN we will get time out and roll the WAL writer. But anyway, it can not be too small so adding other threshold to check for slow DN is still valueable I guess. I can not recall whether we have the logic for maintaining exclude DNs, thanks for bring this up. > Support detect and exclude slow DNs in fan-out of WAL > - > > Key: HBASE-26347 > URL: https://issues.apache.org/jira/browse/HBASE-26347 > Project: HBase > Issue Type: New Feature > Components: wal >Affects Versions: 2.0.0, 3.0.0-alpha-2 >Reporter: Xiaolin Ha >Assignee: Xiaolin Ha >Priority: Major > > We all knows the WAL sync performance directly affects the RPC process time. > And we use self-designed FanOutOneBlockAsyncDFSOutput to sync WAL entries, > which connect straightly to all the block located DNs. But when even one DN > of the locations is slow, e.g. some disk hardware failures, the WAL syncs > slow. And what's more, the hardware failure detected by the lower layer HDFS > system is not so sensitive. > We can detect slow DNs by the ACK time of packets in > FanOutOneBlockAsyncDFSOutput, and exclude them when add new blocks after log > rolled(rolling log can also be triggered by slow syncs). And shows this info > in UI. We can also invalid these excluded DN cache after a duration, to aware > the recovery of those DNs. > I think this idea can quickly reduce the influence of slow DNs, and improve > the service availability. > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache9 commented on a change in pull request #3690: HBASE-26045 Master control the global throughput of all compaction servers
Apache9 commented on a change in pull request #3690:
URL: https://github.com/apache/hbase/pull/3690#discussion_r726077713
##
File path:
hbase-client/src/main/java/org/apache/hadoop/hbase/client/RawAsyncHBaseAdmin.java
##
@@ -3822,6 +3824,26 @@ private void getProcedureResult(long procId,
CompletableFuture future, int
return future;
}
+ @Override
+ public CompletableFuture>
updateCompactionServerTotalThroughput(long upperBound,
+ long lowerBound, long offPeak) {
+CompletableFuture> future = this.>
newMasterCaller().action(
+ (controller, stub) -> this.> call(
+controller, stub,
UpdateCompactionServerTotalThroughputRequest.newBuilder()
+
.setMaxThroughputUpperBound(upperBound).setMaxThroughputLowerBound(lowerBound)
+.setMaxThroughputOffPeak(offPeak).build(),
+ (s, c, req, done) -> s.updateCompactionServerTotalThroughput(c, req,
done), resp -> {
+Map result = new HashMap<>();
+result.put("UpperBound", resp.getMaxThroughputUpperBound());
Review comment:
It depends. But at least here, I think a new class is better than Map,
as only have 3 elements and they have different meanings.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #3700: HBASE-26263 [Rolling Upgrading] Persist the StoreFileTracker configur…
Apache-HBase commented on pull request #3700: URL: https://github.com/apache/hbase/pull/3700#issuecomment-939988673 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 1s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ HBASE-26067 Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 20s | HBASE-26067 passed | | +1 :green_heart: | compile | 1m 4s | HBASE-26067 passed | | +1 :green_heart: | shadedjars | 9m 6s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 39s | HBASE-26067 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 8s | the patch passed | | +1 :green_heart: | compile | 1m 3s | the patch passed | | +1 :green_heart: | javac | 1m 3s | the patch passed | | +1 :green_heart: | shadedjars | 9m 2s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 37s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 223m 26s | hbase-server in the patch failed. | | | | 256m 7s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3700/4/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3700 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux b81c064415e4 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | HBASE-26067 / c4d7d28911 | | Default Java | AdoptOpenJDK-1.8.0_282-b08 | | unit | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3700/4/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3700/4/testReport/ | | Max. process+thread count | 2939 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3700/4/console | | versions | git=2.17.1 maven=3.6.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-26284) Add HBase Thrift API to get all table names along with whether it is enabled or not
[ https://issues.apache.org/jira/browse/HBASE-26284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427091#comment-17427091 ] Wellington Chevreuil commented on HBASE-26284: -- Thanks for the contribution, [~dora.horvath]. I had merged the PR into master branch. Tried to cherry-pick it into branch-2 reported conflicts. Is it possible to submit a branch-2 compatible PR? > Add HBase Thrift API to get all table names along with whether it is enabled > or not > --- > > Key: HBASE-26284 > URL: https://issues.apache.org/jira/browse/HBASE-26284 > Project: HBase > Issue Type: New Feature > Components: Thrift >Affects Versions: 3.0.0-alpha-1, 2.2.7, 2.4.6 >Reporter: Dóra Horváth >Assignee: Dóra Horváth >Priority: Major > Fix For: 3.0.0-alpha-2 > > > When loading Hue HBase page, hue will firstly get all the table names in one > thrift call, then hue will send a request as a new connection to Hbase thrift > server for each table to check if the table is enabled or not. When the > number of table becomes big, for example a few hundreds. Hue will have the > chance to fail to show the table list, and it shows an error message on Hue > web UI "Api Error: Unable to authenticate". In Hbase thrift server log, we > can see error message, below is an example from test environment: > == > 2020-07-02 21:54:01,025 INFO > org.apache.hadoop.hbase.thrift.ThriftHttpServlet: Failed to authenticate with > HTTP/[...]@HADOOP.COM kerberos principal > 2020-07-02 21:54:01,025 ERROR > org.apache.hadoop.hbase.thrift.ThriftHttpServlet: Kerberos Authentication > failed > org.apache.hadoop.hbase.thrift.HttpAuthenticationException: > java.lang.reflect.UndeclaredThrowableException > .. > Caused by: java.lang.reflect.UndeclaredThrowableException > .. > Caused by: org.apache.hadoop.hbase.thrift.HttpAuthenticationException: > Kerberos authentication failed: > .. > Caused by: GSSException: Failure unspecified at GSS-API level (Mechanism > level: Request is a replay (34)) > .. > Caused by: KrbException: Request is a replay (34) > == > ~~ > My current understanding of the cause is Hue sends requests too fast so that > it has the chance to send 2 requests with the same Kerberos authenticator > (timestamp is same). So Hbase thrift server will think this is a replay > attack. We came up with this assumption based on tcpdump observation and this > document, https://web.mit.edu/kerberos/krb5-latest/doc/basic/rcache_def.html > If HBase Thrift server can have an API call that Hue can call it once and get > all table names with whether is enabled or not, we can avoid above issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-26347) Support detect and exclude slow DNs in fan-out of WAL
[ https://issues.apache.org/jira/browse/HBASE-26347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaolin Ha updated HBASE-26347: --- Description: We all knows the WAL sync performance directly affects the RPC process time. And we use self-designed FanOutOneBlockAsyncDFSOutput to sync WAL entries, which connect straightly to all the block located DNs. But when even one DN of the locations is slow, e.g. some disk hardware failures, the WAL syncs slow. And what's more, the hardware failure detected by the lower layer HDFS system is not so sensitive. We can detect slow DNs by the ACK time of packets in FanOutOneBlockAsyncDFSOutput, and exclude them when add new blocks after log rolled(rolling log can also be triggered by slow syncs). And shows this info in UI. We can also invalid these excluded DN cache after a duration, to aware the recovery of those DNs. I think this idea can quickly reduce the influence of slow DNs, and improve the service availability. was: We all knows the WAL sync performance directly affects the RPC process time. And we use self-designed FanOutOneBlockAsyncDFSOutput to sync WAL entries, which connect straightly to all the block located DNs. But when even one DN of the locations is slow, e.g. some disk hardware failures, the WAL syncs slow. And what's more, the hardware failure detected by the lower layer HDFS system is not so sensitive. We can detect slow DNs by the ACK time of packets in FanOutOneBlockAsyncDFSOutput, and exclude them when add new blocks after log rolled(rolling log can also be triggered by slow syncs). And shows this info in UI. We can also invalid these excluded DN cache after a duration, to aware the recovery of those DNs. But anymore, this idea can quickly reduce the influence of slow DNs, and improve the service availability. > Support detect and exclude slow DNs in fan-out of WAL > - > > Key: HBASE-26347 > URL: https://issues.apache.org/jira/browse/HBASE-26347 > Project: HBase > Issue Type: New Feature > Components: wal >Affects Versions: 2.0.0, 3.0.0-alpha-2 >Reporter: Xiaolin Ha >Assignee: Xiaolin Ha >Priority: Major > > We all knows the WAL sync performance directly affects the RPC process time. > And we use self-designed FanOutOneBlockAsyncDFSOutput to sync WAL entries, > which connect straightly to all the block located DNs. But when even one DN > of the locations is slow, e.g. some disk hardware failures, the WAL syncs > slow. And what's more, the hardware failure detected by the lower layer HDFS > system is not so sensitive. > We can detect slow DNs by the ACK time of packets in > FanOutOneBlockAsyncDFSOutput, and exclude them when add new blocks after log > rolled(rolling log can also be triggered by slow syncs). And shows this info > in UI. We can also invalid these excluded DN cache after a duration, to aware > the recovery of those DNs. > I think this idea can quickly reduce the influence of slow DNs, and improve > the service availability. > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-26284) Add HBase Thrift API to get all table names along with whether it is enabled or not
[ https://issues.apache.org/jira/browse/HBASE-26284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HBASE-26284: - Fix Version/s: 3.0.0-alpha-2 > Add HBase Thrift API to get all table names along with whether it is enabled > or not > --- > > Key: HBASE-26284 > URL: https://issues.apache.org/jira/browse/HBASE-26284 > Project: HBase > Issue Type: New Feature > Components: Thrift >Affects Versions: 3.0.0-alpha-1, 2.2.7, 2.4.6 >Reporter: Dóra Horváth >Assignee: Dóra Horváth >Priority: Major > Fix For: 3.0.0-alpha-2 > > > When loading Hue HBase page, hue will firstly get all the table names in one > thrift call, then hue will send a request as a new connection to Hbase thrift > server for each table to check if the table is enabled or not. When the > number of table becomes big, for example a few hundreds. Hue will have the > chance to fail to show the table list, and it shows an error message on Hue > web UI "Api Error: Unable to authenticate". In Hbase thrift server log, we > can see error message, below is an example from test environment: > == > 2020-07-02 21:54:01,025 INFO > org.apache.hadoop.hbase.thrift.ThriftHttpServlet: Failed to authenticate with > HTTP/[...]@HADOOP.COM kerberos principal > 2020-07-02 21:54:01,025 ERROR > org.apache.hadoop.hbase.thrift.ThriftHttpServlet: Kerberos Authentication > failed > org.apache.hadoop.hbase.thrift.HttpAuthenticationException: > java.lang.reflect.UndeclaredThrowableException > .. > Caused by: java.lang.reflect.UndeclaredThrowableException > .. > Caused by: org.apache.hadoop.hbase.thrift.HttpAuthenticationException: > Kerberos authentication failed: > .. > Caused by: GSSException: Failure unspecified at GSS-API level (Mechanism > level: Request is a replay (34)) > .. > Caused by: KrbException: Request is a replay (34) > == > ~~ > My current understanding of the cause is Hue sends requests too fast so that > it has the chance to send 2 requests with the same Kerberos authenticator > (timestamp is same). So Hbase thrift server will think this is a replay > attack. We came up with this assumption based on tcpdump observation and this > document, https://web.mit.edu/kerberos/krb5-latest/doc/basic/rcache_def.html > If HBase Thrift server can have an API call that Hue can call it once and get > all table names with whether is enabled or not, we can avoid above issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-26347) Support detect and exclude slow DNs in fan-out of WAL
Xiaolin Ha created HBASE-26347: -- Summary: Support detect and exclude slow DNs in fan-out of WAL Key: HBASE-26347 URL: https://issues.apache.org/jira/browse/HBASE-26347 Project: HBase Issue Type: New Feature Components: wal Affects Versions: 2.0.0, 3.0.0-alpha-2 Reporter: Xiaolin Ha Assignee: Xiaolin Ha We all knows the WAL sync performance directly affects the RPC process time. And we use self-designed FanOutOneBlockAsyncDFSOutput to sync WAL entries, which connect straightly to all the block located DNs. But when even one DN of the locations is slow, e.g. some disk hardware failures, the WAL syncs slow. And what's more, the hardware failure detected by the lower layer HDFS system is not so sensitive. We can detect slow DNs by the ACK time of packets in FanOutOneBlockAsyncDFSOutput, and exclude them when add new blocks after log rolled(rolling log can also be triggered by slow syncs). And shows this info in UI. We can also invalid these excluded DN cache after a duration, to aware the recovery of those DNs. But anymore, this idea can quickly reduce the influence of slow DNs, and improve the service availability. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-26284) Add HBase Thrift API to get all table names along with whether it is enabled or not
[ https://issues.apache.org/jira/browse/HBASE-26284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HBASE-26284: - Affects Version/s: 3.0.0-alpha-1 > Add HBase Thrift API to get all table names along with whether it is enabled > or not > --- > > Key: HBASE-26284 > URL: https://issues.apache.org/jira/browse/HBASE-26284 > Project: HBase > Issue Type: New Feature > Components: Thrift >Affects Versions: 3.0.0-alpha-1, 2.2.7, 2.4.6 >Reporter: Dóra Horváth >Assignee: Dóra Horváth >Priority: Major > > When loading Hue HBase page, hue will firstly get all the table names in one > thrift call, then hue will send a request as a new connection to Hbase thrift > server for each table to check if the table is enabled or not. When the > number of table becomes big, for example a few hundreds. Hue will have the > chance to fail to show the table list, and it shows an error message on Hue > web UI "Api Error: Unable to authenticate". In Hbase thrift server log, we > can see error message, below is an example from test environment: > == > 2020-07-02 21:54:01,025 INFO > org.apache.hadoop.hbase.thrift.ThriftHttpServlet: Failed to authenticate with > HTTP/[...]@HADOOP.COM kerberos principal > 2020-07-02 21:54:01,025 ERROR > org.apache.hadoop.hbase.thrift.ThriftHttpServlet: Kerberos Authentication > failed > org.apache.hadoop.hbase.thrift.HttpAuthenticationException: > java.lang.reflect.UndeclaredThrowableException > .. > Caused by: java.lang.reflect.UndeclaredThrowableException > .. > Caused by: org.apache.hadoop.hbase.thrift.HttpAuthenticationException: > Kerberos authentication failed: > .. > Caused by: GSSException: Failure unspecified at GSS-API level (Mechanism > level: Request is a replay (34)) > .. > Caused by: KrbException: Request is a replay (34) > == > ~~ > My current understanding of the cause is Hue sends requests too fast so that > it has the chance to send 2 requests with the same Kerberos authenticator > (timestamp is same). So Hbase thrift server will think this is a replay > attack. We came up with this assumption based on tcpdump observation and this > document, https://web.mit.edu/kerberos/krb5-latest/doc/basic/rcache_def.html > If HBase Thrift server can have an API call that Hue can call it once and get > all table names with whether is enabled or not, we can avoid above issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] wchevreuil merged pull request #3693: HBASE-26284 Add HBase Thrift API to get all table names along with wh…
wchevreuil merged pull request #3693: URL: https://github.com/apache/hbase/pull/3693 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] nyl3532016 commented on a change in pull request #3690: HBASE-26045 Master control the global throughput of all compaction servers
nyl3532016 commented on a change in pull request #3690:
URL: https://github.com/apache/hbase/pull/3690#discussion_r726041989
##
File path:
hbase-client/src/main/java/org/apache/hadoop/hbase/client/RawAsyncHBaseAdmin.java
##
@@ -3822,6 +3824,26 @@ private void getProcedureResult(long procId,
CompletableFuture future, int
return future;
}
+ @Override
+ public CompletableFuture>
updateCompactionServerTotalThroughput(long upperBound,
+ long lowerBound, long offPeak) {
+CompletableFuture> future = this.>
newMasterCaller().action(
+ (controller, stub) -> this.> call(
+controller, stub,
UpdateCompactionServerTotalThroughputRequest.newBuilder()
+
.setMaxThroughputUpperBound(upperBound).setMaxThroughputLowerBound(lowerBound)
+.setMaxThroughputOffPeak(offPeak).build(),
+ (s, c, req, done) -> s.updateCompactionServerTotalThroughput(c, req,
done), resp -> {
+Map result = new HashMap<>();
+result.put("UpperBound", resp.getMaxThroughputUpperBound());
Review comment:
we only need get/set total throughput (the sum value of upperBound,
LowerBound and offpeakBound). we do not care the throughput of each compaction
server. And introduce a new class is better than return a Map?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #3700: HBASE-26263 [Rolling Upgrading] Persist the StoreFileTracker configur…
Apache-HBase commented on pull request #3700: URL: https://github.com/apache/hbase/pull/3700#issuecomment-939930903 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 26s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ HBASE-26067 Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 33s | HBASE-26067 passed | | +1 :green_heart: | compile | 1m 13s | HBASE-26067 passed | | +1 :green_heart: | shadedjars | 8m 28s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 44s | HBASE-26067 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 26s | the patch passed | | +1 :green_heart: | compile | 1m 16s | the patch passed | | +1 :green_heart: | javac | 1m 16s | the patch passed | | +1 :green_heart: | shadedjars | 8m 14s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 40s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 143m 41s | hbase-server in the patch failed. | | | | 175m 45s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3700/4/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3700 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 4dd59c0aa01f 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | HBASE-26067 / c4d7d28911 | | Default Java | AdoptOpenJDK-11.0.10+9 | | unit | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3700/4/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3700/4/testReport/ | | Max. process+thread count | 4138 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3700/4/console | | versions | git=2.17.1 maven=3.6.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] wchevreuil commented on pull request #3693: HBASE-26284 Add HBase Thrift API to get all table names along with wh…
wchevreuil commented on pull request #3693: URL: https://github.com/apache/hbase/pull/3693#issuecomment-939883434 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] wchevreuil commented on pull request #3693: HBASE-26284 Add HBase Thrift API to get all table names along with wh…
wchevreuil commented on pull request #3693: URL: https://github.com/apache/hbase/pull/3693#issuecomment-939882761 recheck -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #3700: HBASE-26263 [Rolling Upgrading] Persist the StoreFileTracker configur…
Apache-HBase commented on pull request #3700: URL: https://github.com/apache/hbase/pull/3700#issuecomment-939839193 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 34s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ HBASE-26067 Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 13s | HBASE-26067 passed | | +1 :green_heart: | compile | 3m 31s | HBASE-26067 passed | | +1 :green_heart: | checkstyle | 1m 6s | HBASE-26067 passed | | +1 :green_heart: | spotbugs | 2m 13s | HBASE-26067 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 56s | the patch passed | | +1 :green_heart: | compile | 3m 43s | the patch passed | | +1 :green_heart: | javac | 3m 43s | the patch passed | | -0 :warning: | checkstyle | 1m 9s | hbase-server: The patch generated 12 new + 95 unchanged - 0 fixed = 107 total (was 95) | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 21m 45s | Patch does not cause any errors with Hadoop 3.1.2 3.2.1 3.3.0. | | +1 :green_heart: | spotbugs | 2m 27s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 13s | The patch does not generate ASF License warnings. | | | | 53m 34s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3700/4/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3700 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile | | uname | Linux 95338f48b02b 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | HBASE-26067 / c4d7d28911 | | Default Java | AdoptOpenJDK-1.8.0_282-b08 | | checkstyle | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3700/4/artifact/yetus-general-check/output/diff-checkstyle-hbase-server.txt | | Max. process+thread count | 96 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3700/4/console | | versions | git=2.17.1 maven=3.6.3 spotbugs=4.2.2 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] GeorryHuang commented on pull request #3700: HBASE-26263 [Rolling Upgrading] Persist the StoreFileTracker configur…
GeorryHuang commented on pull request #3700: URL: https://github.com/apache/hbase/pull/3700#issuecomment-939798810 Please take a look. UTs will be pushed later -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-26346) Design support for rsgroup data isolation
[ https://issues.apache.org/jira/browse/HBASE-26346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mallikarjun updated HBASE-26346: Description: Put down design for changes required to support rsgroup data isolation. (was: TODO) > Design support for rsgroup data isolation > -- > > Key: HBASE-26346 > URL: https://issues.apache.org/jira/browse/HBASE-26346 > Project: HBase > Issue Type: New Feature > Components: rsgroup >Reporter: Mallikarjun >Assignee: Mallikarjun >Priority: Major > > Put down design for changes required to support rsgroup data isolation. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work started] (HBASE-26346) Design support for rsgroup data isolation
[ https://issues.apache.org/jira/browse/HBASE-26346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-26346 started by Mallikarjun. --- > Design support for rsgroup data isolation > -- > > Key: HBASE-26346 > URL: https://issues.apache.org/jira/browse/HBASE-26346 > Project: HBase > Issue Type: New Feature > Components: rsgroup >Reporter: Mallikarjun >Assignee: Mallikarjun >Priority: Major > > Put down design for changes required to support rsgroup data isolation. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-26346) Design support for rsgroup data isolation
Mallikarjun created HBASE-26346: --- Summary: Design support for rsgroup data isolation Key: HBASE-26346 URL: https://issues.apache.org/jira/browse/HBASE-26346 Project: HBase Issue Type: New Feature Components: rsgroup Reporter: Mallikarjun Assignee: Mallikarjun TODO -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #3648: HBASE-26190 High rate logging of Bucket Allocator Allocation fails
Apache-HBase commented on pull request #3648: URL: https://github.com/apache/hbase/pull/3648#issuecomment-939727450 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 25s | Docker mode activated. | | -0 :warning: | yetus | 0m 4s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 51s | master passed | | +1 :green_heart: | compile | 1m 1s | master passed | | +1 :green_heart: | shadedjars | 8m 19s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 38s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 55s | the patch passed | | +1 :green_heart: | compile | 1m 1s | the patch passed | | +1 :green_heart: | javac | 1m 1s | the patch passed | | +1 :green_heart: | shadedjars | 8m 17s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 37s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 147m 1s | hbase-server in the patch passed. | | | | 177m 11s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3648/8/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3648 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 55c26aa17fe5 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 82ccd33186 | | Default Java | AdoptOpenJDK-1.8.0_282-b08 | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3648/8/testReport/ | | Max. process+thread count | 5545 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3648/8/console | | versions | git=2.17.1 maven=3.6.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #3648: HBASE-26190 High rate logging of Bucket Allocator Allocation fails
Apache-HBase commented on pull request #3648: URL: https://github.com/apache/hbase/pull/3648#issuecomment-939724554 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 33s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 46s | master passed | | +1 :green_heart: | compile | 1m 13s | master passed | | +1 :green_heart: | shadedjars | 8m 18s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 43s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 25s | the patch passed | | +1 :green_heart: | compile | 1m 13s | the patch passed | | +1 :green_heart: | javac | 1m 13s | the patch passed | | +1 :green_heart: | shadedjars | 8m 16s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 42s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 141m 0s | hbase-server in the patch failed. | | | | 172m 39s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3648/8/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/3648 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 0d6b74d0c7d4 4.15.0-156-generic #163-Ubuntu SMP Thu Aug 19 23:31:58 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 82ccd33186 | | Default Java | AdoptOpenJDK-11.0.10+9 | | unit | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3648/8/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3648/8/testReport/ | | Max. process+thread count | 4387 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3648/8/console | | versions | git=2.17.1 maven=3.6.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
