Re: Please add me to Jira

2022-07-01 Thread Josh Elser
You're now a contributor :) On 6/27/22 10:19 AM, Luca Kovács wrote: Hello, My name is Luca, and I would like to contribute to the Apache project. Please add me to HBase Jira project. My username is: lkovacs Many thanks, Luca

[jira] [Resolved] (HBASE-20951) Ratis LogService backed WALs

2022-06-13 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-20951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-20951. Resolution: Later > Ratis LogService backed W

[jira] [Resolved] (HBASE-27042) hboss doesn't compile against hadoop branch-3.3 now that s3guard is cut

2022-05-23 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-27042. Hadoop Flags: Reviewed Release Note: Adds support for Apache Hadoop 3.3.3 and removes S3Guard

[jira] [Created] (HBASE-27044) Serialized procedures which point to users from other Kerberos domains can prevent master startup

2022-05-16 Thread Josh Elser (Jira)
Josh Elser created HBASE-27044: -- Summary: Serialized procedures which point to users from other Kerberos domains can prevent master startup Key: HBASE-27044 URL: https://issues.apache.org/jira/browse/HBASE-27044

Re: [ANNOUNCE] New HBase committer Bryan Beaudreault

2022-04-26 Thread Josh Elser
Congrats Bryan! On 4/9/22 7:44 AM, 张铎(Duo Zhang) wrote: On behalf of the Apache HBase PMC, I am pleased to announce that Bryan Beaudreault(bbeaudreault) has accepted the PMC's invitation to become a committer on the project. We appreciate all of Bryan's generous contributions thus far and look

[jira] [Resolved] (HBASE-26588) Implement a migration tool to help users migrate SFT implementation for a large set of tables

2022-04-04 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-26588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-26588. Resolution: Later Closing since we have HBASE-26673. Can re-open this if we have a reason

Re: A tweak to our checkstyle configuration

2022-03-20 Thread Josh Elser
Going through my inbox... 1. Great to have tooling which can validate (and fix) code which is not currently to style. 2. I would prefer a style guide (such as Google's Java Style) which is "generally accepted" by the Java industry at large and we can use as-is. However, I don't feel strongly

Re: [DISCUSS] operator tools, HBase 3 and StoreFileTracking

2022-03-01 Thread Josh Elser
n use the same opportunity to release SFT even if we designate it as an experimental feature if that would simplify some other logistics. For what it’s worth. On Feb 15, 2022, at 7:44 AM, Josh Elser wrote: I was talking with Szabolcs prior to him sending this one, and it's a tricky issue for

[jira] [Resolved] (HBASE-26767) Rest server should not use a large Header Cache.

2022-02-23 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-26767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-26767. Hadoop Flags: Reviewed Resolution: Fixed Pushed! Thanks for the great work, Sergey. > R

Re: [DISCUSS] deprecating jdk8, progress on LTS jdk support

2022-02-17 Thread Josh Elser
On 2/16/22 12:24 AM, Sean Busbey wrote: Regarding the original question, I would be in favor of the proposal. Time marches on. I assume just to state the obvious that our destination of minimum LTS would shift from 8 to 11. Yes, sorry I should have expressly stated JDK11 would become the

Re: [DISCUSS] deprecating jdk8, progress on LTS jdk support

2022-02-15 Thread Josh Elser
Deprecating jdk8 for HBase 3 and requiring minJdk=11 seems reasonable to me. Gotta start pushing the issue somehow. On 2/15/22 1:47 PM, Sean Busbey wrote: Hi folks! It's been some time since we decided to stick to LTS JDK releases as a way of getting a handle on the JDK treadmill. What do

Re: [DISCUSS] operator tools, HBase 3 and StoreFileTracking

2022-02-15 Thread Josh Elser
I was talking with Szabolcs prior to him sending this one, and it's a tricky issue for sure. To date, we've solved any HBase API issues by copying code into HBCK2 e.g. HBCKMetaTableAccessor which copies parts of MetaTableAccessor, or we push the logic down server-side to the HBase Master and

[jira] [Resolved] (HBASE-26644) Spurious compaction failures with file tracker

2022-02-10 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-26644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-26644. Resolution: Not A Problem Yep, all good. I believe you fixed this in HBASE-26675 > Spuri

[jira] [Resolved] (HBASE-26655) Initial commit with basic functionality and example code

2022-01-20 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-26655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-26655. Hadoop Flags: Reviewed Resolution: Fixed > Initial commit with basic functional

[jira] [Resolved] (HBASE-26687) Account for HBASE-24500 in regionInfoMismatch tool

2022-01-19 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-26687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-26687. Hadoop Flags: Reviewed Resolution: Fixed Thanks for the speedy review, Peter! > Acco

[jira] [Created] (HBASE-26687) Account for HBASE-24500 in regionInfoMismatch tool

2022-01-19 Thread Josh Elser (Jira)
Josh Elser created HBASE-26687: -- Summary: Account for HBASE-24500 in regionInfoMismatch tool Key: HBASE-26687 URL: https://issues.apache.org/jira/browse/HBASE-26687 Project: HBase Issue Type

[jira] [Created] (HBASE-26669) Add JWT section to HBase book

2022-01-13 Thread Josh Elser (Jira)
Josh Elser created HBASE-26669: -- Summary: Add JWT section to HBase book Key: HBASE-26669 URL: https://issues.apache.org/jira/browse/HBASE-26669 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-26668) Define user experience for JWT renewal

2022-01-13 Thread Josh Elser (Jira)
Josh Elser created HBASE-26668: -- Summary: Define user experience for JWT renewal Key: HBASE-26668 URL: https://issues.apache.org/jira/browse/HBASE-26668 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-26667) Integrate user-experience for hbase-client

2022-01-13 Thread Josh Elser (Jira)
Josh Elser created HBASE-26667: -- Summary: Integrate user-experience for hbase-client Key: HBASE-26667 URL: https://issues.apache.org/jira/browse/HBASE-26667 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-26666) Address bearer token being sent over wire before RPC encryption is enabled

2022-01-13 Thread Josh Elser (Jira)
Josh Elser created HBASE-2: -- Summary: Address bearer token being sent over wire before RPC encryption is enabled Key: HBASE-2 URL: https://issues.apache.org/jira/browse/HBASE-2 Project

[jira] [Created] (HBASE-26665) Standalone unit test in hbase-examples

2022-01-13 Thread Josh Elser (Jira)
Josh Elser created HBASE-26665: -- Summary: Standalone unit test in hbase-examples Key: HBASE-26665 URL: https://issues.apache.org/jira/browse/HBASE-26665 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-26656) [operator-tools] Provide a utility to detect and correct incorrect RegionInfo's in hbase:meta

2022-01-10 Thread Josh Elser (Jira)
Josh Elser created HBASE-26656: -- Summary: [operator-tools] Provide a utility to detect and correct incorrect RegionInfo's in hbase:meta Key: HBASE-26656 URL: https://issues.apache.org/jira/browse/HBASE-26656

[jira] [Created] (HBASE-26644) Spurious compaction failures with file tracker

2022-01-04 Thread Josh Elser (Jira)
Josh Elser created HBASE-26644: -- Summary: Spurious compaction failures with file tracker Key: HBASE-26644 URL: https://issues.apache.org/jira/browse/HBASE-26644 Project: HBase Issue Type: Sub

Re: [VOTE] Second release candidate for hbase-operator-tools 1.2.0 is available for download

2021-12-22 Thread Josh Elser
+1 (binding) * xsums/sigs OK * apache-rat:check OK * Can build from src * Ran all UT * Log4j 2.17 in use Looks great, Guangxu! On 12/20/21 1:15 AM, Guangxu Cheng wrote: Please vote on this Apache hbase operator tools release candidate, hbase-operator-tools-1.2.0RC1 The VOTE will remain open

Re: [VOTE] Third release candidate for hbase 3.0.0-alpha-2 is available for download

2021-12-22 Thread Josh Elser
+1 (binding) * xsums/sigs look good * apache-rat:check OK * Built from source * Can run PE on a bin tarball built from src * bin/client-bin both look good (log4j2.17) Good stuff, Duo. Thanks! On 12/19/21 10:36 AM, Duo Zhang wrote: Please vote on this Apache hbase release candidate,

Re: [VOTE] First release candidate for HBase 2.4.9 (RC0) is available

2021-12-22 Thread Josh Elser
+1 (binding) * xsums/sigs are good * bin and client-bin tarballs look fine * apache-rat:check passes * Can build from source with hadoop.profile=3.0 * Can run a simple pe randomWrite against tarball built from src * API compat report looks great - Josh On 12/18/21 4:18 PM, Andrew Purtell

[RESULT] [VOTE] Merge HBASE-26067 (storefile tracking) into master and branch-2

2021-12-22 Thread Josh Elser
This merge vote passes with 4 binding +1's and 3 non-binding +1's. Thanks everyone. I'll go ahead with the merge into master and see how easily it comes back to branch-2. On 2021/12/16 21:30:09 Josh Elser wrote: Hi! I'm extremely pleased to send this official vote to merge the feature

Re: [VOTE] Merge HBASE-26067 (storefile tracking) into master and branch-2

2021-12-21 Thread Josh Elser
the time to drop an email! On Tue, Dec 21, 2021 at 5:09 PM Andrew Purtell wrote: > > +1 (binding) > > Really happy to see this. Apologies that I have so limited bandwidth these > days. > > > On Mon, Dec 20, 2021 at 10:54 AM Josh Elser wrote: > > > Thanks to all

[jira] [Created] (HBASE-26612) Adjust log level when looking for .filelist/{f1,f2}

2021-12-20 Thread Josh Elser (Jira)
Josh Elser created HBASE-26612: -- Summary: Adjust log level when looking for .filelist/{f1,f2} Key: HBASE-26612 URL: https://issues.apache.org/jira/browse/HBASE-26612 Project: HBase Issue Type

re: [VOTE] Merge HBASE-26067 (storefile tracking) into master and branch-2

2021-12-20 Thread Josh Elser
time to weigh in. On 2021/12/16 21:30:09 Josh Elser wrote: Hi! I'm extremely pleased to send this official vote to merge the feature branch for HBASE-26067[1] into master and backport into branch-2 (2.x, not 2.5.x). This feature branch introduces the pluggable StoreFileTracker interface

[jira] [Created] (HBASE-26605) TestHStore#testRefreshStoreFiles broken due to unqualified and qualified paths

2021-12-18 Thread Josh Elser (Jira)
Josh Elser created HBASE-26605: -- Summary: TestHStore#testRefreshStoreFiles broken due to unqualified and qualified paths Key: HBASE-26605 URL: https://issues.apache.org/jira/browse/HBASE-26605 Project

Re: [VOTE] Second release candidate for hbase 3.0.0-alpha-2 is available for download

2021-12-18 Thread Josh Elser
+1 (binding) * Xsums/sigs good * Can build from source * Log4j 2.15 is included (more on this in the below) * log4j2.formatMsgNoLookups=true is set (multiple times per process, but properly set) * hbase-config.sh issue is fixed over rc1 Best as I've been able to keep up, it seems like we

[jira] [Created] (HBASE-26599) Netty exclusion through ZooKeeper not effective as intended

2021-12-17 Thread Josh Elser (Jira)
Josh Elser created HBASE-26599: -- Summary: Netty exclusion through ZooKeeper not effective as intended Key: HBASE-26599 URL: https://issues.apache.org/jira/browse/HBASE-26599 Project: HBase

Re: [VOTE] Merge HBASE-26067 (storefile tracking) into master and branch-2

2021-12-17 Thread Josh Elser
PM Andor Molnar wrote: +1 (non-binding) Andor On 2021. Dec 16., at 22:30, Josh Elser wrote: Hi! I'm extremely pleased to send this official vote to merge the feature branch for HBASE-26067[1] into master and backport into branch-2 (2.x, not 2.5.x). This feature branch introduces

Re: [VOTE] First release candidate for hbase-operator-tools 1.2.0 is available for download

2021-12-17 Thread Josh Elser
+1 (binding) Thanks for putting this together, Guangxu! * xsums/sigs are great * RAT check passes on src release * Can run unit tests (against 2.3.7, 2.4.4, 2.4.8) * Can build from source * CHANGES and RELEASENOTES look fine at a glance * Public key published in KEYS * Verified log4j2.16 is in

[VOTE] Merge HBASE-26067 (storefile tracking) into master and branch-2

2021-12-16 Thread Josh Elser
Hi! I'm extremely pleased to send this official vote to merge the feature branch for HBASE-26067[1] into master and backport into branch-2 (2.x, not 2.5.x). This feature branch introduces the pluggable StoreFileTracker interface. The StoreFileTracker allows the StoreFileEngine to be

[jira] [Resolved] (HBASE-26265) Update ref guide to mention the new store file tracker implementations

2021-12-16 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-26265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-26265. Resolution: Fixed > Update ref guide to mention the new store file tracker implementati

[jira] [Resolved] (HBASE-26286) Add support for specifying store file tracker when restoring or cloning snapshot

2021-12-15 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-26286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-26286. Hadoop Flags: Reviewed Resolution: Fixed Thanks for everyone's careful reviews! Great work

Re: [DISCUSS] Merge HBASE-26067 branch into master, and backport it to base 2 branches

2021-12-14 Thread Josh Elser
, Dec 8, 2021 at 1:37 PM Josh Elser wrote: I was going to wait for some other folks to chime in, but I guess I can be the next one :) Duo, Wellington, and Szabolcs have been doing some excellent work on the storefile tracking (SFT) to a degree that I never expected to see. I remember some

[jira] [Resolved] (HBASE-26568) hbase master got stuck after running couple of days in Azure setup

2021-12-13 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-26568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-26568. Resolution: Workaround Resolving with "Workaround" being upgrade. > hbase master go

[jira] [Reopened] (HBASE-26557) log4j2 has a critical RCE vulnerability

2021-12-13 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-26557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser reopened HBASE-26557: > log4j2 has a critical RCE vulnerabil

Re: [VOTE] First release candidate for hbase 3.0.0-alpha-2 is available for download

2021-12-13 Thread Josh Elser
-1 (binding) Log4j2 CVE mitigation is ineffective due an incorrect `export` in bin/hbase-config.sh. Appears that HBASE-26557 tried to add the mitigation to HBASE_OPTS but added spaces around either side of the equals sign, e.g. `export HBASE_OPTS = ".."`, which is invalid syntax. $

Re: [NOTICE] Apache log4j2 security vulnerability

2021-12-13 Thread Josh Elser
Thanks Guangxu! On 12/13/21 6:01 AM, Guangxu Cheng wrote: If there is no objection, I’ll volunteer to RM hbase-operation-tools 1.2.0 -- Best Regards, Guangxu 张铎(Duo Zhang) 于2021年12月12日周日 22:37写道: Besides 3.0.0-alpha-2, we also need to make a new release for hbase-operation-tools, any

[jira] [Created] (HBASE-26550) NPE if balance request comes in before master is initialized

2021-12-08 Thread Josh Elser (Jira)
Josh Elser created HBASE-26550: -- Summary: NPE if balance request comes in before master is initialized Key: HBASE-26550 URL: https://issues.apache.org/jira/browse/HBASE-26550 Project: HBase

Re: [DISCUSS] Merge HBASE-26067 branch into master, and backport it to base 2 branches

2021-12-08 Thread Josh Elser
There are also improvements in compaction, splits and merges times. Talking with Duo Zhang and Josh Elser in the HBASE-26067 jira, we feel optimistic that the current implementation is in a good state to get merged into master branch, but it would be nice to hear other opinions about it, before

[jira] [Resolved] (HBASE-26512) Make timestamp format configurable in HBase shell scan output

2021-12-01 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-26512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-26512. Hadoop Flags: Reviewed Resolution: Fixed Thanks for the patch, Istvan! I took the liberty

[jira] [Created] (HBASE-26461) [hboss] Delete self lock without orphaning znode

2021-11-17 Thread Josh Elser (Jira)
Josh Elser created HBASE-26461: -- Summary: [hboss] Delete self lock without orphaning znode Key: HBASE-26461 URL: https://issues.apache.org/jira/browse/HBASE-26461 Project: HBase Issue Type: Bug

[jira] [Resolved] (HBASE-26453) [hboss] removeInMemoryLocks can remove still in-use locks

2021-11-17 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-26453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-26453. Fix Version/s: hbase-filesystem-1.0.0-alpha2 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Resolved] (HBASE-26267) Master initialization fails if Master Region WAL dir is missing

2021-11-16 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-26267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-26267. Hadoop Flags: Reviewed Resolution: Fixed Thanks for the reminders to merge this, Duo

[jira] [Created] (HBASE-26453) [hboss] removeInMemoryLocks can remove still in-use locks

2021-11-12 Thread Josh Elser (Jira)
Josh Elser created HBASE-26453: -- Summary: [hboss] removeInMemoryLocks can remove still in-use locks Key: HBASE-26453 URL: https://issues.apache.org/jira/browse/HBASE-26453 Project: HBase Issue

[jira] [Created] (HBASE-26437) [hboss] Rename does not clean up znodes for src location

2021-11-09 Thread Josh Elser (Jira)
Josh Elser created HBASE-26437: -- Summary: [hboss] Rename does not clean up znodes for src location Key: HBASE-26437 URL: https://issues.apache.org/jira/browse/HBASE-26437 Project: HBase Issue

[jira] [Resolved] (HBASE-22394) HdfsFileStatus incompatibility when used with Hadoop 3.1.x

2021-10-19 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-22394. Resolution: Not A Bug Like HBASE-24154, this is just "how it is" in HBase presently.

[jira] [Created] (HBASE-26350) Missing server side debugging on failed SASL handshake

2021-10-11 Thread Josh Elser (Jira)
Josh Elser created HBASE-26350: -- Summary: Missing server side debugging on failed SASL handshake Key: HBASE-26350 URL: https://issues.apache.org/jira/browse/HBASE-26350 Project: HBase Issue

[jira] [Resolved] (HBASE-25900) HBoss tests compile/failure against Hadoop 3.3.1

2021-10-05 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-25900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-25900. Fix Version/s: hbase-filesystem-1.0.0-alpha2 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Resolved] (HBASE-26277) Revert 26240, Apply InterfaceAudience.Private to BalanceResponse$Builder

2021-09-10 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-26277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-26277. Hadoop Flags: Reviewed Resolution: Fixed Thanks for the quick fix-up, Bryan! > Rev

[jira] [Created] (HBASE-26267) Master initialization fails if Master Region WAL dir is missing

2021-09-08 Thread Josh Elser (Jira)
Josh Elser created HBASE-26267: -- Summary: Master initialization fails if Master Region WAL dir is missing Key: HBASE-26267 URL: https://issues.apache.org/jira/browse/HBASE-26267 Project: HBase

[jira] [Resolved] (HBASE-26147) Add dry run mode to hbase balancer

2021-09-01 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-26147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-26147. Resolution: Fixed Thanks for the excellent work, Bryan. This really came together to be a great

[jira] [Created] (HBASE-26236) Simple travis build for hbase-filesystem

2021-08-29 Thread Josh Elser (Jira)
Josh Elser created HBASE-26236: -- Summary: Simple travis build for hbase-filesystem Key: HBASE-26236 URL: https://issues.apache.org/jira/browse/HBASE-26236 Project: HBase Issue Type: Improvement

[jira] [Created] (HBASE-26212) Allow AuthUtil automatic renewal to be disabled

2021-08-20 Thread Josh Elser (Jira)
Josh Elser created HBASE-26212: -- Summary: Allow AuthUtil automatic renewal to be disabled Key: HBASE-26212 URL: https://issues.apache.org/jira/browse/HBASE-26212 Project: HBase Issue Type

[jira] [Created] (HBASE-26165) 2.3.5 listed on website downloads page but row intends to be for 2.3.6

2021-08-02 Thread Josh Elser (Jira)
Josh Elser created HBASE-26165: -- Summary: 2.3.5 listed on website downloads page but row intends to be for 2.3.6 Key: HBASE-26165 URL: https://issues.apache.org/jira/browse/HBASE-26165 Project: HBase

[jira] [Created] (HBASE-26164) Update dependencies in hbase-filesystem

2021-08-02 Thread Josh Elser (Jira)
Josh Elser created HBASE-26164: -- Summary: Update dependencies in hbase-filesystem Key: HBASE-26164 URL: https://issues.apache.org/jira/browse/HBASE-26164 Project: HBase Issue Type: Task

Re: [DISCUSS] Breakout discussion on storefile tracking storage solutions

2021-05-26 Thread Josh Elser
:24 PM Josh Elser wrote: Hi folks, This is a follow-on for the HBASE-24749 discussion on storefile tracking, specifically focusing on where/how do we store the list of files for each Store. I tried to capture my thoughts and the suggestions by Duo and Wellington in this google doc [1]. Please

[DISCUSS] Breakout discussion on storefile tracking storage solutions

2021-05-25 Thread Josh Elser
Hi folks, This is a follow-on for the HBASE-24749 discussion on storefile tracking, specifically focusing on where/how do we store the list of files for each Store. I tried to capture my thoughts and the suggestions by Duo and Wellington in this google doc [1]. Please feel free to ask for

Re: [DISCUSS] Implement and release HBASE-24749 (an hfile tracker that allows for avoiding renames)

2021-05-25 Thread Josh Elser
le will be very small, renaming will not be a big problem. Would this be a file per store? A file per region? Ah. Below you imply it's per store. Wellington Chevreuil 于2021年5 月19日周三 下午10:43写道: Thank you, Andrew and Duo, Talking internally with Josh Elser, initial idea was to rebase

Re: [DISCUSS] Implement and release HBASE-24749 (an hfile tracker that allows for avoiding renames)

2021-05-24 Thread Josh Elser
g and generate the 'hfile.list' file. WDYT? Thanks. Wellington Chevreuil 于2021年5月19日周三 下午10:43写道: Thank you, Andrew and Duo, Talking internally with Josh Elser, initial idea was to rebase the feature branch with master (in order to catch with latest commits), then focus on work to ha

Re: [DISCUSS] Implement and release HBASE-24749 (an hfile tracker that allows for avoiding renames)

2021-05-24 Thread Josh Elser
ot be a big problem. Would this be a file per store? A file per region? Ah. Below you imply it's per store. Wellington Chevreuil 于2021年5月19日周三 下午10:43写道: Thank you, Andrew and Duo, Talking internally with Josh Elser, initial idea was to rebase the feature branch with master (in or

Re: [ANNOUNCE] New HBase committer Geoffrey Jacoby

2021-04-09 Thread Josh Elser
Congrats and well-deserved, Geoffrey! On 4/9/21 12:47 PM, Bharath Vissapragada wrote: Congrats Geoffrey. On Fri, Apr 9, 2021 at 9:25 AM Tak-Lon (Stephen) Wu wrote: Congrats Geoffrey ! -Stephen On Fri, Apr 9, 2021 at 8:53 AM Rushabh Shah wrote: Congratulations Geoffrey ! Rushabh Shah

[jira] [Resolved] (HBASE-22078) corrupted procs in proc WAL

2021-03-31 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-22078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-22078. Resolution: Incomplete Goin' looking at missing stacks for an instance I've just run into. Came

[jira] [Created] (HBASE-25712) Port failure to close InputStream to 1.x

2021-03-29 Thread Josh Elser (Jira)
Josh Elser created HBASE-25712: -- Summary: Port failure to close InputStream to 1.x Key: HBASE-25712 URL: https://issues.apache.org/jira/browse/HBASE-25712 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-25692) Failure to instantiate WALCellCodec leaks socket

2021-03-24 Thread Josh Elser (Jira)
Josh Elser created HBASE-25692: -- Summary: Failure to instantiate WALCellCodec leaks socket Key: HBASE-25692 URL: https://issues.apache.org/jira/browse/HBASE-25692 Project: HBase Issue Type: Bug

Re: [DISCUSS] Updating the 'stable' pointer to 2.4.2

2021-03-18 Thread Josh Elser
Fun timing, as we've been trying to lift ourselves off of 2.2 and into 2.3. Our Norbert has been hard at work with these efforts. It's important to me that we do the best we can to stay in line with the rest of you doing great work closer to the tip. While I go looking at the changelog on my

[jira] [Created] (HBASE-25601) Remove search hadoop references in book

2021-02-23 Thread Josh Elser (Jira)
Josh Elser created HBASE-25601: -- Summary: Remove search hadoop references in book Key: HBASE-25601 URL: https://issues.apache.org/jira/browse/HBASE-25601 Project: HBase Issue Type: Task

[jira] [Resolved] (HBASE-25449) 'dfs.client.read.shortcircuit' should not be set in hbase-default.xml

2021-01-08 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-25449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-25449. Hadoop Flags: Reviewed Release Note: The presence of HDFS short-circuit read configuration

Re: [DISCUSS] Clarifying guidance around Signed-off-by in commit messages

2020-12-01 Thread Josh Elser
cited by Bharath. I like the Bharath idea on 'Reviewed-by' too. We can talk up 'Reviewed-by' credits as a way to earn standing in the community, of how they are given weight evaluating whether to make a candidate a committer/PMC'er or not. S On Fri, Nov 20, 2020 at 3:13 PM Josh Elser

Re: [DISCUSS] Clarifying guidance around Signed-off-by in commit messages

2020-12-01 Thread Josh Elser
definition cited by Bharath. I like the Bharath idea on 'Reviewed-by' too. We can talk up 'Reviewed-by' credits as a way to earn standing in the community, of how they are given weight evaluating whether to make a candidate a committer/PMC'er or not. S On Fri, Nov 20, 2020 at 3:13 PM Josh E

[jira] [Resolved] (HBASE-24268) REST and Thrift server do not handle the "doAs" parameter case insensitively

2020-11-24 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-24268. Hadoop Flags: Reviewed Release Note: This change allows the REST and Thrift servers to handle

Re: [DISCUSS] Clarifying guidance around Signed-off-by in commit messages

2020-11-20 Thread Josh Elser
On 11/20/20 1:07 PM, Bharath Vissapragada wrote: * All individuals mentioned in a sign-off*must* be capable of giving a binding vote (i.e. they are an HBase committer) It appears that the original intent

[DISCUSS] Clarifying guidance around Signed-off-by in commit messages

2020-11-20 Thread Josh Elser
Hi! As most of you know, we've been using the "Signed-off-by: " line in out commit messages more and more lately to indicate who reviewed some change. We've recently had an event in which one of these Signed-off-by lines showed up with someone's name who didn't consider themselves to have

[jira] [Created] (HBASE-25279) Non-daemon thread in ZKWatcher

2020-11-12 Thread Josh Elser (Jira)
Josh Elser created HBASE-25279: -- Summary: Non-daemon thread in ZKWatcher Key: HBASE-25279 URL: https://issues.apache.org/jira/browse/HBASE-25279 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-25278) Add option to toggle CACHE_BLOCKS in count.rb

2020-11-12 Thread Josh Elser (Jira)
Josh Elser created HBASE-25278: -- Summary: Add option to toggle CACHE_BLOCKS in count.rb Key: HBASE-25278 URL: https://issues.apache.org/jira/browse/HBASE-25278 Project: HBase Issue Type: New

Re: EOL 1.3.x?

2020-08-12 Thread Josh Elser
It's gone both ways, if memory serves. On 8/11/20 2:43 PM, Zach York wrote: +1 Do we typically do a final release or can we just EOL as is? On Tue, Aug 11, 2020 at 9:43 AM Geoffrey Jacoby wrote: +1 (non-binding) Geoffrey On Tue, Aug 11, 2020 at 8:19 AM Josh Elser wrote: Sounds good

[jira] [Resolved] (HBASE-24860) Bump copyright year in NOTICE

2020-08-11 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-24860. Resolution: Fixed Pushed without review. FYI [~zhangduo], in case you have to do a 3.4.0-rc2

[jira] [Created] (HBASE-24860) Bump copyright year in NOTICE

2020-08-11 Thread Josh Elser (Jira)
Josh Elser created HBASE-24860: -- Summary: Bump copyright year in NOTICE Key: HBASE-24860 URL: https://issues.apache.org/jira/browse/HBASE-24860 Project: HBase Issue Type: Task

[jira] [Created] (HBASE-24858) Builds without a `clean` phase fail on hbase-shaded-jetty

2020-08-11 Thread Josh Elser (Jira)
Josh Elser created HBASE-24858: -- Summary: Builds without a `clean` phase fail on hbase-shaded-jetty Key: HBASE-24858 URL: https://issues.apache.org/jira/browse/HBASE-24858 Project: HBase Issue

Re: [VOTE] Second release candidate for hbase-thirdparty 3.4.0 is available for download

2020-08-11 Thread Josh Elser
+1 (binding) Everything with 3.4.0 looks fine to me. I used the staged artifacts at the URL which Viraj corrected. A couple of non-blocking issues. * NOTICE needs updating (2018 year) * hbase-thirdparty build fails w/o a `clean` (see below) * TestRESTApiClusterManager failed in the hbase

Re: EOL 1.3.x?

2020-08-11 Thread Josh Elser
Sounds good to me. On 8/11/20 4:01 AM, 张铎(Duo Zhang) wrote: The last release for 1.3.x is 2019.10.20, which means we do not have a release for this release line for about 10 months. Let's make it EOL and tell users to at least upgrade to 1.4.x? Thanks.

[jira] [Resolved] (HBASE-24834) TestReplicationSource.testWALEntryFilter failing in branch-2+

2020-08-11 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-24834. Resolution: Cannot Reproduce Maybe fixed by HBASE-24830

[jira] [Created] (HBASE-24834) TestReplicationSource.testWALEntryFilter failing in branch-2+

2020-08-07 Thread Josh Elser (Jira)
Josh Elser created HBASE-24834: -- Summary: TestReplicationSource.testWALEntryFilter failing in branch-2+ Key: HBASE-24834 URL: https://issues.apache.org/jira/browse/HBASE-24834 Project: HBase

[jira] [Created] (HBASE-24779) Improve insight into replication WAL readers hung on checkQuota

2020-07-27 Thread Josh Elser (Jira)
Josh Elser created HBASE-24779: -- Summary: Improve insight into replication WAL readers hung on checkQuota Key: HBASE-24779 URL: https://issues.apache.org/jira/browse/HBASE-24779 Project: HBase

Re: [DISCUSS] HBASE-24749

2020-07-22 Thread Josh Elser
good call on bulk load, thanks. Also, we will try to support snapshot related features well. -Stephen On Tue, Jul 21, 2020 at 4:54 PM Josh Elser wrote: Oh, and don't forget, you have to update bulk load to work with this approach. Never knew that we had a utility to pick up files that folks wrote di

[jira] [Resolved] (HBASE-22146) SpaceQuotaViolationPolicy Disable is not working in Namespace level

2020-07-21 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-22146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-22146. Resolution: Fixed Thanks for your patch and thoughtful tests, Surbhi

Re: [DISCUSS] HBASE-24749

2020-07-21 Thread Josh Elser
Oh, and don't forget, you have to update bulk load to work with this approach. Never knew that we had a utility to pick up files that folks wrote directly into the hbase.rootdir (RefreshHFilesClient). I am 110% behind ripping that out. We have bulk loading as the supported path for a reason

Re: [DISCUSS] HBASE-24749

2020-07-21 Thread Josh Elser
Great idea -- big problem on slow storage :) (but I'm sure I'm not telling you anything new). A quick quesiton: with the split-able meta work going on, any reason to not put these files in meta itself (rather than yet-another-system-table)? FWIW, listing the files for each region in the meta

Re: HBase 2 slower than HBase 1?

2020-07-14 Thread Josh Elser
Wow. Great stuff, Andrew! Thank you for compiling and posting it all here. I can only imagine how time-consuming this was. On 6/26/20 1:57 PM, Andrew Purtell wrote: Hey Anoop, I opened https://issues.apache.org/jira/browse/HBASE-24637 and attached the patches and script used to make the

Re: [DISCUSS] Removing problematic terms from our project

2020-06-22 Thread Josh Elser
+1 On 6/22/20 4:03 PM, Sean Busbey wrote: We should change our use of these terms. We can be equally or more clear in what we are trying to convey where they are present. That they have been used historically is only useful if the advantage we gain from using them through that shared context

[jira] [Resolved] (HBASE-19365) FSTableDescriptors#get() can return null reference, in some cases, it is not checked

2020-06-17 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-19365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-19365. Hadoop Flags: Reviewed Resolution: Fixed Thanks for the review, [~vjasani

[jira] [Resolved] (HBASE-24235) Java client with IBM JDK does not work if HBase is configured with Kerberos

2020-06-17 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-24235. Resolution: Incomplete > Java client with IBM JDK does not work if HBase is configu

Re: apply

2020-06-15 Thread Josh Elser
Hi, Anyone is able to contribute to the project. When you submit your first code change, we'll make sure that the appropriate Jira group(s) are updated to allow you to be the "Assignee". Thanks for your interest. On 6/14/20 6:13 PM, wang120445...@sina.com wrote: hi hbase: I want

Re: [DISCUSS] Change the IA for MutableSizeHistogram and MutableTimeHistogram to LImitedPrivate

2020-06-15 Thread Josh Elser
OPROC rather than LimitedPrivate.PHOENIX. Geoffrey On Thu, Jun 11, 2020 at 11:28 AM Josh Elser wrote: Sounds reasonable to me! On 6/11/20 1:06 PM, Andrew Purtell wrote: hbase-metrics-api is available for coprocessors already and interfaces within are already LimitedPrivate(COPROC). However, that

[jira] [Resolved] (HBASE-23195) FSDataInputStreamWrapper unbuffer can NOT invoke the classes that NOT implements CanUnbuffer but its parents class implements CanUnbuffer

2020-06-12 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-23195. Hadoop Flags: Reviewed Resolution: Fixed Thanks for the work, [~zhaoyim]! Sorry it took so

  1   2   3   4   5   6   7   8   9   >