Re: [VOTE] The first release candidate for hbase 2.4.18 is available

2024-05-22 Thread Andrew Purtell
+1 (binding) * Signature: ok * Checksum : ok * Rat check (1.8.0_382): ok - mvn clean apache-rat:check * Built from source (1.8.0_382): ok - mvn clean install -DskipTests * Unit tests pass (1.8.0_382): failed - mvn clean package

Re: [DISCUSS] Dropping Java 8 support in HBase 3

2024-05-07 Thread Andrew Purtell
en a PR for branch-2.x too, so we can catch the >> differences between the 2 PRs, and whether to align them. >> >> WDYT? >> >> Thanks. >> >> Andrew Purtell 于2024年5月7日周二 20:20写道: >>> >>> I don’t expect 2.x to wind down for up to several

Re: [DISCUSS] Dropping Java 8 support in HBase 3

2024-05-07 Thread Andrew Purtell
anch-2.x too, before mering the master PR, we should make sure the > contributor open a PR for branch-2.x too, so we can catch the > differences between the 2 PRs, and whether to align them. > > WDYT? > > Thanks. > > Andrew Purtell 于2024年5月7日周二 20:20写道: >> >> I

Re: [VOTE] The third release candidate for 2.6.0, RC4, is available

2024-05-07 Thread Andrew Purtell
This sounds very reasonable to me, especially with the promise of a quick follow on release of 2.6.1. — I apologize for not voting on the 2.6 candidates. I will set up a VM somewhere where I can drive release candidate tests by phone for the next time but did not think of this in advance. On

Re: [DISCUSS] Dropping Java 8 support in HBase 3

2024-05-07 Thread Andrew Purtell
that the > > > initial > > > > release of java11 was released 6 years ago and java17 released 3 > years. > > > > Java21 is already released as well. So I could see java17 being > widely > > > > available enough that we could jump "in the middle" r

Re: [DISCUSS] Dropping Java 8 support in HBase 3

2024-04-29 Thread Andrew Purtell
I also agree that mitigation of security problems in dependencies will be increasingly difficult, as we cannot expect our dependencies to continue to support Java 8. They might, but as time goes on it is less likely. A minimum of Java 11 makes a lot of sense. This is where the center of

Re: [VOTE] The first release candiate for hbase-thirdparty 4.1.7 is available

2024-04-15 Thread Andrew Purtell
+1 (binding) * CHANGES.md and RELEASENOTES.md: ok * Signature: ok * Checksum : ok * Rat check (1.8.0_382): ok - mvn clean apache-rat:check * Built from source (1.8.0_382): ok - mvn clean install -DskipTests * Unit tests pass

Re: Considering deprecation and removal of XZ compression (hbase-compression-xz)

2024-04-09 Thread Andrew Purtell
appy or zstd. > > So for me I prefer we just deprecated the xz compression immediately > and remove it 2.6.0. > > Thanks. > > Andrew Purtell 于2024年4月2日周二 08:02写道: > > > > Red Hat filed CVE-2024-3094 late last week on 2024-03-29. This implicates > > recent

Re: [DISCUSS] About the SemVar change for protobuf

2024-04-05 Thread Andrew Purtell
That makes sense. Their support for protobuf-java 3.x ends in one year from now, and that is only for 3.25.x. > On Apr 5, 2024, at 5:47 AM, 张铎 wrote: > > When bumping dependency versions for hbase-thirdparty, I found that > the next version for 3.25.x is 4.26.x... > > After investigating,

Re: [ANNOUNCE] New HBase committer Istvan Toth

2024-04-03 Thread Andrew Purtell
Congratulations and welcome, Istvan! On Tue, Apr 2, 2024 at 4:23 AM Duo Zhang wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that > Istvan Toth(stoty) > has accepted the PMC's invitation to become a committer on the > project. We appreciate all > of Istvan Toth's generous

Considering deprecation and removal of XZ compression (hbase-compression-xz)

2024-04-01 Thread Andrew Purtell
Red Hat filed CVE-2024-3094 late last week on 2024-03-29. This implicates recent releases of the native liblzma library as a vector for malicious code. This is not the pure Java version that we depend upon for HBase's support for the LZMA algorithm (

Re: Aiming for 2.6.0RC0 tomorrow

2024-03-22 Thread Andrew Purtell
gt; > > We already commit the changes to master I believe. Let me see if we > > > can cherry-pick them and commit to branch-2.6 as well. > > > > > > Thanks. > > > > > > Bryan Beaudreault 于2024年3月22日周五 07:35写道: > > > > > > >

Re: Aiming for 2.6.0RC0 tomorrow

2024-03-21 Thread Andrew Purtell
The hadoop3 bin tarball for 2.5.8 is 352.8MB. Perhaps we have just barely and recently crossed a threshold. File an INFRA JIRA and ask about it. Perhaps some limit can be increased, or maybe they will ask us to live within it. Related, looking at the 2.5.8 hadoop3 bin tarball, the majority of the

[ANNOUNCE] Apache HBase 2.5.8 is now available for download

2024-03-13 Thread Andrew Purtell
The HBase team is happy to announce the immediate availability of HBase 2.5.8. Apache HBase™ is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn

[RESULT] [VOTE] The first release candidate for 2.5.8 (RC0) is available

2024-03-12 Thread Andrew Purtell
With 4 binding +1 votes, including my own, and one non-binding +1 vote, and no 0 or -1 votes, this vote passes. Thanks to everyone who evaluated the release candidate! On Fri, Mar 1, 2024 at 1:40 PM Andrew Purtell wrote: > Please vote on this Apache HBase release candidate, 2.5.8

Re: Archiving old/invalid versions (was Re: Unreleased hbase-thirdparty-3.5.2)

2024-03-12 Thread Andrew Purtell
of > HBase", released in 3.0.0-alpha-1 > * HBASE-26067 -- "Change the way on how we track store file list", released > in 2.6.0 > * HBASE-26233 -- "The region replication framework should not be built upon > the general replication framework", released

Re: [VOTE] The first release candidate for 2.5.8 (RC0) is available

2024-03-08 Thread Andrew Purtell
PMC, We need one more binding +1 in order to complete this VOTE. Currently we have two binding +1s, one from myself and one from Nick, and one nonbinding +1 from Rajeshbabu. On Fri, Mar 1, 2024 at 1:40 PM Andrew Purtell wrote: > Please vote on this Apache HBase release candidate, 2.5.8

[VOTE] The first release candidate for 2.5.8 (RC0) is available

2024-03-01 Thread Andrew Purtell
Please vote on this Apache HBase release candidate, 2.5.8RC0 The VOTE will remain open for at least 72 hours. [ ] +1 Release this package as Apache HBase 2.5.8 [ ] -1 Do not release this package because ... The tag to be voted on is 2.5.8RC0: https://github.com/apache/hbase/tree/2.5.8RC0

Re: [VOTE] hbase-thirdparty 4.1.6 (RC0)

2024-03-01 Thread Andrew Purtell
+1 (binding) * Signature: ok * Checksum : ok * Rat check (1.8.0_382): ok - mvn clean apache-rat:check * Built from source (1.8.0_382): ok - mvn clean install -DskipTests * Unit tests pass (1.8.0_382): ok - mvn clean package -P

Re: [DISCUSS] Deprecating zookeeper-based client connectivity

2024-03-01 Thread Andrew Purtell
> > > > > > > And in fact, I now realize that something like it will continue to > > exist > > > > even after the class is removed from our public API because I suspect > > > that > > > > the HMaster will need to use it in order to bootst

Re: [DISCUSS] Deprecating zookeeper-based client connectivity

2024-02-29 Thread Andrew Purtell
ate it in 2.6 and remove it in 4.0. > This is how the HBase 2.x API changes were handled, where the removal of > the old HBase 1.x APIs were targeted to 3.0. > The ZK registry code is small, and doesn't cost much to keep in the > codebase. > > Istvan > > On Fri, Mar 1, 20

Re: [DISCUSS] Deprecating zookeeper-based client connectivity

2024-02-29 Thread Andrew Purtell
+1 for deprecating ZKConnectionRegistry beginning with/in 2.6.0. On Thu, Feb 29, 2024 at 2:30 AM Nick Dimiduk wrote: > Heya, > > We have long had the ambition to get away from ZooKeeper as the means by > which a client interfaces with an HBase cluster. The ConnectionRegistry was > introduced

Re: [DISCUSS] Remove the need for ADMIN permissions for listDecommissionedRegionServers

2024-02-27 Thread Andrew Purtell
We have had this discussion before about other list* methods and we have sometimes decided to restrict them to ADMIN. The reason for that was the information returned by the method might leak sensitive information. For example, listing table descriptors will include all arbitrary and potentially

Time for 2.5.8

2024-02-26 Thread Andrew Purtell
It's been about two months since 2.5.7 and 2.5.8 has 42 completed issues ( https://issues.apache.org/jira/projects/HBASE/versions/12354047). Looks like we are due another 2.5 release. I plan to spin a release candidate toward the end of this week and submit it for voting next week on the Monday.

Re: [DISCUSS] Enabling JDK17 build pipelines

2024-02-22 Thread Andrew Purtell
> Would like to gather opinion on which branches should we prioritize/enable > JDK 17 pipelines master branch-3 When the JDK 17 pipelines have stabilized for those, then consider branch-2 and the release branches. Probably by then most issues would have a prior developed solution that can be

Re: Unreleased hbase-thirdparty-3.5.2

2024-02-16 Thread Andrew Purtell
Sounds right to me. On Fri, Feb 16, 2024 at 7:40 AM Nick Dimiduk wrote: > Heya team, > > I noticed that we still have thirdparty-3.5.2 as an unreleased version in > Jira. Looking at the release archives [0], I don't see that release in our > history -- it appears that the world has moved on.

Re: [DISCUSS] Pre splitting an existing table to avoid hotspotting issues.

2024-02-09 Thread Andrew Purtell
f we > think this is a useful new feature, we could open an issue and also > design doc. > > Thanks. > > Andrew Purtell 于2024年2月9日周五 11:09写道: > > > > Agreed, the key is going to be changing the design of references to > support this new. > > > > Spli

Re: [DISCUSS] Pre splitting an existing table to avoid hotspotting issues.

2024-02-08 Thread Andrew Purtell
me when > splitting, and also the fail recovery will be more complicated. > > Thanks. > > Bryan Beaudreault 于2024年2月9日周五 09:27写道: >> >> Yep, I forgot about that nuance. I agree we can add a splitRegion overload >> which takes a byte[][] for multiple spl

Re: [DISCUSS] Pre splitting an existing table to avoid hotspotting issues.

2024-02-08 Thread Andrew Purtell
Rushabh already covered this but splitting is not complete until the region can be split again. This is a very important nuance. The daughter regions are online very quickly, as designed, but then background housekeeping (compaction) must copy the data before the daughters become splittable.

Re: [DISCUSS] Pre splitting an existing table to avoid hotspotting issues.

2024-01-26 Thread Andrew Purtell
I have not thought out the idea in detail but it seems to me this is less about splitting and more about normalization. That is, the table exists on both sides, and what we want is to apply a series of transformations to the region boundaries to bring them closer in alignment such that then a

Re: Handling of fixVersion for umbrella tasks

2024-01-22 Thread Andrew Purtell
ssible, I could potentially fix these. >>>> Thanks for the guidance. >>>> On Tue, Jan 16, 2024 at 12:54 PM Bryan Beaudreault < >>>> bbeaudrea...@apache.org> >>>> wrote: >>>>> Thank you both for the input. That's a good idea And

Re: HBASE-28242: Remove support for async-profiler v1

2024-01-18 Thread Andrew Purtell
I was the original developer of this feature. It existed in pretty much the same form in Hive and was a straightforward port. The style of using enums to encode and restrict supported parameters came from the origin. I thought it a good idea, though, because this shells out to an external

Re: Handling of fixVersion for umbrella tasks

2024-01-14 Thread Andrew Purtell
For 2.5.0 I based the change log on the change log of what was then the last/most recent 2.4 release. Anything committed into 2.4 with a fix version of 2.5, I dropped the 2.5 fix version. The 2.5 fix version was kept for anything novel in 2.5. The result was an orderly cumulative change log. I

Re: Hbase, Hbase-thirdparty, and netty

2024-01-04 Thread Andrew Purtell
e. > > Otherwise, I agree with everything else. I have the PR ready for updating > netty in hbase-thirdparty. I can also vote and do the bump of > hbase-thirdparty.version in hbase once the release is made. > > On Thu, Jan 4, 2024 at 3:15 PM Andrew Purtell wrote: > > > We sh

Re: Hbase, Hbase-thirdparty, and netty

2024-01-04 Thread Andrew Purtell
://issues.apache.org/jira/browse/HBASE-28291 to update > pom.xml in hbase-thirdparty. I will handle that. We will need to do an > hbase-thirdparty release, which I'm not sure I'll have time for given I'm > already behind on the 2.6.0 release > > On Thu, Jan 4, 2024 at 11:58 AM And

Re: Hbase, Hbase-thirdparty, and netty

2024-01-04 Thread Andrew Purtell
We should do that bump to hbase-thirdparty and spin another release to keep our house in order. It isn’t urgent but would be good to address this in the normal release cadence. That has been about once per fiscal quarter recently. It’s weird to have netty dependency versions diverging. I

[ANNOUNCE] Apache HBase 2.5.7 is now available for download

2024-01-03 Thread Andrew Purtell
The HBase team is happy to announce the immediate availability of HBase 2.5.7. Apache HBase™ is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn

[RESULT] [VOTE] The first release candidate for 2.5.7 (RC0) is available

2023-12-24 Thread Andrew Purtell
With four binding +1s, including my own, and no 0 or -1 votes, this vote passes. Thanks to everyone who voted on this release candidate! On Mon, Dec 18, 2023 at 4:37 PM Andrew Purtell wrote: > Please vote on this Apache HBase release candidate, 2.5.7RC0 > > The VOTE will re

Re: [VOTE] The first release candidate for 2.5.7 (RC0) is available

2023-12-22 Thread Andrew Purtell
so for replication, we may find that there is already a new >> file in the queue but when reading the previous file, we can not read >> the trailer yet, thus we consider the WAL file as not closed cleanly. >> >> Let me check how do we deal with this on master and branch-3.

Re: [VOTE] The first release candidate for 2.5.7 (RC0) is available

2023-12-20 Thread Andrew Purtell
Please file or promote an existing JIRA for this test issue (I seem to recall some have been opened and closed over the previous months) so we can track them. If you set a fix version of 2.5.8 it will be an effective reminder. On Wed, Dec 20, 2023 at 9:59 AM Andrew Purtell wrote: > This t

Re: [VOTE] The first release candidate for 2.5.7 (RC0) is available

2023-12-20 Thread Andrew Purtell
tent > off-by-one failure > > > > On Mon, Dec 18, 2023 at 10:38 PM Andrew Purtell > wrote: > > > Please vote on this Apache HBase release candidate, 2.5.7RC0 > > > > The VOTE will remain open for at least 72 hours. > > > > [ ] +1 Release this

Re: [VOTE] The first release candidate for 2.5.7 (RC0) is available

2023-12-20 Thread Andrew Purtell
amFSHLog > fails nearly 100% of times. > > I think we need to find out whether this is just a test issue, if not > we need to find out the root cause and fix it. > > Thanks. > > Andrew Purtell 于2023年12月19日周二 05:38写道: > > > > Please vote on this Apache HBase release can

[VOTE] The first release candidate for 2.5.7 (RC0) is available

2023-12-18 Thread Andrew Purtell
Please vote on this Apache HBase release candidate, 2.5.7RC0 The VOTE will remain open for at least 72 hours. [ ] +1 Release this package as Apache HBase 2.5.7 [ ] -1 Do not release this package because ... The tag to be voted on is 2.5.7RC0: https://github.com/apache/hbase/tree/2.5.7RC0

[NOTICE] Recent changes to ZooKeeper dependencies due to CVE issues has a compatibility impact

2023-12-14 Thread Andrew Purtell
In the upcoming 2.5.7RC0 you will notice in the compatibility report an impact due to a recent upgrade of our ZooKeeper dependencies to deal with a CVE issue in ZooKeeper. As 2.5 RM, I ask you to ALLOW these changes, for these reasons: - The ZooKeeper dependency must be upgraded because ZooKeeper

Re: Time for 2.5.6 (last release this year)

2023-12-14 Thread Andrew Purtell
HBASE-28248 is resolved, proceeding. On Thu, Dec 7, 2023 at 8:07 AM Andrew Purtell wrote: > If I could edit the thread subject I would. > > > HBASE-28248 > > Noted. > > > On Dec 6, 2023, at 10:44 PM, 张铎 wrote: > > > > You must mean 2.5.7 :) > &

Re: Time for 2.5.6 (last release this year)

2023-12-07 Thread Andrew Purtell
If I could edit the thread subject I would. > HBASE-28248 Noted. > On Dec 6, 2023, at 10:44 PM, 张铎 wrote: > > You must mean 2.5.7 :) > > I think we should include HBASE-28248 , as HBASE-28210 and HBASE-28212 > has already been committed to branch-2.5. > > Andre

Time for 2.5.6 (last release this year)

2023-12-05 Thread Andrew Purtell
Some important fixes in branch-2.5. Let's do one more 2.5 release this year, 2.5.6. If you have any pending work, please try to commit it before Thursday of this week. I will start the work of cutting RC0 then. If you are aware of any potentially blocking issues feel free to raise them on this

Re: Time for 2.5.6 and 2.6.0.

2023-11-30 Thread Andrew Purtell
change. At the very > least, updating the doc would be good. I'll try to remember to do that when > I have time. > > On Thu, Nov 30, 2023 at 12:24 PM Andrew Purtell > wrote: > > > Maven automates the change so the human does not edit the POM files by > > hand. A PR

Re: Time for 2.5.6 and 2.6.0.

2023-11-30 Thread Andrew Purtell
ten enough time to do it since it is > not easy for me as I'm not a jenkins expert... > > Andrew Purtell 于2023年11月30日周四 10:45写道: >> >> It seems silly to do a review just for a change that modifies the project >> version. I mean, it's trivial to "mvn versi

Re: Time for 2.5.6 and 2.6.0.

2023-11-29 Thread Andrew Purtell
related operations > in a release tool, I do not think we need the signoff, just running > the automatic tool is fine, but now it still requires manual > operations, so I think having a double check is better. > > Thanks. > > Andrew Purtell 于2023年11月30日周四 02:45写道: > > > &g

Re: Time for 2.5.6 and 2.6.0.

2023-11-29 Thread Andrew Purtell
> > Just send a notice to the dev mailing list, and then use the > normal > > >> > > git way to create a new branch called branch-2.6 from branch-2, > push > > >> > > it to github, done :) > > >> > > > > >> > > Bryan Beaudreault 于20

[ANNOUNCE] Apache HBase 2.5.6 is now available for download

2023-10-23 Thread Andrew Purtell
The HBase team is happy to announce the immediate availability of HBase 2.5.6. Apache HBase™ is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn

[RESULT] [VOTE] The first release candidate for 2.5.6 (RC0) is available

2023-10-20 Thread Andrew Purtell
With 4 binding +1s, including my own, and 3 non-binding +1 votes, and no 0 or -1 votes, this vote passes. Thanks to all who voted on the release! On Mon, Oct 16, 2023 at 11:23 AM Andrew Purtell wrote: > Please vote on this Apache HBase release candidate, 2.5.6RC0. > > The VOTE will re

Re: Time for 2.5.6 and 2.6.0.

2023-10-19 Thread Andrew Purtell
> > Hi Bryan, do we still have any blocker issues for cutting branch-2.6 > > > and starting to release 2.6.0? > > > > > > Thanks. > > > > > > Andrew Purtell 于2023年9月26日周二 01:02写道: > > > > > > > > Thanks Duo

[VOTE] The first release candidate for 2.5.6 (RC0) is available

2023-10-16 Thread Andrew Purtell
Please vote on this Apache HBase release candidate, 2.5.6RC0. The VOTE will remain open for at least 72 hours. [ ] +1 Release this package as Apache HBase 2.5.6 [ ] -1 Do not release this package because ... The tag to be voted on is 2.5.6RC0: https://github.com/apache/hbase/tree/2.5.6RC0

Re: Time for 2.5.6

2023-09-25 Thread Andrew Purtell
Thank you Viraj. > On Sep 25, 2023, at 6:14 PM, Viraj Jasani wrote: > > Apologies, I am bit occupied this week. Let me take a look tomorrow. > >> On Mon, Sep 25, 2023 at 10:04 AM Andrew Purtell wrote: >> >> The blocker is HBASE-28081. The regression is from

Re: Time for 2.5.6

2023-09-25 Thread Andrew Purtell
The blocker is HBASE-28081. The regression is from HBASE-28042 On Mon, Sep 25, 2023 at 9:57 AM Andrew Purtell wrote: > HBASE-28042 is blocking. Let's see about resolving it soon. >

Re: Time for 2.5.6

2023-09-25 Thread Andrew Purtell
HBASE-28042 is blocking. Let's see about resolving it soon. On Thu, Sep 21, 2023 at 11:24 AM Andrew Purtell wrote: > We are holding 2.6.0 for the resolution of some thirdparty related changes > but can proceed with the next 2.5. > > If you have something pending for 2.5.6, please t

Re: Time for 2.5.6 and 2.6.0.

2023-09-25 Thread Andrew Purtell
081, but anyway we have already > found the root cause is HBASE-28042, so I think it will be fixed soon. > > All other issues have been resolved. > > Thanks. > > Andrew Purtell 于2023年9月22日周五 02:21写道: > > > > Both sound good, thanks. > > > > > > O

Time for 2.5.6

2023-09-21 Thread Andrew Purtell
We are holding 2.6.0 for the resolution of some thirdparty related changes but can proceed with the next 2.5. If you have something pending for 2.5.6, please try to commit it before this coming Monday. (9/25) Best regards, Andrew

Re: Time for 2.5.6 and 2.6.0.

2023-09-21 Thread Andrew Purtell
he RC yet, please also include HBASE-28061 in > > > > > 2.5.6, as it could solve the problem for running pre compiled 2.5.x > > > > > tarball and also our published artifacts in maven repo against > hadoop > > > > > 3.3.x. > > > > &g

Re: Time for 2.5.6 and 2.6.0.

2023-09-19 Thread Andrew Purtell
ed artifacts in maven repo against hadoop > > 3.3.x. > > > > The hive community needs this as they want to upgrade hbase and hadoop > > dependencies. > > > > Thanks. > > > > Andrew Purtell 于2023年8月30日周三 06:48写道: > > > > > > I am back from vacatio

Re: Branching for 2.6 code line (branch-2.6)

2023-08-31 Thread Andrew Purtell
lem, HBASE-27941, which is found > when running ITBLL against branch-3. > > Viraj reported that it also affects branch-2.x. > > Buy anyway, since it also affects branch-2.5, should not be a blocker > for branch-2.6. > > Andrew Purtell 于2023年8月31日周四 00:50写道: > >

Re: Branching for 2.6 code line (branch-2.6)

2023-08-30 Thread Andrew Purtell
ult < > bbeaudrea...@apache.org> > > wrote: > > > > > I made > > > https://issues.apache.org/jira/browse/HBASE-28010 a blocker so we > don’t > > > release a broken new feature. We will have it fixed early this week. > > > > > > On Fri, Aug

Time for 2.5.6 and 2.6.0.

2023-08-29 Thread Andrew Purtell
I am back from vacation. Slowly clearing my inbox. 1,545 unread, it's been a while. It seems we are ready to cut branch-2.6 for stabilizing for 2.6.0. Any volunteers to RM 2.6.0? Otherwise I'm happy to do it, starting next week, probably 9/5 or 9/6. Some good changes have landed in branch-2.5.

Re: Time for new releases?

2023-08-23 Thread Andrew Purtell
Yes I think it is about time too. I’m back from vacation next week and can do a release then unless you want to do it Duo. > On Aug 23, 2023, at 9:49 AM, 张铎 wrote: > > Bump. > > If the release managers are not available, I could help make the next > 2.5.x release. > > Thanks. > > 张铎(Duo

Re: Branching for 2.6 code line (branch-2.6)

2023-08-18 Thread Andrew Purtell
ough we were >>>>> comparing against our legacy haproxy setup and can't really compare >>> against >>>>> kerberos. >>>>> >>>>> One outstanding issue is >>> https://issues.apache.org/jira/browse/HBASE-27782, >>>>> which w

[ANNOUNCE] Apache HBase 2.5.5 is now available for download

2023-06-13 Thread Andrew Purtell
The HBase team is happy to announce the immediate availability of HBase 2.5.5. Apache HBase™ is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn

[RESULT] The first release candidate for 2.5.5 (RC0) is available

2023-06-13 Thread Andrew Purtell
With five binding +1, including my own, and one non-binding +1, and no 0 or -1 votes, this vote passes. Thanks to all who voted on the release candidate! On Fri, Jun 2, 2023 at 9:20 AM Andrew Purtell wrote: > Please vote on this Apache hbase release candidate, hbase-2.5.5RC0 > >

Re: [VOTE] First release candidate for hbase 3.0.0-alpha-4 is available for download

2023-06-06 Thread Andrew Purtell
+1 (binding) * Signature: ok * Checksum : ok * Rat check (11.0.19): ok - mvn clean apache-rat:check * Built from source (11.0.19): ok - mvn clean install -DskipTests * Unit tests pass (11.0.19): failed - mvn clean package -P

[VOTE] The first release candidate for 2.5.5 (RC0) is available

2023-06-02 Thread Andrew Purtell
Please vote on this Apache hbase release candidate, hbase-2.5.5RC0 The VOTE will remain open for at least 72 hours. [ ] +1 Release this package as Apache HBase 2.5.5 [ ] -1 Do not release this package because ... The tag to be voted on is 2.5.5RC0:

[WITHDRAWN] The first release candidate for 2.5.5 (RC0) is available

2023-05-27 Thread Andrew Purtell
, 2023 at 10:21 AM Andrew Purtell wrote: > Please vote on this Apache hbase release candidate, > hbase-2.5.5RC0 > > The VOTE will remain open for at least 72 hours. > > [ ] +1 Release this package as Apache hbase 2.5.5 > [ ] -1 Do not release this package because ... &g

Re: About time for 2.5.5

2023-05-27 Thread Andrew Purtell
ons. > > Thanks. > > Andrew Purtell 于2023年5月27日周六 08:39写道: > > > I tried to make a release but ran into HBASE-27894. > > > > Next week. > > > > On Thu, May 25, 2023 at 5:24 PM Andrew Purtell > > wrote: > > > > > All open issues res

[VOTE] The first release candidate for 2.5.5 (RC0) is available

2023-05-27 Thread Andrew Purtell
Please vote on this Apache hbase release candidate, hbase-2.5.5RC0 The VOTE will remain open for at least 72 hours. [ ] +1 Release this package as Apache hbase 2.5.5 [ ] -1 Do not release this package because ... The tag to be voted on is 2.5.5RC0:

Re: About time for 2.5.5

2023-05-26 Thread Andrew Purtell
I tried to make a release but ran into HBASE-27894. Next week. On Thu, May 25, 2023 at 5:24 PM Andrew Purtell wrote: > All open issues resolved or moved. Cutting RC0 tomorrow. > > On Mon, May 8, 2023 at 11:17 AM Andrew Purtell > wrote: > >> https://issues.apache.or

Re: About time for 2.5.5

2023-05-25 Thread Andrew Purtell
All open issues resolved or moved. Cutting RC0 tomorrow. On Mon, May 8, 2023 at 11:17 AM Andrew Purtell wrote: > https://issues.apache.org/jira/projects/HBASE/versions/12353053 > > There are 24 resolved issues marked with the fix version of 2.5.5, a few > in progress, and ~30 pe

About time for 2.5.5

2023-05-08 Thread Andrew Purtell
https://issues.apache.org/jira/projects/HBASE/versions/12353053 There are 24 resolved issues marked with the fix version of 2.5.5, a few in progress, and ~30 pending issues to evaluate. I'm going to go through them this week and hopefully cut a RC for 2.5.5 by the end of this week. If you have

Re: [DISCUSS] Move stable pointer to 2.5.x

2023-05-05 Thread Andrew Purtell
+1 > On May 5, 2023, at 12:13 AM, 张铎 wrote: > > As discussed in the online meeting, and also other places, before EOL > 2.4.x, we should first move our stable pointer to 2.5.x. > > And there are also som2.5.x usages around the community on large clusters > which proves that the release can

Re: [ANNOUNCE] New HBase committer Nihal Jain

2023-05-03 Thread Andrew Purtell
Congratulations and welcome, Nihal! On Wed, May 3, 2023 at 5:12 AM Nick Dimiduk wrote: > Hello! > > On behalf of the Apache HBase PMC, I am pleased to announce that Nihal Jain > has accepted the PMC's invitation to become a committer on the project. We > appreciate all of Nihal's generous

Re: [DISCUSS] Do not send jira notification emails to dev list?

2023-04-26 Thread Andrew Purtell
Gmail manages it pretty well for me, as a data point. Iteresting mails are promoted to the inbox. Other mail clients have similar features. I haven't been around much over the past month or so, so my hbase folder has > 1000 messages in it. It is true that discussions in dev@ are buried among the

[ANNOUNCE] Apache HBase 2.5.4 is now available for download

2023-04-14 Thread Andrew Purtell
The HBase team is happy to announce the immediate availability of HBase 2.5.4. Apache HBase™ is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn

[RESULT] [VOTE] The first release candidate for 2.5.4 (RC0) is available

2023-04-14 Thread Andrew Purtell
With 5 +1 votes, and no 0 or -1 votes, this vote passes. Thanks to all who voted on the release candidate. On Thu, Apr 6, 2023 at 10:03 PM Andrew Purtell wrote: > The VOTE will remain open for at least 72 hours. > > [ ] +1 Release this package as Apache HBase 2.5.4 > [ ] -1 Do

Re: More votes requested for 2.5.4 RC0

2023-04-13 Thread Andrew Purtell
Thank you, everyone. I will close the vote tomorrow (Friday), Pacific day time. On Wed, Apr 12, 2023 at 8:50 PM 张铎(Duo Zhang) wrote: > Will take a look today. > > Andrew Purtell 于2023年4月13日周四 05:31写道: > > > Between Stephen and myself we have 2 +1 votes, but need a

More votes requested for 2.5.4 RC0

2023-04-12 Thread Andrew Purtell
Between Stephen and myself we have 2 +1 votes, but need at least one more. -- Best regards, Andrew

[VOTE] The first release candidate for 2.5.4 (RC0) is available

2023-04-06 Thread Andrew Purtell
The VOTE will remain open for at least 72 hours. [ ] +1 Release this package as Apache HBase 2.5.4 [ ] -1 Do not release this package because ... The tag to be voted on is 2.5.4RC0: https://github.com/apache/hbase/tree/2.5.4RC0 This tag currently points to git reference

Re: Branching for 2.6 code line (branch-2.6)

2023-04-06 Thread Andrew Purtell
n > > the roadmap. > > > > It seems like cloudera may be closer to integrating TLS in production. > > Balazs recently filed and fixed HBASE-27673 related to mTLS. Maybe he can > > chime in on his status, or let me know if I am totally off base :) > > > > On Sun,

Re: Branching for 2.6 code line (branch-2.6)

2023-03-26 Thread Andrew Purtell
s. > > Mallikarjun 于2022年10月17日周一 02:09写道: > >> On hbase-backup, we are using in production for more then 1 year. I can >> vouch for it to be stable enough to be in a release version so that more >> people can use it and polished it further. >> >>

Re: [DISCUSS] Time for new releases?

2023-03-24 Thread Andrew Purtell
+1, I can also help if we need a RM, although you did great last time, Stephen. On Fri, Mar 24, 2023 at 8:58 AM Tak Lon (Stephen) Wu wrote: > +1, I can help and see if anyone shows interests > > -Stephen > > On Fri, Mar 24, 2023 at 12:17 AM Nick Dimiduk wrote: > > > > On Fri, Mar 24, 2023 at

Re: [DISCUSS] Kubernetes Orchestration for ZK, HDFS, and HBase

2023-03-22 Thread Andrew Purtell
I hope that such an effort could lead to a > review and abstraction of how authentication and authorization are handled > in Hadoop generally. > >> On Fri, Mar 17, 2023 at 6:51 PM Andrew Purtell wrote: >> >> We have also completed a migration to kubernetes (more specifical

Re: [DISCUSS] Kubernetes Orchestration for ZK, HDFS, and HBase

2023-03-17 Thread Andrew Purtell
We have also completed a migration to kubernetes (more specifically, EKS) at $dayjob. Our basic deployment stack is helm, terraform, and spinnaker, so we took a different approach in implementation. I think we would be happy to review and offer advice/opinion/suggestion on points of commonality,

Re: [DISCUSS] Add Ozone as dependency to hbase-asyncfs ?

2023-03-16 Thread Andrew Purtell
posal when we change the base interface/abstract >> class >>> in FileSystem (if it's non-backward compatible). The discussion here >> helps >>> to confirm the direction, and let's see how we can make it generic and >>> could help to avoid confusion in both

Re: [DISCUSS] Add Ozone as dependency to hbase-asyncfs ?

2023-03-15 Thread Andrew Purtell
. > On Mar 15, 2023, at 1:53 PM, Sean Busbey wrote: > > the check that Stephen is referring to is for logic around lease recovery > and not stream flush/sync. the lease recovery is specific to DFS IIRC and > doesn't have a FileSystem marker. > >> On Wed, Mar 15, 2023 a

Re: [DISCUSS] Add Ozone as dependency to hbase-asyncfs ?

2023-03-15 Thread Andrew Purtell
sks. That way it is future proofing. Also a good idea. > >> On Wed, Mar 15, 2023 at 12:50 PM Andrew Purtell wrote: >> >> Does Hadoop have a marker interface that lets an application know its >> FileSystem instances can support hsync/hflush? Ideally all we should need >>

Re: [DISCUSS] Add Ozone as dependency to hbase-asyncfs ?

2023-03-15 Thread Andrew Purtell
the FS Data OutputStream probe fails for > Hflush/Hsync: > > StreamLacksCapabilityException(StreamCapabilities.HFLUSH) > and > StreamLacksCapabilityException(StreamCapabilities.HSYNC) > > > On Wed, Mar 15, 2023 at 12:51 PM Andrew Purtell > wrote: > > > Doe

Re: [DISCUSS] Add Ozone as dependency to hbase-asyncfs ?

2023-03-15 Thread Andrew Purtell
Does Hadoop have a marker interface that lets an application know its FileSystem instances can support hsync/hflush? Ideally all we should need to do is test with instanceof for that marker and use reflection (in the worst case) to get a handle to the hsync or hflush method, and then call it. This

Re: [Discuss] Mapreduce based major compactions to minimise compactions overhead in HBase cluster

2023-03-06 Thread Andrew Purtell
gt; and >>> APIs that make an implementation possible than in any specific >>> implementation. I’d also like to see consideration for a cluster-wide >>> compaction scheduler, something to prioritize allocation of precious IO >>> resources. >>> >>&g

Re: [DISCUSS] How to deal with the disabling of public sign ups for jira.a.o(enable github issues?)

2023-03-06 Thread Andrew Purtell
Approved the PR. I see the self service portal is already mailing us about requests. I approved one a few minutes ago. On Mon, Mar 6, 2023 at 2:02 AM 张铎(Duo Zhang) wrote: > https://selfserve.apache.org/jira-account.html > > The INFRA team has delivered a self serving tool for requesting a jira

Re: [Discuss] Mapreduce based major compactions to minimise compactions overhead in HBase cluster

2023-03-01 Thread Andrew Purtell
Hi Rajesbabu, You have proposed a solution without describing the problem. Please do that first. That said, compaction is fundamental to HBase operation and should have no external dependency on a particular compute framework. Especially MapReduce, which is out of favor and deprecated in many

Re: [DISCUSS] Deprecated the 'hbase.regionserver.hlog.reader.impl' and 'hbase.regionserver.hlog.writer.impl' configurations

2023-02-10 Thread Andrew Purtell
As you point out these configuration settings were introduced when we migrated from SequenceFile based WALs to the protobuf format. We needed to give users a way to manually migrate, although, arguably, an auto migration would have been better. In theory these settings allow users to

Re: [VOTE] The first release candidate for HBase 2.4.16 is available

2023-01-31 Thread Andrew Purtell
+1 (binding) * Signature: ok * Checksum : ok * Rat check (1.8.0_332): ok - mvn clean apache-rat:check * Built from source (1.8.0_332): ok - mvn clean install -DskipTests * Unit tests pass (1.8.0_332): failed, see below - mvn

  1   2   3   4   5   6   7   8   9   10   >