Re: Aiming for 2.6.0RC0 tomorrow

2024-03-26 Thread Bryan Beaudreault
As another update, that blocker has been fixed. I'm going to start creating the next RC tomorrow morning Eastern Time. On Mon, Mar 25, 2024 at 2:20 PM Bryan Beaudreault wrote: > Over the weekend an issue[1] was submitted for Backup & Restore. I think > it's potentially bad enough that it should

Re: Aiming for 2.6.0RC0 tomorrow

2024-03-25 Thread Bryan Beaudreault
Over the weekend an issue[1] was submitted for Backup & Restore. I think it's potentially bad enough that it should be a blocker for this release. I already have a solution for the problem, so it shouldn't delay us much. I'm working on turning it into a PR now. [1] https://issues.apache.org/jira/b

Re: Aiming for 2.6.0RC0 tomorrow

2024-03-23 Thread Bryan Beaudreault
The INFRA ticket has been resolved, and I confirmed that I can now commit the tarballs. Unfortunately, I realized that I used the wrong gpg key, so I need to create a new RC. I'll kick that off tomorrow morning. On Fri, Mar 22, 2024 at 3:27 PM Bryan Beaudreault wrote: > Unfortunately, it still

Re: Aiming for 2.6.0RC0 tomorrow

2024-03-22 Thread Bryan Beaudreault
Unfortunately, it still failed. This time it actually failed on hbase-2.6.0-hadoop3-client-bin.tar.gz, which is only 344MB. I tried it a few times and it swaps between that one and hbase-2.6.0-hadoop3-bin.tar.gz so maybe it's non-deterministically ordered. I wonder if a limit was just recently int

Re: Aiming for 2.6.0RC0 tomorrow

2024-03-22 Thread Andrew Purtell
> If something needs to be removed, I propose the full fat ( > *hbase-shaded-client*) shaded client JAR. > That is never returned by the hbase command AFAIK, and is also the largest > in size. Sounds good, if removing examples is insufficient, the limit cannot be increased, and some other step nee

Re: Aiming for 2.6.0RC0 tomorrow

2024-03-22 Thread Bryan Beaudreault
Thanks all. I'm running RC1 now with the included commits. I'll report back in a few hours, since it takes a while to run On Fri, Mar 22, 2024 at 1:40 AM Istvan Toth wrote: > The *hbase classpath* and *hbase mapredcp* command outputs do include the > respective *hbase-shaded-client-byo-hadoop*

Re: Aiming for 2.6.0RC0 tomorrow

2024-03-21 Thread Istvan Toth
The *hbase classpath* and *hbase mapredcp* command outputs do include the respective *hbase-shaded-client-byo-hadoop* and *hbase-shaded-mapreduce* jars. At least the 'hbase mapredcp' jars are used by both Spark and Hive integration, and expected to be available on the node filesystem. We also pl

Re: Aiming for 2.6.0RC0 tomorrow

2024-03-21 Thread Duo Zhang
Tested locally, after removing hbase-example from tarball, the hadoop3 tarball is about 351MB. So you could try to include this commit to publish again, to see if this helps. Thanks. 张铎(Duo Zhang) 于2024年3月22日周五 09:18写道: > > If we exclude hbase-example from the binaries, will it be smaller enoug

Re: Aiming for 2.6.0RC0 tomorrow

2024-03-21 Thread Duo Zhang
If we exclude hbase-example from the binaries, will it be smaller enough to fit? We already commit the changes to master I believe. Let me see if we can cherry-pick them and commit to branch-2.6 as well. Thanks. Bryan Beaudreault 于2024年3月22日周五 07:35写道: > > Thanks, I filed > https://issues.apach

Re: Aiming for 2.6.0RC0 tomorrow

2024-03-21 Thread Bryan Beaudreault
Thanks, I filed https://issues.apache.org/jira/browse/INFRA-25634 On Thu, Mar 21, 2024 at 5:46 PM Andrew Purtell wrote: > The hadoop3 bin tarball for 2.5.8 is 352.8MB. Perhaps we have just barely > and recently crossed a threshold. File an INFRA JIRA and ask about it. > Perhaps some limit can be

Re: Aiming for 2.6.0RC0 tomorrow

2024-03-21 Thread Andrew Purtell
The hadoop3 bin tarball for 2.5.8 is 352.8MB. Perhaps we have just barely and recently crossed a threshold. File an INFRA JIRA and ask about it. Perhaps some limit can be increased, or maybe they will ask us to live within it. Related, looking at the 2.5.8 hadoop3 bin tarball, the majority of the

Re: Aiming for 2.6.0RC0 tomorrow

2024-03-21 Thread Bryan Beaudreault
I got most of the way through, but failed during publish-dist: Transmitting file data ..svn: E175002: Commit failed (details follow): svn: E175002: PUT request on '/repos/dist/!svn/txr/68050-1le9/dev/hbase/2.6.0RC0/hbase-2.6.0-hadoop3-bin.tar.gz' failed Running manually, it looks to be a Request

Re: Aiming for 2.6.0RC0 tomorrow

2024-03-20 Thread Duo Zhang
HBASE-28444 has been resolved. Please go ahead to cut 2.6.0RC0, really a long journey :) 张铎(Duo Zhang) 于2024年3月20日周三 14:29写道: > > There is a security issue for zookeeper, but simply upgrading > zookeeper will break a test. > > Pelase see HBASE-28444 for more details. > > I think we should get th

Re: Aiming for 2.6.0RC0 tomorrow

2024-03-19 Thread Duo Zhang
There is a security issue for zookeeper, but simply upgrading zookeeper will break a test. Pelase see HBASE-28444 for more details. I think we should get this in before cutting the RC. Thanks. Bryan Beaudreault 于2024年3月19日周二 23:51写道: > > I've finished auditing fixVersions and run ITBLL for an