Re: Missing full tarball for Hadoop 3.4.2

> > > From: Xiaoqiao He > > Date: Wednesday, 24 September 2025 at 03:34 > > To: Steve Loughran > > Cc: "Suhail, Ahmar" , slfan1989 < > > slfan1...@apache.org>, "Suhail, Ahmar" , " > > ah...@apache.org" , Ayush Saxena , &g

Re: Missing full tarball for Hadoop 3.4.2

t; , " > ah...@apache.org" , Ayush Saxena , > Chris Nauroth , Hadoop Common < > common-...@hadoop.apache.org>, yarn-dev , > mapreduce-dev , Hdfs-dev < > hdfs-...@hadoop.apache.org>, "" < > priv...@hadoop.apache.org> > Subject: RE: [EX

Re: Missing full tarball for Hadoop 3.4.2

t; , "ah...@apache.org" , Ayush Saxena , Chris Nauroth , Hadoop Common , yarn-dev , mapreduce-dev , Hdfs-dev , "" Subject: RE: [EXTERNAL] Missing full tarball for Hadoop 3.4.2 CAUTION: This email originated from outside of the organization. Do not click links or open attach

Re: Missing full tarball for Hadoop 3.4.2

Friday, 19 September 2025 at 04:20 >> *To: *"Suhail, Ahmar" >> *Cc: *"Suhail, Ahmar" , "ah...@apache.org" >> , Ayush Saxena , Xiaoqiao He < >> hexiaoq...@apache.org>, Steve Loughran , Chris >> Nauroth , Hadoop Common < >&g

Re: Missing full tarball for Hadoop 3.4.2

Saxena , Xiaoqiao He < > hexiaoq...@apache.org>, Steve Loughran , Chris > Nauroth , Hadoop Common , > yarn-dev , mapreduce-dev < > mapreduce-dev@hadoop.apache.org>, Hdfs-dev , > "" > *Subject: *RE: [EXTERNAL] Missing full tarball for Hadoop 3.4.2 > > &

Re: Missing full tarball for Hadoop 3.4.2

th , Hadoop Common , yarn-dev , mapreduce-dev , Hdfs-dev , "" Subject: RE: [EXTERNAL] Missing full tarball for Hadoop 3.4.2 CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content

Re: Missing full tarball for Hadoop 3.4.2

Thank you for your feedback. I think we do need to make a collective decision regarding the uploaded packages. At present, the absence of the full tar package prevents Ozone and Hive from using the latest Hadoop 3.4.2 release. From my perspective, using the minimal package as a substitute for the

Re: Missing full tarball for Hadoop 3.4.2

Hey all, Heard back from Infra: "The 1GB increase in INFRA-25423 was temporary. Your project needs to reduce the size of these binaries. In the previous temporary space increase, your project stated they would be removing extraneous dependencies/SDKs. We cannot keep increasing this allocation

Re: Missing full tarball for Hadoop 3.4.2

Thanks Shilun, I’ve cut: https://issues.apache.org/jira/browse/INFRA-27182. Will upload the full tarball once this is resolved. From: slfan1989 Date: Saturday, 30 August 2025 at 09:29 To: "ah...@apache.org" Cc: Ayush Saxena , Xiaoqiao He , Steve Loughran , Chris Nauroth , Hadoop Common , yar

Re: [VOTE] Release Apache Hadoop 3.4.2

Thank you everyone for testing and voting, and apologies for not creating a separate thread for RC3, will keep that in mind next time. The voting summary is: +5 binding (Ayush, Steve, He Xiaoqiao, Mukund, Masatake) +3 non-binding (Erdogan, Dongjoon, Cheng Pan) With 5 binding votes, the Hadoop

Re: [VOTE] Release Apache Hadoop 3.4.2

+1 (binding) + verified checksums and signatures of src and site tarballs. + built from source tarball with native profile enabled on Rocky Linux 9 (x86_64 and aarch64). + deployed pseudo cluster with and without kerberos enabled. + ran some example jobs. + ran some simple query against htt

Re: [VOTE] Release Apache Hadoop 3.4.2

Thank you everyone for voting, Voting summary so far: +4 binding (Ayush, Steve, He Xiaoqiao, Mukund) +1 non-binding (Erdogan) Looking for one more binding vote, and I will also add mine soon. Hoping to close voting by the end of the week and get the release out, so please do test and vote soo

Re: [VOTE] Release Apache Hadoop 3.4.2

+1 (Binding) * Built from source (X86 & ARM) * Validated checksums. * Verified Signatures. * Verified all source files have ASF headers * Validated NOTICE & LICENSE files * Verified no diff b/w git tag & src tar * Verified the output of `hadoop version` * Ran some basic HDFS commands * Ran example

Re: [VOTE] Release Apache Hadoop 3.4.2

+1(binding). [Y] Verified sha512 checksum and signature. [Y] LICENSE files exist and NOTICE is included in source tarball. [Y] Build the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. [Y] Rat check is ok. `mvn clean apache-rat:check` [Y] Setup pseudo

Re: [VOTE] Release Apache Hadoop 3.4.2

+1 binding Verified signature and checksums. Compiled the full source tree successfully. Downloaded and untar the arm binary on Mac OS M3 and ran hadoop fs command on us-west2 bucket which verified dropping in of aws sdk library. Also verified access to abfs containers. Compiled gcs connector using

Re: [VOTE] Release Apache Hadoop 3.4.2

+1 binding * downloaded, checked signing and hashes of binary, arm binary and source artifacts * full clean build of source * aws test runs against s3 london and dell ecs. One oddity in building from the untarred source tree, Terasort failing with history server not starting. This did work in my g

Re: [VOTE] Release Apache Hadoop 3.4.2

Thanks Anuj, I've merged. Since I cut RC-3 yesterday, this won't be included in the release yet, if the RC fails the vote, will include it in the next one. On 21/08/2025, 05:08, "Anuj Modi" mailto:anujmodi2...@gmail.com>> wrote: CAUTION: This email originated from outside of the organization.

Re: [VOTE] Release Apache Hadoop 3.4.2

Hi, Ahmar Here are the PRs for the fix raised for ABFS close() causing NPE raised on RC. PR on branch-3.4.2: https://github.com/apache/hadoop/pull/7888 PR on branch-3.4: https://github.com/apache/hadoop/pull/7889 Feel free to merge them as per the release timelines. Thanks On Wed, Aug 20, 2025

Re: [VOTE] Release Apache Hadoop 3.4.2

just discovering as I do the third party compatibility testing of the latest sdk that the fs.s3a.create.checksum.algorithm stuff is a bit broken -nothing to worry about though as its a new feature so not a regression On Wed, 20 Aug 2025 at 16:13, Suhail, Ahmar wrote: > Hey all, > > I've fixed th

Re: [VOTE] Release Apache Hadoop 3.4.2

Hey all, I've fixed the following issues: 1) Issues with changelog, release notes and landing page. Created a new build so they now include all the JIRA's that were missing before. 2) Create the lean tar on ubuntu so you won't get the tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xa

Re: [VOTE] Release Apache Hadoop 3.4.2

Since I have to regenerate the site and changelog, do I need to do the whole build again or is there an easier way to do that? (just by regenerating the site manually and updating the artifacts in SVN maybe?) I think just running the create-release[1] script could be an easy way while it does

Re: [VOTE] Release Apache Hadoop 3.4.2

Thanks Masatake and Steve, Here's the PR for updating the top page of the site https://github.com/apache/hadoop/pull/7887 , if there's anything else we think needs to go in there, let me know, otherwise I will merge by tomorrow. Since I have to regenerate the site and changelog, do I need to

Re: [VOTE] Release Apache Hadoop 3.4.2

Thanks for the update, Ahmar The binary artifacts basically looks good. I have some comments about inconsistencies. - Some JIRAs of additional commits did not have 3.4.2 as "Fix Version/s". I updated them. Jira/Git commit message diff starting:

Re: [VOTE] Release Apache Hadoop 3.4.2

sorry, been behind on this. -1 packaging related. that hadoop-3.4.2-lean.tar.gz file is actually a tar file. Took me a while to work this down as I just assumed my ant build script was at fault. file downloads/hadoop-3.4.2-RC2/hadoop-3.4.2-lean.tar.gz downloads/hadoop-3.4.2-RC2/hadoop-3.4.2-lean

Re: [VOTE] Release Apache Hadoop 3.4.2

Thanks Ahmar for your work on this. Will check it ASAP. Best Regards, - He Xiaoqiao On Thu, Aug 14, 2025 at 5:14 PM Ahmar Suhail wrote: > Hey all, > > Just a reminder about this. Would be great to get some votes in asap and > hopefully finalise 3.4.2. > > Thanks, > Ahmar > > On Thu, Aug 7, 2025

Re: [VOTE] Release Apache Hadoop 3.4.2

Hey all, Just a reminder about this. Would be great to get some votes in asap and hopefully finalise 3.4.2. Thanks, Ahmar On Thu, Aug 7, 2025 at 9:35 PM Ahmar Suhail wrote: > Hey all, > > RC2 for Hadoop 3.4.2 is now available for voting. > > There are a couple of things to note: > > 1/ We have

Re: [DISCUSS] Future Release and Support Strategy for Hadoop

lost in the nested historical JIRAs for Java 17 >> > support [1]. I'd like to start by summarizing my understanding of work done >> > and work remaining for Java 17 as well as other significant features the >> > community wants to ship in 3.5.0: >> >> >

Re: [VOTE] Release Apache Hadoop 3.4.2

gt; > Thank you, > Ahmar > > > From: Masatake Iwasaki > Sent: Thursday, June 5, 2025 4:46:06 PM > To: Wei-Chiu Chuang; Ahmar Suhail > Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; > mapreduce-dev@hadoop.apache.org; yarn-..

Re: [VOTE] Release Apache Hadoop 3.4.2

e Iwasaki Sent: Thursday, June 5, 2025 4:46:06 PM To: Wei-Chiu Chuang; Ahmar Suhail Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: RE: [EXTERNAL] [VOTE] Release Apache Hadoop 3.4.2 CAUTION: This email originated from

Re: [VOTE] Release Apache Hadoop 3.4.2

Hi Wei-Chiu Chuang, I really wish we can make ARM64 binaries. Would like to find time to work on the two jiras mentioned. I submitted PRs for YARN-11712 and YARN-11713. Could you check the patches? Thanks, Masatake Iwasaki On 2025/06/05 1:14, Wei-Chiu Chuang wrote: I really wish we can make

Re: [VOTE] Release Apache Hadoop 3.4.2

I really wish we can make ARM64 binaries. Would like to find time to work on the two jiras mentioned. On Wed, May 28, 2025 at 5:25 AM Ahmar Suhail wrote: > Hey all, > > The first release candidate for Hadoop 3.4.2 is now available for voting. > > There are a couple of things to note: > > 1/ No A

Re: [VOTE] Release Apache Hadoop 3.4.2

t;> will do the merge and test >>> >>> On Mon, 2 Jun 2025 at 16:51, Suhail, Ahmar >>> wrote: >>> >>>> Steve - I created a PR on hadoop-release-support with my properties >>>> file: https://github.com/apache/hadoop-relea

Re: [VOTE] Release Apache Hadoop 3.4.2

the documentation for the new >>> RC if it is created. >>> >>> >>> Mukund - I realised too late that I messed up the commit for that one. >>> Will figure out how to fix.. >>> >>> >>> From: Steve Loughran >

Re Hadoop 3.5.0/Java 17 Release Planning

made significant progress on the JUnit 5 upgrade [3], and we > have a list of several PRs remaining to be reviewed and committed [4]. > - There is some sun.misc usage that needs alternate implementations [5] > [6]. There are PRs, but they haven't had any recent activity. > -

Re: [VOTE] Release Apache Hadoop 3.4.2

___ >> From: Steve Loughran >> Sent: Monday, June 2, 2025 4:25:00 PM >> To: Ahmar Suhail >> Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; >> mapreduce-dev@hadoop.apache.org; yarn-...@hadoop.apache.org >> Subject: RE: [EXTERNAL] [VOTE] Release Apache

Re: [VOTE] Release Apache Hadoop 3.4.2

> From: Steve Loughran > Sent: Monday, June 2, 2025 4:25:00 PM > To: Ahmar Suhail > Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; > mapreduce-dev@hadoop.apache.org; yarn-...@hadoop.apache.org > Subject: RE: [EXTERNAL] [VOTE] Release Apa

Re: [VOTE] Release Apache Hadoop 3.4.2

. Will figure out how to fix.. From: Steve Loughran Sent: Monday, June 2, 2025 4:25:00 PM To: Ahmar Suhail Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: RE: [EXTERNAL] [VOTE

Re: [VOTE] Release Apache Hadoop 3.4.2

can you put up the relevant changes to the hadoop-release-support module; I'd like to use it as part of my validation and I'm assuming you have that src/releases/release-info-3.4.2.properties file On Wed, 28 May 2025 at 13:25, Ahmar Suhail wrote: > Hey all, > > The first release candidate for Ha

Re: [VOTE] Release Apache Hadoop 3.4.2

* git_jira_fix_version_check.py reported some inconsistencies between commits and JIRA. I updated JIRA's "Fix Versions/s" and "Resolution" along with the commit status. Since HADOOP-19580 was commited to branch-3.4.2 but not in the RC1, it will be contained if RC2 is created. "Fix Versions/s"

Re: [VOTE] Release Apache Hadoop 3.4.2

Thanks for driving the release, Ahmar. I found some issues on documentations. While it is not worth for sinking the RC1, it would be nice to fix if we cut RC2. * The top page of site documentation looks mentioning changes of 3.4.1. https://github.com/apache/hadoop/blob/release-3.4.2-RC1/hado

Re: [VOTE] Release Apache Hadoop 3.4.2

Thanks for starting this! I tried accessing the S3 bucket using the RC by dropping in the bundle jar and it works. Will test more! On Wed, May 28, 2025 at 7:25 AM Ahmar Suhail wrote: > Hey all, > > The first release candidate for Hadoop 3.4.2 is now available for voting. > > There are a couple o

Re: [VOTE] Release Apache Hadoop 3.4.2

Thanks Ahmar for your work. Will try to verify and give feedback here. Best Regards, - He Xiaoqiao On Wed, May 28, 2025 at 8:56 PM Ahmar Suhail wrote: > > Hey all, > > The first release candidate for Hadoop 3.4.2 is now available for voting. > > There are a couple of things to note: > > 1/ No Ar

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

Thanks Steve for driving this release. +0 and will give my +1 while tag to be fixed. [Y] LICENSE files exist and NOTICE is included. [Y] Build the source code on Ubuntu and OpenJDK 11. [Y] Verified checksums and Signature. [Y] Skimmed over the contents of ReleaseNotes and ChangeLogs. [N] release

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

+1 (Binding) * Built from source * Verified checksums * Verified Signature * Verified no diff b/w branch-1.4 & src tar [1] * Skimmed over the contents of ReleaseNotes & ChangeLog * Checked the NOTICE & LICENSE files Thanx Steve for driving the release. Good Luck!!! -Ayush [1] I think releas

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

This is committed to trunk and branch-1.4.0 now, ready for another RC. Thanks to Aayush for the code review. Chris Nauroth On Wed, Mar 19, 2025 at 1:51 PM Chris Nauroth wrote: > -1 > > Signatures look good, but I found a few spots that need an update for the > new protobuf version: > > https:/

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

thanks. will kick off a new build. Did anyone else see problems with the gpg versions? I destroyed the entire .gpgconf dir on the host i was building on; did manual verify after importing KEYS, and all seemed good. On Thu, 20 Mar 2025 at 04:37, Chris Nauroth wrote: > This is committed to tru

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

The time is up, the votes are in and they are +1 (binding) Ayush Saxena (binding) Chris Nauroth (binding) Steve Loughran (binding) Wei-Chiu Chuang (binding) Xiaoqiao He (binding) = 0: none -1: none Accordingly, the RC is the release; I will do the next steps in the process ASAP Steve On Tue,

Re: JDK 17 (or beyond) upgrade

Hello Vincent, There isn't a firm timeline yet, but the community is rallying around a 3.5.0 release with full support for JDK 17. In addition to the issue you linked, there is also this one: https://issues.apache.org/jira/browse/HADOOP-17177 Known work related to JDK 17 compatibility is going t

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

Update: +1(binding). On Tue, Mar 25, 2025 at 7:10 PM Steve Loughran wrote: > > > pushed up. thanks for spotting that. Added another 3p. target to the > release-support build file. Really trying to automate all these steps > > 3p.git-tag-push: > [git] To github.com:apache/hadoop-thirdparty.

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

pushed up. thanks for spotting that. Added another 3p. target to the release-support build file. Really trying to automate all these steps 3p.git-tag-push: [git] To github.com:apache/hadoop-thirdparty.git [git] * [new tag] release-1.4.0-RC1 -> release-1.4.0-RC1 On Mon, 24 M

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

I am +1 too. * Verified signature. * Release notes and changelogs look good. On Fri, Mar 21, 2025 at 4:35 PM Chris Nauroth wrote: > +1 > > * Verified signatures. > * LICENSE-binary has the expected dependencies and versions. > * Site looks good too. > * Specifically confirmed inclusion of HADOO

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

+1 * Verified signatures. * LICENSE-binary has the expected dependencies and versions. * Site looks good too. * Specifically confirmed inclusion of HADOOP-19510, previously identified during RC0. Thanks for the release, Steve! Chris Nauroth On Fri, Mar 21, 2025 at 10:43 AM Steve Loughran wrot

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

I did try everything, no problem with the keys or so. -Ayush On Thu, 20 Mar 2025 at 23:21, Steve Loughran wrote: > thanks. will kick off a new build. > > Did anyone else see problems with the gpg versions? > > I destroyed the entire .gpgconf dir on the host i was building on; did > manual verif

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

-1 Signatures look good, but I found a few spots that need an update for the new protobuf version: https://issues.apache.org/jira/browse/HADOOP-19510 https://github.com/apache/hadoop-thirdparty/pull/44 Chris Nauroth On Tue, Mar 18, 2025 at 8:47 AM Wei-Chiu Chuang wrote: > I just did > gpg -

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

I just did gpg --verify .tar.gz.asc .tar.gz Ok after importing hadoop KEYS , this is the output which looks good to me: gpg: Signature made Fri Mar 14 08:56:01 2025 PDT gpg:using RSA key 38237EE425050285077DB57AD22CF846DBB162A0 gpg:

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

can you give me what command you ran to check the signature, and see if you can update all your keys from the central servers? My key thinks it is not expired, so maybe its the KEYS file i need to update or you need to refresh your keys. I will have a look at the keys file tomorrow On Fri, 14 Mar

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

Let me check that; getting signing set up on the transient vm was tricky as my yubikey one wasn't there so I used my other .. regarding the jersey -bigger piece off work to actually pick up, so not touching it. On Fri, 14 Mar 2025 at 21:46, Wei-Chiu Chuang wrote: > Looks like your GPG key expir

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

Verified SHA-512 checksum, GPG signature -- all good except that the signing key expired. Confirmed git tag release-1.4.0-RC0 and branch name branch-1.4.0 both maps to commit hash 5595f1357eaad02e1cfb660bcce7fd34515197ff. Confirmed it is released as 1.4.0. Noticed HADOOP-19075

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

Looks like your GPG key expired? gpg: Signature made Fri Mar 14 08:56:00 2025 PDT gpg:using RSA key 38237EE425050285077DB57AD22CF846DBB162A0 gpg: Good signature from "Steve Loughran (ASF code sign key - 2018) < ste...@apache.org>" [expired] gpg: aka "[jpeg image of

Re: [DISCUSS] Hadoop 3.4.2 release

+1, thanx Ahmar for driving it. I plan to c-pick YARN-11738 to branch-3.4, if folks are ok with it, that is need by Tez, or atleast makes life easier there -Ayush On Sun, 2 Mar 2025 at 01:30, Chao Sun wrote: > +1, thanks Ahmar! > > On Fri, Feb 28, 2025 at 7:21 AM larry mccay wrote: > > > +1 >

Re: [DISCUSS] Hadoop 3.4.2 release

+1, thanks Ahmar! On Fri, Feb 28, 2025 at 7:21 AM larry mccay wrote: > +1 > > Thanks, Ahmar! > > On Fri, Feb 28, 2025 at 7:37 AM slfan1989 wrote: > > > +1 > > > > I can provide assistance with the ARM release, as I originally planned to > > release Hadoop 3.5.0, which supports JDK17, and have b

Re: [DISCUSS] Hadoop 3.4.2 release

+1 Thanks, Ahmar! On Fri, Feb 28, 2025 at 7:37 AM slfan1989 wrote: > +1 > > I can provide assistance with the ARM release, as I originally planned to > release Hadoop 3.5.0, which supports JDK17, and have been conducting > related tests. > > My approach is a workaround, and I hope it helps. > >

Re: [DISCUSS] Hadoop 3.4.2 release

+1 I can provide assistance with the ARM release, as I originally planned to release Hadoop 3.5.0, which supports JDK17, and have been conducting related tests. My approach is a workaround, and I hope it helps. Best Regards, - Shilun Fan On Thu, Feb 27, 2025 at 9:08 PM Bhavik Patel wrote: > H

Re: [DISCUSS] Hadoop 3.4.2 release

Hello PMCs, Can we do a release for hadoop-thirdparty 1.4.0 or 1.3.1 with the fix for CVE-2024-7254(HADOOP-19289) and bump hadoop-thirdparty version in hadoop-3.4.2? On Thu, 27 Feb 2025, 5:15 pm Anuj Modi, wrote: > +1 > Thanks for initiative Ahmar. > > For ABFS we would like to highlight two ma

Re: [DISCUSS] Hadoop 3.4.2 release

+1 Thanks for initiative Ahmar. For ABFS we would like to highlight two major changes in the upcoming release. 1. Announcing Deprecation of WASB driver: Jira , Documentation

Re: [DISCUSS] Hadoop 3.4.2 release

+1. Thanks Ahmar. On Thu, Feb 27, 2025 at 2:31 AM Chris Nauroth wrote: > +1 > > Thank you, Ahmar! > > Chris Nauroth > > > On Wed, Feb 26, 2025 at 8:31 AM Ahmar Suhail wrote: > > > Hey all, > > > > Would like to start a discussion for a Hadoop 3.4.2 release. > > > > For S3A, we would like to rel

Re: [DISCUSS] Hadoop 3.4.2 release

+1 Thank you, Ahmar! Chris Nauroth On Wed, Feb 26, 2025 at 8:31 AM Ahmar Suhail wrote: > Hey all, > > Would like to start a discussion for a Hadoop 3.4.2 release. > > For S3A, we would like to release support for conditional writes, and > integration of a new analytics input stream. > > I hav

Re: [External Sender] Re: JDK17 support for Hadoop

; Asanuma , Hadoop Common , > yarn-dev , mapreduce-dev < > mapreduce-dev@hadoop.apache.org>, Hdfs-dev > *Subject: *[External Sender] Re: JDK17 support for Hadoop > > Thank you all for your interest in this topic! > > In my opinion, upgrading is very beneficial. Based on

Re: Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

+1 (binding) * Successfully built from source with `mvn clean install` * Verified signatures and checksums Thanks Steve and Mukund for driving this release. Hope the release goes smoothly. Shilun Fan. On Fri, Aug 23, 2024 at 11:41 PM Shilun Fan wrote: +1 (Binding) > > * Built from source > *

Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

+1 (Binding) * Built from source * Verified Signature(Signed by Mukund) * Verified Checksums * No diff b/w the git tag & src tar * Verified the NOTICE & LICENSE files * Skimmed over the contents of the site jar * Built Hadoop trunk with 1.3.0 version * Checked the hadoop test results here [1], not

Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

+1 (binding). Thanks Steve and Mukund for driving this release. Best Regards - He Xiaoqiao On Wed, Aug 21, 2024 at 11:51 PM Mukund Madhav Thakur wrote: > +1 ( binding) > > On Tue, Aug 20, 2024 at 9:16 AM Steve Loughran > > wrote: > > > Mukund and I have built a release candidate (RC1) for Had

Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

de-protobuf) on > project hadoop-shaded-protobuf_3_25: Error creating shaded jar: duplicate > entry: META-INF/LICENSE.txt -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e switch. > [ERROR] Re-run Maven using the -X switch to

Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

--- > > mvn install package -DskipTests > > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-shade-plugin:3.1.1:shade (shade-protobuf) on > project hadoop-shaded-protobuf_3_25: Error creating shaded jar: duplicate > entry: META

Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

project hadoop-shaded-protobuf_3_25: Error creating shaded jar: duplicate entry: META-INF/LICENSE.txt -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For m

Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

+1 ( binding) On Tue, Aug 20, 2024 at 9:16 AM Steve Loughran wrote: > Mukund and I have built a release candidate (RC1) for Hadoop-Thirdparty > 1.3.0. > > The RC is available at: > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-thirdparty-1.3.0-RC1/ > > The git tag is release-1.3.0-RC1, co

Re: [DISCUSS] what needs to be done to switch to java17

> One thing I know is that it is necessary to upgrade JUnit 4 to JUnit 5 Do you know any specific reason or docs mentioning that? Just curious as to why we need to migrate to JUnit 5 for JDK-17, Looking here [1], it seems like it supports JDK-21 as well and even [2] mentions like it does support

Re: [DISCUSS] what needs to be done to switch to java17

Thanks, everyone, for starting this discussion. This sounds like a good plan to start with. As I was working on the JUnit 4 to 5 upgrade, I paused for a while as I got occupied with other stuff. But I would be happy to complete it as part of the Java switch process. On Tue, Jul 30, 2024 at 4:21 AM

Re: [DISCUSS] what needs to be done to switch to java17

Thank you very much for initiating this discussion! I am also very much looking forward to JDK 17. I have observed that using --add-opens= is quite common in other Apache projects. One thing I know is that it is necessary to upgrade JUnit 4 to JUnit 5. There are some JIRA issues currently being wor

Re: [DISCUSS] what needs to be done to switch to java17

Depends on what we mean by switching to JDK-17, Compile time support or Runtime support, We don't have compile time support for JDK-11 too, it is just runtime, We have a daily build as well for JDK-11, which has now some genuine failures now, need to check [1], as of now the version is hardcoded he

Re: [DISCUSS] what needs to be done to switch to java17

I think this is worth considering. I think it would require a minor release like 3.5.0 as opposed to considering it for future 3.4.x patch releases. I tend to build locally with Java 11, by default and I haven't hit major issues building Hadoop. There may be some gotcha somewhere but it is likely t

Re: [DISCUSS] pruning surplus branches/tags from the main hadoop repo

On Thu, 30 May 2024 at 03:47, Xiaoqiao He wrote: > Strong +1. One concerns, how we define 'unnecessary branches', which > mean how to distinguish the branches someone accidentally created, I try > to traverse some of them but didn't get one obvious rule. Thanks. > If we take a snapshot into an

Re: [DISCUSS] pruning surplus branches/tags from the main hadoop repo

Strong +1. One concerns, how we define 'unnecessary branches', which mean how to distinguish the branches someone accidentally created, I try to traverse some of them but didn't get one obvious rule. Thanks. Best Regards, - He Xiaoqiao On Wed, May 29, 2024 at 10:11 PM Ayush Saxena wrote: > +1

Re: [DISCUSS] pruning surplus branches/tags from the main hadoop repo

+1 for the proposal, the first thing might be to just drop the unnecessary branches which are either from dependabot or someone accidentally created a branch in the main repo rather than in their fork, there are many, I don't think we need them in the archived repo either Regarding (3) If you mean

Re: [ANNOUNCE] New Hadoop Committer - Haiyang Hu

Thanks! Looking forward to participating more in the Apache Hadoop community! Yuanbo Liu 于2024年4月22日周一 15:26写道： > Congratulations > > On Mon, Apr 22, 2024 at 12:14 PM Ayush Saxena wrote: > >> Congratulations Haiyang!!! >> >> -Ayush >> >> > On 22 Apr 2024, at 9:41 AM, Xiaoqiao He wrote: >> > >

Re: [ANNOUNCE] New Hadoop Committer - Haiyang Hu

Congratulations On Mon, Apr 22, 2024 at 12:14 PM Ayush Saxena wrote: > Congratulations Haiyang!!! > > -Ayush > > > On 22 Apr 2024, at 9:41 AM, Xiaoqiao He wrote: > > > > I am pleased to announce that Haiyang Hu has been elected as > > a committer on the Apache Hadoop project. We appreciate all

Re: [ANNOUNCE] New Hadoop Committer - Haiyang Hu

Congratulations Haiyang!!! -Ayush > On 22 Apr 2024, at 9:41 AM, Xiaoqiao He wrote: > > I am pleased to announce that Haiyang Hu has been elected as > a committer on the Apache Hadoop project. We appreciate all of > Haiyang's work, and look forward to her/his continued contributions. > > Congr

Re: [ANNOUNCE] Apache Hadoop 3.4.0 release

Xiaoqiao He and Shilun Fan Awesome! Thanks for leading the effort to release the Hadoop 3.4.0 ! Bests, Sammi On Tue, 19 Mar 2024 at 21:12, slfan1989 wrote: > On behalf of the Apache Hadoop Project Management Committee, We are > pleased to announce the release of Apache Hadoop 3.4.0. > > This

Re: [jira] [Created] (MAPREDUCE-7472) decode value of hive.query.string for the job Confguration which was encoded by hive

who is reviewing MR patches these days? On Fri, 2 Feb 2024 at 01:46, wangzhongwei (Jira) wrote: > wangzhongwei created MAPREDUCE-7472: > --- > > Summary: decode value of hive.query.string for the job > Confguration which was encoded by hive >

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

4日(木) 15:19 Xiaoqiao He : >> >>> Thanks Ayush for highlighting this information. Absolutely true, we >>> should >>> count RM's vote when explicit +1 here. >>> >>> Best Regards, >>> - He Xiaoqiao >>> >>> On Thu, Mar 14

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

we should >> count RM's vote when explicit +1 here. >> >> Best Regards, >> - He Xiaoqiao >> >> On Thu, Mar 14, 2024 at 3:55 AM Ayush Saxena wrote: >> >> > > Counter should be with yourself vote, where the current summary >> > is 5 +1

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

> > > > Counter should be with yourself vote, where the current summary > > is 5 +1 binding and 1 +1 non-binding. Let's re-count when deadline. > > > > Just on the process: The release manager needs to "explicitly" vote like > > any other before co

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

g and 1 +1 non-binding. Let's re-count when deadline. > > Just on the process: The release manager needs to "explicitly" vote like > any other before counting their own vote, there has been a lot of > discussions around that at multiple places & the official apache

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

> Counter should be with yourself vote, where the current summary is 5 +1 binding and 1 +1 non-binding. Let's re-count when deadline. Just on the process: The release manager needs to "explicitly" vote like any other before counting their own vote, there has been a lot of discu

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

unter should be with yourself vote, where the current summary > is 5 +1 binding and 1 +1 non-binding. Let's re-count when deadline. > Thanks again. > > Best Regards, > - He Xiaoqiao > > On Tue, Mar 12, 2024 at 9:00 AM slfan1989 wrote: > > > As of now, we have collecte

Re: [DISCUSS] Support/Fate of HBase v1 in Hadoop

Thanx Everyone. I think we have an agreement around dropping the Hbase v1 support. I have created a ticket: https://issues.apache.org/jira/browse/HADOOP-19107 FYI. The HBase v2 build is broken now. I tried " mvn clean install -DskipTests -Dhbase.profile=2.0" & it didn't work (It worked couple of

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

Hi Shilun, Counter should be with yourself vote, where the current summary is 5 +1 binding and 1 +1 non-binding. Let's re-count when deadline. Thanks again. Best Regards, - He Xiaoqiao On Tue, Mar 12, 2024 at 9:00 AM slfan1989 wrote: > As of now, we have collected 5 affirmative votes

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

As of now, we have collected 5 affirmative votes, with 4 votes binding and 1 vote non-binding. Thank you very much for voting and verifying! This voting will continue until March 15th, this Friday. Best Regards, Shilun Fan. On Tue, Mar 12, 2024 at 4:29 AM Steve Loughran wrote: > +1 binding >

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

+1 binding (sorry, this had ended in the yarn-dev folder, otherwise I'd have seen it earlier. been testing it this afternoon: pulled the latest version of https://github.com/apache/hadoop-release-support (note, this module is commit-then-review; whoever is working on/validating a release can comm

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

+1 (binding) Thanks for driving the release, Shilun Fan. - Verified checksums and signatures. - Build the source on macOS and Java 8. - Ran AWS and Azure tests ( some known failures, created Jira's HADOOP-19106 it is a test side issue only mostly related to test configs, also as Ah

Re: [DISCUSS] Support/Fate of HBase v1 in Hadoop

+1 for cutting hbase 1; it only reduces dependency pain (no more protobuf 2.5!) Created the JIRA on that a few days back https://issues.apache.org/jira/browse/YARN-11658 On Tue, 5 Mar 2024 at 12:08, Bryan Beaudreault wrote: > Hbase v1 is EOL for a while now, so option 2 probably makes sense. W

  1   2   3   4   5   6   7   8   9   10   >