+1 (binding) [x] Verified signature and checksum. [x] LICENSE files exist and NOTICE is included. [x] Rat check is ok. mvn clean apache-rat:check [x] Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. [x] Setup pseudo cluster with HDFS and YARN. [x] Run simple FsShell - mkdir/put/get/mv/rm (include EC) and check the result. [x] Run example mr jobs and check the result - Pi & wordcount. [x] Spot-check and run some unit tests. [x] Skimmed the Web UI of NameNode/DataNode/Resourcemanager/NodeManager etc. [x] Skimmed over the contents of site documentation. [x] Skimmed over the contents of maven repo.
Best Regards, - He Xiaoqiao On Sat, Mar 9, 2024 at 9:22 PM Suhail, Ahmar <ahma...@amazon.co.uk> wrote: > +1 (non-binding) > > > Thanks for driving the release, Shilun. > > > * Verified sha512 checksum and signature was correct for source tarball > * Built source code on Amazon-Linux 2 and OpenJDK 8 in Amazon EC2 > * Verified S3A (hadoop-tools/hadoop-aws) unit tests passing > * Ran S3A (hadoop-tools/hadoop-aws) integ tests with scale profile > agains Amazon S3 in eu-west-1, and in us-east-1 for directory buckets. > * untar the binaries and able to access objects in S3 (for both standard > and S3 express) via hadoop fs commands. > > We have some failures in S3A tests, but these are expected due to one of > the public landsat buckets we relied on no longer being available, these > tests were fixed in HADOOP-19057 > <https://issues.apache.org/jira/browse/HADOOP-19057>. > > ------------------------------ > *From:* slfan1989 <slfan1...@apache.org> > *Sent:* Monday, March 4, 2024 10:07:05 PM > *To:* Hadoop Common; Hdfs-dev; yarn-dev; mapreduce-dev; < > priv...@hadoop.apache.org> > *Cc:* Steve Loughran; Xiaoqiao He > *Subject:* [EXTERNAL] [VOTE] Release Apache Hadoop 3.4.0 (RC3) > > CAUTION: This email originated from outside of the organization. Do not > click links or open attachments unless you can confirm the sender and know > the content is safe. > > > > Hi folks, > > Xiaoqiao He and I have put together a release candidate (RC3) for Hadoop > 3.4.0. > > What we would like is for anyone who can to verify the tarballs, especially > anyone who can try the arm64 binaries as we want to include them too. > > The RC is available at: > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.4.0-RC3/ > > The git tag is release-3.4.0-RC3, commit bd8b77f398f > > The maven artifacts are staged at > https://repository.apache.org/content/repositories/orgapachehadoop-1408 > > You can find my public key at: > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > Change log > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.4.0-RC3/CHANGELOG.md > > Release notes > > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.4.0-RC3/RELEASENOTES.md > > This is off branch-3.4.0 and is the first big release since 3.3.6. > > Key changes include > > * S3A: Upgrade AWS SDK to V2 > * HDFS DataNode Split one FsDatasetImpl lock to volume grain locks > * YARN Federation improvements > * YARN Capacity Scheduler improvements > * HDFS RBF: Code Enhancements, New Features, and Bug Fixes > * HDFS EC: Code Enhancements and Bug Fixes > * Transitive CVE fixes > > Differences from Hadoop-3.4.0-RC2 > > * From branch-3.4 to branch-3.4.0 backport 2 Prs > * HADOOP-18088: Replacing log4j 1.x with reload4j. (ad8b6541117b) > * HADOOP-19084: Pruning hadoop-common transitive dependencies. > (80b4bb68159c) > * Use hadoop-release-support[1] for packaging and verification. > * Add protobuf compatibility issue description > > Note, because the arm64 binaries are built separately on a different > platform and JVM, their jar files may not match those of the x86 > release -and therefore the maven artifacts. I don't think this is > an issue (the ASF actually releases source tarballs, the binaries are > there for help only, though with the maven repo that's a bit blurred). > > The only way to be consistent would actually untar the x86.tar.gz, > overwrite its binaries with the arm stuff, retar, sign and push out > for the vote. Even automating that would be risky. > > [1] hadoop-release-support: > https://github.com/apache/hadoop-release-support > Thanks to steve for providing hadoop-release-support. > > Best Regards, > Shilun Fan. >