+1 (binding) Thanks for driving the release, Shilun Fan.
- Verified checksums and signatures. - Build the source on macOS and Java 8. - Ran AWS and Azure tests ( some known failures, created Jira's HADOOP-19106 it is a test side issue only mostly related to test configs, also as Ahmar pointed out) - Untar the binaries and ran hadoop fs commands on S3 and ABFS buckets. - Compiled gcs-connector and ran tests using the 3.4.0 version. On Mon, Mar 11, 2024 at 4:10 AM Xiaoqiao He <hexiaoq...@apache.org> wrote: > +1 (binding) > > [x] Verified signature and checksum. > [x] LICENSE files exist and NOTICE is included. > [x] Rat check is ok. mvn clean apache-rat:check > [x] Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package > -DskipTests -Pnative -Pdist -Dtar`. > [x] Setup pseudo cluster with HDFS and YARN. > [x] Run simple FsShell - mkdir/put/get/mv/rm (include EC) and check the > result. > [x] Run example mr jobs and check the result - Pi & wordcount. > [x] Spot-check and run some unit tests. > [x] Skimmed the Web UI of NameNode/DataNode/Resourcemanager/NodeManager > etc. > [x] Skimmed over the contents of site documentation. > [x] Skimmed over the contents of maven repo. > > Best Regards, > - He Xiaoqiao > > > On Sat, Mar 9, 2024 at 9:22 PM Suhail, Ahmar <ahma...@amazon.co.uk> wrote: > > > +1 (non-binding) > > > > > > Thanks for driving the release, Shilun. > > > > > > * Verified sha512 checksum and signature was correct for source tarball > > * Built source code on Amazon-Linux 2 and OpenJDK 8 in Amazon EC2 > > * Verified S3A (hadoop-tools/hadoop-aws) unit tests passing > > * Ran S3A (hadoop-tools/hadoop-aws) integ tests with scale profile > > agains Amazon S3 in eu-west-1, and in us-east-1 for directory buckets. > > * untar the binaries and able to access objects in S3 (for both standard > > and S3 express) via hadoop fs commands. > > > > We have some failures in S3A tests, but these are expected due to one of > > the public landsat buckets we relied on no longer being available, these > > tests were fixed in HADOOP-19057 > > <https://issues.apache.org/jira/browse/HADOOP-19057>. > > > > ------------------------------ > > *From:* slfan1989 <slfan1...@apache.org> > > *Sent:* Monday, March 4, 2024 10:07:05 PM > > *To:* Hadoop Common; Hdfs-dev; yarn-dev; mapreduce-dev; < > > priv...@hadoop.apache.org> > > *Cc:* Steve Loughran; Xiaoqiao He > > *Subject:* [EXTERNAL] [VOTE] Release Apache Hadoop 3.4.0 (RC3) > > > > CAUTION: This email originated from outside of the organization. Do not > > click links or open attachments unless you can confirm the sender and > know > > the content is safe. > > > > > > > > Hi folks, > > > > Xiaoqiao He and I have put together a release candidate (RC3) for Hadoop > > 3.4.0. > > > > What we would like is for anyone who can to verify the tarballs, > especially > > anyone who can try the arm64 binaries as we want to include them too. > > > > The RC is available at: > > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.4.0-RC3/ > > > > The git tag is release-3.4.0-RC3, commit bd8b77f398f > > > > The maven artifacts are staged at > > https://repository.apache.org/content/repositories/orgapachehadoop-1408 > > > > You can find my public key at: > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > > > Change log > > > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.4.0-RC3/CHANGELOG.md > > > > Release notes > > > > > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.4.0-RC3/RELEASENOTES.md > > > > This is off branch-3.4.0 and is the first big release since 3.3.6. > > > > Key changes include > > > > * S3A: Upgrade AWS SDK to V2 > > * HDFS DataNode Split one FsDatasetImpl lock to volume grain locks > > * YARN Federation improvements > > * YARN Capacity Scheduler improvements > > * HDFS RBF: Code Enhancements, New Features, and Bug Fixes > > * HDFS EC: Code Enhancements and Bug Fixes > > * Transitive CVE fixes > > > > Differences from Hadoop-3.4.0-RC2 > > > > * From branch-3.4 to branch-3.4.0 backport 2 Prs > > * HADOOP-18088: Replacing log4j 1.x with reload4j. (ad8b6541117b) > > * HADOOP-19084: Pruning hadoop-common transitive dependencies. > > (80b4bb68159c) > > * Use hadoop-release-support[1] for packaging and verification. > > * Add protobuf compatibility issue description > > > > Note, because the arm64 binaries are built separately on a different > > platform and JVM, their jar files may not match those of the x86 > > release -and therefore the maven artifacts. I don't think this is > > an issue (the ASF actually releases source tarballs, the binaries are > > there for help only, though with the maven repo that's a bit blurred). > > > > The only way to be consistent would actually untar the x86.tar.gz, > > overwrite its binaries with the arm stuff, retar, sign and push out > > for the vote. Even automating that would be risky. > > > > [1] hadoop-release-support: > > https://github.com/apache/hadoop-release-support > > Thanks to steve for providing hadoop-release-support. > > > > Best Regards, > > Shilun Fan. > > >
