We have a daily build running for 3.3.5: https://ci-hadoop.apache.org/job/hadoop-qbt-3.3.5-java8-linux-x86_64/
We have already released it, so I feel we can disable it. Will do it tomorrow, if nobody objects. In case the one who configured it wants to do it early, feel free to do so. We already have one for branch-3.3 which runs weekly which most probably most of us don't follow :) -Ayush On Wed, 22 Mar 2023 at 00:20, Steve Loughran <ste...@cloudera.com.invalid> wrote: > > ok, here's my summary, even though most of the binding voters forgot to > declare they were on the PMC. > > +1 binding > > Steve Loughran > Chris Nauroth > Masatake Iwasaki > Ayush Saxena > Xiaoqiao He > > +1 non-binding > > Viraj Jasani > > > 0 or -1 votes: none. > > > Accordingly: the release is good! > > I will send the formal announcement out tomorrow > > A big thank you to everyone who qualified the RC, I know its a lot of work. > We can now get this out and *someone else* can plan the followup. > > > steve > > On Mon, 20 Mar 2023 at 16:01, Chris Nauroth <cnaur...@apache.org> wrote: > > > +1 > > > > Thank you for the release candidate, Steve! > > > > * Verified all checksums. > > * Verified all signatures. > > * Built from source, including native code on Linux. > > * mvn clean package -Pnative -Psrc -Drequire.openssl -Drequire.snappy > > -Drequire.zstd -DskipTests > > * Tests passed. > > * mvn --fail-never clean test -Pnative -Dparallel-tests > > -Drequire.snappy -Drequire.zstd -Drequire.openssl > > -Dsurefire.rerunFailingTestsCount=3 -DtestsThreadCount=8 > > * Checked dependency tree to make sure we have all of the expected library > > updates that are mentioned in the release notes. > > * mvn -o dependency:tree > > * Confirmed that hadoop-openstack is now just a stub placeholder artifact > > with no code. > > * For ARM verification: > > * Ran "file <X>" on all native binaries in the ARM tarball to confirm > > they actually came out with ARM as the architecture. > > * Output of hadoop checknative -a on ARM looks good. > > * Ran a MapReduce job with the native bzip2 codec for compression, and > > it worked fine. > > * Ran a MapReduce job with YARN configured to use > > LinuxContainerExecutor and verified launching the containers through > > container-executor worked. > > > > Chris Nauroth > > > > > > On Mon, Mar 20, 2023 at 3:45 AM Ayush Saxena <ayush...@gmail.com> wrote: > > > > > +1(Binding) > > > > > > * Built from source (x86 & ARM) > > > * Successful Native Build (x86 & ARM) > > > * Verified Checksums (x86 & ARM) > > > * Verified Signature (x86 & ARM) > > > * Checked the output of hadoop version (x86 & ARM) > > > * Verified the output of hadoop checknative (x86 & ARM) > > > * Ran some basic HDFS shell commands. > > > * Ran some basic Yarn shell commands. > > > * Played a bit with HDFS Erasure Coding. > > > * Ran TeraGen & TeraSort > > > * Browed through NN, DN, RM & NM UI > > > * Skimmed over the contents of website. > > > * Skimmed over the contents of maven repo. > > > * Selectively ran some HDFS & CloudStore tests > > > > > > Thanx Steve for driving the release. Good Luck!!! > > > > > > -Ayush > > > > > > > On 20-Mar-2023, at 12:54 PM, Xiaoqiao He <hexiaoq...@apache.org> > > wrote: > > > > > > > > +1 > > > > > > > > * Verified signature and checksum of the source tarball. > > > > * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package > > > > -DskipTests -Pnative -Pdist -Dtar`. > > > > * Setup pseudo cluster with HDFS and YARN. > > > > * Run simple FsShell - mkdir/put/get/mv/rm (include EC) and check the > > > > result. > > > > * Run example mr applications and check the result - Pi & wordcount. > > > > * Check the Web UI of NameNode/DataNode/Resourcemanager/NodeManager > > etc. > > > > > > > > Thanks Steve for your work. > > > > > > > > Best Regards, > > > > - He Xiaoqiao > > > > > > > >> On Mon, Mar 20, 2023 at 12:04 PM Masatake Iwasaki < > > > iwasak...@oss.nttdata.com> > > > >> wrote: > > > >> > > > >> +1 > > > >> > > > >> + verified the signature and checksum of the source tarball. > > > >> > > > >> + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK > > 8 > > > >> with native profile enabled. > > > >> + launched pseudo distributed cluster including kms and httpfs with > > > >> Kerberos and SSL enabled. > > > >> + created encryption zone, put and read files via httpfs. > > > >> + ran example MR wordcount over encryption zone. > > > >> + checked the binary of container-executor. > > > >> > > > >> + built rpm packages by Bigtop (with trivial modifications) on Rocky > > > Linux > > > >> 8 (aarch64). > > > >> + ran smoke-tests of hdfs, yarn and mapreduce. > > > >> + built site documentation and skimmed the contents. > > > >> + Javadocs are contained. > > > >> > > > >> Thanks, > > > >> Masatake Iwasaki > > > >> > > > >>> On 2023/03/16 4:47, Steve Loughran wrote: > > > >>> Apache Hadoop 3.3.5 > > > >>> > > > >>> Mukund and I have put together a release candidate (RC3) for Hadoop > > > >> 3.3.5. > > > >>> > > > >>> What we would like is for anyone who can to verify the tarballs, > > > >> especially > > > >>> anyone who can try the arm64 binaries as we want to include them too. > > > >>> > > > >>> The RC is available at: > > > >>> https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.5-RC3/ > > > >>> > > > >>> The git tag is release-3.3.5-RC3, commit 706d88266ab > > > >>> > > > >>> The maven artifacts are staged at > > > >>> > > > https://repository.apache.org/content/repositories/orgapachehadoop-1369/ > > > >>> > > > >>> You can find my public key at: > > > >>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > > >>> > > > >>> Change log > > > >>> > > > >> > > > > > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.5-RC3/CHANGELOG.md > > > >>> > > > >>> Release notes > > > >>> > > > >> > > > > > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.5-RC3/RELEASENOTES.md > > > >>> > > > >>> This is off branch-3.3 and is the first big release since 3.3.2. > > > >>> > > > >>> Key changes include > > > >>> > > > >>> * Big update of dependencies to try and keep those reports of > > > >>> transitive CVEs under control -both genuine and false positives. > > > >>> * HDFS RBF enhancements > > > >>> * Critical fix to ABFS input stream prefetching for correct reading. > > > >>> * Vectored IO API for all FSDataInputStream implementations, with > > > >>> high-performance versions for file:// and s3a:// filesystems. > > > >>> file:// through java native io > > > >>> s3a:// parallel GET requests. > > > >>> * This release includes Arm64 binaries. Please can anyone with > > > >>> compatible systems validate these. > > > >>> * and compared to the previous RC, all the major changes are > > > >>> HDFS issues. > > > >>> > > > >>> Note, because the arm64 binaries are built separately on a different > > > >>> platform and JVM, their jar files may not match those of the x86 > > > >>> release -and therefore the maven artifacts. I don't think this is > > > >>> an issue (the ASF actually releases source tarballs, the binaries are > > > >>> there for help only, though with the maven repo that's a bit > > blurred). > > > >>> > > > >>> The only way to be consistent would actually untar the x86.tar.gz, > > > >>> overwrite its binaries with the arm stuff, retar, sign and push out > > > >>> for the vote. Even automating that would be risky. > > > >>> > > > >>> Please try the release and vote. The vote will run for 5 days. > > > >>> > > > >>> -Steve > > > >>> > > > >> > > > >> --------------------------------------------------------------------- > > > >> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > > > >> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > > >> > > > >> > > > > > > --------------------------------------------------------------------- > > > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > > > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > > > > > > > > --------------------------------------------------------------------- To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
