+1 (binding) - Deployed a cluster with 3 NNs, 3 RMs and 1 DN/NM on Azure - Tested the Active probe for the Load Balancer in front of the NNs and the RMs - Checked the NN, RBF, and RM Web UIs - Executed a TeraGen, TeraSort and TeraValidate - Executed a YARN service with a TensorFlow app on Docker - Scaled up the cluster to 5 DNs/NMs and executed the tests again - Checked the HDFS output folders through the Web UI
On Tue, Jan 15, 2019 at 9:05 AM Wangda Tan <wheele...@gmail.com> wrote: > +1 (Binding). > > Deployed a local cluster from binary, and ran some sample sanity jobs. > > Thanks Sunil for driving the release. > > Best, > Wangda > > > On Mon, Jan 14, 2019 at 11:26 AM Virajith Jalaparti <virajit...@gmail.com> > wrote: > > > Thanks Sunil and others who have worked on the making this release > happen! > > > > +1 (non-binding) > > > > - Built from source > > - Deployed a pseudo-distributed one node cluster > > - Ran basic wordcount, sort, pi jobs > > - Basic HDFS/WebHDFS commands > > - Ran all the ABFS driver tests against an ADLS Gen 2 account in EAST US > > > > Non-blockers (AFAICT): The following tests in ABFS (HADOOP-15407) fail: > > - For ACLs ({{ITestAzureBlobFilesystemAcl}}) -- However, I believe these > > have been fixed in trunk. > > - {{ > > ITestAzureBlobFileSystemE2EScale#testWriteHeavyBytesToFileAcrossThreads}} > > fails with an OutOfMemoryError exception. I see the same failure on trunk > > as well. > > > > > > On Mon, Jan 14, 2019 at 6:21 AM Elek, Marton <e...@apache.org> wrote: > > > >> Thanks Sunil to manage this release. > >> > >> +1 (non-binding) > >> > >> 1. built from the source (with clean local maven repo) > >> 2. verified signatures + checksum > >> 3. deployed 3 node cluster to Google Kubernetes Engine with generated > >> k8s resources [1] > >> 4. Executed basic HDFS commands > >> 5. Executed basic yarn example jobs > >> > >> Marton > >> > >> [1]: FTR: resources: > >> https://github.com/flokkr/k8s/tree/master/examples/hadoop , generator: > >> https://github.com/elek/flekszible > >> > >> > >> On 1/8/19 12:42 PM, Sunil G wrote: > >> > Hi folks, > >> > > >> > > >> > Thanks to all of you who helped in this release [1] and for helping to > >> vote > >> > for RC0. I have created second release candidate (RC1) for Apache > Hadoop > >> > 3.2.0. > >> > > >> > > >> > Artifacts for this RC are available here: > >> > > >> > http://home.apache.org/~sunilg/hadoop-3.2.0-RC1/ > >> > > >> > > >> > RC tag in git is release-3.2.0-RC1. > >> > > >> > > >> > > >> > The maven artifacts are available via repository.apache.org at > >> > > >> > https://repository.apache.org/content/repositories/orgapachehadoop-1178/ > >> > > >> > > >> > This vote will run 7 days (5 weekdays), ending on 14th Jan at 11:59 pm > >> PST. > >> > > >> > > >> > > >> > 3.2.0 contains 1092 [2] fixed JIRA issues since 3.1.0. Below feature > >> > additions > >> > > >> > are the highlights of this release. > >> > > >> > 1. Node Attributes Support in YARN > >> > > >> > 2. Hadoop Submarine project for running Deep Learning workloads on > YARN > >> > > >> > 3. Support service upgrade via YARN Service API and CLI > >> > > >> > 4. HDFS Storage Policy Satisfier > >> > > >> > 5. Support Windows Azure Storage - Blob file system in Hadoop > >> > > >> > 6. Phase 3 improvements for S3Guard and Phase 5 improvements S3a > >> > > >> > 7. Improvements in Router-based HDFS federation > >> > > >> > > >> > > >> > Thanks to Wangda, Vinod, Marton for helping me in preparing the > release. > >> > > >> > I have done few testing with my pseudo cluster. My +1 to start. > >> > > >> > > >> > > >> > Regards, > >> > > >> > Sunil > >> > > >> > > >> > > >> > [1] > >> > > >> > > >> > https://lists.apache.org/thread.html/68c1745dcb65602aecce6f7e6b7f0af3d974b1bf0048e7823e58b06f@%3Cyarn-dev.hadoop.apache.org%3E > >> > > >> > [2] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in > (3.2.0) > >> > AND fixVersion not in (3.1.0, 3.0.0, 3.0.0-beta1) AND status = > Resolved > >> > ORDER BY fixVersion ASC > >> > > >> > >> --------------------------------------------------------------------- > >> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > >> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > >> > >> >