Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Includes these additional votings we got 5 binding votings, and 12 non-binding votings, we have many others like Bibin/Akhil gave offline suggestions and testing results. Thanks everyone for your help! I've done most of staging/pushing works for the 3.1.1 release. Given Apache mirrors will take some time to finish syncing tasks, I plan to send out the release announcement by Thu noon PDT time. If there anything wanna to highlight for the announcement of 3.1.1, please let me know by Thu 10 AM PDT. Thanks again for your help of the release! Best, Wangda On Tue, Aug 7, 2018 at 7:57 PM Chandni Singh wrote: > Thanks Wangda! > > +1 (non-binding) > > Tested the following: > - Built from source and ran a single node cluster > - Ran the example pi job > - Launched yarn service sleep example > - Verified upgrade of yarn service sleep > > Thanks, > Chandni > > > On Tue, Aug 7, 2018 at 7:02 PM Suma Shivaprasad < > sumasai.shivapra...@gmail.com> wrote: > >> Thanks Wangda! >> >> +1 (non-binding) >> >> Tested the following: >> - Built from source >> - Setup single node cluster >> - Tested Dynamic queues >> - Tested MR and DS with default, docker runtime >> - Tested Yarn Services with various restart policies >> >> Thanks >> Suma >> >> >> On Tue, Aug 7, 2018 at 2:45 PM Eric Payne > .invalid> >> wrote: >> >> > Thanks Wangda for creating this release. >> > >> > +1 (binding) >> > Tested: >> > - Built from source >> > - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with >> > hierarchical queue structure (CS) >> > - Refreshed queue (CS) properties >> > - Intra-queue preemption (CS) >> > - inter-queue preemption (CS) >> > - User weights (CS) >> > >> > Issues: >> > - Inter-queue preemption seems to be preempting unnecessarily (flapping) >> > when the queue balancing feature is enabled. This does not seem to be >> > specific to this release. >> > - The preemption-to-balance-queue-after-satisfied.enabled property seems >> > to always be enabled, but again, that is not specific to this release. >> > >> > >> > Eric >> > >> > >> > On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan < >> > wheele...@gmail.com> wrote: >> > >> > >> > >> > >> > >> > Hi folks, >> > >> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available >> here: >> > >> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/ >> > >> > The RC tag in git is release-3.1.1-RC0: >> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0 >> > >> > The maven artifacts are available via repository.apache.org at >> > >> https://repository.apache.org/content/repositories/orgapachehadoop-1139/ >> > >> > You can find my public key at >> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS >> > >> > This vote will run 5 days from now. >> > >> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0. >> > >> > I have done testing with a pseudo cluster and distributed shell job. My >> +1 >> > to start. >> > >> > Best, >> > Wangda Tan >> > >> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1) >> > ORDER BY priority DESC >> > >> > - >> > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org >> > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org >> > >> > >> >
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Thanks Wangda! +1 (non-binding) Tested the following: - Built from source and ran a single node cluster - Ran the example pi job - Launched yarn service sleep example - Verified upgrade of yarn service sleep Thanks, Chandni On Tue, Aug 7, 2018 at 7:02 PM Suma Shivaprasad < sumasai.shivapra...@gmail.com> wrote: > Thanks Wangda! > > +1 (non-binding) > > Tested the following: > - Built from source > - Setup single node cluster > - Tested Dynamic queues > - Tested MR and DS with default, docker runtime > - Tested Yarn Services with various restart policies > > Thanks > Suma > > > On Tue, Aug 7, 2018 at 2:45 PM Eric Payne > wrote: > > > Thanks Wangda for creating this release. > > > > +1 (binding) > > Tested: > > - Built from source > > - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with > > hierarchical queue structure (CS) > > - Refreshed queue (CS) properties > > - Intra-queue preemption (CS) > > - inter-queue preemption (CS) > > - User weights (CS) > > > > Issues: > > - Inter-queue preemption seems to be preempting unnecessarily (flapping) > > when the queue balancing feature is enabled. This does not seem to be > > specific to this release. > > - The preemption-to-balance-queue-after-satisfied.enabled property seems > > to always be enabled, but again, that is not specific to this release. > > > > > > Eric > > > > > > On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan < > > wheele...@gmail.com> wrote: > > > > > > > > > > > > Hi folks, > > > > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available > here: > > > > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/ > > > > The RC tag in git is release-3.1.1-RC0: > > https://github.com/apache/hadoop/commits/release-3.1.1-RC0 > > > > The maven artifacts are available via repository.apache.org at > > https://repository.apache.org/content/repositories/orgapachehadoop-1139/ > > > > You can find my public key at > > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS > > > > This vote will run 5 days from now. > > > > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0. > > > > I have done testing with a pseudo cluster and distributed shell job. My > +1 > > to start. > > > > Best, > > Wangda Tan > > > > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1) > > ORDER BY priority DESC > > > > - > > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > > > > >
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Thanks Wangda! +1 (non-binding) Tested the following: - Built from source - Setup single node cluster - Tested Dynamic queues - Tested MR and DS with default, docker runtime - Tested Yarn Services with various restart policies Thanks Suma On Tue, Aug 7, 2018 at 2:45 PM Eric Payne wrote: > Thanks Wangda for creating this release. > > +1 (binding) > Tested: > - Built from source > - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with > hierarchical queue structure (CS) > - Refreshed queue (CS) properties > - Intra-queue preemption (CS) > - inter-queue preemption (CS) > - User weights (CS) > > Issues: > - Inter-queue preemption seems to be preempting unnecessarily (flapping) > when the queue balancing feature is enabled. This does not seem to be > specific to this release. > - The preemption-to-balance-queue-after-satisfied.enabled property seems > to always be enabled, but again, that is not specific to this release. > > > Eric > > > On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan < > wheele...@gmail.com> wrote: > > > > > > Hi folks, > > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here: > > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/ > > The RC tag in git is release-3.1.1-RC0: > https://github.com/apache/hadoop/commits/release-3.1.1-RC0 > > The maven artifacts are available via repository.apache.org at > https://repository.apache.org/content/repositories/orgapachehadoop-1139/ > > You can find my public key at > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS > > This vote will run 5 days from now. > > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0. > > I have done testing with a pseudo cluster and distributed shell job. My +1 > to start. > > Best, > Wangda Tan > > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1) > ORDER BY priority DESC > > - > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > >
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Thanks Wangda for creating this release. +1 (binding) Tested: - Built from source - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with hierarchical queue structure (CS) - Refreshed queue (CS) properties - Intra-queue preemption (CS) - inter-queue preemption (CS) - User weights (CS) Issues: - Inter-queue preemption seems to be preempting unnecessarily (flapping) when the queue balancing feature is enabled. This does not seem to be specific to this release. - The preemption-to-balance-queue-after-satisfied.enabled property seems to always be enabled, but again, that is not specific to this release. Eric On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan wrote: Hi folks, I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here: http://people.apache.org/~wangda/hadoop-3.1.1-RC0/ The RC tag in git is release-3.1.1-RC0: https://github.com/apache/hadoop/commits/release-3.1.1-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1139/ You can find my public key at http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS This vote will run 5 days from now. 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0. I have done testing with a pseudo cluster and distributed shell job. My +1 to start. Best, Wangda Tan [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1) ORDER BY priority DESC - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Thanks everyone for voting! With 4 binding votes, 10 non-binding votes and no veto. The vote passed, I'm going to work on staging the release. Best, Wangda On Tue, Aug 7, 2018 at 12:33 PM Nandakumar Vadivelu < nvadiv...@hortonworks.com> wrote: > Thanks for all the hard work Wangda! > +1 > > * Verified pgp signatures > * Verified MD5 checksums > * Verified both source and binary releases > * Installed pseudo distributed cluster > * Verified hdfs filesystem commands > * Verified hdfs admin commands > * Verified hdfs snapshot commands > * Basic sanity check on NN UI > > Issue found > * In "Browse the file system" under "Utilities" tab in NN UI, "Head the > file" and "Tail the file" are not working. > > -Nanda > > On 8/3/18, 12:14 AM, "Wangda Tan" wrote: > > Hi folks, > > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available > here: > > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/ > > The RC tag in git is release-3.1.1-RC0: > https://github.com/apache/hadoop/commits/release-3.1.1-RC0 > > The maven artifacts are available via repository.apache.org at > > https://repository.apache.org/content/repositories/orgapachehadoop-1139/ > > You can find my public key at > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS > > This vote will run 5 days from now. > > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0. > > I have done testing with a pseudo cluster and distributed shell job. > My +1 > to start. > > Best, > Wangda Tan > > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in > (3.1.1) > ORDER BY priority DESC > > >
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
+1 (binding) - Thanks for putting this together Wangda. - Built from source - Deployed a single node cluster on CentOS 7.4 - Basic dfs command checkout - Ran dshell, MR pi, and MR sleep with the default and docker runtimes - Validated the ability to disable the docker runtime - Validated the ability to disable privileged docker containers - Successfully launched a docker based YARN service - Validated basic lookups against Registry DNS -Shane On Thu, Aug 2, 2018 at 12:44 PM Wangda Tan wrote: > Hi folks, > > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here: > > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/ > > The RC tag in git is release-3.1.1-RC0: > https://github.com/apache/hadoop/commits/release-3.1.1-RC0 > > The maven artifacts are available via repository.apache.org at > https://repository.apache.org/content/repositories/orgapachehadoop-1139/ > > You can find my public key at > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS > > This vote will run 5 days from now. > > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0. > > I have done testing with a pseudo cluster and distributed shell job. My +1 > to start. > > Best, > Wangda Tan > > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1) > ORDER BY priority DESC >
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
+1 (non-binding). Built from tag, spun up single-node cluster, ran basic DFS commands, various MR / YARN jobs with and without Docker. Craig Condit On 2018/08/02 18:43:50, Wangda Tan mailto:w...@gmail.com>> wrote: > Hi folks,> > > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:> > > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/> > > The RC tag in git is release-3.1.1-RC0:> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0> > > The maven artifacts are available via repository.apache.org at> > https://repository.apache.org/content/repositories/orgapachehadoop-1139/> > > You can find my public key at> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS> > > This vote will run 5 days from now.> > > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.> > > I have done testing with a pseudo cluster and distributed shell job. My +1> > to start.> > > Best,> > Wangda Tan> > > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)> > ORDER BY priority DESC> >
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
+1 ,(binding). Wangda Tan thanks for driving this. --Built with source. --Installed the HA cluster --Ran basic hdfs operations through shell/API --Ran Sample jobs like pi, wordcount --Browsed UI. On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan wrote: > Hi folks, > > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here: > > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/ > > The RC tag in git is release-3.1.1-RC0: > https://github.com/apache/hadoop/commits/release-3.1.1-RC0 > > The maven artifacts are available via repository.apache.org at > https://repository.apache.org/content/repositories/orgapachehadoop-1139/ > > You can find my public key at > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS > > This vote will run 5 days from now. > > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0. > > I have done testing with a pseudo cluster and distributed shell job. My +1 > to start. > > Best, > Wangda Tan > > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1) > ORDER BY priority DESC >
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.13.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs On Tue, Aug 7, 2018 at 8:46 AM, Shashikant Banerjee < sbaner...@hortonworks.com> wrote: > +1(non-binding) > > * checked out git tag release-3.1.1-RC0 > * built from source > * deployed on a single node cluster > * executed basic dfs commands > * executed some snapshot commands > > Thank you very much the work Wangda. > > Thanks > Shashi > > On 8/7/18, 6:43 PM, "Elek, Marton" wrote: > > > +1 (non-binding) > > 1. Built from the source package. > 2. Checked the signature > 3. Started docker based pseudo cluster and smoketested some basic > functionality (hdfs cli, ec cli, viewfs, yarn examples, spark word > count > job) > > Thank you very much the work Wangda. > Marton > > > On 08/02/2018 08:43 PM, Wangda Tan wrote: > > Hi folks, > > > > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are > available here: > > > > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/ > > > > The RC tag in git is release-3.1.1-RC0: > > https://github.com/apache/hadoop/commits/release-3.1.1-RC0 > > > > The maven artifacts are available via repository.apache.org at > > https://repository.apache.org/content/repositories/ > orgapachehadoop-1139/ > > > > You can find my public key at > > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS > > > > This vote will run 5 days from now. > > > > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0. > > > > I have done testing with a pseudo cluster and distributed shell job. > My +1 > > to start. > > > > Best, > > Wangda Tan > > > > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in > (3.1.1) > > ORDER BY priority DESC > > > > - > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > > > - > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > >
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
+1 (non-binding) 1. Built from the source package. 2. Checked the signature 3. Started docker based pseudo cluster and smoketested some basic functionality (hdfs cli, ec cli, viewfs, yarn examples, spark word count job) Thank you very much the work Wangda. Marton On 08/02/2018 08:43 PM, Wangda Tan wrote: Hi folks, I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here: http://people.apache.org/~wangda/hadoop-3.1.1-RC0/ The RC tag in git is release-3.1.1-RC0: https://github.com/apache/hadoop/commits/release-3.1.1-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1139/ You can find my public key at http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS This vote will run 5 days from now. 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0. I have done testing with a pseudo cluster and distributed shell job. My +1 to start. Best, Wangda Tan [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1) ORDER BY priority DESC - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Thanks Wangda for the initiative. +1 for this RC. I have tested this RC built from source file. - Also ran few MR apps and verified both new YARN UI and old RM UI. - Tested Application priority and timeout - Inter Queue and Intra Queue Preemption cases were also verified - Tested basic placement constraints with DS. - Tested NodeLabel scenarios. - Tested new YARN UI with ATS v2 - Sunil On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan wrote: > Hi folks, > > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here: > > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/ > > The RC tag in git is release-3.1.1-RC0: > https://github.com/apache/hadoop/commits/release-3.1.1-RC0 > > The maven artifacts are available via repository.apache.org at > https://repository.apache.org/content/repositories/orgapachehadoop-1139/ > > You can find my public key at > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS > > This vote will run 5 days from now. > > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0. > > I have done testing with a pseudo cluster and distributed shell job. My +1 > to start. > > Best, > Wangda Tan > > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1) > ORDER BY priority DESC >
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
+1 (binding) - Built from source and deployed 2 node RM HA non-secure cluster - ATSv2 enabled for profile hbase.profile=2.0. Enabled both ats 1.5 and 2.0. - Ran sample MR and DS applications - Verified for RM HA, Work preserving restart, NM work preserving restart. - Verified jobs for application priority and application timeout. - Accessed UI2 for all web pages. Verified for UI2+ATSv2 integration web pages. -Rohith Sharma K S On Fri, 3 Aug 2018 at 00:14, Wangda Tan wrote: > Hi folks, > > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here: > > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/ > > The RC tag in git is release-3.1.1-RC0: > https://github.com/apache/hadoop/commits/release-3.1.1-RC0 > > The maven artifacts are available via repository.apache.org at > https://repository.apache.org/content/repositories/orgapachehadoop-1139/ > > You can find my public key at > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS > > This vote will run 5 days from now. > > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0. > > I have done testing with a pseudo cluster and distributed shell job. My +1 > to start. > > Best, > Wangda Tan > > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1) > ORDER BY priority DESC >
