Re: [VOTE] Release Apache Hadoop 3.0.2 (RC0)
Hi Lei, Did you have any luck with deploy? Could you please post your findings on https://issues.apache.org/jira/browse/HADOOP-15205 Thanks, --Konstantin On Tue, Apr 10, 2018 at 12:10 PM, Lei Xu wrote: > Ajay, thanks for spotting this. > > I am working on fix the deploy. > > On Tue, Apr 10, 2018 at 8:32 AM, Ajay Kumar > wrote: > > Thanks Lie for working on this. > > > >- Downloaded src tarball and verified checksums > >- Built from src on mac with java 1.8.0_111 > >- Built a pseudo distributed hdfs cluster > >- Run test mr jobs (pi, dfsio,wordcount > >- Verified basic hdfs operations > >- Basic validation for webui > > > > ** I checked maven artifacts and it seems source jars are not there > (checked hadoop-hdfs , hadoop-client). Not sure if they are required for > release. > > > > > > On 4/9/18, 4:19 PM, "Xiao Chen" wrote: > > > > Thanks Eddy for the effort! > > > > +1 (binding) > > > >- Downloaded src tarball and verified checksums > >- Built from src > >- Started a pseudo distributed hdfs cluster > >- Verified basic hdfs operations work > >- Sanity checked logs / webui > > > > Best, > > -Xiao > > > > > > On Mon, Apr 9, 2018 at 11:28 AM, Eric Payne invalid> > > wrote: > > > > > Thanks a lot for working to produce this release. > > > > > > +1 (binding) > > > Tested the following: > > > - built from source and installed on 6-node pseudo-cluster > > > - tested Capacity Scheduler FairOrderingPolicy and > FifoOrderingPolicy to > > > determine that capacity was assigned as expected in each case > > > - tested user weights with FifoOrderingPolicy to ensure that > weights were > > > assigned to users as expected. > > > > > > Eric Payne > > > > > > > > > > > > > > > > > > > > > On Friday, April 6, 2018, 1:17:10 PM CDT, Lei Xu > wrote: > > > > > > > > > > > > > > > > > > Hi, All > > > > > > I've created release candidate RC-0 for Apache Hadoop 3.0.2. > > > > > > Please note: this is an amendment for Apache Hadoop 3.0.1 release > to > > > fix shaded jars in apache maven repository. The codebase of 3.0.2 > > > release is the same as 3.0.1. New bug fixes will be included in > > > Apache Hadoop 3.0.3 instead. > > > > > > The release page is: > > > https://cwiki.apache.org/confluence/display/HADOOP/ > Hadoop+3.0+Release > > > > > > New RC is available at: http://home.apache.org/~lei/ > hadoop-3.0.2-RC0/ > > > > > > The git tag is release-3.0.2-RC0, and the latest commit is > > > 5c141f7c0f24c12cb8704a6ccc1ff8ec991f41ee > > > > > > The maven artifacts are available at > > > https://repository.apache.org/content/repositories/ > orgapachehadoop-1096/ > > > > > > Please try the release, especially, *verify the maven artifacts*, > and vote. > > > > > > The vote will run 5 days, ending 4/11/2018. > > > > > > Thanks for everyone who helped to spot the error and proposed > fixes! > > > > > > > - > > > To unsubscribe, e-mail: mapreduce-dev-unsubscribe@ > hadoop.apache.org > > > For additional commands, e-mail: mapreduce-dev-help@hadoop. > apache.org > > > > > > > > > > - > > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > > > > > > > > > > > > -- > Lei (Eddy) Xu > Software Engineer, Cloudera > > - > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > >
Re: [VOTE] Release Apache Hadoop 3.0.2 (RC0)
Ajay, thanks for spotting this. I am working on fix the deploy. On Tue, Apr 10, 2018 at 8:32 AM, Ajay Kumar wrote: > Thanks Lie for working on this. > >- Downloaded src tarball and verified checksums >- Built from src on mac with java 1.8.0_111 >- Built a pseudo distributed hdfs cluster >- Run test mr jobs (pi, dfsio,wordcount >- Verified basic hdfs operations >- Basic validation for webui > > ** I checked maven artifacts and it seems source jars are not there (checked > hadoop-hdfs , hadoop-client). Not sure if they are required for release. > > > On 4/9/18, 4:19 PM, "Xiao Chen" wrote: > > Thanks Eddy for the effort! > > +1 (binding) > >- Downloaded src tarball and verified checksums >- Built from src >- Started a pseudo distributed hdfs cluster >- Verified basic hdfs operations work >- Sanity checked logs / webui > > Best, > -Xiao > > > On Mon, Apr 9, 2018 at 11:28 AM, Eric Payne > > wrote: > > > Thanks a lot for working to produce this release. > > > > +1 (binding) > > Tested the following: > > - built from source and installed on 6-node pseudo-cluster > > - tested Capacity Scheduler FairOrderingPolicy and FifoOrderingPolicy to > > determine that capacity was assigned as expected in each case > > - tested user weights with FifoOrderingPolicy to ensure that weights > were > > assigned to users as expected. > > > > Eric Payne > > > > > > > > > > > > > > On Friday, April 6, 2018, 1:17:10 PM CDT, Lei Xu > wrote: > > > > > > > > > > > > Hi, All > > > > I've created release candidate RC-0 for Apache Hadoop 3.0.2. > > > > Please note: this is an amendment for Apache Hadoop 3.0.1 release to > > fix shaded jars in apache maven repository. The codebase of 3.0.2 > > release is the same as 3.0.1. New bug fixes will be included in > > Apache Hadoop 3.0.3 instead. > > > > The release page is: > > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release > > > > New RC is available at: http://home.apache.org/~lei/hadoop-3.0.2-RC0/ > > > > The git tag is release-3.0.2-RC0, and the latest commit is > > 5c141f7c0f24c12cb8704a6ccc1ff8ec991f41ee > > > > The maven artifacts are available at > > https://repository.apache.org/content/repositories/orgapachehadoop-1096/ > > > > Please try the release, especially, *verify the maven artifacts*, and > vote. > > > > The vote will run 5 days, ending 4/11/2018. > > > > Thanks for everyone who helped to spot the error and proposed fixes! > > > > - > > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org > > > > > > - > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > > > > -- Lei (Eddy) Xu Software Engineer, Cloudera - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.2 (RC0)
A note to release managers. As discussed in https://issues.apache.org/jira/browse/HADOOP-15205 We are producing release artifacts without sources jars. See e.g. https://repository.apache.org/content/repositories/releases/org/apache/hadoop/hadoop-common/3.0.1/ Based on what is staged on Nexus for 3.0.2 (RC0) I see the next release will not have sources as well. https://repository.apache.org/#stagingRepositories I believe this has something to do with maven deployment stage, potentially maven-source-plugin. This is similar for all releases now, and I believe it should be fixed. Thanks, --Konstantin On Tue, Apr 10, 2018 at 8:32 AM, Ajay Kumar wrote: > Thanks Lie for working on this. > >- Downloaded src tarball and verified checksums >- Built from src on mac with java 1.8.0_111 >- Built a pseudo distributed hdfs cluster >- Run test mr jobs (pi, dfsio,wordcount >- Verified basic hdfs operations >- Basic validation for webui > > ** I checked maven artifacts and it seems source jars are not there > (checked hadoop-hdfs , hadoop-client). Not sure if they are required for > release. > > > On 4/9/18, 4:19 PM, "Xiao Chen" wrote: > > Thanks Eddy for the effort! > > +1 (binding) > >- Downloaded src tarball and verified checksums >- Built from src >- Started a pseudo distributed hdfs cluster >- Verified basic hdfs operations work >- Sanity checked logs / webui > > Best, > -Xiao > > > On Mon, Apr 9, 2018 at 11:28 AM, Eric Payne invalid> > wrote: > > > Thanks a lot for working to produce this release. > > > > +1 (binding) > > Tested the following: > > - built from source and installed on 6-node pseudo-cluster > > - tested Capacity Scheduler FairOrderingPolicy and > FifoOrderingPolicy to > > determine that capacity was assigned as expected in each case > > - tested user weights with FifoOrderingPolicy to ensure that weights > were > > assigned to users as expected. > > > > Eric Payne > > > > > > > > > > > > > > On Friday, April 6, 2018, 1:17:10 PM CDT, Lei Xu > wrote: > > > > > > > > > > > > Hi, All > > > > I've created release candidate RC-0 for Apache Hadoop 3.0.2. > > > > Please note: this is an amendment for Apache Hadoop 3.0.1 release to > > fix shaded jars in apache maven repository. The codebase of 3.0.2 > > release is the same as 3.0.1. New bug fixes will be included in > > Apache Hadoop 3.0.3 instead. > > > > The release page is: > > https://cwiki.apache.org/confluence/display/HADOOP/ > Hadoop+3.0+Release > > > > New RC is available at: http://home.apache.org/~lei/ > hadoop-3.0.2-RC0/ > > > > The git tag is release-3.0.2-RC0, and the latest commit is > > 5c141f7c0f24c12cb8704a6ccc1ff8ec991f41ee > > > > The maven artifacts are available at > > https://repository.apache.org/content/repositories/ > orgapachehadoop-1096/ > > > > Please try the release, especially, *verify the maven artifacts*, > and vote. > > > > The vote will run 5 days, ending 4/11/2018. > > > > Thanks for everyone who helped to spot the error and proposed fixes! > > > > > - > > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: mapreduce-dev-help@hadoop. > apache.org > > > > > > > - > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > > > > > > - > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: common-dev-h...@hadoop.apache.org >
Re: [VOTE] Release Apache Hadoop 3.0.2 (RC0)
Thanks Lie for working on this. - Downloaded src tarball and verified checksums - Built from src on mac with java 1.8.0_111 - Built a pseudo distributed hdfs cluster - Run test mr jobs (pi, dfsio,wordcount - Verified basic hdfs operations - Basic validation for webui ** I checked maven artifacts and it seems source jars are not there (checked hadoop-hdfs , hadoop-client). Not sure if they are required for release. On 4/9/18, 4:19 PM, "Xiao Chen" wrote: Thanks Eddy for the effort! +1 (binding) - Downloaded src tarball and verified checksums - Built from src - Started a pseudo distributed hdfs cluster - Verified basic hdfs operations work - Sanity checked logs / webui Best, -Xiao On Mon, Apr 9, 2018 at 11:28 AM, Eric Payne wrote: > Thanks a lot for working to produce this release. > > +1 (binding) > Tested the following: > - built from source and installed on 6-node pseudo-cluster > - tested Capacity Scheduler FairOrderingPolicy and FifoOrderingPolicy to > determine that capacity was assigned as expected in each case > - tested user weights with FifoOrderingPolicy to ensure that weights were > assigned to users as expected. > > Eric Payne > > > > > > > On Friday, April 6, 2018, 1:17:10 PM CDT, Lei Xu wrote: > > > > > > Hi, All > > I've created release candidate RC-0 for Apache Hadoop 3.0.2. > > Please note: this is an amendment for Apache Hadoop 3.0.1 release to > fix shaded jars in apache maven repository. The codebase of 3.0.2 > release is the same as 3.0.1. New bug fixes will be included in > Apache Hadoop 3.0.3 instead. > > The release page is: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release > > New RC is available at: http://home.apache.org/~lei/hadoop-3.0.2-RC0/ > > The git tag is release-3.0.2-RC0, and the latest commit is > 5c141f7c0f24c12cb8704a6ccc1ff8ec991f41ee > > The maven artifacts are available at > https://repository.apache.org/content/repositories/orgapachehadoop-1096/ > > Please try the release, especially, *verify the maven artifacts*, and vote. > > The vote will run 5 days, ending 4/11/2018. > > Thanks for everyone who helped to spot the error and proposed fixes! > > - > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org > > > - > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.2 (RC0)
Thanks Eddy for the effort! +1 (binding) - Downloaded src tarball and verified checksums - Built from src - Started a pseudo distributed hdfs cluster - Verified basic hdfs operations work - Sanity checked logs / webui Best, -Xiao On Mon, Apr 9, 2018 at 11:28 AM, Eric Payne wrote: > Thanks a lot for working to produce this release. > > +1 (binding) > Tested the following: > - built from source and installed on 6-node pseudo-cluster > - tested Capacity Scheduler FairOrderingPolicy and FifoOrderingPolicy to > determine that capacity was assigned as expected in each case > - tested user weights with FifoOrderingPolicy to ensure that weights were > assigned to users as expected. > > Eric Payne > > > > > > > On Friday, April 6, 2018, 1:17:10 PM CDT, Lei Xu wrote: > > > > > > Hi, All > > I've created release candidate RC-0 for Apache Hadoop 3.0.2. > > Please note: this is an amendment for Apache Hadoop 3.0.1 release to > fix shaded jars in apache maven repository. The codebase of 3.0.2 > release is the same as 3.0.1. New bug fixes will be included in > Apache Hadoop 3.0.3 instead. > > The release page is: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release > > New RC is available at: http://home.apache.org/~lei/hadoop-3.0.2-RC0/ > > The git tag is release-3.0.2-RC0, and the latest commit is > 5c141f7c0f24c12cb8704a6ccc1ff8ec991f41ee > > The maven artifacts are available at > https://repository.apache.org/content/repositories/orgapachehadoop-1096/ > > Please try the release, especially, *verify the maven artifacts*, and vote. > > The vote will run 5 days, ending 4/11/2018. > > Thanks for everyone who helped to spot the error and proposed fixes! > > - > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org > > > - > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > >
Re: [VOTE] Release Apache Hadoop 3.0.2 (RC0)
Thanks a lot for working to produce this release. +1 (binding) Tested the following: - built from source and installed on 6-node pseudo-cluster - tested Capacity Scheduler FairOrderingPolicy and FifoOrderingPolicy to determine that capacity was assigned as expected in each case - tested user weights with FifoOrderingPolicy to ensure that weights were assigned to users as expected. Eric Payne On Friday, April 6, 2018, 1:17:10 PM CDT, Lei Xu wrote: Hi, All I've created release candidate RC-0 for Apache Hadoop 3.0.2. Please note: this is an amendment for Apache Hadoop 3.0.1 release to fix shaded jars in apache maven repository. The codebase of 3.0.2 release is the same as 3.0.1. New bug fixes will be included in Apache Hadoop 3.0.3 instead. The release page is: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release New RC is available at: http://home.apache.org/~lei/hadoop-3.0.2-RC0/ The git tag is release-3.0.2-RC0, and the latest commit is 5c141f7c0f24c12cb8704a6ccc1ff8ec991f41ee The maven artifacts are available at https://repository.apache.org/content/repositories/orgapachehadoop-1096/ Please try the release, especially, *verify the maven artifacts*, and vote. The vote will run 5 days, ending 4/11/2018. Thanks for everyone who helped to spot the error and proposed fixes! - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.2 (RC0)
Thanks Lei for working on this! +1 (non-binding) - Downloaded the binary tarball and verified the checksum. - Started a pseudo cluster inside one docker container - Run Resource Manager with Fair Scheduler - Verified distributed shell - Verified mapreduce pi job - Sanity checked RM WebUI Best, Yufei On Fri, Apr 6, 2018 at 11:16 AM, Lei Xu wrote: > Hi, All > > I've created release candidate RC-0 for Apache Hadoop 3.0.2. > > Please note: this is an amendment for Apache Hadoop 3.0.1 release to > fix shaded jars in apache maven repository. The codebase of 3.0.2 > release is the same as 3.0.1. New bug fixes will be included in > Apache Hadoop 3.0.3 instead. > > The release page is: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release > > New RC is available at: http://home.apache.org/~lei/hadoop-3.0.2-RC0/ > > The git tag is release-3.0.2-RC0, and the latest commit is > 5c141f7c0f24c12cb8704a6ccc1ff8ec991f41ee > > The maven artifacts are available at > https://repository.apache.org/content/repositories/orgapachehadoop-1096/ > > Please try the release, especially, *verify the maven artifacts*, and vote. > > The vote will run 5 days, ending 4/11/2018. > > Thanks for everyone who helped to spot the error and proposed fixes! > > - > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > >
