Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Hi, All Thanks Arpit to find that 3.0.1 artifacts missed shaded jars. I will create a new 3.0.2 release with the same codebase as 3.0.1, but deploy it as shaded jars. A new vote thread will start later this week. After that, 3.0.3 release will be cut from branch-3.0 and includes the new bug

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Thanks Arpit for reporting this and helping investigate the issue offline! I follow the same tutorial so the previously RC1 maven repo has the same issue. Just deployed jars by removing -DskipShade and shaded jars have correct sizes. Will post an update to RC1 voting thread. - Wangda On Mon,

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Hi, Arpit I followed this instruction https://wiki.apache.org/hadoop/HowToRelease It instructs to use "mvn deploy -Psign -DskipTests -DskipShade". It seems wrong, given that 3.0.0 is a shaded jar. I will do another deploy to fix it. On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Hi Lei, It looks like the release artefacts have dummy shaded jars. E.g. Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar Uploaded by: lei Size: 44.47 KB Uploaded Date:Fri Mar 16 2018 15:50:42 GMT-0700 (PDT) Last Modified:

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Hi, All Thanks everyone for voting! The vote passes successfully with 6 binding +1s, 7 non-binding +1s and no -1s. I will work on the staging and releases. Best, On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla wrote: > +1 (non-binding) > > Built from source. >

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

+1 (non-binding) Built from source. Installed on a pseudo distributed cluster. Ran word count job and basic hdfs commands. Thank you for the effort on this release. Regards, Kuhu On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton wrote: > > +1 (non binding) > > I did a full build

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

+1 (non binding) I did a full build from source code, created a docker container and did various basic level tests with robotframework based automation and docker-compose based pseudo clusters[1]. Including: * Hdfs federation smoke test * Basic ViewFS configuration * Yarn example jobs *

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

+1 (binding) - verified signatures and checksums - built from source and setup 4 node cluster - ran some examples jobs - verified some HDFS operations Thanks, Akira On 2018/03/22 10:08, Robert Kanter wrote: +1 (binding) - verified signatures and checksums - setup pseudo cluster using Fair

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

+1 (binding) - verified signatures and checksums - setup pseudo cluster using Fair Scheduler from binary tarball - ran some of the example jobs, clicked around the UI a bit By the way, ASF recommends using a 4096 bit key for signing, though 2048 is fine for now.

RE: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Thanks Lei Xu for driving this. +1(binding) --Built from the source --Installed the HA Cluster --Verified hdfs operations --Ran sample jobs --Verified the UI's --Brahma Reddy Battula -Original Message- From: Lei Xu [mailto:l...@apache.org] Sent: 18 March 2018 12:11 To: Hadoop

RE: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Payne <erichadoo...@yahoo.com.invalid>; Hadoop Common <common-...@hadoop.apache.org>; Hdfs-dev <hdfs-...@hadoop.apache.org>; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; Lei Xu <l...@apache.org> Subject: Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1) Thanks

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Thanks Eddy! +1 (non-binding) - Downloaded the hadoop-3.0.1.tar.gz from http://home.apache.org/~lei/hadoop-3.0.1-RC1/ - Started a pseudo cluster inside one docker container - Verified distributed shell - Verified mapreduce pi job - Sanity check RM WebUI Best, Yufei On Tue, Mar

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Thanks for working on this release! +1 (binding) I tested the following: - yarn distributed shell job - yarn streaming job - inter-queue preemption - compared behavior of fair and fifo ordering policy - both userlimit_first mode and priority_first mode of intra-queue preemption Eric Payne

RE: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Thanks Eddy for driving 3.0.1 release. I'm testing the release and will vote later. One thing I noticed that the JIRA links on page https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release is linked to the page itself, not the individual JIRA. I'm not sure if it's the design.

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Thanks Eddy for the effort! +1 (binding) - Downloaded src tarball and verified checksums - Built from src - Started a pseudo distributed hdfs cluster - Verified basic hdfs operations work - Verified hdfs encryption basic operations work - Sanity checked logs / webui -Xiao On

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Sure, Akira .mds files are uploaded to http://home.apache.org/~lei/hadoop-3.0.1-RC1/ On Sun, Mar 18, 2018 at 6:04 PM, Akira Ajisaka wrote: > Hi Lei, > > Would you provide SHA checksum files instead of MD5? >

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Hi Lei, Would you provide SHA checksum files instead of MD5? http://www.apache.org/dev/release-distribution#sigs-and-sums -Akira On 2018/03/18 13:11, Lei Xu wrote: Hi, all I've created release candidate RC-1 for Apache Hadoop 3.0.1 Apache Hadoop 3.0.1 will be the first bug fix release for