Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Hi, All Thanks Arpit to find that 3.0.1 artifacts missed shaded jars. I will create a new 3.0.2 release with the same codebase as 3.0.1, but deploy it as shaded jars. A new vote thread will start later this week. After that, 3.0.3 release will be cut from branch-3.0 and includes the new bug

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Thanks Arpit for reporting this and helping investigate the issue offline! I follow the same tutorial so the previously RC1 maven repo has the same issue. Just deployed jars by removing -DskipShade and shaded jars have correct sizes. Will post an update to RC1 voting thread. - Wangda On Mon,

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Hi, Arpit I followed this instruction https://wiki.apache.org/hadoop/HowToRelease It instructs to use "mvn deploy -Psign -DskipTests -DskipShade". It seems wrong, given that 3.0.0 is a shaded jar. I will do another deploy to fix it. On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Hi Lei, It looks like the release artefacts have dummy shaded jars. E.g. Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar Uploaded by: lei Size: 44.47 KB Uploaded Date:Fri Mar 16 2018 15:50:42 GMT-0700 (PDT) Last Modified:

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Hi, All Thanks everyone for voting! The vote passes successfully with 6 binding +1s, 7 non-binding +1s and no -1s. I will work on the staging and releases. Best, On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla wrote: > +1 (non-binding) > > Built from source. >

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

A belated +1, (binding) - ran the hadoop-aws tests with s3guard on and authoritative against s3 ireland - ran the hadoop-azure tests against azure ireland, saw one error which looks like an overloaded client (https://issues.apache.org/jira/browse/HADOOP-15341) +

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

+1 (non-binding) Built from source. Installed on a pseudo distributed cluster. Ran word count job and basic hdfs commands. Thank you for the effort on this release. Regards, Kuhu On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton wrote: > > +1 (non binding) > > I did a full build

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

+1 (non binding) I did a full build from source code, created a docker container and did various basic level tests with robotframework based automation and docker-compose based pseudo clusters[1]. Including: * Hdfs federation smoke test * Basic ViewFS configuration * Yarn example jobs *

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

+1 (non-binding) 1. verified md5 checksum. 2. Built from source and deployed a 5 node cluster. 3. Ran few basic commands of hdfs operations. 4. Deployed a federated cluster (2 namenodes) and ran few hdfs basic commands 5. Checked NN web UI. Thanks, Bharat On 3/22/18, 10:02 AM, "Ajay Kumar"

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

gt; --Verified the UI's >> >> >> >> --Brahma Reddy Battula >> >> >> -Original Message- >> From: Lei Xu [mailto:l...@apache.org] >> Sent: 18 March 2018 12:11 >> To: Hadoop Common <common-dev@hadoop.

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

ilto:l...@apache.org] Sent: 18 March 2018 12:11 To: Hadoop Common <common-dev@hadoop.apache.org>; Hdfs-dev < hdfs-...@hadoop.apache.org>; mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: [VOTE] Release Apache Hadoop 3.0.1 (RC1) Hi, all I've created release candida

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

< > hdfs-...@hadoop.apache.org>; mapreduce-...@hadoop.apache.org; > yarn-...@hadoop.apache.org > Subject: [VOTE] Release Apache Hadoop 3.0.1 (RC1) > > Hi, all > > I've created release candidate RC-1 for Apache Hadoop 3.0.1 > > Apache Hadoop 3.0.1 will be the first bug f

RE: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Common <common-dev@hadoop.apache.org>; Hdfs-dev <hdfs-...@hadoop.apache.org>; mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: [VOTE] Release Apache Hadoop 3.0.1 (RC1) Hi, all I've created release candidate RC-1 for Apache Hadoop 3.0.1 Apache Hadoop 3.0.1 will be t

RE: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Payne <erichadoo...@yahoo.com.invalid>; Hadoop Common <common-dev@hadoop.apache.org>; Hdfs-dev <hdfs-...@hadoop.apache.org>; mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org; Lei Xu <l...@apache.org> Subject: Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1) Thanks

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Thanks for working on this Eddy! +1 (non-binding) I've done the following: - checked out git tag release-3.0.1-RC1 - built from source on Mac OS X 10.13.3, openjdk 1.8.0_144 (zulu) - deployed on a 3 node cluster (HDFS HA, Non-HA YARN) - verified example pi job - ran teragen,

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Thanks Eddy! +1 (non-binding) - Downloaded the hadoop-3.0.1.tar.gz from http://home.apache.org/~lei/hadoop-3.0.1-RC1/ - Started a pseudo cluster inside one docker container - Verified distributed shell - Verified mapreduce pi job - Sanity check RM WebUI Best, Yufei On Tue, Mar

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Thanks for working on this release! +1 (binding) I tested the following: - yarn distributed shell job - yarn streaming job - inter-queue preemption - compared behavior of fair and fifo ordering policy - both userlimit_first mode and priority_first mode of intra-queue preemption Eric Payne

RE: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

OTE] Release Apache Hadoop 3.0.1 (RC1) Hi, all I've created release candidate RC-1 for Apache Hadoop 3.0.1 Apache Hadoop 3.0.1 will be the first bug fix release for Apache Hadoop 3.0 release. It includes 49 bug fixes and security fixes, which include 12 blockers and 17 are critical. Please note:

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Is this off the branch-3.0 branch (where've backported some things)? if so, I'm very supportive. Not in a position to do any testing until thursday though > On 18 Mar 2018, at 05:11, Lei Xu wrote: > > Hi, all > > I've created release candidate RC-1 for Apache Hadoop 3.0.1 >

RE: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

ache.org>; Hdfs-dev <hdfs-...@hadoop.apache.org>; mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1) Thanks Eddy for the effort! +1 (binding) - Downloaded src tarball and verified checksums - Built from src - Started a pseudo dist

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Thanks Eddy for the effort! +1 (binding) - Downloaded src tarball and verified checksums - Built from src - Started a pseudo distributed hdfs cluster - Verified basic hdfs operations work - Verified hdfs encryption basic operations work - Sanity checked logs / webui -Xiao On

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Sure, Akira .mds files are uploaded to http://home.apache.org/~lei/hadoop-3.0.1-RC1/ On Sun, Mar 18, 2018 at 6:04 PM, Akira Ajisaka wrote: > Hi Lei, > > Would you provide SHA checksum files instead of MD5? >

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Hi Lei, Would you provide SHA checksum files instead of MD5? http://www.apache.org/dev/release-distribution#sigs-and-sums -Akira On 2018/03/18 13:11, Lei Xu wrote: Hi, all I've created release candidate RC-1 for Apache Hadoop 3.0.1 Apache Hadoop 3.0.1 will be the first bug fix release for

[VOTE] Release Apache Hadoop 3.0.1 (RC1)

Hi, all I've created release candidate RC-1 for Apache Hadoop 3.0.1 Apache Hadoop 3.0.1 will be the first bug fix release for Apache Hadoop 3.0 release. It includes 49 bug fixes and security fixes, which include 12 blockers and 17 are critical. Please note: * HDFS-12990. Change default NameNode