Re: [RESULT] [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks Konstantin, great work! On Sat, Aug 5, 2017 at 1:36 PM Konstantin Shvachko wrote: > My formal vote > +1 (binding) > > I am glad to summarize that > with 7 binding and 13 non-binding +1s and no -1s the vote for Apache > Release 2.7.4 passes. > Thank you everybody for

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (binding) Looked through the src tarball. Checksum and signature match, skimmed NOTICE/LICENSE, ran some unit tests. -C On Sat, Jul 29, 2017 at 4:29 PM, Konstantin Shvachko wrote: > Hi everybody, > > Here is the next release of Apache Hadoop 2.7 line. The previous

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi Wei-Chi, There is bunch of performance jiras in Hadoop. This one is not marked as blocker and seems to be hard to reproduce. And I see that you are still discussing the problem and the solution with Daryn in the jira. I don't think it should block the release. If this or anything else will

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi, I'm sorry coming to this vote late. Daryn mentioned in HDFS-12136 that HDFS-11160 has a performance regression at DataNode due to the way it locks dataset lock. HDFS-11160 is in Hadoop 2.7.4.

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (binding) - Verified the checksum and the signature of the source tarball - Built from source with CentOS 7.2 and OpenJDK 1.8.0_141 - Built Hive 2.1.0/2.3.0 and Tez 0.8.5/0.9.0 with Hadoop 2.7.4 artifacts - Built single node cluster and ran some Hive on Tez queries successfully Regards,

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (non-binding) 1. Verified signatures and digests. 2. Built source. 3. Installed on a pseudo-distributed cluster. 4. Ran sample MR jobs and Tez example jobs like orderedwordcount successfully. Thank you Konstantin and others for this release. Regards, Kuhu On Thursday, August 3, 2017,

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks Konstantin +1 (binding) 1. Build tar ball from source package 2. Ran basic MR jobs and verified UI. 3. Enabled node labels and ran sleep job. Works fine. 4. Verified CLI commands related to node labels and its working fine. 5. RM WorkPreserving restart cases are also verified, and looks

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks! I'll check whether Apache Hive and Tez can be built with the artiacts. -Akira On 2017/08/03 16:34, Konstantin Shvachko wrote: Hi Akira, The artifacts are on Nexus in Staging Repositories: https://repository.apache.org/#stagingRepositories or

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi Akira, The artifacts are on Nexus in Staging Repositories: https://repository.apache.org/#stagingRepositories or https://repository.apache.org/content/repositories/orgapachehadoop-1061/ They are not released yet, which happens once the release is approved. See in Publishing section #5

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks Konstantin for the work! I have a question: Where are the maven artifacts deployed? -Akira On 2017/07/30 8:29, Konstantin Shvachko wrote: Hi everybody, Here is the next release of Apache Hadoop 2.7 line. The previous stable release 2.7.3 was available since 25 August, 2016. Release

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks Konstantin! +1 (non-binding) I have tried several steps including: - Download source package and check the checksums - Build from source using Java 8 - Deploy a test cluster using docker containers w/ 5 DNs and 1 NN - Run basic HDFS client/admin operations (e.g. read/write files,

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

;yarn-...@hadoop.apache.org" <yarn-...@hadoop.apache.org> Sent: Monday, July 31, 2017 8:57 PM Subject: Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0) Uploaded new binaries hadoop-2.7.4-RC0.tar.gz, which adds lib/native/. Same place: http://home.apache.org/~shv/hadoop-2.7.4-RC0/ Thanks, -

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks for driving the 2.7.4 release! +1 (binding) - Verified signatures and digests- Successfully built from source including native- Deployed to a single-node cluster and ran sample MapReduce jobs Jason On Saturday, July 29, 2017 6:29 PM, Konstantin Shvachko wrote:

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

- Verified all checksums signatures - Built from src on macOS 10.12.6 with Java 1.8.0u65 - Deployed single node pseudo cluster - Successfully ran sleep and pi jobs - Navigated the various UIs +1 (non-binding) Thanks, Eric On Wednesday, August 2, 2017 12:31 PM, Chris Douglas

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

On Wed, Aug 2, 2017 at 12:02 AM, Zhe Zhang wrote: > Quick question for Chris: was your +1 for the RC, or to support > Konstantin's statement regarding packaging? For Konstantin's statement. I haven't had a chance to look through the RC yet, but it's on my list. -C > On Mon, Jul

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Quick question for Chris: was your +1 for the RC, or to support Konstantin's statement regarding packaging? Thanks, On Mon, Jul 31, 2017 at 3:56 PM Chris Douglas wrote: > On Mon, Jul 31, 2017 at 3:02 PM, Konstantin Shvachko > wrote: > > For the

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (binding) 1. Downloaded src tar ball, verified m5dsum 2. Built from source on Linux RHEL6, Java 1_8_0_40 3. Tried some HDFS CLI methods with the above build, against two clusters, one running 2.6.1 and another running 2.7.4 (server bin/conf built by an internal Jenkins job, as Ye Zhou

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi, Konstantin. Thanks for leading the release. +1 (non-binding) -Built from the source on mac with jdk_1.8.0_40 -Built on internal Jenkins with jdk_1.8.0_40. -Deployed on a cluster with 121 nodes(Including RM, NM, NN, DN) -Basic shell commands -Distcp 3.7TB data to HDFS -Run GridMix test which

RE: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Wang; Allen Wittenauer; common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0) Uploaded new binaries hadoop-2.7.4-RC0.tar.gz, which adds lib/native/. Same place: http

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Uploaded new binaries hadoop-2.7.4-RC0.tar.gz, which adds lib/native/. Same place: http://home.apache.org/~shv/hadoop-2.7.4-RC0/ Thanks, --Konstantin On Mon, Jul 31, 2017 at 3:56 PM, Chris Douglas wrote: > On Mon, Jul 31, 2017 at 3:02 PM, Konstantin Shvachko >

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

On Mon, Jul 31, 2017 at 3:02 PM, Konstantin Shvachko wrote: > For the packaging, here is the exact phrasing from the sited release-policy > document relevant to binaries: > "As a convenience to users that might not have the appropriate tools to > build a compiled version of

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Maven dependencies should be fine. For the packaging, here is the exact phrasing from the sited release-policy document relevant to binaries: "As a convenience to users that might not have the appropriate tools to build a compiled version of the source, binary/bytecode packages MAY be distributed

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

From: Konstantin Shvachko <shv.had...@gmail.com> Sent: Saturday, July 29, 2017 4:29 PM To: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: [VOTE] Release Apache Hadoop

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi Konstantin, Thanks for preparing the 2.7.4-RC0 release. - Built from source on Mac OS X 10.11.6 with Java 1.7.0_79 - Deployed both binary and built source to a pseudo cluster - Passed the following sanity checks - Basic dfs operations - Wordcount +1 (non-binding) Thanks, Hanisha

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Just confirmed that HADOOP-13707 does fix the NN servlet issuet in branch-2.7. On Mon, Jul 31, 2017 at 11:38 AM, Konstantin Shvachko wrote: > Hi John, > > Thank you for checking and voting. > As far as I know test failures on 2.7.4 are intermittent. We have a jira > for

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

I agree with Brahma on the two issues flagged (having src in the binary tarball, missing native libs). These are regressions from prior releases. As an aside, "we release binaries as a convenience" doesn't relax the quality bar. The binaries are linked on our website and distributed through

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

To avoid any confusion in this regard. I built RC0 manually in compliance with Apache release policy http://www.apache.org/legal/release-policy.html I edited the HowToReleasePreDSBCR page to make sure people don't use Jenkins option for building. A side note. This particular build is broken

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

> On Jul 31, 2017, at 11:20 AM, Konstantin Shvachko > wrote: > > https://wiki.apache.org/hadoop/HowToReleasePreDSBCR FYI: If you are using ASF Jenkins to create an ASF release artifact, it's pretty much an automatic vote failure as any such

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi John, Thank you for checking and voting. As far as I know test failures on 2.7.4 are intermittent. We have a jira for that https://issues.apache.org/jira/browse/HDFS-11985 but decided it should not block the release. The "dr,who" thing is a configuration issue. This page may be helpful:

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

5 messagebus 4096 Jul 30 03:01 src > > > > --Brahma Reddy Battula > > -Original Message- > From: Konstantin Shvachko [mailto:shv.had...@gmail.com] > Sent: 30 July 2017 07:29 > To: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; > mapreduce-dev@hadoop.a

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks for putting this up, Konstantin. I'm +1(non-binding) on the source tarball. * verified signature and mds, * built from source on CentOS 7 and OpenJDK 8 with native profile, * built RPMs by bigtop, deployed 5 nodes cluster by docker provisioner, ran smoke-tests of hdfs, yarn and

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi Konstantin, Thanks a lot for the effort to prepare the 2.7.4-RC0 release! +1 (non-binding) - Verified checksums and signatures of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Verified cloud connectors: - All S3A integration tests -

RE: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

[mailto:shv.had...@gmail.com] Sent: 30 July 2017 07:29 To: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: [VOTE] Release Apache Hadoop 2.7.4 (RC0) Hi everybody, Here is the next release of Apache Hadoop 2.7 line

[VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi everybody, Here is the next release of Apache Hadoop 2.7 line. The previous stable release 2.7.3 was available since 25 August, 2016. Release 2.7.4 includes 264 issues fixed after release 2.7.3, which are critical bug fixes and major optimizations. See more details in Release Note: