回复：[VOTE] Release Apache Hadoop 3.0.0 RC1

.org>; yarn-...@hadoop.apache.org <yarn-...@hadoop.apache.org>; mapreduce-...@hadoop.apache.org <mapreduce-...@hadoop.apache.org>主　题：Re: [VOTE] Release Apache Hadoop 3.0.0 RC1 Thanks Andrew for the great effort! Here is my late vote. +1 (binding)    - Verified checksums and signatures of tarba

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Thanks Andrew for the great effort! Here is my late vote. +1 (binding) - Verified checksums and signatures of tarballs - Built source with native, Oracle Java 1.8.0_152 on Mac OS X 10.13.2 - Verified cloud connectors: - S3A integration tests (perf tests skipped) - Deployed

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Yes, JIRAs will be filed, the wiki-page idea from YARN meetup is to record all combinations of testing that need to be done and correspondingly capture all the testing that someone in the community has already done and record it for future perusal. From what you are saying, I guess we haven't

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Good stuff Andrew, and thanks everyone! +Vinod > On Dec 13, 2017, at 1:05 PM, Andrew Wang wrote: > > To close this out, the vote passes successfully with 13 binding +1s, 5 > non-binding +1s, and no -1s. Thanks everyone for voting! I'll work on staging. >

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

; > Sent: Tuesday, December 12, 2017 3:10 PM > > To: Arun Suresh > > Cc: Andrew Wang; Lei Xu; Wei-Chiu Chuang; Ajay Kumar; Xiao Chen; Aaron > T. Myers; common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; > yarn-...@hadoop.apache.org; mapreduce-...@hadoop.ap

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

release. > > > > > > Thanks, > > > > Junping > > > > > > From: Robert Kanter <rkan...@cloudera.com> > > Sent: Tuesday, December 12, 2017 3:10 PM > > To: Arun Suresh > > Cc: Andrew Wang;

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

> Myers; common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; > yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org > Subject: Re: [VOTE] Release Apache Hadoop 3.0.0 RC1 > > +1 (binding) > > + Downloaded the binary release > + Deployed on a 3 node cluster on CentO

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Looked at RC1. Went through my usual check-list. Here's my summary. +1 (binding) overall Verification - [Check] Successful recompilation from source tar-ball - [Check] Signature verification - [Check] Generating dist tarballs from source tar-ball - [Check] Validating the layout of the binary

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Thanks to everyone who pushed on this release, really great to see a release coming off trunk. +1 (binding). Deployed the RC on a federated YARN cluster consisting of 8 sub-clusters on CentOs 7.4 running Java 1.8.0_144. Hit YARN-7652[1] which is not a blocker as I was able to run multiple jobs

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Thanks Andrew again, +1 (binding) * Downloaded source tarball, and compiled with native libs successfully: -Pdist,native -Drequire.isal -Drequire.snappy -Drequire.openssl -Drequire.zstd. * hadoop checknative ran successfully. * Upgraded a fsimage that was previously used in a Hadoop 2.6-based

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

+1 (non-binding) * Verified md5 of all artifacts * Built with -Pdist * Ran several s3a shell commands * Started a pseudo-distributed HDFS and YARN cluster * Ran grep and pi MR examples * Sanity-checked contents of release notes, rat report, and changes On Fri, Dec 8, 2017 at 1:31 PM, Andrew Wang

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Thanks Andrew for driving this. +1 (Binding) Ran SLS + CS's Perf unit test and saw similar performance compared to trunk. Compiled from source, deployed single node cluster and ran several jobs. Best, Wangda On Wed, Dec 13, 2017 at 7:29 AM, Sunil G wrote: > +1

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

+1 (binding) Thanks Andrew Wang for driving this effort and also thanks to all others who helped in this release. Kudos!!! I tested this RC by building it from source. I met with couple of issues (not blocker) HADOOP-15116 and YARN-7650. This could be tracked separately. - Ran many MR apps

RE: [VOTE] Release Apache Hadoop 3.0.0 RC1

...@cloudera.com] Sent: 09 December 2017 02:01 To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: [VOTE] Release Apache Hadoop 3.0.0 RC1 Hi all, Let me start, as always, by thanking the efforts of all the contributors who

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

+1 (binding) - built from source and deployed 3 node cluster - installed RM HA cluster along with ATSv2 enabled and new YARN UI. - verified for -- RM HA switch / RM Restart / RM Work preserving restart -- NM work preserving restart -- Ran sample MR jobs and Distributed shell along with multiple

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

> > To: Arun Suresh > > Cc: Andrew Wang; Lei Xu; Wei-Chiu Chuang; Ajay Kumar; Xiao Chen; Aaron T. > > Myers; common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; > > yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org > > Subject: Re: [VOTE] Release Apache

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Aaron T. > Myers; common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; > yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org > Subject: Re: [VOTE] Release Apache Hadoop 3.0.0 RC1 > > +1 (binding) > > + Downloaded the binary release > + Deployed on a 3 node cluster

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

reduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 3.0.0 RC1 +1 (binding) + Downloaded the binary release + Deployed on a 3 node cluster on CentOS 7.3 + Ran some MR jobs, clicked around the UI, etc + Ran some CLI commands (yarn logs, etc) Good job everyone on Hadoop 3! - Robert On Tue,

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

+1 (binding) + Downloaded the binary release + Deployed on a 3 node cluster on CentOS 7.3 + Ran some MR jobs, clicked around the UI, etc + Ran some CLI commands (yarn logs, etc) Good job everyone on Hadoop 3! - Robert On Tue, Dec 12, 2017 at 1:56 PM, Arun Suresh wrote: >

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

+1 (non-binding) I tested it in a deployment with 24 nodes across 8 subclusters. Tested a few jobs reading and writing data through HDFS Router-based federation. However, jobs failed to run when setting RBF as the default filesystem because after MAPREDUCE-6954, it tries to invoke

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

+1 (non-binding) * built from the source tarball (archlinux) / verified signature * Deployed to a kubernetes cluster (10/10 datanode/nodemanager pods) * Enabled ec on hdfs directory (hdfs cli) * Started example yarn jobs (pi/terragen) * checked yarn ui/ui2 Thanks for all the efforts.

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

+1 (binding) - Verified signatures of the source tarball. - built from source - using the docker build environment. - set up a pseudo-distributed test cluster. - ran basic HDFS commands - ran some basic MR jobs Cheers -Arun On Tue, Dec 12, 2017 at 1:52 PM, Andrew Wang

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Hi everyone, As a reminder, this vote closes tomorrow at 12:31pm, so please give it a whack if you have time. There are already enough binding +1s to pass this vote, but it'd be great to get additional validation. Thanks to everyone who's voted thus far! Best, Andrew On Tue, Dec 12, 2017 at

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

+1 (binding) * Verified src tarball and bin tarball, verified md5 of each. * Build source with -Pdist,native * Started a pseudo cluster * Run ec -listPolicies / -getPolicy / -setPolicy on / , and run hdfs dfs put/get/cat on "/" with XOR-2-1 policy. Thanks Andrew for this great effort! Best,

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Hi Wei-Chiu, The patchprocess directory is left over from the create-release process, and it looks empty to me. We should still file a create-release JIRA to fix this, but I think this is not a blocker. Would you agree? Best, Andrew On Tue, Dec 12, 2017 at 9:44 AM, Wei-Chiu Chuang

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Hi Andrew, thanks the tremendous effort. I found an empty "patchprocess" directory in the source tarball, that is not there if you clone from github. Any chance you might have some leftover trash when you made the tarball? Not wanting to nitpicking, but you might want to double check so we don't

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

+1 (non-binding) Thanks for driving this, Andrew Wang!! - downloaded the src tarball and verified md5 checksum - built from source with jdk 1.8.0_111-b14 - brought up a pseudo distributed cluster - did basic file system operations (mkdir, list, put, cat) and confirmed that everything was working

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

+1 (binding) - downloaded src tarball, verified md5 - built from source with jdk1.8.0_112 - started a pseudo cluster with hdfs and kms - sanity checked encryption related operations working - sanity checked webui and logs. -Xiao On Mon, Dec 11, 2017 at 6:10 PM, Aaron T. Myers

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

+1 (binding) - downloaded the src tarball and built the source (-Pdist -Pnative) - verified the checksum - brought up a secure pseudo distributed cluster - did some basic file system operations (mkdir, list, put, cat) and confirmed that everything was working - confirmed that the web UI worked

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Good point on the mutability. Release tags are immutable, RCs are not. On Mon, Dec 11, 2017 at 1:39 PM, Sangjin Lee wrote: > Thanks Andrew. For the record, the commit id would be > c25427ceca461ee979d30edd7a4b0f50718e6533. I mention that for completeness > because of the

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Thanks Andrew. For the record, the commit id would be c25427ceca461ee979d30edd7a4b0f50718e6533. I mention that for completeness because of the mutability of tags. On Mon, Dec 11, 2017 at 10:31 AM, Andrew Wang wrote: > Sorry, forgot to push the tag. It's up there now. >

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Hi Andrew, Thanks much for your effort! Just to be clear, could you please state the git commit id of the RC1 we're voting for? Sangjin On Fri, Dec 8, 2017 at 12:31 PM, Andrew Wang wrote: > Hi all, > > Let me start, as always, by thanking the efforts of all the

[VOTE] Release Apache Hadoop 3.0.0 RC1

Hi all, Let me start, as always, by thanking the efforts of all the contributors who contributed to this release, especially those who jumped on the issues found in RC0. I've prepared RC1 for Apache Hadoop 3.0.0. This release incorporates 302 fixed JIRAs since the previous 3.0.0-beta1 release.