Re: 答复: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

2017-11-02 Thread Lei Xu
Hey, Weiwei and Jitendra Thanks a lot for this large effort to bring us ozone. * As the current state of Ozone implementation, what are the major benefits of using today’s Ozone over HDFS? Giving that its missing features like HDFS-12680 and HDFS-12697, being disabled by default, and the closin

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

2017-11-20 Thread Lei Xu
+1 binding Run the following steps: * Check md5 of sources and package. * Run a YARN + HDFS pseudo cluster. * Run terasuite on YARN. * Run HDFS CLIs (ls , rm , etc) On Mon, Nov 20, 2017 at 12:58 PM, Vinod Kumar Vavilapalli wrote: > Quick question. > > I used to be able (in 2.x line) to create

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-12 Thread Lei Xu
+1 (binding) * Verified src tarball and bin tarball, verified md5 of each. * Build source with -Pdist,native * Started a pseudo cluster * Run ec -listPolicies / -getPolicy / -setPolicy on / , and run hdfs dfs put/get/cat on "/" with XOR-2-1 policy. Thanks Andrew for this great effort! Best, O

Apache Hadoop 3.0.1 Release plan

2018-01-09 Thread Lei Xu
Hi, All We have released Apache Hadoop 3.0.0 in December [1]. To further improve the quality of release, we plan to cut branch-3.0.1 branch tomorrow for the preparation of Apache Hadoop 3.0.1 release. The focus of 3.0.1 will be fixing blockers (3), critical bugs (1) and bug fixes [2]. No new feat

Re: Apache Hadoop 3.0.1 Release plan

2018-01-09 Thread Lei Xu
C as possible. > > Jason > > > On Tue, Jan 9, 2018 at 1:17 PM, Lei Xu wrote: >> >> Hi, All >> >> We have released Apache Hadoop 3.0.0 in December [1]. To further >> improve the quality of release, we plan to cut branch-3.0.1 branch >> tomorrow for

Re: Apache Hadoop 3.0.1 Release plan

2018-01-09 Thread Lei Xu
C as possible. > > Jason > > > On Tue, Jan 9, 2018 at 1:17 PM, Lei Xu wrote: >> >> Hi, All >> >> We have released Apache Hadoop 3.0.0 in December [1]. To further >> improve the quality of release, we plan to cut branch-3.0.1 branch >> tomorrow for

Re: Apache Hadoop 3.0.1 Release plan

2018-02-01 Thread Lei Xu
Hi, All I just cut branch-3.0.1 from branch-3.0. Please make sure all patches targeted to 3.0.1 being checked in both branch-3.0 and branch-3.0.1. Thanks! Eddy On Tue, Jan 9, 2018 at 11:17 AM, Lei Xu wrote: > Hi, All > > We have released Apache Hadoop 3.0.0 in December [1]. T

Re: Apache Hadoop 3.0.1 Release plan

2018-02-01 Thread Lei Xu
sues.apache.org/jira/browse/HDFS-12990 > > or are we abandoning it? I believe that this is the last window for us to fix > this issue. > > Should we have a call and get this resolved one way or another? > > Thanks > Anu > > On 2/1/18, 10:51 AM, "Lei Xu" wrot

Re: Apache Hadoop 3.0.1 Release plan

2018-02-01 Thread Lei Xu
or that? > > Best, > Aaron > > On Thu, Feb 1, 2018 at 1:13 PM, Lei Xu wrote: >> >> +Xiao >> >> My understanding is that we will have this for 3.0.1. Xiao, could >> you give your inputs here? >> >> On Thu, Feb 1, 2018 at 11:55 AM, Anu Eng

Re: Apache Hadoop 3.0.1 Release plan

2018-02-08 Thread Lei Xu
ing YARN). Frankly, it's embarrassing to resort to it here, >> > but here we are. >> > >> > > If there is a binding veto in effect then the change must be >> > > abandoned. >> > Else you should be able to proceed with committing. However, 3.0.

[VOTE] Release Apache Hadoop 3.0.1 (RC0)

2018-02-15 Thread Lei Xu
Hi, all I've created release candidate 0 for Apache Hadoop 3.0.1 Apache Hadoop 3.0.1 will be the first bug fix release for Apache Hadoop 3.0 release. It includes 49 bug fixes, which include 10 blockers and 8 are critical. Please note: * HDFS-12990. Change default NameNode RPC port back to 8020.

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC0)

2018-02-20 Thread Lei Xu
Dear PMC and committers Please help to verify and vote this release. I will extend the voting period to Friday (Feb 23th) of this week. Thanks! On Thu, Feb 15, 2018 at 3:36 PM, Lei Xu wrote: > Hi, all > > I've created release candidate 0 for Apache Hadoop 3.0.1 > > Apache

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC0)

2018-02-22 Thread Lei Xu
asic webhdfs commands using curl. > > 5. Verified basic HDFS commands > > > > > > [1] https://github.com/vinayakumarb/docker-cluster-deployer > > > > Thanks, > > -Vinay > > > > On Wed, Feb 21, 2018 at 5:41 AM, Lei Xu wrote: &g

[VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-17 Thread Lei Xu
Hi, all I've created release candidate RC-1 for Apache Hadoop 3.0.1 Apache Hadoop 3.0.1 will be the first bug fix release for Apache Hadoop 3.0 release. It includes 49 bug fixes and security fixes, which include 12 blockers and 17 are critical. Please note: * HDFS-12990. Change default NameNode

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-19 Thread Lei Xu
kira > > > On 2018/03/18 13:11, Lei Xu wrote: >> >> Hi, all >> >> I've created release candidate RC-1 for Apache Hadoop 3.0.1 >> >> Apache Hadoop 3.0.1 will be the first bug fix release for Apache >> Hadoop 3.0 release. It includes 49 bug fix

Re: [VOTE] Adopt HDSL as a new Hadoop subproject

2018-03-22 Thread Lei Xu
Hi, Owen Thanks a lot for this proposal, as I believe it has addressed most of the concerns of the community. I have one concrete question about how this HDSL subproject being separated: Ozone / HDSL was designed in the current way to re-use the existing HDFS code base as much as possible, thus t

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-23 Thread Lei Xu
Yarn example jobs >> * Spark example jobs (with and without yarn) >> * Simple hive table creation >> >> Marton >> >> >> [1]: https://github.com/flokkr/runtime-compose >> >> On 03/18/2018 05:11 AM, Lei Xu wrote: >> >>> Hi, all >>&

Re: [VOTE] Adopt HDSL as a new Hadoop subproject

2018-03-26 Thread Lei Xu
+1 Best, On Mon, Mar 26, 2018 at 10:38 AM, Xiao Chen wrote: > +1 > > Thanks, > -Xiao > > On Sun, Mar 25, 2018 at 9:07 PM, Akira Ajisaka > wrote: > >> +1 >> >> Thanks, >> Akira >> >> >> On 2018/03/24 15:18, Lokesh Jain wrote: >> >>> +1 (non-binding) >>> >>> Thanks >>> Lokesh >>> >>> >>>

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-04-02 Thread Lei Xu
ng or is this supposed to be the shaded jar which is > ~20MB? > > Thanks, > Arpit > > > > On 3/23/18, 10:18 AM, "Lei Xu" wrote: > > Hi, All > > Thanks everyone for voting! The vote passes successfully with 6 > binding +1s, 7 non-binding +1

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-04-04 Thread Lei Xu
fixes. Please change the target version of new fixes to 3.0.3. I will also go over JIRAs to fix targeted versions for committed changes. Best, On Mon, Apr 2, 2018 at 6:08 PM, Lei Xu wrote: > Hi, Arpit > > I followed this instruction > https://wiki.apache.org/hadoop/HowToRelease > &g

[VOTE] Release Apache Hadoop 3.0.2 (RC0)

2018-04-06 Thread Lei Xu
Hi, All I've created release candidate RC-0 for Apache Hadoop 3.0.2. Please note: this is an amendment for Apache Hadoop 3.0.1 release to fix shaded jars in apache maven repository. The codebase of 3.0.2 release is the same as 3.0.1. New bug fixes will be included in Apache Hadoop 3.0.3 instead.

Re: [VOTE] Release Apache Hadoop 3.0.2 (RC0)

2018-04-10 Thread Lei Xu
ned as expected in each case > > - tested user weights with FifoOrderingPolicy to ensure that weights > were > > assigned to users as expected. > > > > Eric Payne > > > > > > > > > > > > > > On Fri

[VOTE] Release Apache Hadoop 3.0.2 (RC1)

2018-04-16 Thread Lei Xu
Hi, All I've created release candidate RC-1 for Apache Hadoop 3.0.2, to address missing source jars in the maven repository in RC-0. Thanks Ajay Kumar for spotting the error. Please note: this is an amendment for Apache Hadoop 3.0.1 release to fix shaded jars in apache maven repository. The code

Re: [VOTE] Release Apache Hadoop 3.0.2 (RC1)

2018-04-22 Thread Lei Xu
x27; UI >> - Tried some rolling upgrade related features: MR over DistributedCache, >> NM >> Restart with work preserving, etc. >> >> Thanks, >> >> Junping >> >> 2018-04-17 7:59 GMT+08:00 Lei Xu : >> >> > Hi, All >> &g

Re: upstream jenkins build broken?

2015-03-10 Thread Lei Xu
Thanks a lot for looking into HDFS-7722, Chris. In HDFS-7722: TestDataNodeVolumeFailureXXX tests reset data dir permissions in TearDown(). TestDataNodeHotSwapVolumes reset permissions in a finally clause. Also I ran mvn test several times on my machine and all tests passed. However, since in Dis

Re: upstream jenkins build broken?

2015-03-13 Thread Lei Xu
removal. >>>> >>>> -- >>>> Sean >>>> On Mar 11, 2015 4:11 PM, "Colin McCabe" wrote: >>>> >>>> > Is there a maven plugin or setting we can use to simply remove >>>> > directories that have no executabl

Re: [VOTE] Release Apache Hadoop 2.7.1 RC0

2015-06-29 Thread Lei Xu
+1 binding Downloaded src and bin distribution, verified md5, sha1 and sha256 checksums of both tar files. Built src using mvn package. Ran a pseudo HDFS cluster Ran dfs -put some files, and checked files on NN's web interface. On Mon, Jun 29, 2015 at 11:54 AM, Wangda Tan wrote: > +1 (non-bind

Re: [VOTE] HDFS-1312 - Diskbalancer branch merge

2016-06-22 Thread Lei Xu
Thanks for the great work, Anu. I have ran a test on a local cluster. One suggestion is that the CLI help messages should be more consistent with the rest of rest of hdfs command line tools. +1 for the merge. On Wed, Jun 22, 2016 at 2:30 PM, Jitendra Pandey wrote: > I think this is a very usef

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC0)

2016-09-27 Thread Lei Xu
+1 The steps I've done: * Downloaded release tar and source tar, verified MD5. * Run a HDFS cluster, and copy files between local filesystem and HDFS. On Tue, Sep 27, 2016 at 1:28 PM, Sangjin Lee wrote: > Hi folks, > > I have created a release candidate RC0 for the Apache Hadoop 2.6.5 release

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

2017-07-06 Thread Lei Xu
+1 (binding) Ran the following tests: * Deploy a pesudo cluster using tar ball, run pi. * Verified MD5 of tar balls for both src and dist. * Build src tarball with -Pdist,tar Thanks Andrew for the efforts! On Thu, Jul 6, 2017 at 3:44 PM, Andrew Wang wrote: > Thanks all for the votes so far! > >

Re: Looking to a Hadoop 3 release

2015-03-02 Thread Lei Xu
+1. Would love to help. On Mon, Mar 2, 2015 at 3:19 PM, Andrew Wang wrote: > Hi devs, > > It's been a year and a half since 2.x went GA, and I think we're about due > for a 3.x release. > Notably, there are two incompatible changes I'd like to call out, that will > have a tremendous positive i

[jira] [Created] (HDFS-6521) Improve the readability of 'hadoop fs -help'

2014-06-11 Thread Lei Xu (JIRA)
Lei Xu created HDFS-6521: Summary: Improve the readability of 'hadoop fs -help' Key: HDFS-6521 URL: https://issues.apache.org/jira/browse/HDFS-6521 Project: Hadoop HDFS Issue Type: I