RE: [DISCUSS] Alpha Release of Ozone

2018-08-08 Thread Chen, Sammi
+1. 
Looking forward to try the fresh Ozone release. 


Bests,
Sammi

-Original Message-
From: Elek, Marton [mailto:e...@apache.org] 
Sent: Tuesday, August 7, 2018 1:34 AM
To: common-...@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; 
yarn-...@hadoop.apache.org; hdfs-...@hadoop.apache.org
Subject: [DISCUSS] Alpha Release of Ozone

Hi All,

I would like to discuss creating an Alpha release for Ozone. The core 
functionality of Ozone is complete but there are two missing features; Security 
and HA, work on these features are progressing in Branches
HDDS-4 and HDDS-151. Right now, Ozone can handle millions of keys and has a 
Hadoop compatible file system, which allows applications like Hive, Spark, and 
YARN use Ozone.

Having an Alpha release of Ozone will help in getting some early feedback (this 
release will be marked as an Alpha -- and not production ready).

Going through a complete release cycle will help us flush out Ozone release 
process, update user documentation and nail down deployment models.

Please share your thoughts on the Alpha release (over mail or in HDDS-214), as 
voted on by the community earlier, Ozone release will be independent of Hadoop 
releases.

Thanks a lot,
Marton Elek




-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org


-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org


RE: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-27 Thread Chen, Sammi
Hi Yongjun,


The artifacts will be pushed to 
https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-project after step 
6 of Publishing steps.
For 2.9.1, I remember I absolutely did the step before. I redo the step 6 today 
and now 2.9.1 is pushed to the mvn repo.
You can double check it. I suspect sometimes Nexus may fail to notify user when 
this is unexpected failures.


Bests,
Sammi
From: Yongjun Zhang [mailto:yzh...@cloudera.com]
Sent: Sunday, June 17, 2018 12:17 PM
To: Jonathan Eagles ; Chen, Sammi 
Cc: Eric Payne ; Hadoop Common 
; Hdfs-dev ; 
mapreduce-dev@hadoop.apache.org; yarn-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

+ Junping, Sammi

Hi Jonathan,

Many thanks for reporting the issues and sorry for the inconvenience.

1. Shouldn't the build be looking for artifacts in

https://repository.apache.org/content/repositories/releases
rather than

https://repository.apache.org/content/repositories/snapshots
?

2.
Not seeing the artifact published here as well.
https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-project

Indeed, I did not see 2.9.1 there too. So included Sammi Chen.

Hi Junping, would you please share which step in
https://wiki.apache.org/hadoop/HowToRelease
should have done this?

Thanks a lot.

--Yongjun

On Fri, Jun 15, 2018 at 10:52 PM, Jonathan Eagles 
mailto:jeag...@gmail.com>> wrote:
Upgraded Tez dependency to hadoop 3.0.3 and found this issue. Anyone else 
seeing this issue?

[ERROR] Failed to execute goal on project hadoop-shim: Could not resolve 
dependencies for project org.apache.tez:hadoop-shim:jar:0.10.0-SNAPSHOT: Failed 
to collect dependencies at org.apache.hadoop:hadoop-yarn-api:jar:3.0.3: Failed 
to read artifact descriptor for org.apache.hadoop:hadoop-yarn-api:jar:3.0.3: 
Could not find artifact org.apache.hadoop:hadoop-project:pom:3.0.3 in 
apache.snapshots.https 
(https://repository.apache.org/content/repositories/snapshots) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-shim

Not seeing the artifact published here as well.
https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-project

On Tue, Jun 12, 2018 at 6:44 PM, Yongjun Zhang 
mailto:yzh...@cloudera.com>> wrote:
Thanks Eric!

--Yongjun

On Mon, Jun 11, 2018 at 8:05 AM, Eric Payne 
mailto:erichadoo...@yahoo.com>> wrote:

> Sorry, Yongjun. My +1 is also binding
> +1 (binding)
> -Eric Payne
>
> On Friday, June 1, 2018, 12:25:36 PM CDT, Eric Payne <
> eric.payne1...@yahoo.com<mailto:eric.payne1...@yahoo.com>> wrote:
>
>
>
>
> Thanks a lot, Yongjun, for your hard work on this release.
>
> +1
> - Built from source
> - Installed on 6 node pseudo cluster
>
>
> Tested the following in the Capacity Scheduler:
> - Verified that running apps in labelled queues restricts tasks to the
> labelled nodes.
> - Verified that various queue config properties for CS are refreshable
> - Verified streaming jobs work as expected
> - Verified that user weights work as expected
> - Verified that FairOrderingPolicy in a CS queue will evenly assign
> resources
> - Verified running yarn shell application runs as expected
>
>
>
>
>
>
>
> On Friday, June 1, 2018, 12:48:26 AM CDT, Yongjun Zhang <
> yjzhan...@apache.org<mailto:yjzhan...@apache.org>> wrote:
>
>
>
>
>
> Greetings all,
>
> I've created the first release candidate (RC0) for Apache Hadoop
> 3.0.3. This is our next maintenance release to follow up 3.0.2. It includes
> about 249
> important fixes and improvements, among which there are 8 blockers. See
> https://issues.apache.org/jira/issues/?filter=12343997
>
> The RC artifacts are available at:
> https://dist.apache.org/repos/dist/dev/hadoop/3.0.3-RC0/
>
> The maven artifacts are available via
> https://repository.apache.org/content/repositories/orgapachehadoop-1126
>
> Please try the release and vote; the vote will run for the usual 5 working
> days, ending on 06/07/2018 PST time. Would really appreciate your
> participation here.
>
> I bumped into quite some issues along the way, many thanks to quite a few
> people who helped, especially Sammi Chen, Andrew Wang, Junping Du, Eddy Xu.
>
> Thanks,
>
> --Yongjun
>




[ANNOUNCE] Apache Hadoop 2.9.1 Release

2018-05-15 Thread Chen, Sammi
Hello everyone,

I am glad to announce that Apache Hadoop 2.9.1 has been released.

Apache Hadoop 2.9.1 is the next release of Apache Hadoop 2.9 line. It includes 
208 bug fixes, improvements and enhancements since previous Apache Hadoop 2.9.0 
release.

 - For major changes included in Hadoop 2.9 line, please refer to Hadoop 2.9.1 
main page [1].
 - For more details about fixes and improvements in 2.9.1 release, please refer 
to CHANGES [2] and RELEASENOTES [3].
 - For download, please got to download page[4]

Thank you all for contributing to the Apache Hadoop 2.9.1.


Last, thanks Yongjun Zhang, Junping Du, Andrew Wang and Chris Douglas for your 
help and support.


Bests,
Sammi Chen

[1] http://hadoop.apache.org/docs/r2.9.1/index.html 
[2] 
http://hadoop.apache.org/docs/r2.9.1/hadoop-project-dist/hadoop-common/release/2.9.1/CHANGES.2.9.1.html
 
[3] 
http://hadoop.apache.org/docs/r2.9.1/hadoop-project-dist/hadoop-common/release/2.9.1/RELEASENOTES.2.9.1.html
 
[4] http://hadoop.apache.org/releases.html#Download 

-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org


RE: [VOTE] Release Apache Hadoop 2.8.4 (RC0)

2018-05-11 Thread Chen, Sammi
Thanks Junping for driving the release!

+1 (binding)
 
   - Download src tarball, verified checksums, verified signature
   - Build successfully from the source code 
   - Start a pseudo distributed hdfs and YARN cluster on Mac
   - verify hadoop runtime version
   - Check NN, RM webUI
   - Run Pi , wordcount
   - Verify basic hdfs operations
   - Verify basic HDFS storage policy commands
   - Verify copy/download file between HDFS and local filesystem 

Bests,
Sammi

-Original Message-
From: Zsolt Venczel [mailto:zvenc...@cloudera.com] 
Sent: Thursday, May 10, 2018 9:08 PM
To: Takanobu Asanuma 
Cc: Gabor Bota ; junping...@apache.org; 
ajay.ku...@hortonworks.com; Hadoop Common ; 
Hdfs-dev ; mapreduce-dev@hadoop.apache.org; 
yarn-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.8.4 (RC0)

Thanks Junping for working on this!

+1 (non-binding)
  - checked out git tag release-2.8.4-RC0
  - successfully run "mvn clean package -Pdist,native -Dtar -DskipTests"
(Ubuntu 16.04.4 LTS)
  - started hadoop clulster with 1 master and 2 slaves
  - run pi estimator, teragen, terasort, teravalidate
  - verified Web UI (file browser)

Thanks,
Zsolt



On Thu, May 10, 2018 at 8:50 AM, Takanobu Asanuma 
wrote:

> Thanks for working on this, Junping!
>
> +1 (non-binding)
>- verified checksums
>- succeeded "mvn clean package -Pdist,native -Dtar -DskipTests" 
> (CentOS
> 7)
>- started hadoop cluster with 1 master and 5 slaves
>- run TeraGen/TeraSort
>- verified Web UI (NN, RM, JobHistory, Timeline)
>- verified some Archival Storage operations
>
> Thanks,
> -Takanobu
>
> > -Original Message-
> > From: Gabor Bota [mailto:gabor.b...@cloudera.com]
> > Sent: Wednesday, May 09, 2018 5:20 PM
> > To: ajay.ku...@hortonworks.com
> > Cc: junping...@apache.org; Hadoop Common 
> > ; Hdfs-dev 
> > ; mapreduce-dev@hadoop.apache.org; 
> > yarn-...@hadoop.apache.org
> > Subject: Re: [VOTE] Release Apache Hadoop 2.8.4 (RC0)
> >
> >   Thanks for the work Junping!
> >
> >   +1 (non-binding)
> >
> >-   checked out git tag release-2.8.4-RC0
> >-   hadoop-aws unit tests ran successfully
> >-   built from source on Mac OS X 10.13.4, java 8.0.171-oracle
> >-   deployed on a 3 node cluster (HDFS HA, Non-HA YARN)
> >-   verified pi job (yarn), teragen, terasort and teravalidate
> >
> >
> >   Regards,
> >   Gabor Bota
> >
> > On Wed, May 9, 2018 at 12:14 AM Ajay Kumar 
> > 
> > wrote:
> >
> > > Thanks for work on this, Junping!!
> > >
> > > +1 (non-binding)
> > >   - verified binary checksum
> > > - built from source and setup 4 node cluster
> > > - run basic hdfs command
> > > - run wordcount, pi & TestDFSIO (read/write)
> > > - basic check for NN UI
> > >
> > > Best,
> > > Ajay
> > >
> > > On 5/8/18, 10:41 AM, "俊平堵"  wrote:
> > >
> > > Hi all,
> > >  I've created the first release candidate (RC0) for Apache
> Hadoop
> > > 2.8.4. This is our next maint release to follow up 2.8.3. It
> includes
> > > 77
> > > important fixes and improvements.
> > >
> > > The RC artifacts are available at:
> > > http://home.apache.org/~junping_du/hadoop-2.8.4-RC0
> > >
> > > The RC tag in git is: release-2.8.4-RC0
> > >
> > > The maven artifacts are available via repository.apache.org<
> > > http://repository.apache.org> at:
> > >
> > >
> > https://repository.apache.org/content/repositories/orgapachehadoop-1
> > 11
> > 8
> > >
> > > Please try the release and vote; the vote will run for the
> usual
> > 5
> > > working days, ending on 5/14/2018 PST time.
> > >
> > > Thanks,
> > >
> > > Junping
> > >
> > >
> > >
> > > --
> > > --- To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> > > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
> > >
>
> -
> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
>
>


RE: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

2018-05-07 Thread Chen, Sammi
Hi all,



Thanks everyone for voting! The vote passes successfully with 3 binding +1s, 4 
non-binding +1s and no -1s.



I will work on the staging and announce the releases soon.





Best,
Sammi
From: 俊平堵 [mailto:dujunp...@gmail.com]
Sent: Tuesday, May 1, 2018 9:41 AM
To: Chen, Sammi <sammi.c...@intel.com>
Cc: Hadoop Common <common-...@hadoop.apache.org>; hdfs-dev 
<hdfs-...@hadoop.apache.org>; mapreduce-dev@hadoop.apache.org; 
yarn-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

Thanks Sammi for working on this!

+1 (binding), based on::
- built from source successfully
- verified signature is correct
- deployed a pseudo cluster and run some simple MR jobs (PI, sleep, etc.)
- checked HDFS/YARN daemons' UI are normal.

Thanks,

Junping
Chen, Sammi <sammi.c...@intel.com<mailto:sammi.c...@intel.com>>于2018年4月19日 
周四下午4:58写道:
Hi all,

This is the first dot release of Apache Hadoop 2.9 line since 2.9.0 was 
released on November 17, 2017.

It includes 208 changes. Among them, 9 blockers, 15 critical issues and rest 
are normal bug fixes and feature improvements.

Thanks to the many who contributed to the 2.9.1 development.

The artifacts are available here:  
https://dist.apache.org/repos/dist/dev/hadoop/2.9.1-RC0/

The RC tag in git is release-2.9.1-RC0. Last git commit SHA is 
e30710aea4e6e55e69372929106cf119af06fd0e.

The maven artifacts are available at:
https://repository.apache.org/content/repositories/orgapachehadoop-1115/

My public key is available from:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS

Please try the release and vote; the vote will run for the usual 5 days, ending 
on 4/25/2018 PST time.

Also I would like thank Lei(Eddy) Xu and Chris Douglas for your help during the 
RC preparation.

Bests,
Sammi Chen


RE: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

2018-04-29 Thread Chen, Sammi
Hi all,

I got 4 non-binding + 1, 2 binding + 1, no -1  by end of the week.   The 
binding +1 is not enough.  

So I would like to extend the vote deadline to 5/3 11:59PM to collect more 
votes from the community. 


Special thanks to Gabor Bota, Jinhu Wu, Takanobu Asanuma, Eric Badger, Rakesh 
Radhakrishnan and  Eric Payne for the effort to verify the package and provide 
feedbacks. 


Bests,
Sammi Chen

-Original Message-
From: Eric Payne [mailto:eric.payne1...@yahoo.com] 
Sent: Saturday, April 28, 2018 4:44 AM
To: Chen, Sammi <sammi.c...@intel.com>; junping...@apache.org
Cc: Hadoop Common <common-...@hadoop.apache.org>; hdfs-dev 
<hdfs-...@hadoop.apache.org>; mapreduce-dev@hadoop.apache.org; 
yarn-...@hadoop.apache.org
Subject: Re: RE: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

Thanks Sammi for all of the hard work!

+1 (binding)
Tested the following:
- Build from source
- Deploy to pseudo cluster
- Various error cases where the AM fails to start. The failure reasons were 
prop ogated to the GUI and to the client.
- Streaming mapred job
- killing apps from the command line
- intra-queue preemption
- inter-queue preemption- verified preemption properties are refreshable 
Thanks, Eric Payne








On Wednesday, April 25, 2018, 12:12:24 AM CDT, Chen, Sammi 
<sammi.c...@intel.com> wrote: 






Paste the links here,

The artifacts are available here:  
https://dist.apache.org/repos/dist/dev/hadoop/2.9.1-RC0/  

The RC tag in git is release-2.9.1-RC0. Last git commit SHA is 
e30710aea4e6e55e69372929106cf119af06fd0e.

The maven artifacts are available at:
https://repository.apache.org/content/repositories/orgapachehadoop-1115/ 

My public key is available from:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS 


Bests,
Sammi

-Original Message-
From: Chen, Sammi [mailto:sammi.c...@intel.com]
Sent: Wednesday, April 25, 2018 12:02 PM
To: junping...@apache.org
Cc: Hadoop Common <common-...@hadoop.apache.org>; Rushabh Shah 
<rusha...@oath.com>; hdfs-dev <hdfs-...@hadoop.apache.org>; 
mapreduce-dev@hadoop.apache.org; yarn-...@hadoop.apache.org
Subject: RE: [VOTE] Release Apache Hadoop 2.9.1 (RC0)


Thanks Jason Lowe for the quick investigation to find out that the test 
failures belong to the test only.

Based on the current facts, I would like to continue calling the VOTE for 2.9.1 
RC0,  and extend the vote deadline to end of this week 4/27.


I will add following note to the final release notes,

HADOOP-15385<https://issues.apache.org/jira/browse/HADOOP-15385>  Test case 
failures in Hadoop-distcp project doesn’t impact the distcp function in 2.9.1


Bests,
Sammi
From: 俊平堵 [mailto:junping...@apache.org]
Sent: Tuesday, April 24, 2018 11:50 PM
To: Chen, Sammi <sammi.c...@intel.com>
Cc: Hadoop Common <common-...@hadoop.apache.org>; Rushabh Shah 
<rusha...@oath.com>; hdfs-dev <hdfs-...@hadoop.apache.org>; 
mapreduce-dev@hadoop.apache.org; yarn-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

Thanks for reporting the issue, Rushabh! Actually, we found that these test 
failures belong to test issues but not production issue, so not really a solid 
blocker for release. Anyway, I will let RM of 2.9.1 to decide if to cancel RC 
or not for this test issue.

Thanks,

Junping


Chen, Sammi <sammi.c...@intel.com<mailto:sammi.c...@intel.com>>于2018年4月24日 
周二下午7:50写道:
Hi Rushabh,

Thanks for reporting the issue.  I will upload a new RC candidate soon after 
the test failing issue is resolved.


Bests,
Sammi Chen
From: Rushabh Shah [mailto:rusha...@oath.com<mailto:rusha...@oath.com>]
Sent: Friday, April 20, 2018 5:12 AM
To: Chen, Sammi <sammi.c...@intel.com<mailto:sammi.c...@intel.com>>
Cc: Hadoop Common 
<common-...@hadoop.apache.org<mailto:common-...@hadoop.apache.org>>; hdfs-dev 
<hdfs-...@hadoop.apache.org<mailto:hdfs-...@hadoop.apache.org>>; 
mapreduce-dev@hadoop.apache.org<mailto:mapreduce-dev@hadoop.apache.org>; 
yarn-...@hadoop.apache.org<mailto:yarn-...@hadoop.apache.org>
Subject: Re: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

Hi Chen,
I am so sorry to bring this up now but there are 16 tests failing in 
hadoop-distcp project.
I have opened a ticket and cc'ed Junping since he is branch-2.8 committer but I 
missed to ping you.

IMHO we should fix the unit tests before we release but I would leave upto 
other members to give their opinion.


-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org


-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org


RE: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

2018-04-24 Thread Chen, Sammi

Paste the links here,

The artifacts are available here:  
https://dist.apache.org/repos/dist/dev/hadoop/2.9.1-RC0/  

The RC tag in git is release-2.9.1-RC0. Last git commit SHA is 
e30710aea4e6e55e69372929106cf119af06fd0e.

The maven artifacts are available at:
https://repository.apache.org/content/repositories/orgapachehadoop-1115/ 

My public key is available from:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS 


Bests,
Sammi
-Original Message-
From: Chen, Sammi [mailto:sammi.c...@intel.com] 
Sent: Wednesday, April 25, 2018 12:02 PM
To: junping...@apache.org
Cc: Hadoop Common <common-...@hadoop.apache.org>; Rushabh Shah 
<rusha...@oath.com>; hdfs-dev <hdfs-...@hadoop.apache.org>; 
mapreduce-dev@hadoop.apache.org; yarn-...@hadoop.apache.org
Subject: RE: [VOTE] Release Apache Hadoop 2.9.1 (RC0)


Thanks Jason Lowe for the quick investigation to find out that the test 
failures belong to the test only.

Based on the current facts, I would like to continue calling the VOTE for 2.9.1 
RC0,  and extend the vote deadline to end of this week 4/27.


I will add following note to the final release notes,

HADOOP-15385<https://issues.apache.org/jira/browse/HADOOP-15385>   Test case 
failures in Hadoop-distcp project doesn’t impact the distcp function in 2.9.1


Bests,
Sammi
From: 俊平堵 [mailto:junping...@apache.org]
Sent: Tuesday, April 24, 2018 11:50 PM
To: Chen, Sammi <sammi.c...@intel.com>
Cc: Hadoop Common <common-...@hadoop.apache.org>; Rushabh Shah 
<rusha...@oath.com>; hdfs-dev <hdfs-...@hadoop.apache.org>; 
mapreduce-dev@hadoop.apache.org; yarn-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

Thanks for reporting the issue, Rushabh! Actually, we found that these test 
failures belong to test issues but not production issue, so not really a solid 
blocker for release. Anyway, I will let RM of 2.9.1 to decide if to cancel RC 
or not for this test issue.

Thanks,

Junping


Chen, Sammi <sammi.c...@intel.com<mailto:sammi.c...@intel.com>>于2018年4月24日 
周二下午7:50写道:
Hi Rushabh,

Thanks for reporting the issue.  I will upload a new RC candidate soon after 
the test failing issue is resolved.


Bests,
Sammi Chen
From: Rushabh Shah [mailto:rusha...@oath.com<mailto:rusha...@oath.com>]
Sent: Friday, April 20, 2018 5:12 AM
To: Chen, Sammi <sammi.c...@intel.com<mailto:sammi.c...@intel.com>>
Cc: Hadoop Common 
<common-...@hadoop.apache.org<mailto:common-...@hadoop.apache.org>>; hdfs-dev 
<hdfs-...@hadoop.apache.org<mailto:hdfs-...@hadoop.apache.org>>; 
mapreduce-dev@hadoop.apache.org<mailto:mapreduce-dev@hadoop.apache.org>; 
yarn-...@hadoop.apache.org<mailto:yarn-...@hadoop.apache.org>
Subject: Re: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

Hi Chen,
I am so sorry to bring this up now but there are 16 tests failing in 
hadoop-distcp project.
I have opened a ticket and cc'ed Junping since he is branch-2.8 committer but I 
missed to ping you.

IMHO we should fix the unit tests before we release but I would leave upto 
other members to give their opinion.

-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org


RE: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

2018-04-24 Thread Chen, Sammi

Thanks Jason Lowe for the quick investigation to find out that the test 
failures belong to the test only.

Based on the current facts, I would like to continue calling the VOTE for 2.9.1 
RC0,  and extend the vote deadline to end of this week 4/27.


I will add following note to the final release notes,

HADOOP-15385<https://issues.apache.org/jira/browse/HADOOP-15385>   Test case 
failures in Hadoop-distcp project doesn’t impact the distcp function in 2.9.1


Bests,
Sammi
From: 俊平堵 [mailto:junping...@apache.org]
Sent: Tuesday, April 24, 2018 11:50 PM
To: Chen, Sammi <sammi.c...@intel.com>
Cc: Hadoop Common <common-...@hadoop.apache.org>; Rushabh Shah 
<rusha...@oath.com>; hdfs-dev <hdfs-...@hadoop.apache.org>; 
mapreduce-dev@hadoop.apache.org; yarn-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

Thanks for reporting the issue, Rushabh! Actually, we found that these test 
failures belong to test issues but not production issue, so not really a solid 
blocker for release. Anyway, I will let RM of 2.9.1 to decide if to cancel RC 
or not for this test issue.

Thanks,

Junping


Chen, Sammi <sammi.c...@intel.com<mailto:sammi.c...@intel.com>>于2018年4月24日 
周二下午7:50写道:
Hi Rushabh,

Thanks for reporting the issue.  I will upload a new RC candidate soon after 
the test failing issue is resolved.


Bests,
Sammi Chen
From: Rushabh Shah [mailto:rusha...@oath.com<mailto:rusha...@oath.com>]
Sent: Friday, April 20, 2018 5:12 AM
To: Chen, Sammi <sammi.c...@intel.com<mailto:sammi.c...@intel.com>>
Cc: Hadoop Common 
<common-...@hadoop.apache.org<mailto:common-...@hadoop.apache.org>>; hdfs-dev 
<hdfs-...@hadoop.apache.org<mailto:hdfs-...@hadoop.apache.org>>; 
mapreduce-dev@hadoop.apache.org<mailto:mapreduce-dev@hadoop.apache.org>; 
yarn-...@hadoop.apache.org<mailto:yarn-...@hadoop.apache.org>
Subject: Re: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

Hi Chen,
I am so sorry to bring this up now but there are 16 tests failing in 
hadoop-distcp project.
I have opened a ticket and cc'ed Junping since he is branch-2.8 committer but I 
missed to ping you.

IMHO we should fix the unit tests before we release but I would leave upto 
other members to give their opinion.


RE: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

2018-04-24 Thread Chen, Sammi
Hi Rushabh,

Thanks for reporting the issue.  I will upload a new RC candidate soon after 
the test failing issue is resolved.


Bests,
Sammi Chen
From: Rushabh Shah [mailto:rusha...@oath.com]
Sent: Friday, April 20, 2018 5:12 AM
To: Chen, Sammi <sammi.c...@intel.com>
Cc: Hadoop Common <common-...@hadoop.apache.org>; hdfs-dev 
<hdfs-...@hadoop.apache.org>; mapreduce-dev@hadoop.apache.org; 
yarn-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

Hi Chen,
I am so sorry to bring this up now but there are 16 tests failing in 
hadoop-distcp project.
I have opened a ticket and cc'ed Junping since he is branch-2.8 committer but I 
missed to ping you.

IMHO we should fix the unit tests before we release but I would leave upto 
other members to give their opinion.



[VOTE] Release Apache Hadoop 2.9.1 (RC0)

2018-04-19 Thread Chen, Sammi
Hi all,

This is the first dot release of Apache Hadoop 2.9 line since 2.9.0 was 
released on November 17, 2017.   

It includes 208 changes. Among them, 9 blockers, 15 critical issues and rest 
are normal bug fixes and feature improvements.

Thanks to the many who contributed to the 2.9.1 development.  

The artifacts are available here:  
https://dist.apache.org/repos/dist/dev/hadoop/2.9.1-RC0/ 

The RC tag in git is release-2.9.1-RC0. Last git commit SHA is 
e30710aea4e6e55e69372929106cf119af06fd0e.

The maven artifacts are available at:
https://repository.apache.org/content/repositories/orgapachehadoop-1115/ 

My public key is available from:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS 

Please try the release and vote; the vote will run for the usual 5 days, ending 
on 4/25/2018 PST time.

Also I would like thank Lei(Eddy) Xu and Chris Douglas for your help during the 
RC preparation.

Bests,
Sammi Chen


RE: Apache Hadoop 2.9.1 Release Plan

2018-04-06 Thread Chen, Sammi
Hi Wei-Chiu,

HDFS-11915 improves the data reliability when there is power failure.  I'm 
happy to include it in 2.9.1 release. 

Would you help to cherry-pick it to both branch-2.9 and branch-2.9.1? 


Thanks,
Sammi 

-Original Message-
From: Wei-Chiu Chuang [mailto:weic...@cloudera.com] 
Sent: Thursday, April 5, 2018 1:30 AM
To: Chen, Sammi <sammi.c...@intel.com>
Cc: hdfs-dev <hdfs-...@hadoop.apache.org>; mapreduce-dev@hadoop.apache.org; 
common-...@hadoop.apache.org; yarn-...@hadoop.apache.org
Subject: Re: Apache Hadoop 2.9.1 Release Plan

Sorry Sammi I was late to this thread.
Please considering incorporating HDFS-11915. Sync rbw dir on the first
hsync() to avoid file lost on power failure.
I thought it was already in 2.9.1 but turns out it didn't land. The cherry pick 
to branch-2.9 is conflict free.

On Mon, Apr 2, 2018 at 4:34 AM, Chen, Sammi <sammi.c...@intel.com> wrote:

> Hi All,
>
> Today I have created branch-2.9.1 from branch-2.9 and started creating the
> RC0  based on branch-2.9.1.   But due to the corporate network conditions
> and my not full privileges on Hadoop,   it will take a while for RC0 to
> come out.
>
> If you have anything want to commit to branch-2.9.1,  please let me know.
>
> Also I will update fix version of all  2.9.1 JIRAs and moved all 
> unresolved JIRA with target version = 2.9.1 to 2.9.2.
>
>
>
> Bests,
> Sammi Chen
>
> -Original Message-
> From: Chen, Sammi [mailto:sammi.c...@intel.com]
> Sent: Friday, March 30, 2018 3:55 PM
> To: hdfs-dev <hdfs-...@hadoop.apache.org>; 
> mapreduce-dev@hadoop.apache.org; common-...@hadoop.apache.org; 
> yarn-...@hadoop.apache.org
> Subject: Apache Hadoop 2.9.1 Release Plan
>
> Hi All,
>
> We have 47 changes on 2.9 branch since last release on Nov. 2017.   There
> are 7 blockers, 5 critical issues and rest are normal bug fixes and 
> feature improvements.
>
>
>
>
>
> Here are current tasks targeting for 2.9.1.  No critical and blockers 
> so far.
>
> https://issues.apache.org/jira/issues/?jql=%22Target+
> Version%2Fs%22+%3D+2.9.1+AND+%28project+%3D+hadoop+OR+
> project+%3D+%22Hadoop+HDFS%22+OR+project+%3D+%22Hadoop+YARN%
> 22+OR+project+%3D+%22Hadoop+Map%2FReduce%22+OR+project+%
> 3D+%22Hadoop+Common%22%29+AND+status+%21%3D+resolved+ORDER+
> BY+priority+DESC
>
>
> I plan to cut the 2.9.1 branch today, and try to deliver the RC0  ASAP.
>  Please let me know if you have any objections or suggestions.
>
>
>
>
>
>
> Bests,
>
> Sammi
>
>
>
>
> -
> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
>
>


--
A very happy Clouderan


RE: Apache Hadoop 2.9.1 Release Plan

2018-04-02 Thread Chen, Sammi
Hi All,

Today I have created branch-2.9.1 from branch-2.9 and started creating the RC0  
based on branch-2.9.1.   But due to the corporate network conditions and my not 
full privileges on Hadoop,   it will take a while for RC0 to come out.  

If you have anything want to commit to branch-2.9.1,  please let me know.  

Also I will update fix version of all  2.9.1 JIRAs and moved all unresolved 
JIRA with target version = 2.9.1 to 2.9.2.



Bests,
Sammi Chen

-Original Message-
From: Chen, Sammi [mailto:sammi.c...@intel.com] 
Sent: Friday, March 30, 2018 3:55 PM
To: hdfs-dev <hdfs-...@hadoop.apache.org>; mapreduce-dev@hadoop.apache.org; 
common-...@hadoop.apache.org; yarn-...@hadoop.apache.org
Subject: Apache Hadoop 2.9.1 Release Plan

Hi All,

We have 47 changes on 2.9 branch since last release on Nov. 2017.   There are 7 
blockers, 5 critical issues and rest are normal bug fixes and feature 
improvements.





Here are current tasks targeting for 2.9.1.  No critical and blockers so far.

https://issues.apache.org/jira/issues/?jql=%22Target+Version%2Fs%22+%3D+2.9.1+AND+%28project+%3D+hadoop+OR+project+%3D+%22Hadoop+HDFS%22+OR+project+%3D+%22Hadoop+YARN%22+OR+project+%3D+%22Hadoop+Map%2FReduce%22+OR+project+%3D+%22Hadoop+Common%22%29+AND+status+%21%3D+resolved+ORDER+BY+priority+DESC


I plan to cut the 2.9.1 branch today, and try to deliver the RC0  ASAP.   
Please let me know if you have any objections or suggestions.






Bests,

Sammi




-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org



Apache Hadoop 2.9.1 Release Plan

2018-03-30 Thread Chen, Sammi
Hi All,

We have 47 changes on 2.9 branch since last release on Nov. 2017.   There are 7 
blockers, 5 critical issues and rest are normal bug fixes and feature 
improvements.





Here are current tasks targeting for 2.9.1.  No critical and blockers so far.

https://issues.apache.org/jira/issues/?jql=%22Target+Version%2Fs%22+%3D+2.9.1+AND+%28project+%3D+hadoop+OR+project+%3D+%22Hadoop+HDFS%22+OR+project+%3D+%22Hadoop+YARN%22+OR+project+%3D+%22Hadoop+Map%2FReduce%22+OR+project+%3D+%22Hadoop+Common%22%29+AND+status+%21%3D+resolved+ORDER+BY+priority+DESC


I plan to cut the 2.9.1 branch today, and try to deliver the RC0  ASAP.   
Please let me know if you have any objections or suggestions.






Bests,

Sammi





RE: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-20 Thread Chen, Sammi
Thanks Eddy for the effort!

+1 (binding)

   - Downloaded binary tarball, verified checksums, verified signature
   - Started a pseudo distributed hdfs and YARN cluster on Mac
   - verified hadoop runtime version
   - Check webUI
   - Run Pi 
   - Verified basic hdfs operations
   - Verified basic erasure coding command(on directory, not file)
   - Verified copy/download file between HDFS and Aliyun OSS


Bests,
Sammi Chen

-Original Message-
From: Gabor Bota [mailto:gabor.b...@cloudera.com] 
Sent: Wednesday, March 21, 2018 7:36 AM
To: Yufei Gu 
Cc: Eric Payne ; Hadoop Common 
; Hdfs-dev ; 
mapreduce-dev@hadoop.apache.org; yarn-...@hadoop.apache.org; Lei Xu 

Subject: Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Thanks for working on this Eddy!

+1 (non-binding)

I've done the following:

   - checked out git tag release-3.0.1-RC1
   - built from source on Mac OS X 10.13.3, openjdk 1.8.0_144 (zulu)
   - deployed on a 3 node cluster (HDFS HA, Non-HA YARN)
   - verified example pi job
   - ran teragen, terasort and teravalidate without errors

Regards,
Gabor Bota

On Tue, Mar 20, 2018 at 2:07 PM, Yufei Gu  wrote:

> Thanks Eddy!
>
> +1 (non-binding)
>
>- Downloaded the hadoop-3.0.1.tar.gz from 
> http://home.apache.org/~lei/hadoop-3.0.1-RC1/
>- Started a pseudo cluster inside one docker container
>- Verified distributed shell
>- Verified mapreduce pi job
>- Sanity check RM WebUI
>
> Best,
>
> Yufei
>
> On Tue, Mar 20, 2018 at 9:32 AM, Eric Payne  invalid>
> wrote:
>
> >  Thanks for working on this release!
> > +1 (binding)
> > I tested the following:
> > - yarn distributed shell job
> >
> > - yarn streaming job
> >
> > - inter-queue preemption
> >
> > - compared behavior of fair and fifo ordering policy
> >
> > - both userlimit_first mode and priority_first mode of intra-queue 
> > preemption
> >
> > Eric Payne
> >
> >
> >
> > On Saturday, March 17, 2018, 11:11:32 PM CDT, Lei Xu 
> >  >
> > wrote:
> >
> >  Hi, all
> >
> > I've created release candidate RC-1 for Apache Hadoop 3.0.1
> >
> > Apache Hadoop 3.0.1 will be the first bug fix release for Apache 
> > Hadoop 3.0 release. It includes 49 bug fixes and security fixes, 
> > which include 12 blockers and 17 are critical.
> >
> > Please note:
> > * HDFS-12990. Change default NameNode RPC port back to 8020. It 
> > makes incompatible changes to Hadoop 3.0.0.  After 3.0.1 releases, 
> > Apache Hadoop 3.0.0 will be deprecated due to this change.
> >
> > The release page is:
> > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Releas
> > e
> >
> > New RC is available at: 
> > http://home.apache.org/~lei/hadoop-3.0.1-RC1/
> >
> > The git tag is release-3.0.1-RC1, and the latest commit is
> > 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
> >
> > The maven artifacts are available at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1
> > 081/
> >
> > Please try the release and vote; the vote will run for the usual 5 
> > days, ending on 3/22/2017 6pm PST time.
> >
> > Thanks!
> >
> > 
> > - To unsubscribe, e-mail: 
> > mapreduce-dev-unsubscr...@hadoop.apache.org
> > For additional commands, e-mail: 
> > mapreduce-dev-h...@hadoop.apache.org
> >
> >
>


RE: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-20 Thread Chen, Sammi
Thanks Eddy for driving 3.0.1 release. 

I'm testing the release and will vote later. 

One thing I noticed that the JIRA links on page 
https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release is linked 
to the page itself, not the individual JIRA.  I'm not sure if it's the design. 


Thanks,
Sammi
-Original Message-
From: Lei Xu [mailto:l...@apache.org] 
Sent: Sunday, March 18, 2018 12:11 PM
To: Hadoop Common ; Hdfs-dev 
; mapreduce-dev@hadoop.apache.org; 
yarn-...@hadoop.apache.org
Subject: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Hi, all

I've created release candidate RC-1 for Apache Hadoop 3.0.1

Apache Hadoop 3.0.1 will be the first bug fix release for Apache Hadoop 3.0 
release. It includes 49 bug fixes and security fixes, which include 12 blockers 
and 17 are critical.

Please note:
* HDFS-12990. Change default NameNode RPC port back to 8020. It makes 
incompatible changes to Hadoop 3.0.0.  After 3.0.1 releases, Apache Hadoop 
3.0.0 will be deprecated due to this change.

The release page is:
https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release

New RC is available at: http://home.apache.org/~lei/hadoop-3.0.1-RC1/

The git tag is release-3.0.1-RC1, and the latest commit is
496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0

The maven artifacts are available at:
https://repository.apache.org/content/repositories/orgapachehadoop-1081/

Please try the release and vote; the vote will run for the usual 5 days, ending 
on 3/22/2017 6pm PST time.

Thanks!

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org



RE: About reset branch-3.1 to trunk before release.

2018-03-19 Thread Chen, Sammi
Thanks Wangda for driving the 3.1 release.

HADOOP-15262 targets 3.1 release too. I didn't commit to the branch-3.1 
previously since I noticed that the branch will be reset to trunk.   

If you have no other concern, I will check pick  HADOOP-15262 to the new 3.1 
branch today. 


Thanks,
Sammi
-Original Message-
From: Wangda Tan [mailto:wheele...@gmail.com] 
Sent: Tuesday, March 20, 2018 2:38 AM
To: Akira Ajisaka 
Cc: Vinod Kumar Vavilapalli ; yarn-...@hadoop.apache.org; 
Hdfs-dev ; common-...@hadoop.apache.org; 
mapreduce-dev@hadoop.apache.org
Subject: Re: About reset branch-3.1 to trunk before release.

Done JIRA fix version update:

Moved all JIRAs with fixVersion = 3.2.0 to 3.1.0 except following few fixes 
(which committed after 49c747ab187d0650143205ba57ca19607ec4c6bd)

YARN-8002. Support NOT_SELF and ALL namespace types for allocation tag.
(Weiwe
i Yang via wangda)

HADOOP-15262. AliyunOSS: move files under a directory in parallel when 
rename a directory. Contributed by Jinhu Wu.

MAPREDUCE-7066. TestQueue fails on Java9

YARN-8028. Support authorizeUserAccessToQueue in RMWebServices.
Contributed by Wangda Tan.

YARN-8040. [UI2] New YARN UI webapp does not respect current pathname for 
REST api. Contributed by Sunil G.

Thanks,
Wangda

On Mon, Mar 19, 2018 at 11:12 AM, Wangda Tan  wrote:

> Thanks Akira for the additional vote,
>
> With help from Apache Infra Team (Daniel Takamori), we just reset
> branch-3.1 to trunk (SHA: 49c747ab187d0650143205ba57ca19607ec4c6bd). 
> Will update JIRA fix version shortly.
>
> - Wangda
>
> On Sun, Mar 18, 2018 at 6:10 PM, Akira Ajisaka 
>  > wrote:
>
>> +1 for resetting branch-3.1.
>>
>> Thanks,
>> Akira
>>
>>
>> On 2018/03/18 12:51, Wangda Tan wrote:
>>
>>> Thanks for sharing your thoughts.
>>>
>>> We have done build and single node cluster deploy / test for the 
>>> latest trunk code (commit: 
>>> 49c747ab187d0650143205ba57ca19607ec4c6bd). Since there are no 
>>> objections, so I will go ahead to do the branch replace.
>>>
>>> Since we don't have force push permission to release branches. I 
>>> just filed
>>> https://issues.apache.org/jira/browse/INFRA-16204 to get help from 
>>> Apache infra team.
>>>
>>> Please hold any commits to branch-3.1, will keep this email thread 
>>> posted.
>>>
>>> Best,
>>> Wangda
>>>
>>> On Wed, Mar 14, 2018 at 3:14 PM, Vinod Kumar Vavilapalli < 
>>> vino...@apache.org
>>>
 wrote:

>>>
>>> I see one new feature: https://issues.apache.org/jira/browse/YARN-7626:
 Allow regular expression matching in container-executor.cfg for 
 devices and named docker volumes mount.

 There are 21 sub-tasks. There are three feature-type JIRAs in those 
 - https://issues.apache.org/jira/browse/YARN-7972,
 https://issues.apache.org/jira/browse/YARN-7891 and 
 https://issues.apache.org/jira/browse/YARN-5015. These should be 
 okay - not major disrupting features.

 Everything else is either a bug-fix or an improvement so we should 
 be good.

  From the list, it doesn't look like resetting will destabilize 
 3.1, +1 for doing this.

 Thanks
 +Vinod

 On Mar 14, 2018, at 1:54 PM, Wangda Tan  wrote:
>
> Hi mapreduce/yarn/common/hdfs-devs,
>
> As of now, we have all blockers done for 3.1.0 release [1]. The 
> release
>
 is running behind schedule due to a few security-related issues.
 Because of
 this and since branch-3.1 is cut 5 weeks before on Feb 8, trunk 3.2 
 is already diverging. There're 64 commits in trunk but not in branch-3.1.
 [2]

>
> I took a quick scan of them, most of them are good fixes which we 
> should
>
 bring to 3.1.0 as well. And this can also reduce differences 
 between
 3.2.0
 and 3.1.0 release for less maintenance burden in the future.

>
> Unless anyone objects, we will reset branch-3.1 to trunk in 1-2 
> days and
>
 cut RC after that.

>
> Thoughts?
>
> - Wangda
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND priority in 
> (Blocker,
>
 Critical) AND resolution = Unresolved AND "Target Version/s" = 
 3.1.0 ORDER BY priority DESC

> [2] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in
> (3.2.0)
>
 AND fixVersion not in (3.1.0)



>>>
>

-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org


RE: Apache Hadoop 2.9.1 Release Plan

2018-01-10 Thread Chen, Sammi
Thanks Arun for the reminder. 

Here is the 2.9.1 monitor list,  

https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true=%22Target+Version%2Fs%22+%3D+2.9.1+AND+%28project+%3D+hadoop+OR+project+%3D+%22Hadoop+HDFS%22+OR+project+%3D+%22Hadoop+YARN%22+OR+project+%3D+%22Hadoop+Map%2FReduce%22+OR+project+%3D+%22Hadoop+Common%22%29+AND+status+%21%3D+resolved+ORDER+BY+priority+DESC
 


Bests,
Sammi
-Original Message-
From: Arun Suresh [mailto:arun.sur...@gmail.com] 
Sent: Thursday, January 11, 2018 2:14 AM
To: Chen, Sammi <sammi.c...@intel.com>
Cc: Hadoop Common <common-...@hadoop.apache.org>; 
mapreduce-dev@hadoop.apache.org; yarn-...@hadoop.apache.org; Hdfs-dev 
<hdfs-...@hadoop.apache.org>
Subject: Re: Apache Hadoop 2.9.1 Release Plan

Hey Sammi,

Looks like your filter is private.

Cheers
-Arun

On Wed, Jan 10, 2018 at 12:28 AM, Chen, Sammi <sammi.c...@intel.com> wrote:

> Hi  All,
>
>
>
> We have successfully released Apache Hadoop 2.9.0 in Nov. 2017 [1] 
> with 30 new features, 407 improvements, 790 bug fixes new fixed issues since
> 2.8.2.   To further improve the quality and stability of the release,  we
> plan to start the 2.9.1 release work.
>
>
>
> The priority of 2.9.1 will be fixing blockers,  critical bugs,  bug fixes
> and improvements.   So far, I don't see any pending blockers and critical
> bugs on 2.9.1[2].
>
>
>
> We plan to cut the branch-2.9.1 on March 1st,  and targeting for March 
> 9th release.
>
>
>
> For all coming commits to land on branch-2.9, please mark the fix 
> version as 2.9.1.
>
>
>
> Please feel free to let me know if you have any thoughts or comments 
> on the plan.
>
>
>
>
>
> [1] http://hadoop.apache.org/docs/r2.9.0/
>
> [2] https://issues.apache.org/jira/issues/?filter=12342845
>
>
>
>
>
> Bests,
>
> Sammi Chen
>
> -
>
> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org hdfs-dev-unsubscr...@hadoop.apache.org>
>
> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org hdfs-dev-h...@hadoop.apache.org>
>
>

-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org


Apache Hadoop 2.9.1 Release Plan

2018-01-10 Thread Chen, Sammi
Hi  All,



We have successfully released Apache Hadoop 2.9.0 in Nov. 2017 [1] with 30 new 
features, 407 improvements, 790 bug fixes new fixed issues since 2.8.2.   To 
further improve the quality and stability of the release,  we plan to start the 
2.9.1 release work.



The priority of 2.9.1 will be fixing blockers,  critical bugs,  bug fixes and 
improvements.   So far, I don't see any pending blockers and critical bugs on 
2.9.1[2].



We plan to cut the branch-2.9.1 on March 1st,  and targeting for March 9th 
release.



For all coming commits to land on branch-2.9, please mark the fix version as 
2.9.1.



Please feel free to let me know if you have any thoughts or comments on the 
plan.





[1] http://hadoop.apache.org/docs/r2.9.0/

[2] https://issues.apache.org/jira/issues/?filter=12342845





Bests,

Sammi Chen

-

To unsubscribe, e-mail: 
hdfs-dev-unsubscr...@hadoop.apache.org

For additional commands, e-mail: 
hdfs-dev-h...@hadoop.apache.org



RE: [VOTE] Release Apache Hadoop 3.0.0 RC0

2017-11-20 Thread Chen, Sammi

+1 (binding)

1) Compile with native from source code
2) Set up a one-node cluster, enabling short-circuit read
3) Tried some basic HDFS commands, ls, put etc. 
4) MapReduce workloads: TestDFSIO, TeraGen and TeraSort
5) Test storage policy and mover successfully

Sorry for the late response. 

-Original Message-
From: John Zhuge [mailto:john.zh...@gmail.com]
Sent: Friday, November 17, 2017 6:56 AM
To: Andrew Wang 
Cc: common-...@hadoop.apache.org; yarn-...@hadoop.apache.org; 
mapreduce-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

+1 (binding)

   - Verified checksums of all tarballs
   - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
   - Passed all S3A and ADL integration tests
   - Deployed both binary and built source to a pseudo cluster, passed the
   following sanity tests in insecure, SSL, and SSL+Kerberos mode:
  - HDFS basic and ACL
  - DistCp basic
  - MapReduce wordcount (skipped in SSL+Kerberos mode)
  - KMS and HttpFS basic
  - Balancer start/stop


On Tue, Nov 14, 2017 at 1:34 PM, Andrew Wang 
wrote:

> Hi folks,
>
> Thanks as always to the many, many contributors who helped with this 
> release. I've created RC0 for Apache Hadoop 3.0.0. The artifacts are 
> available here:
>
> http://people.apache.org/~wang/3.0.0-RC0/
>
> This vote will run 5 days, ending on Nov 19th at 1:30pm Pacific.
>
> 3.0.0 GA contains 291 fixed JIRA issues since 3.0.0-beta1. Notable 
> additions include the merge of YARN resource types, API-based 
> configuration of the CapacityScheduler, and HDFS router-based federation.
>
> I've done my traditional testing with a pseudo cluster and a Pi job. 
> My +1 to start.
>
> Best,
> Andrew
>



--
John