Re: Heads up - 2.0.5-beta

2013-05-03 Thread Konstantin Shvachko
Hi Arun and Suresh, I am glad my choice of words attracted your attention. I consider this important for the project otherwise I wouldn't waste everybody's time. You tend reacting on a latest message taken out of context, which does not reveal full picture. I'll try here to summarize my proposal

Re: Heads up - 2.0.5-beta

2013-05-03 Thread Robert Evans
I agree that destructive is not the correct word to describe features like snapshots and windows support. However, I also agree with Konstantin that any large feature will have a destabilizing effect on the code base, even if it is done on a branch and thoroughly tested before being merged in.

Re: Heads up - 2.0.5-beta

2013-05-02 Thread Chris Douglas
On Wed, May 1, 2013 at 6:24 PM, Arun C Murthy a...@hortonworks.com wrote: Having a strict policy leads to all sorts of further dialogues and issues we could do well without. +1 Can anyone remember why we vote on release plans? -C

Re: Heads up - 2.0.5-beta

2013-05-02 Thread Konstantin Shvachko
I am not sure what was your point here. You seem to be assuming things I never mentioned. I am arguing against invasive and destructive features proposed for the release. Just to remind here they are again, since the history has been wiped out. # Snapshots # NFS gateway for HDFS # HDFS-347 unix

Re: Heads up - 2.0.5-beta

2013-05-02 Thread Konstantin Shvachko
On Thu, May 2, 2013 at 12:07 AM, Chris Douglas cdoug...@apache.org wrote: Can anyone remember why we vote on release plans? -C To vote on features to include in the release. Thanks, --Konstantin

Re: Heads up - 2.0.5-beta

2013-05-02 Thread Arun C Murthy
Konstantin, On May 2, 2013, at 2:08 AM, Konstantin Shvachko wrote: I am arguing against invasive and destructive features proposed for the release. Just to remind here they are again, since the history has been wiped out. # Snapshots # NFS gateway for HDFS # HDFS-347 unix domain socket

Re: Heads up - 2.0.5-beta

2013-05-02 Thread Chris Douglas
On Thu, May 2, 2013 at 2:11 AM, Konstantin Shvachko shv.had...@gmail.com wrote: On Thu, May 2, 2013 at 12:07 AM, Chris Douglas cdoug...@apache.org wrote: Can anyone remember why we vote on release plans? -C To vote on features to include in the release. Since most features are developed in

Re: Heads up - 2.0.5-beta

2013-05-01 Thread Konstantin Shvachko
If there are no objections, I'll start a vote on this proposal now. Thanks, --Konstantin On Tue, Apr 30, 2013 at 4:28 PM, Konstantin Shvachko shv.had...@gmail.comwrote: Hi Arun, I am agnostic about version numbers too, as long as the count goes up. The discussion you are referring to is

Re: Heads up - 2.0.5-beta

2013-05-01 Thread Arun C Murthy
Konstantin, On Apr 30, 2013, at 4:28 PM, Konstantin Shvachko wrote: Hi Arun, I am agnostic about version numbers too, as long as the count goes up. The discussion you are referring to is somewhat outdated, it was talking about 2.0.4-beta, which we already passed. It's very relevant and

Re: Heads up - 2.0.5-beta

2013-05-01 Thread Konstantin Shvachko
On Wed, May 1, 2013 at 1:15 PM, Arun C Murthy a...@hortonworks.com wrote: On Apr 30, 2013, at 4:28 PM, Konstantin Shvachko wrote: If the next release has to be 2.0.5 I would like to make an alternative proposal, which would include - stabilization of current 2.0.4 - making all API

Re: Heads up - 2.0.5-beta

2013-05-01 Thread Arun C Murthy
On May 1, 2013, at 4:08 PM, Konstantin Shvachko wrote: On Wed, May 1, 2013 at 1:15 PM, Arun C Murthy a...@hortonworks.com wrote: On Apr 30, 2013, at 4:28 PM, Konstantin Shvachko wrote: If the next release has to be 2.0.5 I would like to make an alternative proposal, which would include

Re: Heads up - 2.0.5-beta

2013-04-30 Thread Steve Loughran
? On 25 April 2013 19:23, Amir Sanja From: Steve Loughran ste...@hortonworks.com To: common-dev@hadoop.apache.org, Date: 04/29/2013 05:40 PM Subject: Re: Heads up - 2.0.5-beta -- you need those patches to remove sun-specific bits in, don't you?

Re: Heads up - 2.0.5-beta

2013-04-30 Thread Amir Sanjar
you? On 25 April 2013 19:23, Amir Sanja From: Steve Loughran ste...@hortonworks.com To: common-dev@hadoop.apache.org, Date: 04/29/2013 05:40 PM Subject: Re: Heads up - 2.0.5-beta -- you need those patches to remove sun-specific bits in, don't you?

Re: Heads up - 2.0.5-beta

2013-04-30 Thread Konstantin Shvachko
Hi Arun, I am agnostic about version numbers too, as long as the count goes up. The discussion you are referring to is somewhat outdated, it was talking about 2.0.4-beta, which we already passed. It is talking about producing a series not suitable for general consumption, which isn't correct for

Re: Heads up - 2.0.5-beta

2013-04-29 Thread Steve Loughran
-...@hadoop.apache.org, Date: 04/25/2013 08:34 PM Subject: Heads up - 2.0.5-beta -- Gang, With hadoop-2.0.4-alpha released, I'd like 2.0.4 to be the final of our hadoop-2.x alphas. We have made lots of progress on hadoop-2.x and I believe we are nearly there, exciting times

Re: Heads up - 2.0.5-beta

2013-04-29 Thread Amir Sanjar
:40 PM Subject:Re: Heads up - 2.0.5-beta you need those patches to remove sun-specific bits in, don't you? On 25 April 2013 19:23, Amir Sanjar v1san...@us.ibm.com wrote: Arun, thanks for the update. This is indeed the news we (IBM) have been waiting for. Please let us know

Re: Heads up - 2.0.5-beta

2013-04-29 Thread Roman Shaposhnik
On Fri, Apr 26, 2013 at 11:15 AM, Arun C Murthy a...@hortonworks.com wrote: On Apr 25, 2013, at 7:31 PM, Roman Shaposhnik wrote: On Thu, Apr 25, 2013 at 6:34 PM, Arun C Murthy a...@hortonworks.com wrote: With that in mind, I really want to make a serious push to lock down APIs and

Re: Heads up - 2.0.5-beta

2013-04-28 Thread Arun C Murthy
Agreed Luke. Thanks for pointing it out, I'll track it as such. Arun On Apr 26, 2013, at 1:37 PM, Luke Lu wrote: If protocol compatibility of v2 and v3 is a goal, HADOOP-8990 should be a blocker for v2. __Luke On Fri, Apr 26, 2013 at 12:07 PM, Eli Collins e...@cloudera.com wrote: On

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Arun C Murthy
On Apr 25, 2013, at 6:36 PM, Suresh Srinivas wrote: On Thu, Apr 25, 2013 at 6:34 PM, Arun C Murthy a...@hortonworks.com wrote: Similarly on HDFS side, can someone please help out by tagging features, bug-fixes, protocol/API changes etc.? This way we can ensure HDFS APIs protocols are

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Arun C Murthy
On Apr 25, 2013, at 7:31 PM, Roman Shaposhnik wrote: On Thu, Apr 25, 2013 at 6:34 PM, Arun C Murthy a...@hortonworks.com wrote: With that in mind, I really want to make a serious push to lock down APIs and wire-protocols for hadoop-2.0.5-beta. Thus, we can confidently support hadoop-2.x

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Eli Collins
On Fri, Apr 26, 2013 at 11:15 AM, Arun C Murthy a...@hortonworks.com wrote: On Apr 25, 2013, at 7:31 PM, Roman Shaposhnik wrote: On Thu, Apr 25, 2013 at 6:34 PM, Arun C Murthy a...@hortonworks.com wrote: With that in mind, I really want to make a serious push to lock down APIs and

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Luke Lu
If protocol compatibility of v2 and v3 is a goal, HADOOP-8990 should be a blocker for v2. __Luke On Fri, Apr 26, 2013 at 12:07 PM, Eli Collins e...@cloudera.com wrote: On Fri, Apr 26, 2013 at 11:15 AM, Arun C Murthy a...@hortonworks.com wrote: On Apr 25, 2013, at 7:31 PM, Roman Shaposhnik

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Suresh Srinivas
Eli, I will post a more detailed reply soon. But one small correction: I'm also not sure there's currently consensus on what an incompatible change is. For example, I think HADOOP-9151 is incompatible because it broke client/server wire compatibility with previous releases and any change that

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Eli Collins
On Fri, Apr 26, 2013 at 2:42 PM, Suresh Srinivas sur...@hortonworks.com wrote: Eli, I will post a more detailed reply soon. But one small correction: I'm also not sure there's currently consensus on what an incompatible change is. For example, I think HADOOP-9151 is incompatible because it

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Konstantin Shvachko
Arun, Could you please define the release plan and put it into vote. In accordance with the ByLaws. After this discussion of course. http://hadoop.apache.org/bylaws.html Release Plan Defines the timetable and actions for a release. The plan also nominates a Release Manager. Lazy majority of

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Konstantin Shvachko
Arun, Suresh, Very exciting to hear about this final push to stable Hadoop 2. But I have a problem. Either with the plan or with the version number. I'll be arguing for the number change below rather than the plan. 1. Based on features listed by Suresh it looks that you plan a heavy feature-full

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Arpit Agarwal
On Thu, Apr 25, 2013 at 6:36 PM, Suresh Srinivas sur...@hortonworks.com wrote: Thanks for starting this discussion. I volunteer to do a final review of protocol changes, so we can avoid incompatible changes to API and wire protocol post 2.0.5 in Common and HDFS. We have been working really

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Arun C Murthy
Konstantin, On Apr 26, 2013, at 4:34 PM, Konstantin Shvachko wrote: Do you think we can call the version you proposed to release 2.1.0 or 2.1.0-beta? The proposed new features imho do not exactly conform with the idea of dot-dot release, but definitely qualify for a major number change. I

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Arun C Murthy
On Apr 26, 2013, at 12:07 PM, Eli Collins wrote: Arun, Suresh, Mind reviewing the following page Karthik put together on compatibility? http://wiki.apache.org/hadoop/Compatibility Sure. Will do. I just opened https://issues.apache.org/jira/browse/HADOOP-9517 to ensure we capture it for

Heads up - 2.0.5-beta

2013-04-25 Thread Arun C Murthy
Gang, With hadoop-2.0.4-alpha released, I'd like 2.0.4 to be the final of our hadoop-2.x alphas. We have made lots of progress on hadoop-2.x and I believe we are nearly there, exciting times! As we have discussed previously, I hope to do a final push to stabilize hadoop-2.x, release a

Re: Heads up - 2.0.5-beta

2013-04-25 Thread Suresh Srinivas
Thanks for starting this discussion. I volunteer to do a final review of protocol changes, so we can avoid incompatible changes to API and wire protocol post 2.0.5 in Common and HDFS. We have been working really hard on the following features. I would like to get into 2.x and see it reach HDFS

Re: Heads up - 2.0.5-beta

2013-04-25 Thread Amir Sanjar
# 512-838-8858 From: Arun C Murthy a...@hortonworks.com To: common-dev@hadoop.apache.org, hdfs-...@hadoop.apache.org, mapreduce-...@hadoop.apache.org, yarn-...@hadoop.apache.org, Date: 04/25/2013 08:34 PM Subject:Heads up - 2.0.5-beta Gang, With hadoop-2.0.4-alpha

Re: Heads up - 2.0.5-beta

2013-04-25 Thread Roman Shaposhnik
On Thu, Apr 25, 2013 at 6:34 PM, Arun C Murthy a...@hortonworks.com wrote: Gang, With hadoop-2.0.4-alpha released, I'd like 2.0.4 to be the final of our hadoop-2.x alphas. We have made lots of progress on hadoop-2.x and I believe we are nearly there, exciting times! Indeed! As we have