Re: [DISCUSS] Drop legacy hadoop support at the 2.0 release

2016-10-24 Thread Matteo Bertozzi 
cool, thanks all!

to sum up the discussion:
HBase 2.0 will have 2.6.1+ and 2.7.1+ has supported hadoop version.
(hadoop 3.x support will be decided later, since work is still going on)

HBASE-16884 - updates the supported version map in the docs,  with the
2.6.1+ and 2.7.1+ support for 2.0
HBASE-16887 - fixes pre-commit to run with 2.6.1+, 2.7.1+, 3.0 on master (hbase
2.0) and 2.4.0+, 2.5.0+, 2.6.1+, 2.7.1+ on other branches.

On Thu, Oct 20, 2016 at 7:53 AM, 张铎  wrote:

> See HBASE-16887
>
> 2016-10-20 22:50 GMT+08:00 Sean Busbey :
>
> > Unfortunately, I think this means we'll need to update the hadoopcheck
> > versions to vary by branch.
> >
> > On Wed, Oct 19, 2016 at 6:21 PM, 张铎  wrote:
> > > OK, seems no objection. I will file a issue to modify the hadoop
> version
> > > support matrix.
> > >
> > > And I think we also need to change the hadoopcheck versions for our
> > > precommit check?
> > >
> > > Thanks all.
> > >
> > > 2016-10-20 1:14 GMT+08:00 Andrew Purtell :
> > >
> > >> FWIW, we are running 2.7.x in production and it's stable.
> > >>
> > >>
> > >> On Tue, Oct 18, 2016 at 10:18 PM, Sean Busbey 
> > wrote:
> > >>
> > >> > we had not decided yet AFAIK. a big concern was the lack of
> > >> > maintenance releases on more recent Hadoop versions and the
> perception
> > >> > that 2.4 and 2.5 were the last big stable release lines.
> > >> >
> > >> > 2.6 and 2.7 have both gotten a few maintenance releases now, so
> maybe
> > >> > this isn't a concern any more?
> > >> >
> > >> > On Tue, Oct 18, 2016 at 7:00 PM, Enis Söztutar 
> > >> wrote:
> > >> > > I thought we already decided to do that, no?
> > >> > >
> > >> > > Enis
> > >> > >
> > >> > > On Tue, Oct 18, 2016 at 6:56 PM, Ted Yu 
> > wrote:
> > >> > >
> > >> > >> Looking at http://hadoop.apache.org/releases.html , 2.5.x hasn't
> > got
> > >> > new
> > >> > >> release for almost two years.
> > >> > >>
> > >> > >> Seems fine to drop support for 2.4 and 2.5
> > >> > >>
> > >> > >> On Tue, Oct 18, 2016 at 6:42 PM, Duo Zhang 
> > >> wrote:
> > >> > >>
> > >> > >> > This is the current hadoop version support matrix
> > >> > >> >
> > >> > >> > https://hbase.apache.org/book.html#hadoop
> > >> > >> >
> > >> > >> > 2016-10-19 9:40 GMT+08:00 Duo Zhang :
> > >> > >> >
> > >> > >> > > To be specific, hadoop-2.4.x and hadoop-2.5.x.
> > >> > >> > >
> > >> > >> > > The latest releases for these two lines are about two years
> > ago,
> > >> so
> > >> > I
> > >> > >> > > think it is the time to drop the support of them when 2.0
> out.
> > >> Then
> > >> > we
> > >> > >> > > could drop some code in our hadoop-compat module as we may
> > need to
> > >> > add
> > >> > >> > some
> > >> > >> > > code for the incoming hadoop-3.0...
> > >> > >> > >
> > >> > >> > > Thanks.
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> > >>
> > >>
> > >> --
> > >> Best regards,
> > >>
> > >>- Andy
> > >>
> > >> Problems worthy of attack prove their worth by hitting back. - Piet
> Hein
> > >> (via Tom White)
> > >>
> >
> >
> >
> > --
> > busbey
> >
>

Re: [DISCUSS] Drop legacy hadoop support at the 2.0 release

2016-10-20 Thread 张铎 
See HBASE-16887

2016-10-20 22:50 GMT+08:00 Sean Busbey :

> Unfortunately, I think this means we'll need to update the hadoopcheck
> versions to vary by branch.
>
> On Wed, Oct 19, 2016 at 6:21 PM, 张铎  wrote:
> > OK, seems no objection. I will file a issue to modify the hadoop version
> > support matrix.
> >
> > And I think we also need to change the hadoopcheck versions for our
> > precommit check?
> >
> > Thanks all.
> >
> > 2016-10-20 1:14 GMT+08:00 Andrew Purtell :
> >
> >> FWIW, we are running 2.7.x in production and it's stable.
> >>
> >>
> >> On Tue, Oct 18, 2016 at 10:18 PM, Sean Busbey 
> wrote:
> >>
> >> > we had not decided yet AFAIK. a big concern was the lack of
> >> > maintenance releases on more recent Hadoop versions and the perception
> >> > that 2.4 and 2.5 were the last big stable release lines.
> >> >
> >> > 2.6 and 2.7 have both gotten a few maintenance releases now, so maybe
> >> > this isn't a concern any more?
> >> >
> >> > On Tue, Oct 18, 2016 at 7:00 PM, Enis Söztutar 
> >> wrote:
> >> > > I thought we already decided to do that, no?
> >> > >
> >> > > Enis
> >> > >
> >> > > On Tue, Oct 18, 2016 at 6:56 PM, Ted Yu 
> wrote:
> >> > >
> >> > >> Looking at http://hadoop.apache.org/releases.html , 2.5.x hasn't
> got
> >> > new
> >> > >> release for almost two years.
> >> > >>
> >> > >> Seems fine to drop support for 2.4 and 2.5
> >> > >>
> >> > >> On Tue, Oct 18, 2016 at 6:42 PM, Duo Zhang 
> >> wrote:
> >> > >>
> >> > >> > This is the current hadoop version support matrix
> >> > >> >
> >> > >> > https://hbase.apache.org/book.html#hadoop
> >> > >> >
> >> > >> > 2016-10-19 9:40 GMT+08:00 Duo Zhang :
> >> > >> >
> >> > >> > > To be specific, hadoop-2.4.x and hadoop-2.5.x.
> >> > >> > >
> >> > >> > > The latest releases for these two lines are about two years
> ago,
> >> so
> >> > I
> >> > >> > > think it is the time to drop the support of them when 2.0 out.
> >> Then
> >> > we
> >> > >> > > could drop some code in our hadoop-compat module as we may
> need to
> >> > add
> >> > >> > some
> >> > >> > > code for the incoming hadoop-3.0...
> >> > >> > >
> >> > >> > > Thanks.
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >>
> >>
> >>
> >> --
> >> Best regards,
> >>
> >>- Andy
> >>
> >> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> >> (via Tom White)
> >>
>
>
>
> --
> busbey
>

Re: [DISCUSS] Drop legacy hadoop support at the 2.0 release

2016-10-20 Thread Sean Busbey 
Unfortunately, I think this means we'll need to update the hadoopcheck
versions to vary by branch.

On Wed, Oct 19, 2016 at 6:21 PM, 张铎  wrote:
> OK, seems no objection. I will file a issue to modify the hadoop version
> support matrix.
>
> And I think we also need to change the hadoopcheck versions for our
> precommit check?
>
> Thanks all.
>
> 2016-10-20 1:14 GMT+08:00 Andrew Purtell :
>
>> FWIW, we are running 2.7.x in production and it's stable.
>>
>>
>> On Tue, Oct 18, 2016 at 10:18 PM, Sean Busbey  wrote:
>>
>> > we had not decided yet AFAIK. a big concern was the lack of
>> > maintenance releases on more recent Hadoop versions and the perception
>> > that 2.4 and 2.5 were the last big stable release lines.
>> >
>> > 2.6 and 2.7 have both gotten a few maintenance releases now, so maybe
>> > this isn't a concern any more?
>> >
>> > On Tue, Oct 18, 2016 at 7:00 PM, Enis Söztutar 
>> wrote:
>> > > I thought we already decided to do that, no?
>> > >
>> > > Enis
>> > >
>> > > On Tue, Oct 18, 2016 at 6:56 PM, Ted Yu  wrote:
>> > >
>> > >> Looking at http://hadoop.apache.org/releases.html , 2.5.x hasn't got
>> > new
>> > >> release for almost two years.
>> > >>
>> > >> Seems fine to drop support for 2.4 and 2.5
>> > >>
>> > >> On Tue, Oct 18, 2016 at 6:42 PM, Duo Zhang 
>> wrote:
>> > >>
>> > >> > This is the current hadoop version support matrix
>> > >> >
>> > >> > https://hbase.apache.org/book.html#hadoop
>> > >> >
>> > >> > 2016-10-19 9:40 GMT+08:00 Duo Zhang :
>> > >> >
>> > >> > > To be specific, hadoop-2.4.x and hadoop-2.5.x.
>> > >> > >
>> > >> > > The latest releases for these two lines are about two years ago,
>> so
>> > I
>> > >> > > think it is the time to drop the support of them when 2.0 out.
>> Then
>> > we
>> > >> > > could drop some code in our hadoop-compat module as we may need to
>> > add
>> > >> > some
>> > >> > > code for the incoming hadoop-3.0...
>> > >> > >
>> > >> > > Thanks.
>> > >> > >
>> > >> >
>> > >>
>> >
>>
>>
>>
>> --
>> Best regards,
>>
>>- Andy
>>
>> Problems worthy of attack prove their worth by hitting back. - Piet Hein
>> (via Tom White)
>>



-- 
busbey

Re: [DISCUSS] Drop legacy hadoop support at the 2.0 release

2016-10-20 Thread Yu Li 
+1, we are running 2.6.x online and it's also stable.

Best Regards,
Yu

On 20 October 2016 at 13:30, Jerry He  wrote:

> Concur here.  Our distribution has on 2.7.x lines for a while.
>
> Jerry
>
> On Oct 19, 2016 6:26 PM, "张铎"  wrote:
>
> > OK, seems no objection. I will file a issue to modify the hadoop version
> > support matrix.
> >
> > And I think we also need to change the hadoopcheck versions for our
> > precommit check?
> >
> > Thanks all.
> >
> > 2016-10-20 1:14 GMT+08:00 Andrew Purtell :
> >
> > > FWIW, we are running 2.7.x in production and it's stable.
> > >
> > >
> > > On Tue, Oct 18, 2016 at 10:18 PM, Sean Busbey 
> wrote:
> > >
> > > > we had not decided yet AFAIK. a big concern was the lack of
> > > > maintenance releases on more recent Hadoop versions and the
> perception
> > > > that 2.4 and 2.5 were the last big stable release lines.
> > > >
> > > > 2.6 and 2.7 have both gotten a few maintenance releases now, so maybe
> > > > this isn't a concern any more?
> > > >
> > > > On Tue, Oct 18, 2016 at 7:00 PM, Enis Söztutar 
> > > wrote:
> > > > > I thought we already decided to do that, no?
> > > > >
> > > > > Enis
> > > > >
> > > > > On Tue, Oct 18, 2016 at 6:56 PM, Ted Yu 
> wrote:
> > > > >
> > > > >> Looking at http://hadoop.apache.org/releases.html , 2.5.x hasn't
> > got
> > > > new
> > > > >> release for almost two years.
> > > > >>
> > > > >> Seems fine to drop support for 2.4 and 2.5
> > > > >>
> > > > >> On Tue, Oct 18, 2016 at 6:42 PM, Duo Zhang 
> > > wrote:
> > > > >>
> > > > >> > This is the current hadoop version support matrix
> > > > >> >
> > > > >> > https://hbase.apache.org/book.html#hadoop
> > > > >> >
> > > > >> > 2016-10-19 9:40 GMT+08:00 Duo Zhang :
> > > > >> >
> > > > >> > > To be specific, hadoop-2.4.x and hadoop-2.5.x.
> > > > >> > >
> > > > >> > > The latest releases for these two lines are about two years
> ago,
> > > so
> > > > I
> > > > >> > > think it is the time to drop the support of them when 2.0 out.
> > > Then
> > > > we
> > > > >> > > could drop some code in our hadoop-compat module as we may
> need
> > to
> > > > add
> > > > >> > some
> > > > >> > > code for the incoming hadoop-3.0...
> > > > >> > >
> > > > >> > > Thanks.
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> > >
> > >
> > > --
> > > Best regards,
> > >
> > >- Andy
> > >
> > > Problems worthy of attack prove their worth by hitting back. - Piet
> Hein
> > > (via Tom White)
> > >
> >
>

Re: [DISCUSS] Drop legacy hadoop support at the 2.0 release

2016-10-19 Thread Jerry He 
Concur here.  Our distribution has on 2.7.x lines for a while.

Jerry

On Oct 19, 2016 6:26 PM, "张铎"  wrote:

> OK, seems no objection. I will file a issue to modify the hadoop version
> support matrix.
>
> And I think we also need to change the hadoopcheck versions for our
> precommit check?
>
> Thanks all.
>
> 2016-10-20 1:14 GMT+08:00 Andrew Purtell :
>
> > FWIW, we are running 2.7.x in production and it's stable.
> >
> >
> > On Tue, Oct 18, 2016 at 10:18 PM, Sean Busbey  wrote:
> >
> > > we had not decided yet AFAIK. a big concern was the lack of
> > > maintenance releases on more recent Hadoop versions and the perception
> > > that 2.4 and 2.5 were the last big stable release lines.
> > >
> > > 2.6 and 2.7 have both gotten a few maintenance releases now, so maybe
> > > this isn't a concern any more?
> > >
> > > On Tue, Oct 18, 2016 at 7:00 PM, Enis Söztutar 
> > wrote:
> > > > I thought we already decided to do that, no?
> > > >
> > > > Enis
> > > >
> > > > On Tue, Oct 18, 2016 at 6:56 PM, Ted Yu  wrote:
> > > >
> > > >> Looking at http://hadoop.apache.org/releases.html , 2.5.x hasn't
> got
> > > new
> > > >> release for almost two years.
> > > >>
> > > >> Seems fine to drop support for 2.4 and 2.5
> > > >>
> > > >> On Tue, Oct 18, 2016 at 6:42 PM, Duo Zhang 
> > wrote:
> > > >>
> > > >> > This is the current hadoop version support matrix
> > > >> >
> > > >> > https://hbase.apache.org/book.html#hadoop
> > > >> >
> > > >> > 2016-10-19 9:40 GMT+08:00 Duo Zhang :
> > > >> >
> > > >> > > To be specific, hadoop-2.4.x and hadoop-2.5.x.
> > > >> > >
> > > >> > > The latest releases for these two lines are about two years ago,
> > so
> > > I
> > > >> > > think it is the time to drop the support of them when 2.0 out.
> > Then
> > > we
> > > >> > > could drop some code in our hadoop-compat module as we may need
> to
> > > add
> > > >> > some
> > > >> > > code for the incoming hadoop-3.0...
> > > >> > >
> > > >> > > Thanks.
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> >
> >
> > --
> > Best regards,
> >
> >- Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>

Re: [DISCUSS] Drop legacy hadoop support at the 2.0 release

2016-10-19 Thread Andrew Purtell 
FWIW, we are running 2.7.x in production and it's stable.


On Tue, Oct 18, 2016 at 10:18 PM, Sean Busbey  wrote:

> we had not decided yet AFAIK. a big concern was the lack of
> maintenance releases on more recent Hadoop versions and the perception
> that 2.4 and 2.5 were the last big stable release lines.
>
> 2.6 and 2.7 have both gotten a few maintenance releases now, so maybe
> this isn't a concern any more?
>
> On Tue, Oct 18, 2016 at 7:00 PM, Enis Söztutar  wrote:
> > I thought we already decided to do that, no?
> >
> > Enis
> >
> > On Tue, Oct 18, 2016 at 6:56 PM, Ted Yu  wrote:
> >
> >> Looking at http://hadoop.apache.org/releases.html , 2.5.x hasn't got
> new
> >> release for almost two years.
> >>
> >> Seems fine to drop support for 2.4 and 2.5
> >>
> >> On Tue, Oct 18, 2016 at 6:42 PM, Duo Zhang  wrote:
> >>
> >> > This is the current hadoop version support matrix
> >> >
> >> > https://hbase.apache.org/book.html#hadoop
> >> >
> >> > 2016-10-19 9:40 GMT+08:00 Duo Zhang :
> >> >
> >> > > To be specific, hadoop-2.4.x and hadoop-2.5.x.
> >> > >
> >> > > The latest releases for these two lines are about two years ago, so
> I
> >> > > think it is the time to drop the support of them when 2.0 out. Then
> we
> >> > > could drop some code in our hadoop-compat module as we may need to
> add
> >> > some
> >> > > code for the incoming hadoop-3.0...
> >> > >
> >> > > Thanks.
> >> > >
> >> >
> >>
>



-- 
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)

Re: [DISCUSS] Drop legacy hadoop support at the 2.0 release

2016-10-18 Thread Sean Busbey 
we had not decided yet AFAIK. a big concern was the lack of
maintenance releases on more recent Hadoop versions and the perception
that 2.4 and 2.5 were the last big stable release lines.

2.6 and 2.7 have both gotten a few maintenance releases now, so maybe
this isn't a concern any more?

On Tue, Oct 18, 2016 at 7:00 PM, Enis Söztutar  wrote:
> I thought we already decided to do that, no?
>
> Enis
>
> On Tue, Oct 18, 2016 at 6:56 PM, Ted Yu  wrote:
>
>> Looking at http://hadoop.apache.org/releases.html , 2.5.x hasn't got new
>> release for almost two years.
>>
>> Seems fine to drop support for 2.4 and 2.5
>>
>> On Tue, Oct 18, 2016 at 6:42 PM, Duo Zhang  wrote:
>>
>> > This is the current hadoop version support matrix
>> >
>> > https://hbase.apache.org/book.html#hadoop
>> >
>> > 2016-10-19 9:40 GMT+08:00 Duo Zhang :
>> >
>> > > To be specific, hadoop-2.4.x and hadoop-2.5.x.
>> > >
>> > > The latest releases for these two lines are about two years ago, so I
>> > > think it is the time to drop the support of them when 2.0 out. Then we
>> > > could drop some code in our hadoop-compat module as we may need to add
>> > some
>> > > code for the incoming hadoop-3.0...
>> > >
>> > > Thanks.
>> > >
>> >
>>

Re: [DISCUSS] Drop legacy hadoop support at the 2.0 release

2016-10-18 Thread Enis Söztutar 
I thought we already decided to do that, no?

Enis

On Tue, Oct 18, 2016 at 6:56 PM, Ted Yu  wrote:

> Looking at http://hadoop.apache.org/releases.html , 2.5.x hasn't got new
> release for almost two years.
>
> Seems fine to drop support for 2.4 and 2.5
>
> On Tue, Oct 18, 2016 at 6:42 PM, Duo Zhang  wrote:
>
> > This is the current hadoop version support matrix
> >
> > https://hbase.apache.org/book.html#hadoop
> >
> > 2016-10-19 9:40 GMT+08:00 Duo Zhang :
> >
> > > To be specific, hadoop-2.4.x and hadoop-2.5.x.
> > >
> > > The latest releases for these two lines are about two years ago, so I
> > > think it is the time to drop the support of them when 2.0 out. Then we
> > > could drop some code in our hadoop-compat module as we may need to add
> > some
> > > code for the incoming hadoop-3.0...
> > >
> > > Thanks.
> > >
> >
>

Re: [DISCUSS] Drop legacy hadoop support at the 2.0 release

2016-10-18 Thread Ted Yu 
Looking at http://hadoop.apache.org/releases.html , 2.5.x hasn't got new
release for almost two years.

Seems fine to drop support for 2.4 and 2.5

On Tue, Oct 18, 2016 at 6:42 PM, Duo Zhang  wrote:

> This is the current hadoop version support matrix
>
> https://hbase.apache.org/book.html#hadoop
>
> 2016-10-19 9:40 GMT+08:00 Duo Zhang :
>
> > To be specific, hadoop-2.4.x and hadoop-2.5.x.
> >
> > The latest releases for these two lines are about two years ago, so I
> > think it is the time to drop the support of them when 2.0 out. Then we
> > could drop some code in our hadoop-compat module as we may need to add
> some
> > code for the incoming hadoop-3.0...
> >
> > Thanks.
> >
>

Re: [DISCUSS] Drop legacy hadoop support at the 2.0 release

2016-10-18 Thread Duo Zhang 
This is the current hadoop version support matrix

https://hbase.apache.org/book.html#hadoop

2016-10-19 9:40 GMT+08:00 Duo Zhang :

> To be specific, hadoop-2.4.x and hadoop-2.5.x.
>
> The latest releases for these two lines are about two years ago, so I
> think it is the time to drop the support of them when 2.0 out. Then we
> could drop some code in our hadoop-compat module as we may need to add some
> code for the incoming hadoop-3.0...
>
> Thanks.
>

[DISCUSS] Drop legacy hadoop support at the 2.0 release

2016-10-18 Thread Duo Zhang 
To be specific, hadoop-2.4.x and hadoop-2.5.x.

The latest releases for these two lines are about two years ago, so I think
it is the time to drop the support of them when 2.0 out. Then we could drop
some code in our hadoop-compat module as we may need to add some code for
the incoming hadoop-3.0...

Thanks.