Re: Hadoop 3 support

2018-02-22 Thread Ramesh Mani
+1 for Ranger 1.0.0 release.

Thanks,
Ramesh

On 2/22/18, 3:17 PM, "Sailaja Polavarapu" <spolavar...@hortonworks.com>
wrote:

>Rangers:
> I am volunteering to be the release manager for ranger 1.0.0 release.
>Based on the below discussion I will start a new thread on kick of plan
>for the release soon. Please let me know if any of you have any concerns
>and/or suggestions.
>
>Thanks,
>Sailaja.
>
>On 1/22/18, 9:01 AM, "Colm O hEigeartaigh" <cohei...@apache.org> wrote:
>
>Sounds good, thanks!
>
>Colm.
>
>On Fri, Jan 19, 2018 at 10:59 PM, Madhan Neethiraj <mad...@apache.org>
>wrote:
>
>> Colm,
>>
>> Atlas team is in the process of releasing 1.0.0-alpha, which should
>go out
>> next week. Once this release is out, Atlas team will get started on
>0.8.2
>> release; and this release should go out by end of the month.
>>
>> Thanks,
>> Madhan
>>
>>
>>
>>
>> On 1/19/18, 6:42 AM, "Colm O hEigeartaigh" <cohei...@apache.org>
>wrote:
>>
>> Are the Atlas team still planning on releasing 0.8.2 by the end
>of the
>> month? Are there features we need currently missing on the
>relevant
>> branch
>> in Atlas?
>>
>> Colm.
>>
>> On Wed, Jan 17, 2018 at 2:59 PM, Velmurugan Periasamy
><v...@apache.org>
>> wrote:
>>
>> > +1
>> >
>> > Another suggestion. Atlas is in the process
>> > 
><https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd298
>> 7d19573069eec90984d9d71277@%3Cdev.atlas.apache.org%3E>
>> > of releasing 1.0.0-alpha. Once this is complete, Ranger
>1.0.0-alpha
>> can be
>> > released based on that. Atlas team can be requested to back
>port any
>> > changes in Ranger/Atlas interface to 0.8.2, which can be used
>for
>> Ranger
>> > 1.0.0.
>> >
>> > From: Colm O hEigeartaigh <cohei...@apache.org>
>> > Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, "
>> > cohei...@apache.org" <cohei...@apache.org>
>> > Date: Tuesday, January 9, 2018 at 10:40 AM
>> > To: Abhay Kulkarni <akulka...@hortonworks.com>
>> > Cc: "dev@ranger.apache.org" <dev@ranger.apache.org>, Ramesh
>Mani <
>> > rm...@hortonworks.com>
>> >
>> > Subject: Re: Hadoop 3 support
>> >
>> > +1 for this suggestion. Will there be any issue with
>downgrading
>> Atlas in
>> > Ranger from the current 1.0.0-SNAPSHOT version?
>> >
>> > Colm.
>> >
>> > On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni <
>> akulka...@hortonworks.com
>> > >
>> > wrote:
>> >
>> > All,
>> >
>> > Here is another proposal for Ranger release 1.0.0.
>> >
>> > Atlas team is planning to make a Atlas-0.8.2 release towards
>the end
>> of
>> > this month. Once that is done, Ranger can do release 1.0.0
>with
>> dependency
>> > on Atlas 0.8.2 (without Hadoop 3.0.0).
>> >
>> > Thanks,
>> > -Abhay
>> >
>> > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" <
>> vperias...@hortonworks.com on
>> > behalf of v...@apache.org> wrote:
>> >
>> > >+1 for getting the 1.0.0 release out soon.
>> > >
>> > >From:  Colm O hEigeartaigh <cohei...@apache.org>
>> > >Reply-To:  "dev@ranger.apache.org" <dev@ranger.apache.org>,
>> > >"cohei...@apache.org" <cohei...@apache.org>
>> > >Date:  Monday, January 8, 2018 at 12:37 PM
>> > >To:  Ramesh Mani <rm...@hortonworks.com>
>> > >Cc:  "dev@ranger.apache.org" <dev@ranger.apache.org>
>> > >Subject:  Re: Hadoop 3 support
>> > >
>> > >OK thanks. I will test the patch a bit more thoroughly before
>> submitting
>> > >for a RR.
>&g

Re: Hadoop 3 support

2018-02-22 Thread Sailaja Polavarapu
Rangers:
 I am volunteering to be the release manager for ranger 1.0.0 release. Based on 
the below discussion I will start a new thread on kick of plan for the release 
soon. Please let me know if any of you have any concerns and/or suggestions.

Thanks,
Sailaja.

On 1/22/18, 9:01 AM, "Colm O hEigeartaigh" <cohei...@apache.org> wrote:

Sounds good, thanks!

Colm.

On Fri, Jan 19, 2018 at 10:59 PM, Madhan Neethiraj <mad...@apache.org>
wrote:

> Colm,
>
> Atlas team is in the process of releasing 1.0.0-alpha, which should go out
> next week. Once this release is out, Atlas team will get started on 0.8.2
> release; and this release should go out by end of the month.
>
> Thanks,
> Madhan
>
>
>
>
> On 1/19/18, 6:42 AM, "Colm O hEigeartaigh" <cohei...@apache.org> wrote:
>
> Are the Atlas team still planning on releasing 0.8.2 by the end of the
> month? Are there features we need currently missing on the relevant
> branch
> in Atlas?
>
> Colm.
>
> On Wed, Jan 17, 2018 at 2:59 PM, Velmurugan Periasamy 
<v...@apache.org>
> wrote:
>
> > +1
> >
> > Another suggestion. Atlas is in the process
> > <https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd298
> 7d19573069eec90984d9d71277@%3Cdev.atlas.apache.org%3E>
> > of releasing 1.0.0-alpha. Once this is complete, Ranger 1.0.0-alpha
> can be
> > released based on that. Atlas team can be requested to back port any
> > changes in Ranger/Atlas interface to 0.8.2, which can be used for
> Ranger
> > 1.0.0.
> >
> > From: Colm O hEigeartaigh <cohei...@apache.org>
> > Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, "
> > cohei...@apache.org" <cohei...@apache.org>
> > Date: Tuesday, January 9, 2018 at 10:40 AM
> > To: Abhay Kulkarni <akulka...@hortonworks.com>
> > Cc: "dev@ranger.apache.org" <dev@ranger.apache.org>, Ramesh Mani <
> > rm...@hortonworks.com>
> >
> > Subject: Re: Hadoop 3 support
> >
> > +1 for this suggestion. Will there be any issue with downgrading
> Atlas in
> > Ranger from the current 1.0.0-SNAPSHOT version?
> >
> > Colm.
> >
> > On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni <
> akulka...@hortonworks.com
> > >
> > wrote:
> >
> > All,
> >
> > Here is another proposal for Ranger release 1.0.0.
> >
> > Atlas team is planning to make a Atlas-0.8.2 release towards the end
> of
> > this month. Once that is done, Ranger can do release 1.0.0 with
> dependency
> > on Atlas 0.8.2 (without Hadoop 3.0.0).
> >
> > Thanks,
> > -Abhay
> >
> > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" <
> vperias...@hortonworks.com on
> > behalf of v...@apache.org> wrote:
    > >
> > >+1 for getting the 1.0.0 release out soon.
> > >
> > >From:  Colm O hEigeartaigh <cohei...@apache.org>
> > >Reply-To:  "dev@ranger.apache.org" <dev@ranger.apache.org>,
> > >"cohei...@apache.org" <cohei...@apache.org>
> > >Date:  Monday, January 8, 2018 at 12:37 PM
> > >To:  Ramesh Mani <rm...@hortonworks.com>
> > >Cc:  "dev@ranger.apache.org" <dev@ranger.apache.org>
> > >Subject:  Re: Hadoop 3 support
> > >
> > >OK thanks. I will test the patch a bit more thoroughly before
> submitting
> > >for a RR.
> > >
> > >Just in regards as to whether to release 1.0.0 with or without
> Hadoop
> > >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT.
> What's the
> > >timeline for releasing this? That would be the only thing blocking
> getting
> > >a 1.0.0 of Ranger out "quickly". If that's not imminent then I
> guess that
> > >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 
support.
> > >
> > >However, it's been ages since the last release s

Re: Hadoop 3 support

2018-01-22 Thread Colm O hEigeartaigh
Sounds good, thanks!

Colm.

On Fri, Jan 19, 2018 at 10:59 PM, Madhan Neethiraj <mad...@apache.org>
wrote:

> Colm,
>
> Atlas team is in the process of releasing 1.0.0-alpha, which should go out
> next week. Once this release is out, Atlas team will get started on 0.8.2
> release; and this release should go out by end of the month.
>
> Thanks,
> Madhan
>
>
>
>
> On 1/19/18, 6:42 AM, "Colm O hEigeartaigh" <cohei...@apache.org> wrote:
>
> Are the Atlas team still planning on releasing 0.8.2 by the end of the
> month? Are there features we need currently missing on the relevant
> branch
> in Atlas?
>
> Colm.
>
> On Wed, Jan 17, 2018 at 2:59 PM, Velmurugan Periasamy <v...@apache.org>
> wrote:
>
> > +1
> >
> > Another suggestion. Atlas is in the process
> > <https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd298
> 7d19573069eec90984d9d71277@%3Cdev.atlas.apache.org%3E>
> > of releasing 1.0.0-alpha. Once this is complete, Ranger 1.0.0-alpha
> can be
> > released based on that. Atlas team can be requested to back port any
> > changes in Ranger/Atlas interface to 0.8.2, which can be used for
> Ranger
> > 1.0.0.
> >
> > From: Colm O hEigeartaigh <cohei...@apache.org>
> > Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, "
> > cohei...@apache.org" <cohei...@apache.org>
> > Date: Tuesday, January 9, 2018 at 10:40 AM
> > To: Abhay Kulkarni <akulka...@hortonworks.com>
> > Cc: "dev@ranger.apache.org" <dev@ranger.apache.org>, Ramesh Mani <
> > rm...@hortonworks.com>
> >
> > Subject: Re: Hadoop 3 support
> >
> > +1 for this suggestion. Will there be any issue with downgrading
> Atlas in
> > Ranger from the current 1.0.0-SNAPSHOT version?
> >
> > Colm.
> >
> > On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni <
> akulka...@hortonworks.com
> > >
> > wrote:
> >
> > All,
> >
> > Here is another proposal for Ranger release 1.0.0.
> >
> > Atlas team is planning to make a Atlas-0.8.2 release towards the end
> of
> > this month. Once that is done, Ranger can do release 1.0.0 with
> dependency
> > on Atlas 0.8.2 (without Hadoop 3.0.0).
> >
> > Thanks,
> > -Abhay
> >
> > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" <
> vperias...@hortonworks.com on
> > behalf of v...@apache.org> wrote:
> >
> > >+1 for getting the 1.0.0 release out soon.
> > >
> > >From:  Colm O hEigeartaigh <cohei...@apache.org>
> > >Reply-To:  "dev@ranger.apache.org" <dev@ranger.apache.org>,
> > >"cohei...@apache.org" <cohei...@apache.org>
> > >Date:  Monday, January 8, 2018 at 12:37 PM
> > >To:  Ramesh Mani <rm...@hortonworks.com>
> > >Cc:  "dev@ranger.apache.org" <dev@ranger.apache.org>
> > >Subject:  Re: Hadoop 3 support
> > >
> > >OK thanks. I will test the patch a bit more thoroughly before
> submitting
> > >for a RR.
> > >
> > >Just in regards as to whether to release 1.0.0 with or without
> Hadoop
> > >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT.
> What's the
> > >timeline for releasing this? That would be the only thing blocking
> getting
> > >a 1.0.0 of Ranger out "quickly". If that's not imminent then I
> guess that
> > >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support.
> > >
> > >However, it's been ages since the last release so we should
> probably not
> > >wait too long before getting a release out.
> > >
> > >Colm.
> > >
> > >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani <rm...@hortonworks.com>
> > wrote:
> > >
> > >>  Thanks Colm,
> > >>
> > >>  I am fine with Option 1 or 3.  Do you want to create a RR for
> this
> > >>patch?
> > >>
> > >>  Thanks,
> > >>  Ramesh
> > >>
> > >>  From: Colm O hEigeartaigh <cohei...@apache.org>
> > >>  Reply-To: "cohei...@apache.org" <cohei...@apache.org>
> > >>  Date: F

Re: Hadoop 3 support

2018-01-19 Thread Colm O hEigeartaigh
Are the Atlas team still planning on releasing 0.8.2 by the end of the
month? Are there features we need currently missing on the relevant branch
in Atlas?

Colm.

On Wed, Jan 17, 2018 at 2:59 PM, Velmurugan Periasamy <v...@apache.org>
wrote:

> +1
>
> Another suggestion. Atlas is in the process
> <https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd2987d19573069eec90984d9d71277@%3Cdev.atlas.apache.org%3E>
> of releasing 1.0.0-alpha. Once this is complete, Ranger 1.0.0-alpha can be
> released based on that. Atlas team can be requested to back port any
> changes in Ranger/Atlas interface to 0.8.2, which can be used for Ranger
> 1.0.0.
>
> From: Colm O hEigeartaigh <cohei...@apache.org>
> Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, "
> cohei...@apache.org" <cohei...@apache.org>
> Date: Tuesday, January 9, 2018 at 10:40 AM
> To: Abhay Kulkarni <akulka...@hortonworks.com>
> Cc: "dev@ranger.apache.org" <dev@ranger.apache.org>, Ramesh Mani <
> rm...@hortonworks.com>
>
> Subject: Re: Hadoop 3 support
>
> +1 for this suggestion. Will there be any issue with downgrading Atlas in
> Ranger from the current 1.0.0-SNAPSHOT version?
>
> Colm.
>
> On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni <akulka...@hortonworks.com
> >
> wrote:
>
> All,
>
> Here is another proposal for Ranger release 1.0.0.
>
> Atlas team is planning to make a Atlas-0.8.2 release towards the end of
> this month. Once that is done, Ranger can do release 1.0.0 with dependency
> on Atlas 0.8.2 (without Hadoop 3.0.0).
>
> Thanks,
> -Abhay
>
> On 1/8/18, 12:23 PM, "Velmurugan Periasamy" <vperias...@hortonworks.com on
> behalf of v...@apache.org> wrote:
>
> >+1 for getting the 1.0.0 release out soon.
> >
> >From:  Colm O hEigeartaigh <cohei...@apache.org>
> >Reply-To:  "dev@ranger.apache.org" <dev@ranger.apache.org>,
> >"cohei...@apache.org" <cohei...@apache.org>
> >Date:  Monday, January 8, 2018 at 12:37 PM
> >To:  Ramesh Mani <rm...@hortonworks.com>
> >Cc:  "dev@ranger.apache.org" <dev@ranger.apache.org>
> >Subject:  Re: Hadoop 3 support
> >
> >OK thanks. I will test the patch a bit more thoroughly before submitting
> >for a RR.
> >
> >Just in regards as to whether to release 1.0.0 with or without Hadoop
> >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the
> >timeline for releasing this? That would be the only thing blocking getting
> >a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that
> >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support.
> >
> >However, it's been ages since the last release so we should probably not
> >wait too long before getting a release out.
> >
> >Colm.
> >
> >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani <rm...@hortonworks.com>
> wrote:
> >
> >>  Thanks Colm,
> >>
> >>  I am fine with Option 1 or 3.  Do you want to create a RR for this
> >>patch?
> >>
> >>  Thanks,
> >>  Ramesh
> >>
> >>  From: Colm O hEigeartaigh <cohei...@apache.org>
> >>  Reply-To: "cohei...@apache.org" <cohei...@apache.org>
> >>  Date: Friday, January 5, 2018 at 4:19 AM
> >>  To: Ramesh Mani <rm...@hortonworks.com>
> >>  Cc: "dev@ranger.apache.org" <dev@ranger.apache.org>
> >>  Subject: Re: Hadoop 3 support
> >>
> >>  I should have added - a third option is just not to support Hadoop
> >>3.0.0
> >>  at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then
> >>update
> >>  to Hadoop 3.0.0 in Ranger 1.1/2.0 etc.
> >>
> >>  Colm.
> >>
> >>  On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh
> >><cohei...@apache.org>
> >>  wrote:
> >>
> >>>  Hi Ramesh,
> >>>
> >>>  Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn
> >>>  plugins will support Hadoop 3.0.0 only. There is no other option due
> >>>to API
> >>>  changes. A user can use the earlier plugins from 0.7.x if support for
> >>>  Hadoop 2.7.x is required.
> >>>
> >>>  I am not really tied to this approach though - I'm also fine with just
> >>>  having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The
> >>>approach to
> >>>  update all of Ranger to use Hadoop 3.0.0 was based on the 

Re: Hadoop 3 support

2018-01-17 Thread Velmurugan Periasamy
+1 

Another suggestion. Atlas is in the process
<https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd2987d195730
69eec90984d9d71277@%3Cdev.atlas.apache.org%3E>  of releasing 1.0.0-alpha.
Once this is complete, Ranger 1.0.0-alpha can be released based on that.
Atlas team can be requested to back port any changes in Ranger/Atlas
interface to 0.8.2, which can be used for Ranger 1.0.0.

From:  Colm O hEigeartaigh <cohei...@apache.org>
Reply-To:  "dev@ranger.apache.org" <dev@ranger.apache.org>,
"cohei...@apache.org" <cohei...@apache.org>
Date:  Tuesday, January 9, 2018 at 10:40 AM
To:  Abhay Kulkarni <akulka...@hortonworks.com>
Cc:  "dev@ranger.apache.org" <dev@ranger.apache.org>, Ramesh Mani
<rm...@hortonworks.com>
Subject:  Re: Hadoop 3 support

+1 for this suggestion. Will there be any issue with downgrading Atlas in
Ranger from the current 1.0.0-SNAPSHOT version?

Colm.

On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni <akulka...@hortonworks.com>
wrote:

>  All,
> 
>  Here is another proposal for Ranger release 1.0.0.
> 
>  Atlas team is planning to make a Atlas-0.8.2 release towards the end of
>  this month. Once that is done, Ranger can do release 1.0.0 with dependency
>  on Atlas 0.8.2 (without Hadoop 3.0.0).
> 
>  Thanks,
>  -Abhay
> 
>  On 1/8/18, 12:23 PM, "Velmurugan Periasamy" <vperias...@hortonworks.com on
>  behalf of v...@apache.org> wrote:
> 
>>  >+1 for getting the 1.0.0 release out soon.
>>  >
>>  >From:  Colm O hEigeartaigh <cohei...@apache.org>
>>  >Reply-To:  "dev@ranger.apache.org" <dev@ranger.apache.org>,
>>  >"cohei...@apache.org" <cohei...@apache.org>
>>  >Date:  Monday, January 8, 2018 at 12:37 PM
>>  >To:  Ramesh Mani <rm...@hortonworks.com>
>>  >Cc:  "dev@ranger.apache.org" <dev@ranger.apache.org>
>>  >Subject:  Re: Hadoop 3 support
>>  >
>>  >OK thanks. I will test the patch a bit more thoroughly before submitting
>>  >for a RR.
>>  >
>>  >Just in regards as to whether to release 1.0.0 with or without Hadoop
>>  >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the
>>  >timeline for releasing this? That would be the only thing blocking getting
>>  >a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that
>>  >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support.
>>  >
>>  >However, it's been ages since the last release so we should probably not
>>  >wait too long before getting a release out.
>>  >
>>  >Colm.
>>  >
>>  >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani <rm...@hortonworks.com>
>  wrote:
>>  >
>>>  >>  Thanks Colm,
>>>  >>
>>>  >>  I am fine with Option 1 or 3.  Do you want to create a RR for this
>>>  >>patch?
>>>  >>
>>>  >>  Thanks,
>>>  >>  Ramesh
>>>  >>
>>>  >>  From: Colm O hEigeartaigh <cohei...@apache.org>
>>>  >>  Reply-To: "cohei...@apache.org" <cohei...@apache.org>
>>>  >>  Date: Friday, January 5, 2018 at 4:19 AM
>>>  >>  To: Ramesh Mani <rm...@hortonworks.com>
>>>  >>  Cc: "dev@ranger.apache.org" <dev@ranger.apache.org>
>>>  >>  Subject: Re: Hadoop 3 support
>>>  >>
>>>  >>  I should have added - a third option is just not to support Hadoop
>>>  >>3.0.0
>>>  >>  at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then
>>>  >>update
>>>  >>  to Hadoop 3.0.0 in Ranger 1.1/2.0 etc.
>>>  >>
>>>  >>  Colm.
>>>  >>
>>>  >>  On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh
>>>  >><cohei...@apache.org>
>>>  >>  wrote:
>>>  >>
>>>>  >>>  Hi Ramesh,
>>>>  >>>
>>>>  >>>  Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn
>>>>  >>>  plugins will support Hadoop 3.0.0 only. There is no other option due
>>>>  >>>to API
>>>>  >>>  changes. A user can use the earlier plugins from 0.7.x if support for
>>>>  >>>  Hadoop 2.7.x is required.
>>>>  >>>
>>>>  >>>  I am not really tied to this approach though - I'm also fine with
just
>>>>  >>>  having new plugins to support H

Re: Hadoop 3 support

2018-01-09 Thread Colm O hEigeartaigh
+1 for this suggestion. Will there be any issue with downgrading Atlas in
Ranger from the current 1.0.0-SNAPSHOT version?

Colm.

On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni <akulka...@hortonworks.com>
wrote:

> All,
>
> Here is another proposal for Ranger release 1.0.0.
>
> Atlas team is planning to make a Atlas-0.8.2 release towards the end of
> this month. Once that is done, Ranger can do release 1.0.0 with dependency
> on Atlas 0.8.2 (without Hadoop 3.0.0).
>
> Thanks,
> -Abhay
>
> On 1/8/18, 12:23 PM, "Velmurugan Periasamy" <vperias...@hortonworks.com on
> behalf of v...@apache.org> wrote:
>
> >+1 for getting the 1.0.0 release out soon.
> >
> >From:  Colm O hEigeartaigh <cohei...@apache.org>
> >Reply-To:  "dev@ranger.apache.org" <dev@ranger.apache.org>,
> >"cohei...@apache.org" <cohei...@apache.org>
> >Date:  Monday, January 8, 2018 at 12:37 PM
> >To:  Ramesh Mani <rm...@hortonworks.com>
> >Cc:  "dev@ranger.apache.org" <dev@ranger.apache.org>
> >Subject:  Re: Hadoop 3 support
> >
> >OK thanks. I will test the patch a bit more thoroughly before submitting
> >for a RR.
> >
> >Just in regards as to whether to release 1.0.0 with or without Hadoop
> >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the
> >timeline for releasing this? That would be the only thing blocking getting
> >a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that
> >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support.
> >
> >However, it's been ages since the last release so we should probably not
> >wait too long before getting a release out.
> >
> >Colm.
> >
> >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani <rm...@hortonworks.com>
> wrote:
> >
> >>  Thanks Colm,
> >>
> >>  I am fine with Option 1 or 3.  Do you want to create a RR for this
> >>patch?
> >>
> >>  Thanks,
> >>  Ramesh
> >>
> >>  From: Colm O hEigeartaigh <cohei...@apache.org>
> >>  Reply-To: "cohei...@apache.org" <cohei...@apache.org>
> >>  Date: Friday, January 5, 2018 at 4:19 AM
> >>  To: Ramesh Mani <rm...@hortonworks.com>
> >>  Cc: "dev@ranger.apache.org" <dev@ranger.apache.org>
> >>  Subject: Re: Hadoop 3 support
> >>
> >>  I should have added - a third option is just not to support Hadoop
> >>3.0.0
> >>  at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then
> >>update
> >>  to Hadoop 3.0.0 in Ranger 1.1/2.0 etc.
> >>
> >>  Colm.
> >>
> >>  On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh
> >><cohei...@apache.org>
> >>  wrote:
> >>
> >>>  Hi Ramesh,
> >>>
> >>>  Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn
> >>>  plugins will support Hadoop 3.0.0 only. There is no other option due
> >>>to API
> >>>  changes. A user can use the earlier plugins from 0.7.x if support for
> >>>  Hadoop 2.7.x is required.
> >>>
> >>>  I am not really tied to this approach though - I'm also fine with just
> >>>  having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The
> >>>approach to
> >>>  update all of Ranger to use Hadoop 3.0.0 was based on the comments on
> >>>this
> >>>  JIRA:
> >>>
> >>>  https://issues.apache.org/jira/browse/RANGER-1738
> >>>
> >>>  Colm.
> >>>
> >>>  On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani <rm...@hortonworks.com>
> >>>  wrote:
> >>>
> >>>>  Colm,
> >>>>
> >>>>  Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only?
> >>>>
> >>>>  Thanks.
> >>>>  Ramesh
> >>>>
> >>>>
> >>>>
> >>>>  On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" <cohei...@apache.org>
> >>>>wrote:
> >>>>
> >>>>>  >Hi Ranger devs,
> >>>>>  >
> >>>>>  >I posted an initial patch here to bump Ranger up to use Hadoop
> >>>>>3.0.0:
> >>>>>  >
> >>>>>  >https://issues.apache.org/jira/browse/RANGER-1935
> >>>>>  >
> >>>>>  >I would appreciate some initial feedback before proceeding further
> >>>>>with
> >>>>>  >testing it (just a general "looks ok" or "this would be problematic
> >>>>>  >because
> >>>>>  >X").
> >>>>>  >
> >>>>>  >Colm.
> >>>>>  >
> >>>>>  >
> >>>>>  >--
> >>>>>  >Colm O hEigeartaigh
> >>>>>  >
> >>>>>  >Talend Community Coder
> >>>>>  >http://coders.talend.com
> >>>>
> >>>>
> >>>
> >>>
> >>>  --
> >>>  Colm O hEigeartaigh
> >>>
> >>>  Talend Community Coder
> >>>  http://coders.talend.com
> >>>
> >>
> >>
> >>
> >>  --
> >>  Colm O hEigeartaigh
> >>
> >>  Talend Community Coder
> >>  http://coders.talend.com
> >>
> >
> >
> >
> >--
> >Colm O hEigeartaigh
> >
> >Talend Community Coder
> >http://coders.talend.com
> >
> >
> >
>
>


-- 
Colm O hEigeartaigh

Talend Community Coder
http://coders.talend.com


Re: Hadoop 3 support

2018-01-08 Thread Abhay Kulkarni
All,

Here is another proposal for Ranger release 1.0.0.

Atlas team is planning to make a Atlas-0.8.2 release towards the end of
this month. Once that is done, Ranger can do release 1.0.0 with dependency
on Atlas 0.8.2 (without Hadoop 3.0.0).

Thanks,
-Abhay

On 1/8/18, 12:23 PM, "Velmurugan Periasamy" <vperias...@hortonworks.com on
behalf of v...@apache.org> wrote:

>+1 for getting the 1.0.0 release out soon.
>
>From:  Colm O hEigeartaigh <cohei...@apache.org>
>Reply-To:  "dev@ranger.apache.org" <dev@ranger.apache.org>,
>"cohei...@apache.org" <cohei...@apache.org>
>Date:  Monday, January 8, 2018 at 12:37 PM
>To:  Ramesh Mani <rm...@hortonworks.com>
>Cc:  "dev@ranger.apache.org" <dev@ranger.apache.org>
>Subject:  Re: Hadoop 3 support
>
>OK thanks. I will test the patch a bit more thoroughly before submitting
>for a RR.
>
>Just in regards as to whether to release 1.0.0 with or without Hadoop
>3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the
>timeline for releasing this? That would be the only thing blocking getting
>a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that
>gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support.
>
>However, it's been ages since the last release so we should probably not
>wait too long before getting a release out.
>
>Colm.
>
>On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani <rm...@hortonworks.com> wrote:
>
>>  Thanks Colm,
>> 
>>  I am fine with Option 1 or 3.  Do you want to create a RR for this
>>patch?
>> 
>>  Thanks,
>>  Ramesh
>> 
>>  From: Colm O hEigeartaigh <cohei...@apache.org>
>>  Reply-To: "cohei...@apache.org" <cohei...@apache.org>
>>  Date: Friday, January 5, 2018 at 4:19 AM
>>  To: Ramesh Mani <rm...@hortonworks.com>
>>  Cc: "dev@ranger.apache.org" <dev@ranger.apache.org>
>>  Subject: Re: Hadoop 3 support
>> 
>>  I should have added - a third option is just not to support Hadoop
>>3.0.0
>>  at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then
>>update
>>  to Hadoop 3.0.0 in Ranger 1.1/2.0 etc.
>> 
>>  Colm.
>> 
>>  On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh
>><cohei...@apache.org>
>>  wrote:
>> 
>>>  Hi Ramesh,
>>> 
>>>  Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn
>>>  plugins will support Hadoop 3.0.0 only. There is no other option due
>>>to API
>>>  changes. A user can use the earlier plugins from 0.7.x if support for
>>>  Hadoop 2.7.x is required.
>>> 
>>>  I am not really tied to this approach though - I'm also fine with just
>>>  having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The
>>>approach to
>>>  update all of Ranger to use Hadoop 3.0.0 was based on the comments on
>>>this
>>>  JIRA:
>>> 
>>>  https://issues.apache.org/jira/browse/RANGER-1738
>>> 
>>>  Colm.
>>> 
>>>  On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani <rm...@hortonworks.com>
>>>  wrote:
>>> 
>>>>  Colm,
>>>> 
>>>>  Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only?
>>>> 
>>>>  Thanks.
>>>>  Ramesh
>>>> 
>>>> 
>>>> 
>>>>  On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" <cohei...@apache.org>
>>>>wrote:
>>>> 
>>>>>  >Hi Ranger devs,
>>>>>  >
>>>>>  >I posted an initial patch here to bump Ranger up to use Hadoop
>>>>>3.0.0:
>>>>>  >
>>>>>  >https://issues.apache.org/jira/browse/RANGER-1935
>>>>>  >
>>>>>  >I would appreciate some initial feedback before proceeding further
>>>>>with
>>>>>  >testing it (just a general "looks ok" or "this would be problematic
>>>>>  >because
>>>>>  >X").
>>>>>  >
>>>>>  >Colm.
>>>>>  >
>>>>>  >
>>>>>  >--
>>>>>  >Colm O hEigeartaigh
>>>>>  >
>>>>>  >Talend Community Coder
>>>>>  >http://coders.talend.com
>>>> 
>>>> 
>>> 
>>> 
>>>  --
>>>  Colm O hEigeartaigh
>>> 
>>>  Talend Community Coder
>>>  http://coders.talend.com
>>> 
>> 
>> 
>> 
>>  --
>>  Colm O hEigeartaigh
>> 
>>  Talend Community Coder
>>  http://coders.talend.com
>> 
>
>
>
>-- 
>Colm O hEigeartaigh
>
>Talend Community Coder
>http://coders.talend.com
>
>
>



Re: Hadoop 3 support

2018-01-08 Thread Velmurugan Periasamy
+1 for getting the 1.0.0 release out soon.

From:  Colm O hEigeartaigh <cohei...@apache.org>
Reply-To:  "dev@ranger.apache.org" <dev@ranger.apache.org>,
"cohei...@apache.org" <cohei...@apache.org>
Date:  Monday, January 8, 2018 at 12:37 PM
To:  Ramesh Mani <rm...@hortonworks.com>
Cc:  "dev@ranger.apache.org" <dev@ranger.apache.org>
Subject:  Re: Hadoop 3 support

OK thanks. I will test the patch a bit more thoroughly before submitting
for a RR.

Just in regards as to whether to release 1.0.0 with or without Hadoop
3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the
timeline for releasing this? That would be the only thing blocking getting
a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that
gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support.

However, it's been ages since the last release so we should probably not
wait too long before getting a release out.

Colm.

On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani <rm...@hortonworks.com> wrote:

>  Thanks Colm,
> 
>  I am fine with Option 1 or 3.  Do you want to create a RR for this patch?
> 
>  Thanks,
>  Ramesh
> 
>  From: Colm O hEigeartaigh <cohei...@apache.org>
>  Reply-To: "cohei...@apache.org" <cohei...@apache.org>
>  Date: Friday, January 5, 2018 at 4:19 AM
>  To: Ramesh Mani <rm...@hortonworks.com>
>  Cc: "dev@ranger.apache.org" <dev@ranger.apache.org>
>  Subject: Re: Hadoop 3 support
> 
>  I should have added - a third option is just not to support Hadoop 3.0.0
>  at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update
>  to Hadoop 3.0.0 in Ranger 1.1/2.0 etc.
> 
>  Colm.
> 
>  On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh <cohei...@apache.org>
>  wrote:
> 
>>  Hi Ramesh,
>> 
>>  Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn
>>  plugins will support Hadoop 3.0.0 only. There is no other option due to API
>>  changes. A user can use the earlier plugins from 0.7.x if support for
>>  Hadoop 2.7.x is required.
>> 
>>  I am not really tied to this approach though - I'm also fine with just
>>  having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach to
>>  update all of Ranger to use Hadoop 3.0.0 was based on the comments on this
>>  JIRA:
>> 
>>  https://issues.apache.org/jira/browse/RANGER-1738
>> 
>>  Colm.
>> 
>>  On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani <rm...@hortonworks.com>
>>  wrote:
>> 
>>>  Colm,
>>> 
>>>  Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only?
>>> 
>>>  Thanks.
>>>  Ramesh
>>> 
>>> 
>>> 
>>>  On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" <cohei...@apache.org> wrote:
>>> 
>>>>  >Hi Ranger devs,
>>>>  >
>>>>  >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0:
>>>>  >
>>>>  >https://issues.apache.org/jira/browse/RANGER-1935
>>>>  >
>>>>  >I would appreciate some initial feedback before proceeding further with
>>>>  >testing it (just a general "looks ok" or "this would be problematic
>>>>  >because
>>>>  >X").
>>>>  >
>>>>  >Colm.
>>>>  >
>>>>  >
>>>>  >--
>>>>  >Colm O hEigeartaigh
>>>>  >
>>>>  >Talend Community Coder
>>>>  >http://coders.talend.com
>>> 
>>> 
>> 
>> 
>>  --
>>  Colm O hEigeartaigh
>> 
>>  Talend Community Coder
>>  http://coders.talend.com
>> 
> 
> 
> 
>  --
>  Colm O hEigeartaigh
> 
>  Talend Community Coder
>  http://coders.talend.com
> 



-- 
Colm O hEigeartaigh

Talend Community Coder
http://coders.talend.com





Re: Hadoop 3 support

2018-01-08 Thread Colm O hEigeartaigh
OK thanks. I will test the patch a bit more thoroughly before submitting
for a RR.

Just in regards as to whether to release 1.0.0 with or without Hadoop
3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the
timeline for releasing this? That would be the only thing blocking getting
a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that
gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support.

However, it's been ages since the last release so we should probably not
wait too long before getting a release out.

Colm.

On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani <rm...@hortonworks.com> wrote:

> Thanks Colm,
>
> I am fine with Option 1 or 3.  Do you want to create a RR for this patch?
>
> Thanks,
> Ramesh
>
> From: Colm O hEigeartaigh <cohei...@apache.org>
> Reply-To: "cohei...@apache.org" <cohei...@apache.org>
> Date: Friday, January 5, 2018 at 4:19 AM
> To: Ramesh Mani <rm...@hortonworks.com>
> Cc: "dev@ranger.apache.org" <dev@ranger.apache.org>
> Subject: Re: Hadoop 3 support
>
> I should have added - a third option is just not to support Hadoop 3.0.0
> at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update
> to Hadoop 3.0.0 in Ranger 1.1/2.0 etc.
>
> Colm.
>
> On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh <cohei...@apache.org>
> wrote:
>
>> Hi Ramesh,
>>
>> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn
>> plugins will support Hadoop 3.0.0 only. There is no other option due to API
>> changes. A user can use the earlier plugins from 0.7.x if support for
>> Hadoop 2.7.x is required.
>>
>> I am not really tied to this approach though - I'm also fine with just
>> having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach to
>> update all of Ranger to use Hadoop 3.0.0 was based on the comments on this
>> JIRA:
>>
>> https://issues.apache.org/jira/browse/RANGER-1738
>>
>> Colm.
>>
>> On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani <rm...@hortonworks.com>
>> wrote:
>>
>>> Colm,
>>>
>>> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only?
>>>
>>> Thanks.
>>> Ramesh
>>>
>>>
>>>
>>> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" <cohei...@apache.org> wrote:
>>>
>>> >Hi Ranger devs,
>>> >
>>> >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0:
>>> >
>>> >https://issues.apache.org/jira/browse/RANGER-1935
>>> >
>>> >I would appreciate some initial feedback before proceeding further with
>>> >testing it (just a general "looks ok" or "this would be problematic
>>> >because
>>> >X").
>>> >
>>> >Colm.
>>> >
>>> >
>>> >--
>>> >Colm O hEigeartaigh
>>> >
>>> >Talend Community Coder
>>> >http://coders.talend.com
>>>
>>>
>>
>>
>> --
>> Colm O hEigeartaigh
>>
>> Talend Community Coder
>> http://coders.talend.com
>>
>
>
>
> --
> Colm O hEigeartaigh
>
> Talend Community Coder
> http://coders.talend.com
>



-- 
Colm O hEigeartaigh

Talend Community Coder
http://coders.talend.com


Re: Hadoop 3 support

2018-01-05 Thread Velmurugan Periasamy
My preference is for option 3 or option 1.

From: Zsombor <gzsom...@gmail.com<mailto:gzsom...@gmail.com>>
Reply-To: "dev@ranger.apache.org<mailto:dev@ranger.apache.org>" 
<dev@ranger.apache.org<mailto:dev@ranger.apache.org>>, 
"gzsom...@gmail.com<mailto:gzsom...@gmail.com>" 
<gzsom...@gmail.com<mailto:gzsom...@gmail.com>>
Date: Friday, January 5, 2018 at 8:18 AM
To: ranger <dev@ranger.apache.org<mailto:dev@ranger.apache.org>>, Colm O 
hEigeartaigh <cohei...@apache.org<mailto:cohei...@apache.org>>
Cc: Ramesh Mani <rm...@hortonworks.com<mailto:rm...@hortonworks.com>>
Subject: Re: Hadoop 3 support

Fourth option:
Create a 0.8 release for Hadoop 2.x and JDK 7 - maybe someone still needs
to use these 'legacy' versions.

Regards,
Zsombor

On Fri, Jan 5, 2018 at 1:19 PM, Colm O hEigeartaigh 
<cohei...@apache.org<mailto:cohei...@apache.org>>
wrote:

I should have added - a third option is just not to support Hadoop 3.0.0 at
all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update to
Hadoop 3.0.0 in Ranger 1.1/2.0 etc.

Colm.

On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh 
<cohei...@apache.org<mailto:cohei...@apache.org>>
wrote:

> Hi Ramesh,
>
> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn
> plugins will support Hadoop 3.0.0 only. There is no other option due to
API
> changes. A user can use the earlier plugins from 0.7.x if support for
> Hadoop 2.7.x is required.
>
> I am not really tied to this approach though - I'm also fine with just
> having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach
to
> update all of Ranger to use Hadoop 3.0.0 was based on the comments on
this
> JIRA:
>
> https://issues.apache.org/jira/browse/RANGER-1738
>
> Colm.
>
> On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani 
> <rm...@hortonworks.com<mailto:rm...@hortonworks.com>>
> wrote:
>
>> Colm,
>>
>> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only?
>>
>> Thanks.
>> Ramesh
>>
>>
>>
>> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" 
>> <cohei...@apache.org<mailto:cohei...@apache.org>> wrote:
>>
>> >Hi Ranger devs,
>> >
>> >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0:
>> >
>> >https://issues.apache.org/jira/browse/RANGER-1935
>> >
>> >I would appreciate some initial feedback before proceeding further with
>> >testing it (just a general "looks ok" or "this would be problematic
>> >because
>> >X").
>> >
>> >Colm.
>> >
>> >
>> >--
>> >Colm O hEigeartaigh
>> >
>> >Talend Community Coder
>> >http://coders.talend.com
>>
>>
>
>
> --
> Colm O hEigeartaigh
>
> Talend Community Coder
> http://coders.talend.com
>



--
Colm O hEigeartaigh

Talend Community Coder
http://coders.talend.com




Re: Hadoop 3 support

2018-01-05 Thread Zsombor
Fourth option:
 Create a 0.8 release for Hadoop 2.x and JDK 7 - maybe someone still needs
to use these 'legacy' versions.

Regards,
 Zsombor

On Fri, Jan 5, 2018 at 1:19 PM, Colm O hEigeartaigh 
wrote:

> I should have added - a third option is just not to support Hadoop 3.0.0 at
> all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update to
> Hadoop 3.0.0 in Ranger 1.1/2.0 etc.
>
> Colm.
>
> On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh 
> wrote:
>
> > Hi Ramesh,
> >
> > Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn
> > plugins will support Hadoop 3.0.0 only. There is no other option due to
> API
> > changes. A user can use the earlier plugins from 0.7.x if support for
> > Hadoop 2.7.x is required.
> >
> > I am not really tied to this approach though - I'm also fine with just
> > having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach
> to
> > update all of Ranger to use Hadoop 3.0.0 was based on the comments on
> this
> > JIRA:
> >
> > https://issues.apache.org/jira/browse/RANGER-1738
> >
> > Colm.
> >
> > On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani 
> > wrote:
> >
> >> Colm,
> >>
> >> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only?
> >>
> >> Thanks.
> >> Ramesh
> >>
> >>
> >>
> >> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh"  wrote:
> >>
> >> >Hi Ranger devs,
> >> >
> >> >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0:
> >> >
> >> >https://issues.apache.org/jira/browse/RANGER-1935
> >> >
> >> >I would appreciate some initial feedback before proceeding further with
> >> >testing it (just a general "looks ok" or "this would be problematic
> >> >because
> >> >X").
> >> >
> >> >Colm.
> >> >
> >> >
> >> >--
> >> >Colm O hEigeartaigh
> >> >
> >> >Talend Community Coder
> >> >http://coders.talend.com
> >>
> >>
> >
> >
> > --
> > Colm O hEigeartaigh
> >
> > Talend Community Coder
> > http://coders.talend.com
> >
>
>
>
> --
> Colm O hEigeartaigh
>
> Talend Community Coder
> http://coders.talend.com
>


Re: Hadoop 3 support

2018-01-05 Thread Colm O hEigeartaigh
I should have added - a third option is just not to support Hadoop 3.0.0 at
all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update to
Hadoop 3.0.0 in Ranger 1.1/2.0 etc.

Colm.

On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh 
wrote:

> Hi Ramesh,
>
> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn
> plugins will support Hadoop 3.0.0 only. There is no other option due to API
> changes. A user can use the earlier plugins from 0.7.x if support for
> Hadoop 2.7.x is required.
>
> I am not really tied to this approach though - I'm also fine with just
> having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach to
> update all of Ranger to use Hadoop 3.0.0 was based on the comments on this
> JIRA:
>
> https://issues.apache.org/jira/browse/RANGER-1738
>
> Colm.
>
> On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani 
> wrote:
>
>> Colm,
>>
>> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only?
>>
>> Thanks.
>> Ramesh
>>
>>
>>
>> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh"  wrote:
>>
>> >Hi Ranger devs,
>> >
>> >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0:
>> >
>> >https://issues.apache.org/jira/browse/RANGER-1935
>> >
>> >I would appreciate some initial feedback before proceeding further with
>> >testing it (just a general "looks ok" or "this would be problematic
>> >because
>> >X").
>> >
>> >Colm.
>> >
>> >
>> >--
>> >Colm O hEigeartaigh
>> >
>> >Talend Community Coder
>> >http://coders.talend.com
>>
>>
>
>
> --
> Colm O hEigeartaigh
>
> Talend Community Coder
> http://coders.talend.com
>



-- 
Colm O hEigeartaigh

Talend Community Coder
http://coders.talend.com


Re: Hadoop 3 support

2018-01-05 Thread Colm O hEigeartaigh
Hi Ramesh,

Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn
plugins will support Hadoop 3.0.0 only. There is no other option due to API
changes. A user can use the earlier plugins from 0.7.x if support for
Hadoop 2.7.x is required.

I am not really tied to this approach though - I'm also fine with just
having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach to
update all of Ranger to use Hadoop 3.0.0 was based on the comments on this
JIRA:

https://issues.apache.org/jira/browse/RANGER-1738

Colm.

On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani  wrote:

> Colm,
>
> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only?
>
> Thanks.
> Ramesh
>
>
>
> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh"  wrote:
>
> >Hi Ranger devs,
> >
> >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0:
> >
> >https://issues.apache.org/jira/browse/RANGER-1935
> >
> >I would appreciate some initial feedback before proceeding further with
> >testing it (just a general "looks ok" or "this would be problematic
> >because
> >X").
> >
> >Colm.
> >
> >
> >--
> >Colm O hEigeartaigh
> >
> >Talend Community Coder
> >http://coders.talend.com
>
>


-- 
Colm O hEigeartaigh

Talend Community Coder
http://coders.talend.com


Re: Hadoop 3 support

2018-01-04 Thread Ramesh Mani
Colm,

Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only?

Thanks.
Ramesh



On 1/4/18, 9:32 AM, "Colm O hEigeartaigh"  wrote:

>Hi Ranger devs,
>
>I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0:
>
>https://issues.apache.org/jira/browse/RANGER-1935
>
>I would appreciate some initial feedback before proceeding further with
>testing it (just a general "looks ok" or "this would be problematic
>because
>X").
>
>Colm.
>
>
>-- 
>Colm O hEigeartaigh
>
>Talend Community Coder
>http://coders.talend.com



Hadoop 3 support

2018-01-04 Thread Colm O hEigeartaigh
Hi Ranger devs,

I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0:

https://issues.apache.org/jira/browse/RANGER-1935

I would appreciate some initial feedback before proceeding further with
testing it (just a general "looks ok" or "this would be problematic because
X").

Colm.


-- 
Colm O hEigeartaigh

Talend Community Coder
http://coders.talend.com