Re: Hadoop 3 support
+1 for Ranger 1.0.0 release. Thanks, Ramesh On 2/22/18, 3:17 PM, "Sailaja Polavarapu" <spolavar...@hortonworks.com> wrote: >Rangers: > I am volunteering to be the release manager for ranger 1.0.0 release. >Based on the below discussion I will start a new thread on kick of plan >for the release soon. Please let me know if any of you have any concerns >and/or suggestions. > >Thanks, >Sailaja. > >On 1/22/18, 9:01 AM, "Colm O hEigeartaigh" <cohei...@apache.org> wrote: > >Sounds good, thanks! > >Colm. > >On Fri, Jan 19, 2018 at 10:59 PM, Madhan Neethiraj <mad...@apache.org> >wrote: > >> Colm, >> >> Atlas team is in the process of releasing 1.0.0-alpha, which should >go out >> next week. Once this release is out, Atlas team will get started on >0.8.2 >> release; and this release should go out by end of the month. >> >> Thanks, >> Madhan >> >> >> >> >> On 1/19/18, 6:42 AM, "Colm O hEigeartaigh" <cohei...@apache.org> >wrote: >> >> Are the Atlas team still planning on releasing 0.8.2 by the end >of the >> month? Are there features we need currently missing on the >relevant >> branch >> in Atlas? >> >> Colm. >> >> On Wed, Jan 17, 2018 at 2:59 PM, Velmurugan Periasamy ><v...@apache.org> >> wrote: >> >> > +1 >> > >> > Another suggestion. Atlas is in the process >> > ><https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd298 >> 7d19573069eec90984d9d71277@%3Cdev.atlas.apache.org%3E> >> > of releasing 1.0.0-alpha. Once this is complete, Ranger >1.0.0-alpha >> can be >> > released based on that. Atlas team can be requested to back >port any >> > changes in Ranger/Atlas interface to 0.8.2, which can be used >for >> Ranger >> > 1.0.0. >> > >> > From: Colm O hEigeartaigh <cohei...@apache.org> >> > Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, " >> > cohei...@apache.org" <cohei...@apache.org> >> > Date: Tuesday, January 9, 2018 at 10:40 AM >> > To: Abhay Kulkarni <akulka...@hortonworks.com> >> > Cc: "dev@ranger.apache.org" <dev@ranger.apache.org>, Ramesh >Mani < >> > rm...@hortonworks.com> >> > >> > Subject: Re: Hadoop 3 support >> > >> > +1 for this suggestion. Will there be any issue with >downgrading >> Atlas in >> > Ranger from the current 1.0.0-SNAPSHOT version? >> > >> > Colm. >> > >> > On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni < >> akulka...@hortonworks.com >> > > >> > wrote: >> > >> > All, >> > >> > Here is another proposal for Ranger release 1.0.0. >> > >> > Atlas team is planning to make a Atlas-0.8.2 release towards >the end >> of >> > this month. Once that is done, Ranger can do release 1.0.0 >with >> dependency >> > on Atlas 0.8.2 (without Hadoop 3.0.0). >> > >> > Thanks, >> > -Abhay >> > >> > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" < >> vperias...@hortonworks.com on >> > behalf of v...@apache.org> wrote: >> > >> > >+1 for getting the 1.0.0 release out soon. >> > > >> > >From: Colm O hEigeartaigh <cohei...@apache.org> >> > >Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, >> > >"cohei...@apache.org" <cohei...@apache.org> >> > >Date: Monday, January 8, 2018 at 12:37 PM >> > >To: Ramesh Mani <rm...@hortonworks.com> >> > >Cc: "dev@ranger.apache.org" <dev@ranger.apache.org> >> > >Subject: Re: Hadoop 3 support >> > > >> > >OK thanks. I will test the patch a bit more thoroughly before >> submitting >> > >for a RR. >&g
Re: Hadoop 3 support
Rangers: I am volunteering to be the release manager for ranger 1.0.0 release. Based on the below discussion I will start a new thread on kick of plan for the release soon. Please let me know if any of you have any concerns and/or suggestions. Thanks, Sailaja. On 1/22/18, 9:01 AM, "Colm O hEigeartaigh" <cohei...@apache.org> wrote: Sounds good, thanks! Colm. On Fri, Jan 19, 2018 at 10:59 PM, Madhan Neethiraj <mad...@apache.org> wrote: > Colm, > > Atlas team is in the process of releasing 1.0.0-alpha, which should go out > next week. Once this release is out, Atlas team will get started on 0.8.2 > release; and this release should go out by end of the month. > > Thanks, > Madhan > > > > > On 1/19/18, 6:42 AM, "Colm O hEigeartaigh" <cohei...@apache.org> wrote: > > Are the Atlas team still planning on releasing 0.8.2 by the end of the > month? Are there features we need currently missing on the relevant > branch > in Atlas? > > Colm. > > On Wed, Jan 17, 2018 at 2:59 PM, Velmurugan Periasamy <v...@apache.org> > wrote: > > > +1 > > > > Another suggestion. Atlas is in the process > > <https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd298 > 7d19573069eec90984d9d71277@%3Cdev.atlas.apache.org%3E> > > of releasing 1.0.0-alpha. Once this is complete, Ranger 1.0.0-alpha > can be > > released based on that. Atlas team can be requested to back port any > > changes in Ranger/Atlas interface to 0.8.2, which can be used for > Ranger > > 1.0.0. > > > > From: Colm O hEigeartaigh <cohei...@apache.org> > > Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, " > > cohei...@apache.org" <cohei...@apache.org> > > Date: Tuesday, January 9, 2018 at 10:40 AM > > To: Abhay Kulkarni <akulka...@hortonworks.com> > > Cc: "dev@ranger.apache.org" <dev@ranger.apache.org>, Ramesh Mani < > > rm...@hortonworks.com> > > > > Subject: Re: Hadoop 3 support > > > > +1 for this suggestion. Will there be any issue with downgrading > Atlas in > > Ranger from the current 1.0.0-SNAPSHOT version? > > > > Colm. > > > > On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni < > akulka...@hortonworks.com > > > > > wrote: > > > > All, > > > > Here is another proposal for Ranger release 1.0.0. > > > > Atlas team is planning to make a Atlas-0.8.2 release towards the end > of > > this month. Once that is done, Ranger can do release 1.0.0 with > dependency > > on Atlas 0.8.2 (without Hadoop 3.0.0). > > > > Thanks, > > -Abhay > > > > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" < > vperias...@hortonworks.com on > > behalf of v...@apache.org> wrote: > > > > >+1 for getting the 1.0.0 release out soon. > > > > > >From: Colm O hEigeartaigh <cohei...@apache.org> > > >Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, > > >"cohei...@apache.org" <cohei...@apache.org> > > >Date: Monday, January 8, 2018 at 12:37 PM > > >To: Ramesh Mani <rm...@hortonworks.com> > > >Cc: "dev@ranger.apache.org" <dev@ranger.apache.org> > > >Subject: Re: Hadoop 3 support > > > > > >OK thanks. I will test the patch a bit more thoroughly before > submitting > > >for a RR. > > > > > >Just in regards as to whether to release 1.0.0 with or without > Hadoop > > >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. > What's the > > >timeline for releasing this? That would be the only thing blocking > getting > > >a 1.0.0 of Ranger out "quickly". If that's not imminent then I > guess that > > >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. > > > > > >However, it's been ages since the last release s
Re: Hadoop 3 support
Sounds good, thanks! Colm. On Fri, Jan 19, 2018 at 10:59 PM, Madhan Neethiraj <mad...@apache.org> wrote: > Colm, > > Atlas team is in the process of releasing 1.0.0-alpha, which should go out > next week. Once this release is out, Atlas team will get started on 0.8.2 > release; and this release should go out by end of the month. > > Thanks, > Madhan > > > > > On 1/19/18, 6:42 AM, "Colm O hEigeartaigh" <cohei...@apache.org> wrote: > > Are the Atlas team still planning on releasing 0.8.2 by the end of the > month? Are there features we need currently missing on the relevant > branch > in Atlas? > > Colm. > > On Wed, Jan 17, 2018 at 2:59 PM, Velmurugan Periasamy <v...@apache.org> > wrote: > > > +1 > > > > Another suggestion. Atlas is in the process > > <https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd298 > 7d19573069eec90984d9d71277@%3Cdev.atlas.apache.org%3E> > > of releasing 1.0.0-alpha. Once this is complete, Ranger 1.0.0-alpha > can be > > released based on that. Atlas team can be requested to back port any > > changes in Ranger/Atlas interface to 0.8.2, which can be used for > Ranger > > 1.0.0. > > > > From: Colm O hEigeartaigh <cohei...@apache.org> > > Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, " > > cohei...@apache.org" <cohei...@apache.org> > > Date: Tuesday, January 9, 2018 at 10:40 AM > > To: Abhay Kulkarni <akulka...@hortonworks.com> > > Cc: "dev@ranger.apache.org" <dev@ranger.apache.org>, Ramesh Mani < > > rm...@hortonworks.com> > > > > Subject: Re: Hadoop 3 support > > > > +1 for this suggestion. Will there be any issue with downgrading > Atlas in > > Ranger from the current 1.0.0-SNAPSHOT version? > > > > Colm. > > > > On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni < > akulka...@hortonworks.com > > > > > wrote: > > > > All, > > > > Here is another proposal for Ranger release 1.0.0. > > > > Atlas team is planning to make a Atlas-0.8.2 release towards the end > of > > this month. Once that is done, Ranger can do release 1.0.0 with > dependency > > on Atlas 0.8.2 (without Hadoop 3.0.0). > > > > Thanks, > > -Abhay > > > > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" < > vperias...@hortonworks.com on > > behalf of v...@apache.org> wrote: > > > > >+1 for getting the 1.0.0 release out soon. > > > > > >From: Colm O hEigeartaigh <cohei...@apache.org> > > >Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, > > >"cohei...@apache.org" <cohei...@apache.org> > > >Date: Monday, January 8, 2018 at 12:37 PM > > >To: Ramesh Mani <rm...@hortonworks.com> > > >Cc: "dev@ranger.apache.org" <dev@ranger.apache.org> > > >Subject: Re: Hadoop 3 support > > > > > >OK thanks. I will test the patch a bit more thoroughly before > submitting > > >for a RR. > > > > > >Just in regards as to whether to release 1.0.0 with or without > Hadoop > > >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. > What's the > > >timeline for releasing this? That would be the only thing blocking > getting > > >a 1.0.0 of Ranger out "quickly". If that's not imminent then I > guess that > > >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. > > > > > >However, it's been ages since the last release so we should > probably not > > >wait too long before getting a release out. > > > > > >Colm. > > > > > >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani <rm...@hortonworks.com> > > wrote: > > > > > >> Thanks Colm, > > >> > > >> I am fine with Option 1 or 3. Do you want to create a RR for > this > > >>patch? > > >> > > >> Thanks, > > >> Ramesh > > >> > > >> From: Colm O hEigeartaigh <cohei...@apache.org> > > >> Reply-To: "cohei...@apache.org" <cohei...@apache.org> > > >> Date: F
Re: Hadoop 3 support
Are the Atlas team still planning on releasing 0.8.2 by the end of the month? Are there features we need currently missing on the relevant branch in Atlas? Colm. On Wed, Jan 17, 2018 at 2:59 PM, Velmurugan Periasamy <v...@apache.org> wrote: > +1 > > Another suggestion. Atlas is in the process > <https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd2987d19573069eec90984d9d71277@%3Cdev.atlas.apache.org%3E> > of releasing 1.0.0-alpha. Once this is complete, Ranger 1.0.0-alpha can be > released based on that. Atlas team can be requested to back port any > changes in Ranger/Atlas interface to 0.8.2, which can be used for Ranger > 1.0.0. > > From: Colm O hEigeartaigh <cohei...@apache.org> > Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, " > cohei...@apache.org" <cohei...@apache.org> > Date: Tuesday, January 9, 2018 at 10:40 AM > To: Abhay Kulkarni <akulka...@hortonworks.com> > Cc: "dev@ranger.apache.org" <dev@ranger.apache.org>, Ramesh Mani < > rm...@hortonworks.com> > > Subject: Re: Hadoop 3 support > > +1 for this suggestion. Will there be any issue with downgrading Atlas in > Ranger from the current 1.0.0-SNAPSHOT version? > > Colm. > > On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni <akulka...@hortonworks.com > > > wrote: > > All, > > Here is another proposal for Ranger release 1.0.0. > > Atlas team is planning to make a Atlas-0.8.2 release towards the end of > this month. Once that is done, Ranger can do release 1.0.0 with dependency > on Atlas 0.8.2 (without Hadoop 3.0.0). > > Thanks, > -Abhay > > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" <vperias...@hortonworks.com on > behalf of v...@apache.org> wrote: > > >+1 for getting the 1.0.0 release out soon. > > > >From: Colm O hEigeartaigh <cohei...@apache.org> > >Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, > >"cohei...@apache.org" <cohei...@apache.org> > >Date: Monday, January 8, 2018 at 12:37 PM > >To: Ramesh Mani <rm...@hortonworks.com> > >Cc: "dev@ranger.apache.org" <dev@ranger.apache.org> > >Subject: Re: Hadoop 3 support > > > >OK thanks. I will test the patch a bit more thoroughly before submitting > >for a RR. > > > >Just in regards as to whether to release 1.0.0 with or without Hadoop > >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the > >timeline for releasing this? That would be the only thing blocking getting > >a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that > >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. > > > >However, it's been ages since the last release so we should probably not > >wait too long before getting a release out. > > > >Colm. > > > >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani <rm...@hortonworks.com> > wrote: > > > >> Thanks Colm, > >> > >> I am fine with Option 1 or 3. Do you want to create a RR for this > >>patch? > >> > >> Thanks, > >> Ramesh > >> > >> From: Colm O hEigeartaigh <cohei...@apache.org> > >> Reply-To: "cohei...@apache.org" <cohei...@apache.org> > >> Date: Friday, January 5, 2018 at 4:19 AM > >> To: Ramesh Mani <rm...@hortonworks.com> > >> Cc: "dev@ranger.apache.org" <dev@ranger.apache.org> > >> Subject: Re: Hadoop 3 support > >> > >> I should have added - a third option is just not to support Hadoop > >>3.0.0 > >> at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then > >>update > >> to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. > >> > >> Colm. > >> > >> On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh > >><cohei...@apache.org> > >> wrote: > >> > >>> Hi Ramesh, > >>> > >>> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn > >>> plugins will support Hadoop 3.0.0 only. There is no other option due > >>>to API > >>> changes. A user can use the earlier plugins from 0.7.x if support for > >>> Hadoop 2.7.x is required. > >>> > >>> I am not really tied to this approach though - I'm also fine with just > >>> having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The > >>>approach to > >>> update all of Ranger to use Hadoop 3.0.0 was based on the
Re: Hadoop 3 support
+1 Another suggestion. Atlas is in the process <https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd2987d195730 69eec90984d9d71277@%3Cdev.atlas.apache.org%3E> of releasing 1.0.0-alpha. Once this is complete, Ranger 1.0.0-alpha can be released based on that. Atlas team can be requested to back port any changes in Ranger/Atlas interface to 0.8.2, which can be used for Ranger 1.0.0. From: Colm O hEigeartaigh <cohei...@apache.org> Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, "cohei...@apache.org" <cohei...@apache.org> Date: Tuesday, January 9, 2018 at 10:40 AM To: Abhay Kulkarni <akulka...@hortonworks.com> Cc: "dev@ranger.apache.org" <dev@ranger.apache.org>, Ramesh Mani <rm...@hortonworks.com> Subject: Re: Hadoop 3 support +1 for this suggestion. Will there be any issue with downgrading Atlas in Ranger from the current 1.0.0-SNAPSHOT version? Colm. On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni <akulka...@hortonworks.com> wrote: > All, > > Here is another proposal for Ranger release 1.0.0. > > Atlas team is planning to make a Atlas-0.8.2 release towards the end of > this month. Once that is done, Ranger can do release 1.0.0 with dependency > on Atlas 0.8.2 (without Hadoop 3.0.0). > > Thanks, > -Abhay > > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" <vperias...@hortonworks.com on > behalf of v...@apache.org> wrote: > >> >+1 for getting the 1.0.0 release out soon. >> > >> >From: Colm O hEigeartaigh <cohei...@apache.org> >> >Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, >> >"cohei...@apache.org" <cohei...@apache.org> >> >Date: Monday, January 8, 2018 at 12:37 PM >> >To: Ramesh Mani <rm...@hortonworks.com> >> >Cc: "dev@ranger.apache.org" <dev@ranger.apache.org> >> >Subject: Re: Hadoop 3 support >> > >> >OK thanks. I will test the patch a bit more thoroughly before submitting >> >for a RR. >> > >> >Just in regards as to whether to release 1.0.0 with or without Hadoop >> >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the >> >timeline for releasing this? That would be the only thing blocking getting >> >a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that >> >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. >> > >> >However, it's been ages since the last release so we should probably not >> >wait too long before getting a release out. >> > >> >Colm. >> > >> >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani <rm...@hortonworks.com> > wrote: >> > >>> >> Thanks Colm, >>> >> >>> >> I am fine with Option 1 or 3. Do you want to create a RR for this >>> >>patch? >>> >> >>> >> Thanks, >>> >> Ramesh >>> >> >>> >> From: Colm O hEigeartaigh <cohei...@apache.org> >>> >> Reply-To: "cohei...@apache.org" <cohei...@apache.org> >>> >> Date: Friday, January 5, 2018 at 4:19 AM >>> >> To: Ramesh Mani <rm...@hortonworks.com> >>> >> Cc: "dev@ranger.apache.org" <dev@ranger.apache.org> >>> >> Subject: Re: Hadoop 3 support >>> >> >>> >> I should have added - a third option is just not to support Hadoop >>> >>3.0.0 >>> >> at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then >>> >>update >>> >> to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. >>> >> >>> >> Colm. >>> >> >>> >> On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh >>> >><cohei...@apache.org> >>> >> wrote: >>> >> >>>> >>> Hi Ramesh, >>>> >>> >>>> >>> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn >>>> >>> plugins will support Hadoop 3.0.0 only. There is no other option due >>>> >>>to API >>>> >>> changes. A user can use the earlier plugins from 0.7.x if support for >>>> >>> Hadoop 2.7.x is required. >>>> >>> >>>> >>> I am not really tied to this approach though - I'm also fine with just >>>> >>> having new plugins to support H
Re: Hadoop 3 support
+1 for this suggestion. Will there be any issue with downgrading Atlas in Ranger from the current 1.0.0-SNAPSHOT version? Colm. On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni <akulka...@hortonworks.com> wrote: > All, > > Here is another proposal for Ranger release 1.0.0. > > Atlas team is planning to make a Atlas-0.8.2 release towards the end of > this month. Once that is done, Ranger can do release 1.0.0 with dependency > on Atlas 0.8.2 (without Hadoop 3.0.0). > > Thanks, > -Abhay > > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" <vperias...@hortonworks.com on > behalf of v...@apache.org> wrote: > > >+1 for getting the 1.0.0 release out soon. > > > >From: Colm O hEigeartaigh <cohei...@apache.org> > >Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, > >"cohei...@apache.org" <cohei...@apache.org> > >Date: Monday, January 8, 2018 at 12:37 PM > >To: Ramesh Mani <rm...@hortonworks.com> > >Cc: "dev@ranger.apache.org" <dev@ranger.apache.org> > >Subject: Re: Hadoop 3 support > > > >OK thanks. I will test the patch a bit more thoroughly before submitting > >for a RR. > > > >Just in regards as to whether to release 1.0.0 with or without Hadoop > >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the > >timeline for releasing this? That would be the only thing blocking getting > >a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that > >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. > > > >However, it's been ages since the last release so we should probably not > >wait too long before getting a release out. > > > >Colm. > > > >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani <rm...@hortonworks.com> > wrote: > > > >> Thanks Colm, > >> > >> I am fine with Option 1 or 3. Do you want to create a RR for this > >>patch? > >> > >> Thanks, > >> Ramesh > >> > >> From: Colm O hEigeartaigh <cohei...@apache.org> > >> Reply-To: "cohei...@apache.org" <cohei...@apache.org> > >> Date: Friday, January 5, 2018 at 4:19 AM > >> To: Ramesh Mani <rm...@hortonworks.com> > >> Cc: "dev@ranger.apache.org" <dev@ranger.apache.org> > >> Subject: Re: Hadoop 3 support > >> > >> I should have added - a third option is just not to support Hadoop > >>3.0.0 > >> at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then > >>update > >> to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. > >> > >> Colm. > >> > >> On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh > >><cohei...@apache.org> > >> wrote: > >> > >>> Hi Ramesh, > >>> > >>> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn > >>> plugins will support Hadoop 3.0.0 only. There is no other option due > >>>to API > >>> changes. A user can use the earlier plugins from 0.7.x if support for > >>> Hadoop 2.7.x is required. > >>> > >>> I am not really tied to this approach though - I'm also fine with just > >>> having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The > >>>approach to > >>> update all of Ranger to use Hadoop 3.0.0 was based on the comments on > >>>this > >>> JIRA: > >>> > >>> https://issues.apache.org/jira/browse/RANGER-1738 > >>> > >>> Colm. > >>> > >>> On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani <rm...@hortonworks.com> > >>> wrote: > >>> > >>>> Colm, > >>>> > >>>> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? > >>>> > >>>> Thanks. > >>>> Ramesh > >>>> > >>>> > >>>> > >>>> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" <cohei...@apache.org> > >>>>wrote: > >>>> > >>>>> >Hi Ranger devs, > >>>>> > > >>>>> >I posted an initial patch here to bump Ranger up to use Hadoop > >>>>>3.0.0: > >>>>> > > >>>>> >https://issues.apache.org/jira/browse/RANGER-1935 > >>>>> > > >>>>> >I would appreciate some initial feedback before proceeding further > >>>>>with > >>>>> >testing it (just a general "looks ok" or "this would be problematic > >>>>> >because > >>>>> >X"). > >>>>> > > >>>>> >Colm. > >>>>> > > >>>>> > > >>>>> >-- > >>>>> >Colm O hEigeartaigh > >>>>> > > >>>>> >Talend Community Coder > >>>>> >http://coders.talend.com > >>>> > >>>> > >>> > >>> > >>> -- > >>> Colm O hEigeartaigh > >>> > >>> Talend Community Coder > >>> http://coders.talend.com > >>> > >> > >> > >> > >> -- > >> Colm O hEigeartaigh > >> > >> Talend Community Coder > >> http://coders.talend.com > >> > > > > > > > >-- > >Colm O hEigeartaigh > > > >Talend Community Coder > >http://coders.talend.com > > > > > > > > -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com
Re: Hadoop 3 support
All, Here is another proposal for Ranger release 1.0.0. Atlas team is planning to make a Atlas-0.8.2 release towards the end of this month. Once that is done, Ranger can do release 1.0.0 with dependency on Atlas 0.8.2 (without Hadoop 3.0.0). Thanks, -Abhay On 1/8/18, 12:23 PM, "Velmurugan Periasamy" <vperias...@hortonworks.com on behalf of v...@apache.org> wrote: >+1 for getting the 1.0.0 release out soon. > >From: Colm O hEigeartaigh <cohei...@apache.org> >Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, >"cohei...@apache.org" <cohei...@apache.org> >Date: Monday, January 8, 2018 at 12:37 PM >To: Ramesh Mani <rm...@hortonworks.com> >Cc: "dev@ranger.apache.org" <dev@ranger.apache.org> >Subject: Re: Hadoop 3 support > >OK thanks. I will test the patch a bit more thoroughly before submitting >for a RR. > >Just in regards as to whether to release 1.0.0 with or without Hadoop >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the >timeline for releasing this? That would be the only thing blocking getting >a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. > >However, it's been ages since the last release so we should probably not >wait too long before getting a release out. > >Colm. > >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani <rm...@hortonworks.com> wrote: > >> Thanks Colm, >> >> I am fine with Option 1 or 3. Do you want to create a RR for this >>patch? >> >> Thanks, >> Ramesh >> >> From: Colm O hEigeartaigh <cohei...@apache.org> >> Reply-To: "cohei...@apache.org" <cohei...@apache.org> >> Date: Friday, January 5, 2018 at 4:19 AM >> To: Ramesh Mani <rm...@hortonworks.com> >> Cc: "dev@ranger.apache.org" <dev@ranger.apache.org> >> Subject: Re: Hadoop 3 support >> >> I should have added - a third option is just not to support Hadoop >>3.0.0 >> at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then >>update >> to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. >> >> Colm. >> >> On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh >><cohei...@apache.org> >> wrote: >> >>> Hi Ramesh, >>> >>> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn >>> plugins will support Hadoop 3.0.0 only. There is no other option due >>>to API >>> changes. A user can use the earlier plugins from 0.7.x if support for >>> Hadoop 2.7.x is required. >>> >>> I am not really tied to this approach though - I'm also fine with just >>> having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The >>>approach to >>> update all of Ranger to use Hadoop 3.0.0 was based on the comments on >>>this >>> JIRA: >>> >>> https://issues.apache.org/jira/browse/RANGER-1738 >>> >>> Colm. >>> >>> On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani <rm...@hortonworks.com> >>> wrote: >>> >>>> Colm, >>>> >>>> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? >>>> >>>> Thanks. >>>> Ramesh >>>> >>>> >>>> >>>> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" <cohei...@apache.org> >>>>wrote: >>>> >>>>> >Hi Ranger devs, >>>>> > >>>>> >I posted an initial patch here to bump Ranger up to use Hadoop >>>>>3.0.0: >>>>> > >>>>> >https://issues.apache.org/jira/browse/RANGER-1935 >>>>> > >>>>> >I would appreciate some initial feedback before proceeding further >>>>>with >>>>> >testing it (just a general "looks ok" or "this would be problematic >>>>> >because >>>>> >X"). >>>>> > >>>>> >Colm. >>>>> > >>>>> > >>>>> >-- >>>>> >Colm O hEigeartaigh >>>>> > >>>>> >Talend Community Coder >>>>> >http://coders.talend.com >>>> >>>> >>> >>> >>> -- >>> Colm O hEigeartaigh >>> >>> Talend Community Coder >>> http://coders.talend.com >>> >> >> >> >> -- >> Colm O hEigeartaigh >> >> Talend Community Coder >> http://coders.talend.com >> > > > >-- >Colm O hEigeartaigh > >Talend Community Coder >http://coders.talend.com > > >
Re: Hadoop 3 support
+1 for getting the 1.0.0 release out soon. From: Colm O hEigeartaigh <cohei...@apache.org> Reply-To: "dev@ranger.apache.org" <dev@ranger.apache.org>, "cohei...@apache.org" <cohei...@apache.org> Date: Monday, January 8, 2018 at 12:37 PM To: Ramesh Mani <rm...@hortonworks.com> Cc: "dev@ranger.apache.org" <dev@ranger.apache.org> Subject: Re: Hadoop 3 support OK thanks. I will test the patch a bit more thoroughly before submitting for a RR. Just in regards as to whether to release 1.0.0 with or without Hadoop 3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the timeline for releasing this? That would be the only thing blocking getting a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. However, it's been ages since the last release so we should probably not wait too long before getting a release out. Colm. On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani <rm...@hortonworks.com> wrote: > Thanks Colm, > > I am fine with Option 1 or 3. Do you want to create a RR for this patch? > > Thanks, > Ramesh > > From: Colm O hEigeartaigh <cohei...@apache.org> > Reply-To: "cohei...@apache.org" <cohei...@apache.org> > Date: Friday, January 5, 2018 at 4:19 AM > To: Ramesh Mani <rm...@hortonworks.com> > Cc: "dev@ranger.apache.org" <dev@ranger.apache.org> > Subject: Re: Hadoop 3 support > > I should have added - a third option is just not to support Hadoop 3.0.0 > at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update > to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. > > Colm. > > On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh <cohei...@apache.org> > wrote: > >> Hi Ramesh, >> >> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn >> plugins will support Hadoop 3.0.0 only. There is no other option due to API >> changes. A user can use the earlier plugins from 0.7.x if support for >> Hadoop 2.7.x is required. >> >> I am not really tied to this approach though - I'm also fine with just >> having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach to >> update all of Ranger to use Hadoop 3.0.0 was based on the comments on this >> JIRA: >> >> https://issues.apache.org/jira/browse/RANGER-1738 >> >> Colm. >> >> On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani <rm...@hortonworks.com> >> wrote: >> >>> Colm, >>> >>> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? >>> >>> Thanks. >>> Ramesh >>> >>> >>> >>> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" <cohei...@apache.org> wrote: >>> >>>> >Hi Ranger devs, >>>> > >>>> >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: >>>> > >>>> >https://issues.apache.org/jira/browse/RANGER-1935 >>>> > >>>> >I would appreciate some initial feedback before proceeding further with >>>> >testing it (just a general "looks ok" or "this would be problematic >>>> >because >>>> >X"). >>>> > >>>> >Colm. >>>> > >>>> > >>>> >-- >>>> >Colm O hEigeartaigh >>>> > >>>> >Talend Community Coder >>>> >http://coders.talend.com >>> >>> >> >> >> -- >> Colm O hEigeartaigh >> >> Talend Community Coder >> http://coders.talend.com >> > > > > -- > Colm O hEigeartaigh > > Talend Community Coder > http://coders.talend.com > -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com
Re: Hadoop 3 support
OK thanks. I will test the patch a bit more thoroughly before submitting for a RR. Just in regards as to whether to release 1.0.0 with or without Hadoop 3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the timeline for releasing this? That would be the only thing blocking getting a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. However, it's been ages since the last release so we should probably not wait too long before getting a release out. Colm. On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani <rm...@hortonworks.com> wrote: > Thanks Colm, > > I am fine with Option 1 or 3. Do you want to create a RR for this patch? > > Thanks, > Ramesh > > From: Colm O hEigeartaigh <cohei...@apache.org> > Reply-To: "cohei...@apache.org" <cohei...@apache.org> > Date: Friday, January 5, 2018 at 4:19 AM > To: Ramesh Mani <rm...@hortonworks.com> > Cc: "dev@ranger.apache.org" <dev@ranger.apache.org> > Subject: Re: Hadoop 3 support > > I should have added - a third option is just not to support Hadoop 3.0.0 > at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update > to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. > > Colm. > > On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh <cohei...@apache.org> > wrote: > >> Hi Ramesh, >> >> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn >> plugins will support Hadoop 3.0.0 only. There is no other option due to API >> changes. A user can use the earlier plugins from 0.7.x if support for >> Hadoop 2.7.x is required. >> >> I am not really tied to this approach though - I'm also fine with just >> having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach to >> update all of Ranger to use Hadoop 3.0.0 was based on the comments on this >> JIRA: >> >> https://issues.apache.org/jira/browse/RANGER-1738 >> >> Colm. >> >> On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani <rm...@hortonworks.com> >> wrote: >> >>> Colm, >>> >>> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? >>> >>> Thanks. >>> Ramesh >>> >>> >>> >>> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" <cohei...@apache.org> wrote: >>> >>> >Hi Ranger devs, >>> > >>> >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: >>> > >>> >https://issues.apache.org/jira/browse/RANGER-1935 >>> > >>> >I would appreciate some initial feedback before proceeding further with >>> >testing it (just a general "looks ok" or "this would be problematic >>> >because >>> >X"). >>> > >>> >Colm. >>> > >>> > >>> >-- >>> >Colm O hEigeartaigh >>> > >>> >Talend Community Coder >>> >http://coders.talend.com >>> >>> >> >> >> -- >> Colm O hEigeartaigh >> >> Talend Community Coder >> http://coders.talend.com >> > > > > -- > Colm O hEigeartaigh > > Talend Community Coder > http://coders.talend.com > -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com
Re: Hadoop 3 support
My preference is for option 3 or option 1. From: Zsombor <gzsom...@gmail.com<mailto:gzsom...@gmail.com>> Reply-To: "dev@ranger.apache.org<mailto:dev@ranger.apache.org>" <dev@ranger.apache.org<mailto:dev@ranger.apache.org>>, "gzsom...@gmail.com<mailto:gzsom...@gmail.com>" <gzsom...@gmail.com<mailto:gzsom...@gmail.com>> Date: Friday, January 5, 2018 at 8:18 AM To: ranger <dev@ranger.apache.org<mailto:dev@ranger.apache.org>>, Colm O hEigeartaigh <cohei...@apache.org<mailto:cohei...@apache.org>> Cc: Ramesh Mani <rm...@hortonworks.com<mailto:rm...@hortonworks.com>> Subject: Re: Hadoop 3 support Fourth option: Create a 0.8 release for Hadoop 2.x and JDK 7 - maybe someone still needs to use these 'legacy' versions. Regards, Zsombor On Fri, Jan 5, 2018 at 1:19 PM, Colm O hEigeartaigh <cohei...@apache.org<mailto:cohei...@apache.org>> wrote: I should have added - a third option is just not to support Hadoop 3.0.0 at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. Colm. On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh <cohei...@apache.org<mailto:cohei...@apache.org>> wrote: > Hi Ramesh, > > Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn > plugins will support Hadoop 3.0.0 only. There is no other option due to API > changes. A user can use the earlier plugins from 0.7.x if support for > Hadoop 2.7.x is required. > > I am not really tied to this approach though - I'm also fine with just > having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach to > update all of Ranger to use Hadoop 3.0.0 was based on the comments on this > JIRA: > > https://issues.apache.org/jira/browse/RANGER-1738 > > Colm. > > On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani > <rm...@hortonworks.com<mailto:rm...@hortonworks.com>> > wrote: > >> Colm, >> >> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? >> >> Thanks. >> Ramesh >> >> >> >> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" >> <cohei...@apache.org<mailto:cohei...@apache.org>> wrote: >> >> >Hi Ranger devs, >> > >> >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: >> > >> >https://issues.apache.org/jira/browse/RANGER-1935 >> > >> >I would appreciate some initial feedback before proceeding further with >> >testing it (just a general "looks ok" or "this would be problematic >> >because >> >X"). >> > >> >Colm. >> > >> > >> >-- >> >Colm O hEigeartaigh >> > >> >Talend Community Coder >> >http://coders.talend.com >> >> > > > -- > Colm O hEigeartaigh > > Talend Community Coder > http://coders.talend.com > -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com
Re: Hadoop 3 support
Fourth option: Create a 0.8 release for Hadoop 2.x and JDK 7 - maybe someone still needs to use these 'legacy' versions. Regards, Zsombor On Fri, Jan 5, 2018 at 1:19 PM, Colm O hEigeartaighwrote: > I should have added - a third option is just not to support Hadoop 3.0.0 at > all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update to > Hadoop 3.0.0 in Ranger 1.1/2.0 etc. > > Colm. > > On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh > wrote: > > > Hi Ramesh, > > > > Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn > > plugins will support Hadoop 3.0.0 only. There is no other option due to > API > > changes. A user can use the earlier plugins from 0.7.x if support for > > Hadoop 2.7.x is required. > > > > I am not really tied to this approach though - I'm also fine with just > > having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach > to > > update all of Ranger to use Hadoop 3.0.0 was based on the comments on > this > > JIRA: > > > > https://issues.apache.org/jira/browse/RANGER-1738 > > > > Colm. > > > > On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani > > wrote: > > > >> Colm, > >> > >> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? > >> > >> Thanks. > >> Ramesh > >> > >> > >> > >> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" wrote: > >> > >> >Hi Ranger devs, > >> > > >> >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: > >> > > >> >https://issues.apache.org/jira/browse/RANGER-1935 > >> > > >> >I would appreciate some initial feedback before proceeding further with > >> >testing it (just a general "looks ok" or "this would be problematic > >> >because > >> >X"). > >> > > >> >Colm. > >> > > >> > > >> >-- > >> >Colm O hEigeartaigh > >> > > >> >Talend Community Coder > >> >http://coders.talend.com > >> > >> > > > > > > -- > > Colm O hEigeartaigh > > > > Talend Community Coder > > http://coders.talend.com > > > > > > -- > Colm O hEigeartaigh > > Talend Community Coder > http://coders.talend.com >
Re: Hadoop 3 support
I should have added - a third option is just not to support Hadoop 3.0.0 at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. Colm. On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaighwrote: > Hi Ramesh, > > Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn > plugins will support Hadoop 3.0.0 only. There is no other option due to API > changes. A user can use the earlier plugins from 0.7.x if support for > Hadoop 2.7.x is required. > > I am not really tied to this approach though - I'm also fine with just > having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach to > update all of Ranger to use Hadoop 3.0.0 was based on the comments on this > JIRA: > > https://issues.apache.org/jira/browse/RANGER-1738 > > Colm. > > On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani > wrote: > >> Colm, >> >> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? >> >> Thanks. >> Ramesh >> >> >> >> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" wrote: >> >> >Hi Ranger devs, >> > >> >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: >> > >> >https://issues.apache.org/jira/browse/RANGER-1935 >> > >> >I would appreciate some initial feedback before proceeding further with >> >testing it (just a general "looks ok" or "this would be problematic >> >because >> >X"). >> > >> >Colm. >> > >> > >> >-- >> >Colm O hEigeartaigh >> > >> >Talend Community Coder >> >http://coders.talend.com >> >> > > > -- > Colm O hEigeartaigh > > Talend Community Coder > http://coders.talend.com > -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com
Re: Hadoop 3 support
Hi Ramesh, Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn plugins will support Hadoop 3.0.0 only. There is no other option due to API changes. A user can use the earlier plugins from 0.7.x if support for Hadoop 2.7.x is required. I am not really tied to this approach though - I'm also fine with just having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach to update all of Ranger to use Hadoop 3.0.0 was based on the comments on this JIRA: https://issues.apache.org/jira/browse/RANGER-1738 Colm. On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Maniwrote: > Colm, > > Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? > > Thanks. > Ramesh > > > > On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" wrote: > > >Hi Ranger devs, > > > >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: > > > >https://issues.apache.org/jira/browse/RANGER-1935 > > > >I would appreciate some initial feedback before proceeding further with > >testing it (just a general "looks ok" or "this would be problematic > >because > >X"). > > > >Colm. > > > > > >-- > >Colm O hEigeartaigh > > > >Talend Community Coder > >http://coders.talend.com > > -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com
Re: Hadoop 3 support
Colm, Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? Thanks. Ramesh On 1/4/18, 9:32 AM, "Colm O hEigeartaigh"wrote: >Hi Ranger devs, > >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: > >https://issues.apache.org/jira/browse/RANGER-1935 > >I would appreciate some initial feedback before proceeding further with >testing it (just a general "looks ok" or "this would be problematic >because >X"). > >Colm. > > >-- >Colm O hEigeartaigh > >Talend Community Coder >http://coders.talend.com
Hadoop 3 support
Hi Ranger devs, I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: https://issues.apache.org/jira/browse/RANGER-1935 I would appreciate some initial feedback before proceeding further with testing it (just a general "looks ok" or "this would be problematic because X"). Colm. -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com