Re: Hadoop 3 support
+1 for Ranger 1.0.0 release. Thanks, Ramesh On 2/22/18, 3:17 PM, "Sailaja Polavarapu" wrote: >Rangers: > I am volunteering to be the release manager for ranger 1.0.0 release. >Based on the below discussion I will start a new thread on kick of plan >for the release soon. Please let me know if any of you have any concerns >and/or suggestions. > >Thanks, >Sailaja. > >On 1/22/18, 9:01 AM, "Colm O hEigeartaigh" wrote: > >Sounds good, thanks! > >Colm. > >On Fri, Jan 19, 2018 at 10:59 PM, Madhan Neethiraj >wrote: > >> Colm, >> >> Atlas team is in the process of releasing 1.0.0-alpha, which should >go out >> next week. Once this release is out, Atlas team will get started on >0.8.2 >> release; and this release should go out by end of the month. >> >> Thanks, >> Madhan >> >> >> >> >> On 1/19/18, 6:42 AM, "Colm O hEigeartaigh" >wrote: >> >> Are the Atlas team still planning on releasing 0.8.2 by the end >of the >> month? Are there features we need currently missing on the >relevant >> branch >> in Atlas? >> >> Colm. >> >> On Wed, Jan 17, 2018 at 2:59 PM, Velmurugan Periasamy > >> wrote: >> >> > +1 >> > >> > Another suggestion. Atlas is in the process >> > ><https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd298 >> 7d19573069eec90984d9d71277@%3Cdev.atlas.apache.org%3E> >> > of releasing 1.0.0-alpha. Once this is complete, Ranger >1.0.0-alpha >> can be >> > released based on that. Atlas team can be requested to back >port any >> > changes in Ranger/Atlas interface to 0.8.2, which can be used >for >> Ranger >> > 1.0.0. > > > >> > From: Colm O hEigeartaigh >> > Reply-To: "dev@ranger.apache.org" , " >> > cohei...@apache.org" >> > Date: Tuesday, January 9, 2018 at 10:40 AM >> > To: Abhay Kulkarni >> > Cc: "dev@ranger.apache.org" , Ramesh >Mani < >> > rm...@hortonworks.com> >> > >> > Subject: Re: Hadoop 3 support >> > >> > +1 for this suggestion. Will there be any issue with >downgrading >> Atlas in >> > Ranger from the current 1.0.0-SNAPSHOT version? >> > >> > Colm. >> > >> > On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni < >> akulka...@hortonworks.com >> > > >> > wrote: >> > >> > All, >> > >> > Here is another proposal for Ranger release 1.0.0. >> > >> > Atlas team is planning to make a Atlas-0.8.2 release towards >the end >> of >> > this month. Once that is done, Ranger can do release 1.0.0 >with > > dependency >> > on Atlas 0.8.2 (without Hadoop 3.0.0). >> > >> > Thanks, >> > -Abhay >> > >> > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" < >> vperias...@hortonworks.com on >> > behalf of v...@apache.org> wrote: >> > >> > >+1 for getting the 1.0.0 release out soon. >> > > >> > >From: Colm O hEigeartaigh >> > >Reply-To: "dev@ranger.apache.org" , >> > >"cohei...@apache.org" >> > >Date: Monday, January 8, 2018 at 12:37 PM >> > >To: Ramesh Mani >> > >Cc: "dev@ranger.apache.org" >> > >Subject: Re: Hadoop 3 support >> > > >> > >OK thanks. I will test the patch a bit more thoroughly before >> submitting >> > >for a RR. >> > > >> > >Just in regards as to whether to release 1.0.0 with or >without >> Hadoop >> > >3.0.0...currently we have a dependency on Atlas >1.0.0-SNAPSHOT. >> What's the >> > >timeline for releasing this? That would be the only thing >blocking > > getting >> > >a 1.0.0 of Ranger out "quickly". If that
Re: Hadoop 3 support
Rangers: I am volunteering to be the release manager for ranger 1.0.0 release. Based on the below discussion I will start a new thread on kick of plan for the release soon. Please let me know if any of you have any concerns and/or suggestions. Thanks, Sailaja. On 1/22/18, 9:01 AM, "Colm O hEigeartaigh" wrote: Sounds good, thanks! Colm. On Fri, Jan 19, 2018 at 10:59 PM, Madhan Neethiraj wrote: > Colm, > > Atlas team is in the process of releasing 1.0.0-alpha, which should go out > next week. Once this release is out, Atlas team will get started on 0.8.2 > release; and this release should go out by end of the month. > > Thanks, > Madhan > > > > > On 1/19/18, 6:42 AM, "Colm O hEigeartaigh" wrote: > > Are the Atlas team still planning on releasing 0.8.2 by the end of the > month? Are there features we need currently missing on the relevant > branch > in Atlas? > > Colm. > > On Wed, Jan 17, 2018 at 2:59 PM, Velmurugan Periasamy > wrote: > > > +1 > > > > Another suggestion. Atlas is in the process > > <https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd298 > 7d19573069eec90984d9d71277@%3Cdev.atlas.apache.org%3E> > > of releasing 1.0.0-alpha. Once this is complete, Ranger 1.0.0-alpha > can be > > released based on that. Atlas team can be requested to back port any > > changes in Ranger/Atlas interface to 0.8.2, which can be used for > Ranger > > 1.0.0. > > > > From: Colm O hEigeartaigh > > Reply-To: "dev@ranger.apache.org" , " > > cohei...@apache.org" > > Date: Tuesday, January 9, 2018 at 10:40 AM > > To: Abhay Kulkarni > > Cc: "dev@ranger.apache.org" , Ramesh Mani < > > rm...@hortonworks.com> > > > > Subject: Re: Hadoop 3 support > > > > +1 for this suggestion. Will there be any issue with downgrading > Atlas in > > Ranger from the current 1.0.0-SNAPSHOT version? > > > > Colm. > > > > On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni < > akulka...@hortonworks.com > > > > > wrote: > > > > All, > > > > Here is another proposal for Ranger release 1.0.0. > > > > Atlas team is planning to make a Atlas-0.8.2 release towards the end > of > > this month. Once that is done, Ranger can do release 1.0.0 with > dependency > > on Atlas 0.8.2 (without Hadoop 3.0.0). > > > > Thanks, > > -Abhay > > > > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" < > vperias...@hortonworks.com on > > behalf of v...@apache.org> wrote: > > > > >+1 for getting the 1.0.0 release out soon. > > > > > >From: Colm O hEigeartaigh > > >Reply-To: "dev@ranger.apache.org" , > > >"cohei...@apache.org" > > >Date: Monday, January 8, 2018 at 12:37 PM > > >To: Ramesh Mani > > >Cc: "dev@ranger.apache.org" > > >Subject: Re: Hadoop 3 support > > > > > >OK thanks. I will test the patch a bit more thoroughly before > submitting > > >for a RR. > > > > > >Just in regards as to whether to release 1.0.0 with or without > Hadoop > > >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. > What's the > > >timeline for releasing this? That would be the only thing blocking > getting > > >a 1.0.0 of Ranger out "quickly". If that's not imminent then I > guess that > > >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. > > > > > >However, it's been ages since the last release so we should > probably not > > >wait too long before getting a release out. > > > > > >Colm. > > > > > >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani > > wrote: > > > > > >> Thanks Colm, > > >> > &g
Re: Hadoop 3 support
Sounds good, thanks! Colm. On Fri, Jan 19, 2018 at 10:59 PM, Madhan Neethiraj wrote: > Colm, > > Atlas team is in the process of releasing 1.0.0-alpha, which should go out > next week. Once this release is out, Atlas team will get started on 0.8.2 > release; and this release should go out by end of the month. > > Thanks, > Madhan > > > > > On 1/19/18, 6:42 AM, "Colm O hEigeartaigh" wrote: > > Are the Atlas team still planning on releasing 0.8.2 by the end of the > month? Are there features we need currently missing on the relevant > branch > in Atlas? > > Colm. > > On Wed, Jan 17, 2018 at 2:59 PM, Velmurugan Periasamy > wrote: > > > +1 > > > > Another suggestion. Atlas is in the process > > <https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd298 > 7d19573069eec90984d9d71277@%3Cdev.atlas.apache.org%3E> > > of releasing 1.0.0-alpha. Once this is complete, Ranger 1.0.0-alpha > can be > > released based on that. Atlas team can be requested to back port any > > changes in Ranger/Atlas interface to 0.8.2, which can be used for > Ranger > > 1.0.0. > > > > From: Colm O hEigeartaigh > > Reply-To: "dev@ranger.apache.org" , " > > cohei...@apache.org" > > Date: Tuesday, January 9, 2018 at 10:40 AM > > To: Abhay Kulkarni > > Cc: "dev@ranger.apache.org" , Ramesh Mani < > > rm...@hortonworks.com> > > > > Subject: Re: Hadoop 3 support > > > > +1 for this suggestion. Will there be any issue with downgrading > Atlas in > > Ranger from the current 1.0.0-SNAPSHOT version? > > > > Colm. > > > > On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni < > akulka...@hortonworks.com > > > > > wrote: > > > > All, > > > > Here is another proposal for Ranger release 1.0.0. > > > > Atlas team is planning to make a Atlas-0.8.2 release towards the end > of > > this month. Once that is done, Ranger can do release 1.0.0 with > dependency > > on Atlas 0.8.2 (without Hadoop 3.0.0). > > > > Thanks, > > -Abhay > > > > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" < > vperias...@hortonworks.com on > > behalf of v...@apache.org> wrote: > > > > >+1 for getting the 1.0.0 release out soon. > > > > > >From: Colm O hEigeartaigh > > >Reply-To: "dev@ranger.apache.org" , > > >"cohei...@apache.org" > > >Date: Monday, January 8, 2018 at 12:37 PM > > >To: Ramesh Mani > > >Cc: "dev@ranger.apache.org" > > >Subject: Re: Hadoop 3 support > > > > > >OK thanks. I will test the patch a bit more thoroughly before > submitting > > >for a RR. > > > > > >Just in regards as to whether to release 1.0.0 with or without > Hadoop > > >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. > What's the > > >timeline for releasing this? That would be the only thing blocking > getting > > >a 1.0.0 of Ranger out "quickly". If that's not imminent then I > guess that > > >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. > > > > > >However, it's been ages since the last release so we should > probably not > > >wait too long before getting a release out. > > > > > >Colm. > > > > > >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani > > wrote: > > > > > >> Thanks Colm, > > >> > > >> I am fine with Option 1 or 3. Do you want to create a RR for > this > > >>patch? > > >> > > >> Thanks, > > >> Ramesh > > >> > > >> From: Colm O hEigeartaigh > > >> Reply-To: "cohei...@apache.org" > > >> Date: Friday, January 5, 2018 at 4:19 AM > > >> To: Ramesh Mani > > >> Cc: "dev@ranger.apache.org" > > >> Subject: Re: Hadoop 3 support > > >> > > >> I should have added - a third option is just not to support > Hadoop > > >>3.0.0 > > >> at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and > then &g
Re: Hadoop 3 support
Colm, Atlas team is in the process of releasing 1.0.0-alpha, which should go out next week. Once this release is out, Atlas team will get started on 0.8.2 release; and this release should go out by end of the month. Thanks, Madhan On 1/19/18, 6:42 AM, "Colm O hEigeartaigh" wrote: Are the Atlas team still planning on releasing 0.8.2 by the end of the month? Are there features we need currently missing on the relevant branch in Atlas? Colm. On Wed, Jan 17, 2018 at 2:59 PM, Velmurugan Periasamy wrote: > +1 > > Another suggestion. Atlas is in the process > <https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd2987d19573069eec90984d9d71277@%3Cdev.atlas.apache.org%3E> > of releasing 1.0.0-alpha. Once this is complete, Ranger 1.0.0-alpha can be > released based on that. Atlas team can be requested to back port any > changes in Ranger/Atlas interface to 0.8.2, which can be used for Ranger > 1.0.0. > > From: Colm O hEigeartaigh > Reply-To: "dev@ranger.apache.org" , " > cohei...@apache.org" > Date: Tuesday, January 9, 2018 at 10:40 AM > To: Abhay Kulkarni > Cc: "dev@ranger.apache.org" , Ramesh Mani < > rm...@hortonworks.com> > > Subject: Re: Hadoop 3 support > > +1 for this suggestion. Will there be any issue with downgrading Atlas in > Ranger from the current 1.0.0-SNAPSHOT version? > > Colm. > > On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni > > wrote: > > All, > > Here is another proposal for Ranger release 1.0.0. > > Atlas team is planning to make a Atlas-0.8.2 release towards the end of > this month. Once that is done, Ranger can do release 1.0.0 with dependency > on Atlas 0.8.2 (without Hadoop 3.0.0). > > Thanks, > -Abhay > > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" behalf of v...@apache.org> wrote: > > >+1 for getting the 1.0.0 release out soon. > > > >From: Colm O hEigeartaigh > >Reply-To: "dev@ranger.apache.org" , > >"cohei...@apache.org" > >Date: Monday, January 8, 2018 at 12:37 PM > >To: Ramesh Mani > >Cc: "dev@ranger.apache.org" > >Subject: Re: Hadoop 3 support > > > >OK thanks. I will test the patch a bit more thoroughly before submitting > >for a RR. > > > >Just in regards as to whether to release 1.0.0 with or without Hadoop > >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the > >timeline for releasing this? That would be the only thing blocking getting > >a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that > >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. > > > >However, it's been ages since the last release so we should probably not > >wait too long before getting a release out. > > > >Colm. > > > >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani > wrote: > > > >> Thanks Colm, > >> > >> I am fine with Option 1 or 3. Do you want to create a RR for this > >>patch? > >> > >> Thanks, > >> Ramesh > >> > >> From: Colm O hEigeartaigh > >> Reply-To: "cohei...@apache.org" > >> Date: Friday, January 5, 2018 at 4:19 AM > >> To: Ramesh Mani > >> Cc: "dev@ranger.apache.org" > >> Subject: Re: Hadoop 3 support > >> > >> I should have added - a third option is just not to support Hadoop > >>3.0.0 > >> at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then > >>update > >> to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. > >> > >> Colm. > >> > >> On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh > >> > >> wrote: > >> > >>> Hi Ramesh, > >>> > >>> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn > >>> plugins will support Hadoop 3.0.0 only. There is no other option due > >>>to API > >>> changes. A user can use the earlier plugins from 0.7.x if support for > >>> Hadoop 2.7.x is required. > >>> > >>> I am not really tied to this approach though - I'm al
Re: Hadoop 3 support
Are the Atlas team still planning on releasing 0.8.2 by the end of the month? Are there features we need currently missing on the relevant branch in Atlas? Colm. On Wed, Jan 17, 2018 at 2:59 PM, Velmurugan Periasamy wrote: > +1 > > Another suggestion. Atlas is in the process > <https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd2987d19573069eec90984d9d71277@%3Cdev.atlas.apache.org%3E> > of releasing 1.0.0-alpha. Once this is complete, Ranger 1.0.0-alpha can be > released based on that. Atlas team can be requested to back port any > changes in Ranger/Atlas interface to 0.8.2, which can be used for Ranger > 1.0.0. > > From: Colm O hEigeartaigh > Reply-To: "dev@ranger.apache.org" , " > cohei...@apache.org" > Date: Tuesday, January 9, 2018 at 10:40 AM > To: Abhay Kulkarni > Cc: "dev@ranger.apache.org" , Ramesh Mani < > rm...@hortonworks.com> > > Subject: Re: Hadoop 3 support > > +1 for this suggestion. Will there be any issue with downgrading Atlas in > Ranger from the current 1.0.0-SNAPSHOT version? > > Colm. > > On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni > > wrote: > > All, > > Here is another proposal for Ranger release 1.0.0. > > Atlas team is planning to make a Atlas-0.8.2 release towards the end of > this month. Once that is done, Ranger can do release 1.0.0 with dependency > on Atlas 0.8.2 (without Hadoop 3.0.0). > > Thanks, > -Abhay > > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" behalf of v...@apache.org> wrote: > > >+1 for getting the 1.0.0 release out soon. > > > >From: Colm O hEigeartaigh > >Reply-To: "dev@ranger.apache.org" , > >"cohei...@apache.org" > >Date: Monday, January 8, 2018 at 12:37 PM > >To: Ramesh Mani > >Cc: "dev@ranger.apache.org" > >Subject: Re: Hadoop 3 support > > > >OK thanks. I will test the patch a bit more thoroughly before submitting > >for a RR. > > > >Just in regards as to whether to release 1.0.0 with or without Hadoop > >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the > >timeline for releasing this? That would be the only thing blocking getting > >a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that > >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. > > > >However, it's been ages since the last release so we should probably not > >wait too long before getting a release out. > > > >Colm. > > > >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani > wrote: > > > >> Thanks Colm, > >> > >> I am fine with Option 1 or 3. Do you want to create a RR for this > >>patch? > >> > >> Thanks, > >> Ramesh > >> > >> From: Colm O hEigeartaigh > >> Reply-To: "cohei...@apache.org" > >> Date: Friday, January 5, 2018 at 4:19 AM > >> To: Ramesh Mani > >> Cc: "dev@ranger.apache.org" > >> Subject: Re: Hadoop 3 support > >> > >> I should have added - a third option is just not to support Hadoop > >>3.0.0 > >> at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then > >>update > >> to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. > >> > >> Colm. > >> > >> On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh > >> > >> wrote: > >> > >>> Hi Ramesh, > >>> > >>> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn > >>> plugins will support Hadoop 3.0.0 only. There is no other option due > >>>to API > >>> changes. A user can use the earlier plugins from 0.7.x if support for > >>> Hadoop 2.7.x is required. > >>> > >>> I am not really tied to this approach though - I'm also fine with just > >>> having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The > >>>approach to > >>> update all of Ranger to use Hadoop 3.0.0 was based on the comments on > >>>this > >>> JIRA: > >>> > >>> https://issues.apache.org/jira/browse/RANGER-1738 > >>> > >>> Colm. > >>> > >>> On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani > >>> wrote: > >>> > >>>> Colm, > >>>> > >>>> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? > >>>> > >>>> Thanks. > >>>>
Re: Hadoop 3 support
+1 Another suggestion. Atlas is in the process <https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd2987d195730 69eec90984d9d71277@%3Cdev.atlas.apache.org%3E> of releasing 1.0.0-alpha. Once this is complete, Ranger 1.0.0-alpha can be released based on that. Atlas team can be requested to back port any changes in Ranger/Atlas interface to 0.8.2, which can be used for Ranger 1.0.0. From: Colm O hEigeartaigh Reply-To: "dev@ranger.apache.org" , "cohei...@apache.org" Date: Tuesday, January 9, 2018 at 10:40 AM To: Abhay Kulkarni Cc: "dev@ranger.apache.org" , Ramesh Mani Subject: Re: Hadoop 3 support +1 for this suggestion. Will there be any issue with downgrading Atlas in Ranger from the current 1.0.0-SNAPSHOT version? Colm. On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni wrote: > All, > > Here is another proposal for Ranger release 1.0.0. > > Atlas team is planning to make a Atlas-0.8.2 release towards the end of > this month. Once that is done, Ranger can do release 1.0.0 with dependency > on Atlas 0.8.2 (without Hadoop 3.0.0). > > Thanks, > -Abhay > > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" behalf of v...@apache.org> wrote: > >> >+1 for getting the 1.0.0 release out soon. >> > >> >From: Colm O hEigeartaigh >> >Reply-To: "dev@ranger.apache.org" , >> >"cohei...@apache.org" >> >Date: Monday, January 8, 2018 at 12:37 PM >> >To: Ramesh Mani >> >Cc: "dev@ranger.apache.org" >> >Subject: Re: Hadoop 3 support >> > >> >OK thanks. I will test the patch a bit more thoroughly before submitting >> >for a RR. >> > >> >Just in regards as to whether to release 1.0.0 with or without Hadoop >> >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the >> >timeline for releasing this? That would be the only thing blocking getting >> >a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that >> >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. >> > >> >However, it's been ages since the last release so we should probably not >> >wait too long before getting a release out. >> > >> >Colm. >> > >> >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani > wrote: >> > >>> >> Thanks Colm, >>> >> >>> >> I am fine with Option 1 or 3. Do you want to create a RR for this >>> >>patch? >>> >> >>> >> Thanks, >>> >> Ramesh >>> >> >>> >> From: Colm O hEigeartaigh >>> >> Reply-To: "cohei...@apache.org" >>> >> Date: Friday, January 5, 2018 at 4:19 AM >>> >> To: Ramesh Mani >>> >> Cc: "dev@ranger.apache.org" >>> >> Subject: Re: Hadoop 3 support >>> >> >>> >> I should have added - a third option is just not to support Hadoop >>> >>3.0.0 >>> >> at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then >>> >>update >>> >> to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. >>> >> >>> >> Colm. >>> >> >>> >> On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh >>> >> >>> >> wrote: >>> >> >>>> >>> Hi Ramesh, >>>> >>> >>>> >>> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn >>>> >>> plugins will support Hadoop 3.0.0 only. There is no other option due >>>> >>>to API >>>> >>> changes. A user can use the earlier plugins from 0.7.x if support for >>>> >>> Hadoop 2.7.x is required. >>>> >>> >>>> >>> I am not really tied to this approach though - I'm also fine with just >>>> >>> having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The >>>> >>>approach to >>>> >>> update all of Ranger to use Hadoop 3.0.0 was based on the comments on >>>> >>>this >>>> >>> JIRA: >>>> >>> >>>> >>> https://issues.apache.org/jira/browse/RANGER-1738 >>>> >>> >>>> >>> Colm. >>>> >>> >>>> >>> On Fri, Jan 5, 2018 at 12:55
Re: Hadoop 3 support
+1 for this suggestion. Will there be any issue with downgrading Atlas in Ranger from the current 1.0.0-SNAPSHOT version? Colm. On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni wrote: > All, > > Here is another proposal for Ranger release 1.0.0. > > Atlas team is planning to make a Atlas-0.8.2 release towards the end of > this month. Once that is done, Ranger can do release 1.0.0 with dependency > on Atlas 0.8.2 (without Hadoop 3.0.0). > > Thanks, > -Abhay > > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" behalf of v...@apache.org> wrote: > > >+1 for getting the 1.0.0 release out soon. > > > >From: Colm O hEigeartaigh > >Reply-To: "dev@ranger.apache.org" , > >"cohei...@apache.org" > >Date: Monday, January 8, 2018 at 12:37 PM > >To: Ramesh Mani > >Cc: "dev@ranger.apache.org" > >Subject: Re: Hadoop 3 support > > > >OK thanks. I will test the patch a bit more thoroughly before submitting > >for a RR. > > > >Just in regards as to whether to release 1.0.0 with or without Hadoop > >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the > >timeline for releasing this? That would be the only thing blocking getting > >a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that > >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. > > > >However, it's been ages since the last release so we should probably not > >wait too long before getting a release out. > > > >Colm. > > > >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani > wrote: > > > >> Thanks Colm, > >> > >> I am fine with Option 1 or 3. Do you want to create a RR for this > >>patch? > >> > >> Thanks, > >> Ramesh > >> > >> From: Colm O hEigeartaigh > >> Reply-To: "cohei...@apache.org" > >> Date: Friday, January 5, 2018 at 4:19 AM > >> To: Ramesh Mani > >> Cc: "dev@ranger.apache.org" > >> Subject: Re: Hadoop 3 support > >> > >> I should have added - a third option is just not to support Hadoop > >>3.0.0 > >> at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then > >>update > >> to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. > >> > >> Colm. > >> > >> On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh > >> > >> wrote: > >> > >>> Hi Ramesh, > >>> > >>> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn > >>> plugins will support Hadoop 3.0.0 only. There is no other option due > >>>to API > >>> changes. A user can use the earlier plugins from 0.7.x if support for > >>> Hadoop 2.7.x is required. > >>> > >>> I am not really tied to this approach though - I'm also fine with just > >>> having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The > >>>approach to > >>> update all of Ranger to use Hadoop 3.0.0 was based on the comments on > >>>this > >>> JIRA: > >>> > >>> https://issues.apache.org/jira/browse/RANGER-1738 > >>> > >>> Colm. > >>> > >>> On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani > >>> wrote: > >>> > >>>> Colm, > >>>> > >>>> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? > >>>> > >>>> Thanks. > >>>> Ramesh > >>>> > >>>> > >>>> > >>>> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" > >>>>wrote: > >>>> > >>>>> >Hi Ranger devs, > >>>>> > > >>>>> >I posted an initial patch here to bump Ranger up to use Hadoop > >>>>>3.0.0: > >>>>> > > >>>>> >https://issues.apache.org/jira/browse/RANGER-1935 > >>>>> > > >>>>> >I would appreciate some initial feedback before proceeding further > >>>>>with > >>>>> >testing it (just a general "looks ok" or "this would be problematic > >>>>> >because > >>>>> >X"). > >>>>> > > >>>>> >Colm. > >>>>> > > >>>>> > > >>>>> >-- > >>>>> >Colm O hEigeartaigh > >>>>> > > >>>>> >Talend Community Coder > >>>>> >http://coders.talend.com > >>>> > >>>> > >>> > >>> > >>> -- > >>> Colm O hEigeartaigh > >>> > >>> Talend Community Coder > >>> http://coders.talend.com > >>> > >> > >> > >> > >> -- > >> Colm O hEigeartaigh > >> > >> Talend Community Coder > >> http://coders.talend.com > >> > > > > > > > >-- > >Colm O hEigeartaigh > > > >Talend Community Coder > >http://coders.talend.com > > > > > > > > -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com
Re: Hadoop 3 support
All, Here is another proposal for Ranger release 1.0.0. Atlas team is planning to make a Atlas-0.8.2 release towards the end of this month. Once that is done, Ranger can do release 1.0.0 with dependency on Atlas 0.8.2 (without Hadoop 3.0.0). Thanks, -Abhay On 1/8/18, 12:23 PM, "Velmurugan Periasamy" wrote: >+1 for getting the 1.0.0 release out soon. > >From: Colm O hEigeartaigh >Reply-To: "dev@ranger.apache.org" , >"cohei...@apache.org" >Date: Monday, January 8, 2018 at 12:37 PM >To: Ramesh Mani >Cc: "dev@ranger.apache.org" >Subject: Re: Hadoop 3 support > >OK thanks. I will test the patch a bit more thoroughly before submitting >for a RR. > >Just in regards as to whether to release 1.0.0 with or without Hadoop >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the >timeline for releasing this? That would be the only thing blocking getting >a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. > >However, it's been ages since the last release so we should probably not >wait too long before getting a release out. > >Colm. > >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani wrote: > >> Thanks Colm, >> >> I am fine with Option 1 or 3. Do you want to create a RR for this >>patch? >> >> Thanks, >> Ramesh >> >> From: Colm O hEigeartaigh >> Reply-To: "cohei...@apache.org" >> Date: Friday, January 5, 2018 at 4:19 AM >> To: Ramesh Mani >> Cc: "dev@ranger.apache.org" >> Subject: Re: Hadoop 3 support >> >> I should have added - a third option is just not to support Hadoop >>3.0.0 >> at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then >>update >> to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. >> >> Colm. >> >> On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh >> >> wrote: >> >>> Hi Ramesh, >>> >>> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn >>> plugins will support Hadoop 3.0.0 only. There is no other option due >>>to API >>> changes. A user can use the earlier plugins from 0.7.x if support for >>> Hadoop 2.7.x is required. >>> >>> I am not really tied to this approach though - I'm also fine with just >>> having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The >>>approach to >>> update all of Ranger to use Hadoop 3.0.0 was based on the comments on >>>this >>> JIRA: >>> >>> https://issues.apache.org/jira/browse/RANGER-1738 >>> >>> Colm. >>> >>> On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani >>> wrote: >>> >>>> Colm, >>>> >>>> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? >>>> >>>> Thanks. >>>> Ramesh >>>> >>>> >>>> >>>> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" >>>>wrote: >>>> >>>>> >Hi Ranger devs, >>>>> > >>>>> >I posted an initial patch here to bump Ranger up to use Hadoop >>>>>3.0.0: >>>>> > >>>>> >https://issues.apache.org/jira/browse/RANGER-1935 >>>>> > >>>>> >I would appreciate some initial feedback before proceeding further >>>>>with >>>>> >testing it (just a general "looks ok" or "this would be problematic >>>>> >because >>>>> >X"). >>>>> > >>>>> >Colm. >>>>> > >>>>> > >>>>> >-- >>>>> >Colm O hEigeartaigh >>>>> > >>>>> >Talend Community Coder >>>>> >http://coders.talend.com >>>> >>>> >>> >>> >>> -- >>> Colm O hEigeartaigh >>> >>> Talend Community Coder >>> http://coders.talend.com >>> >> >> >> >> -- >> Colm O hEigeartaigh >> >> Talend Community Coder >> http://coders.talend.com >> > > > >-- >Colm O hEigeartaigh > >Talend Community Coder >http://coders.talend.com > > >
Re: Hadoop 3 support
+1 for getting the 1.0.0 release out soon. From: Colm O hEigeartaigh Reply-To: "dev@ranger.apache.org" , "cohei...@apache.org" Date: Monday, January 8, 2018 at 12:37 PM To: Ramesh Mani Cc: "dev@ranger.apache.org" Subject: Re: Hadoop 3 support OK thanks. I will test the patch a bit more thoroughly before submitting for a RR. Just in regards as to whether to release 1.0.0 with or without Hadoop 3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the timeline for releasing this? That would be the only thing blocking getting a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. However, it's been ages since the last release so we should probably not wait too long before getting a release out. Colm. On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani wrote: > Thanks Colm, > > I am fine with Option 1 or 3. Do you want to create a RR for this patch? > > Thanks, > Ramesh > > From: Colm O hEigeartaigh > Reply-To: "cohei...@apache.org" > Date: Friday, January 5, 2018 at 4:19 AM > To: Ramesh Mani > Cc: "dev@ranger.apache.org" > Subject: Re: Hadoop 3 support > > I should have added - a third option is just not to support Hadoop 3.0.0 > at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update > to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. > > Colm. > > On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh > wrote: > >> Hi Ramesh, >> >> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn >> plugins will support Hadoop 3.0.0 only. There is no other option due to API >> changes. A user can use the earlier plugins from 0.7.x if support for >> Hadoop 2.7.x is required. >> >> I am not really tied to this approach though - I'm also fine with just >> having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach to >> update all of Ranger to use Hadoop 3.0.0 was based on the comments on this >> JIRA: >> >> https://issues.apache.org/jira/browse/RANGER-1738 >> >> Colm. >> >> On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani >> wrote: >> >>> Colm, >>> >>> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? >>> >>> Thanks. >>> Ramesh >>> >>> >>> >>> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" wrote: >>> >>>> >Hi Ranger devs, >>>> > >>>> >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: >>>> > >>>> >https://issues.apache.org/jira/browse/RANGER-1935 >>>> > >>>> >I would appreciate some initial feedback before proceeding further with >>>> >testing it (just a general "looks ok" or "this would be problematic >>>> >because >>>> >X"). >>>> > >>>> >Colm. >>>> > >>>> > >>>> >-- >>>> >Colm O hEigeartaigh >>>> > >>>> >Talend Community Coder >>>> >http://coders.talend.com >>> >>> >> >> >> -- >> Colm O hEigeartaigh >> >> Talend Community Coder >> http://coders.talend.com >> > > > > -- > Colm O hEigeartaigh > > Talend Community Coder > http://coders.talend.com > -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com
Re: Hadoop 3 support
OK thanks. I will test the patch a bit more thoroughly before submitting for a RR. Just in regards as to whether to release 1.0.0 with or without Hadoop 3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT. What's the timeline for releasing this? That would be the only thing blocking getting a 1.0.0 of Ranger out "quickly". If that's not imminent then I guess that gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support. However, it's been ages since the last release so we should probably not wait too long before getting a release out. Colm. On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani wrote: > Thanks Colm, > > I am fine with Option 1 or 3. Do you want to create a RR for this patch? > > Thanks, > Ramesh > > From: Colm O hEigeartaigh > Reply-To: "cohei...@apache.org" > Date: Friday, January 5, 2018 at 4:19 AM > To: Ramesh Mani > Cc: "dev@ranger.apache.org" > Subject: Re: Hadoop 3 support > > I should have added - a third option is just not to support Hadoop 3.0.0 > at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update > to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. > > Colm. > > On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh > wrote: > >> Hi Ramesh, >> >> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn >> plugins will support Hadoop 3.0.0 only. There is no other option due to API >> changes. A user can use the earlier plugins from 0.7.x if support for >> Hadoop 2.7.x is required. >> >> I am not really tied to this approach though - I'm also fine with just >> having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach to >> update all of Ranger to use Hadoop 3.0.0 was based on the comments on this >> JIRA: >> >> https://issues.apache.org/jira/browse/RANGER-1738 >> >> Colm. >> >> On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani >> wrote: >> >>> Colm, >>> >>> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? >>> >>> Thanks. >>> Ramesh >>> >>> >>> >>> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" wrote: >>> >>> >Hi Ranger devs, >>> > >>> >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: >>> > >>> >https://issues.apache.org/jira/browse/RANGER-1935 >>> > >>> >I would appreciate some initial feedback before proceeding further with >>> >testing it (just a general "looks ok" or "this would be problematic >>> >because >>> >X"). >>> > >>> >Colm. >>> > >>> > >>> >-- >>> >Colm O hEigeartaigh >>> > >>> >Talend Community Coder >>> >http://coders.talend.com >>> >>> >> >> >> -- >> Colm O hEigeartaigh >> >> Talend Community Coder >> http://coders.talend.com >> > > > > -- > Colm O hEigeartaigh > > Talend Community Coder > http://coders.talend.com > -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com
Re: Hadoop 3 support
Thanks Colm, I am fine with Option 1 or 3. Do you want to create a RR for this patch? Thanks, Ramesh From: Colm O hEigeartaigh mailto:cohei...@apache.org>> Reply-To: "cohei...@apache.org<mailto:cohei...@apache.org>" mailto:cohei...@apache.org>> Date: Friday, January 5, 2018 at 4:19 AM To: Ramesh Mani mailto:rm...@hortonworks.com>> Cc: "dev@ranger.apache.org<mailto:dev@ranger.apache.org>" mailto:dev@ranger.apache.org>> Subject: Re: Hadoop 3 support I should have added - a third option is just not to support Hadoop 3.0.0 at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. Colm. On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh mailto:cohei...@apache.org>> wrote: Hi Ramesh, Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn plugins will support Hadoop 3.0.0 only. There is no other option due to API changes. A user can use the earlier plugins from 0.7.x if support for Hadoop 2.7.x is required. I am not really tied to this approach though - I'm also fine with just having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach to update all of Ranger to use Hadoop 3.0.0 was based on the comments on this JIRA: https://issues.apache.org/jira/browse/RANGER-1738 Colm. On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani mailto:rm...@hortonworks.com>> wrote: Colm, Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? Thanks. Ramesh On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" mailto:cohei...@apache.org>> wrote: >Hi Ranger devs, > >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: > >https://issues.apache.org/jira/browse/RANGER-1935 > >I would appreciate some initial feedback before proceeding further with >testing it (just a general "looks ok" or "this would be problematic >because >X"). > >Colm. > > >-- >Colm O hEigeartaigh > >Talend Community Coder >http://coders.talend.com -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com
Re: Hadoop 3 support
My preference is for option 3 or option 1. From: Zsombor mailto:gzsom...@gmail.com>> Reply-To: "dev@ranger.apache.org<mailto:dev@ranger.apache.org>" mailto:dev@ranger.apache.org>>, "gzsom...@gmail.com<mailto:gzsom...@gmail.com>" mailto:gzsom...@gmail.com>> Date: Friday, January 5, 2018 at 8:18 AM To: ranger mailto:dev@ranger.apache.org>>, Colm O hEigeartaigh mailto:cohei...@apache.org>> Cc: Ramesh Mani mailto:rm...@hortonworks.com>> Subject: Re: Hadoop 3 support Fourth option: Create a 0.8 release for Hadoop 2.x and JDK 7 - maybe someone still needs to use these 'legacy' versions. Regards, Zsombor On Fri, Jan 5, 2018 at 1:19 PM, Colm O hEigeartaigh mailto:cohei...@apache.org>> wrote: I should have added - a third option is just not to support Hadoop 3.0.0 at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. Colm. On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh mailto:cohei...@apache.org>> wrote: > Hi Ramesh, > > Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn > plugins will support Hadoop 3.0.0 only. There is no other option due to API > changes. A user can use the earlier plugins from 0.7.x if support for > Hadoop 2.7.x is required. > > I am not really tied to this approach though - I'm also fine with just > having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach to > update all of Ranger to use Hadoop 3.0.0 was based on the comments on this > JIRA: > > https://issues.apache.org/jira/browse/RANGER-1738 > > Colm. > > On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani > mailto:rm...@hortonworks.com>> > wrote: > >> Colm, >> >> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? >> >> Thanks. >> Ramesh >> >> >> >> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" >> mailto:cohei...@apache.org>> wrote: >> >> >Hi Ranger devs, >> > >> >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: >> > >> >https://issues.apache.org/jira/browse/RANGER-1935 >> > >> >I would appreciate some initial feedback before proceeding further with >> >testing it (just a general "looks ok" or "this would be problematic >> >because >> >X"). >> > >> >Colm. >> > >> > >> >-- >> >Colm O hEigeartaigh >> > >> >Talend Community Coder >> >http://coders.talend.com >> >> > > > -- > Colm O hEigeartaigh > > Talend Community Coder > http://coders.talend.com > -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com
Re: Hadoop 3 support
Fourth option: Create a 0.8 release for Hadoop 2.x and JDK 7 - maybe someone still needs to use these 'legacy' versions. Regards, Zsombor On Fri, Jan 5, 2018 at 1:19 PM, Colm O hEigeartaigh wrote: > I should have added - a third option is just not to support Hadoop 3.0.0 at > all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update to > Hadoop 3.0.0 in Ranger 1.1/2.0 etc. > > Colm. > > On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh > wrote: > > > Hi Ramesh, > > > > Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn > > plugins will support Hadoop 3.0.0 only. There is no other option due to > API > > changes. A user can use the earlier plugins from 0.7.x if support for > > Hadoop 2.7.x is required. > > > > I am not really tied to this approach though - I'm also fine with just > > having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach > to > > update all of Ranger to use Hadoop 3.0.0 was based on the comments on > this > > JIRA: > > > > https://issues.apache.org/jira/browse/RANGER-1738 > > > > Colm. > > > > On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani > > wrote: > > > >> Colm, > >> > >> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? > >> > >> Thanks. > >> Ramesh > >> > >> > >> > >> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" wrote: > >> > >> >Hi Ranger devs, > >> > > >> >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: > >> > > >> >https://issues.apache.org/jira/browse/RANGER-1935 > >> > > >> >I would appreciate some initial feedback before proceeding further with > >> >testing it (just a general "looks ok" or "this would be problematic > >> >because > >> >X"). > >> > > >> >Colm. > >> > > >> > > >> >-- > >> >Colm O hEigeartaigh > >> > > >> >Talend Community Coder > >> >http://coders.talend.com > >> > >> > > > > > > -- > > Colm O hEigeartaigh > > > > Talend Community Coder > > http://coders.talend.com > > > > > > -- > Colm O hEigeartaigh > > Talend Community Coder > http://coders.talend.com >
Re: Hadoop 3 support
I should have added - a third option is just not to support Hadoop 3.0.0 at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and then update to Hadoop 3.0.0 in Ranger 1.1/2.0 etc. Colm. On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh wrote: > Hi Ramesh, > > Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn > plugins will support Hadoop 3.0.0 only. There is no other option due to API > changes. A user can use the earlier plugins from 0.7.x if support for > Hadoop 2.7.x is required. > > I am not really tied to this approach though - I'm also fine with just > having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach to > update all of Ranger to use Hadoop 3.0.0 was based on the comments on this > JIRA: > > https://issues.apache.org/jira/browse/RANGER-1738 > > Colm. > > On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani > wrote: > >> Colm, >> >> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? >> >> Thanks. >> Ramesh >> >> >> >> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" wrote: >> >> >Hi Ranger devs, >> > >> >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: >> > >> >https://issues.apache.org/jira/browse/RANGER-1935 >> > >> >I would appreciate some initial feedback before proceeding further with >> >testing it (just a general "looks ok" or "this would be problematic >> >because >> >X"). >> > >> >Colm. >> > >> > >> >-- >> >Colm O hEigeartaigh >> > >> >Talend Community Coder >> >http://coders.talend.com >> >> > > > -- > Colm O hEigeartaigh > > Talend Community Coder > http://coders.talend.com > -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com
Re: Hadoop 3 support
Hi Ramesh, Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS + Yarn plugins will support Hadoop 3.0.0 only. There is no other option due to API changes. A user can use the earlier plugins from 0.7.x if support for Hadoop 2.7.x is required. I am not really tied to this approach though - I'm also fine with just having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The approach to update all of Ranger to use Hadoop 3.0.0 was based on the comments on this JIRA: https://issues.apache.org/jira/browse/RANGER-1738 Colm. On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani wrote: > Colm, > > Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? > > Thanks. > Ramesh > > > > On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" wrote: > > >Hi Ranger devs, > > > >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: > > > >https://issues.apache.org/jira/browse/RANGER-1935 > > > >I would appreciate some initial feedback before proceeding further with > >testing it (just a general "looks ok" or "this would be problematic > >because > >X"). > > > >Colm. > > > > > >-- > >Colm O hEigeartaigh > > > >Talend Community Coder > >http://coders.talend.com > > -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com
Re: Hadoop 3 support
Colm, Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0 only? Thanks. Ramesh On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" wrote: >Hi Ranger devs, > >I posted an initial patch here to bump Ranger up to use Hadoop 3.0.0: > >https://issues.apache.org/jira/browse/RANGER-1935 > >I would appreciate some initial feedback before proceeding further with >testing it (just a general "looks ok" or "this would be problematic >because >X"). > >Colm. > > >-- >Colm O hEigeartaigh > >Talend Community Coder >http://coders.talend.com