Re: [DISCUSS] Dr. Elephant Incubator Proposal
I vote for Apache L.E.Font, MD :-) -- Kevin A. McGrail Asst. Treasurer & VP Fundraising, Apache Software Foundation Chair Emeritus Apache SpamAssassin Project https://www.linkedin.com/in/kmcgrail - 703.798.0171 On Thu, Mar 8, 2018 at 6:43 AM, Pierre Smits wrote: > Hi All, > > While i believe, based on the proposal, it may the works may be a nice > addition to the portfolio of the ASF, I have concerns with the name. > > Are we going to call this (if and when onboarded/graduated): > >- Apache DrElephant? >- Apache Doctor Elephant? >- Apache Dr-Elephant? >- etc > > While it is understandable that existing parties want to retain the name of > where code and team originally came from, I believe the name of the > podling, its community and its works should not always hang to much to > references in the past. Joining the ASF as a podling offers an opportunity > to retain the best from the past (often the code and pre-joining > contributors) and have a do-over for remainder. > > Best regards, > > > Best regards, > > Pierre Smits > > V.P. Apache Trafodion > > On Thu, Mar 8, 2018 at 3:35 AM, Carl Steinbach wrote: > > > Timothy Chen has volunteered to be a mentor. I have updated > > the proposal on the wiki to reflect this. > > > > Thanks Timothy! > > > > - Carl > > > > On Wed, Mar 7, 2018 at 12:47 PM, Carl Steinbach wrote: > > > > > I also wanted to add that we are looking for more mentors. > > > Please email me if you are interested. > > > > > > Thanks. > > > > > > - Carl > > > > > > On Wed, Mar 7, 2018 at 12:46 PM, Carl Steinbach > wrote: > > > > > >> I will followup with LinkedIn's legal team regarding getting an SGA. I > > >> don't > > >> think this will be a problem since the same team has already reviewed > > Dr. > > >> Elephant > > >> and approved it for contribution to the Apache incubator. > > >> > > >> - Carl > > >> > > >> On Wed, Mar 7, 2018 at 11:20 AM, Kevin A. McGrail < > kmcgr...@apache.org> > > >> wrote: > > >> > > >>> Sorry, I missed the copyright and checked only the LICENSE. Agree > > >>> completely with you and Craig an SGA is needed. > > >>> > > >>> -- > > >>> Kevin A. McGrail > > >>> Asst. Treasurer & VP Fundraising, Apache Software Foundation > > >>> Chair Emeritus Apache SpamAssassin Project > > >>> https://www.linkedin.com/in/kmcgrail - 703.798.0171 > > >>> > > >>> On Wed, Mar 7, 2018 at 2:19 PM, John D. Ament > > > >>> wrote: > > >>> > > >>> > On Wed, Mar 7, 2018 at 2:17 PM Kevin A. McGrail < > kmcgr...@apache.org > > > > > >>> > wrote: > > >>> > > > >>> > > Fair enough but it would be procedural not legal. Who would sign > > >>> said > > >>> > > SGA? LI or representatives of the GH project? > > >>> > > > > >>> > > > >>> > LinkedIn. And it is a legal need. Right now, the source files > have > > >>> > Copyright LinkedIn on them. The SGA grants us the ability to > remove > > >>> that > > >>> > copyright header. The CCLA would allow the individual contributors > > to > > >>> > submit the code to us with the appropriate header. Hence why > either > > >>> works > > >>> > in this case. > > >>> > > > >>> > > > >>> > > > > >>> > > -- > > >>> > > Kevin A. McGrail > > >>> > > Asst. Treasurer & VP Fundraising, Apache Software Foundation > > >>> > > Chair Emeritus Apache SpamAssassin Project > > >>> > > https://www.linkedin.com/in/kmcgrail - 703.798.0171 > > >>> <(703)%20798-0171> > > >>> > > > > >>> > > On Wed, Mar 7, 2018 at 1:55 PM, Craig Russell < > > apache@gmail.com> > > >>> > > wrote: > > >>> > > > > >>> > > > If Dr. Elephant *becomes* an Apache project, it needs a SGA. > This > > >>> is > > >>> > part > > >>> > > > of the incubation process, although as Bertrand notes, it's > good > > to > > >>> > know > > >>> > > > ahead of time whether all of the current owners of the code are > > >>> willing > > >>> > > to > > >>> > > > grant an explicit license to Apache. > > >>> > > > > > >>> > > > Please see http://www.apache.org/licenses/#provenance for > > details. > > >>> > > > > > >>> > > > If Dr. Elephant is only *used* as a dependency by an Apache > > >>> project, no > > >>> > > > SGA is needed. > > >>> > > > > > >>> > > > Craig > > >>> > > > > > >>> > > > > On Mar 7, 2018, at 5:51 AM, Kevin A. McGrail < > > >>> kmcgr...@apache.org> > > >>> > > > wrote: > > >>> > > > > > > >>> > > > > I do not believe an SGA is needed as Dr. Elephant is licensed > > >>> under > > >>> > > ASF. > > >>> > > > > https://github.com/linkedin/dr-elephant/blob/master/LICENSE > > >>> > > > > > > >>> > > > > Regards, > > >>> > > > > KAM > > >>> > > > > > > >>> > > > > -- > > >>> > > > > Kevin A. McGrail > > >>> > > > > Asst. Treasurer & VP Fundraising, Apache Software Foundation > > >>> > > > > Chair Emeritus Apache SpamAssassin Project > > >>> > > > > https://www.linkedin.com/in/kmcgrail - 703.798.0171 > > >>> > <(703)%20798-0171> > > >>> > > > > > > >>> > > > > On Wed, Mar 7, 2018 at 6:59 AM, Bertrand Delacretaz < > > >>> > > > > bdelacre...@codeconsult.ch> wrote: > > >>> > > > > > >
Re: [DISCUSS] Dr. Elephant Incubator Proposal
Hi All, While i believe, based on the proposal, it may the works may be a nice addition to the portfolio of the ASF, I have concerns with the name. Are we going to call this (if and when onboarded/graduated): - Apache DrElephant? - Apache Doctor Elephant? - Apache Dr-Elephant? - etc While it is understandable that existing parties want to retain the name of where code and team originally came from, I believe the name of the podling, its community and its works should not always hang to much to references in the past. Joining the ASF as a podling offers an opportunity to retain the best from the past (often the code and pre-joining contributors) and have a do-over for remainder. Best regards, Best regards, Pierre Smits V.P. Apache Trafodion On Thu, Mar 8, 2018 at 3:35 AM, Carl Steinbach wrote: > Timothy Chen has volunteered to be a mentor. I have updated > the proposal on the wiki to reflect this. > > Thanks Timothy! > > - Carl > > On Wed, Mar 7, 2018 at 12:47 PM, Carl Steinbach wrote: > > > I also wanted to add that we are looking for more mentors. > > Please email me if you are interested. > > > > Thanks. > > > > - Carl > > > > On Wed, Mar 7, 2018 at 12:46 PM, Carl Steinbach wrote: > > > >> I will followup with LinkedIn's legal team regarding getting an SGA. I > >> don't > >> think this will be a problem since the same team has already reviewed > Dr. > >> Elephant > >> and approved it for contribution to the Apache incubator. > >> > >> - Carl > >> > >> On Wed, Mar 7, 2018 at 11:20 AM, Kevin A. McGrail > >> wrote: > >> > >>> Sorry, I missed the copyright and checked only the LICENSE. Agree > >>> completely with you and Craig an SGA is needed. > >>> > >>> -- > >>> Kevin A. McGrail > >>> Asst. Treasurer & VP Fundraising, Apache Software Foundation > >>> Chair Emeritus Apache SpamAssassin Project > >>> https://www.linkedin.com/in/kmcgrail - 703.798.0171 > >>> > >>> On Wed, Mar 7, 2018 at 2:19 PM, John D. Ament > >>> wrote: > >>> > >>> > On Wed, Mar 7, 2018 at 2:17 PM Kevin A. McGrail > > >>> > wrote: > >>> > > >>> > > Fair enough but it would be procedural not legal. Who would sign > >>> said > >>> > > SGA? LI or representatives of the GH project? > >>> > > > >>> > > >>> > LinkedIn. And it is a legal need. Right now, the source files have > >>> > Copyright LinkedIn on them. The SGA grants us the ability to remove > >>> that > >>> > copyright header. The CCLA would allow the individual contributors > to > >>> > submit the code to us with the appropriate header. Hence why either > >>> works > >>> > in this case. > >>> > > >>> > > >>> > > > >>> > > -- > >>> > > Kevin A. McGrail > >>> > > Asst. Treasurer & VP Fundraising, Apache Software Foundation > >>> > > Chair Emeritus Apache SpamAssassin Project > >>> > > https://www.linkedin.com/in/kmcgrail - 703.798.0171 > >>> <(703)%20798-0171> > >>> > > > >>> > > On Wed, Mar 7, 2018 at 1:55 PM, Craig Russell < > apache@gmail.com> > >>> > > wrote: > >>> > > > >>> > > > If Dr. Elephant *becomes* an Apache project, it needs a SGA. This > >>> is > >>> > part > >>> > > > of the incubation process, although as Bertrand notes, it's good > to > >>> > know > >>> > > > ahead of time whether all of the current owners of the code are > >>> willing > >>> > > to > >>> > > > grant an explicit license to Apache. > >>> > > > > >>> > > > Please see http://www.apache.org/licenses/#provenance for > details. > >>> > > > > >>> > > > If Dr. Elephant is only *used* as a dependency by an Apache > >>> project, no > >>> > > > SGA is needed. > >>> > > > > >>> > > > Craig > >>> > > > > >>> > > > > On Mar 7, 2018, at 5:51 AM, Kevin A. McGrail < > >>> kmcgr...@apache.org> > >>> > > > wrote: > >>> > > > > > >>> > > > > I do not believe an SGA is needed as Dr. Elephant is licensed > >>> under > >>> > > ASF. > >>> > > > > https://github.com/linkedin/dr-elephant/blob/master/LICENSE > >>> > > > > > >>> > > > > Regards, > >>> > > > > KAM > >>> > > > > > >>> > > > > -- > >>> > > > > Kevin A. McGrail > >>> > > > > Asst. Treasurer & VP Fundraising, Apache Software Foundation > >>> > > > > Chair Emeritus Apache SpamAssassin Project > >>> > > > > https://www.linkedin.com/in/kmcgrail - 703.798.0171 > >>> > <(703)%20798-0171> > >>> > > > > > >>> > > > > On Wed, Mar 7, 2018 at 6:59 AM, Bertrand Delacretaz < > >>> > > > > bdelacre...@codeconsult.ch> wrote: > >>> > > > > > >>> > > > >> Hi, > >>> > > > >> > >>> > > > >> On Wed, Mar 7, 2018 at 12:08 AM, Carl Steinbach < > c...@apache.org > >>> > > >>> > > wrote: > >>> > > > >>> = Source and Intellectual Property Submission Plan = > >>> > > > >>> ...The Dr. Elephant source code is already licensed under > >>> > > > >>> Apache License Version 2.0. Going forward, we will continue > to > >>> have > >>> > > > >>> all the contributions licensed directly to the Apache > Software > >>> > > > >>> Foundation through our signed Individual Contributor License > >>> > > > >>> Agreements for all of the committers on the project > >>>
Re: [DISCUSS] Dr. Elephant Incubator Proposal
Timothy Chen has volunteered to be a mentor. I have updated the proposal on the wiki to reflect this. Thanks Timothy! - Carl On Wed, Mar 7, 2018 at 12:47 PM, Carl Steinbach wrote: > I also wanted to add that we are looking for more mentors. > Please email me if you are interested. > > Thanks. > > - Carl > > On Wed, Mar 7, 2018 at 12:46 PM, Carl Steinbach wrote: > >> I will followup with LinkedIn's legal team regarding getting an SGA. I >> don't >> think this will be a problem since the same team has already reviewed Dr. >> Elephant >> and approved it for contribution to the Apache incubator. >> >> - Carl >> >> On Wed, Mar 7, 2018 at 11:20 AM, Kevin A. McGrail >> wrote: >> >>> Sorry, I missed the copyright and checked only the LICENSE. Agree >>> completely with you and Craig an SGA is needed. >>> >>> -- >>> Kevin A. McGrail >>> Asst. Treasurer & VP Fundraising, Apache Software Foundation >>> Chair Emeritus Apache SpamAssassin Project >>> https://www.linkedin.com/in/kmcgrail - 703.798.0171 >>> >>> On Wed, Mar 7, 2018 at 2:19 PM, John D. Ament >>> wrote: >>> >>> > On Wed, Mar 7, 2018 at 2:17 PM Kevin A. McGrail >>> > wrote: >>> > >>> > > Fair enough but it would be procedural not legal. Who would sign >>> said >>> > > SGA? LI or representatives of the GH project? >>> > > >>> > >>> > LinkedIn. And it is a legal need. Right now, the source files have >>> > Copyright LinkedIn on them. The SGA grants us the ability to remove >>> that >>> > copyright header. The CCLA would allow the individual contributors to >>> > submit the code to us with the appropriate header. Hence why either >>> works >>> > in this case. >>> > >>> > >>> > > >>> > > -- >>> > > Kevin A. McGrail >>> > > Asst. Treasurer & VP Fundraising, Apache Software Foundation >>> > > Chair Emeritus Apache SpamAssassin Project >>> > > https://www.linkedin.com/in/kmcgrail - 703.798.0171 >>> <(703)%20798-0171> >>> > > >>> > > On Wed, Mar 7, 2018 at 1:55 PM, Craig Russell >>> > > wrote: >>> > > >>> > > > If Dr. Elephant *becomes* an Apache project, it needs a SGA. This >>> is >>> > part >>> > > > of the incubation process, although as Bertrand notes, it's good to >>> > know >>> > > > ahead of time whether all of the current owners of the code are >>> willing >>> > > to >>> > > > grant an explicit license to Apache. >>> > > > >>> > > > Please see http://www.apache.org/licenses/#provenance for details. >>> > > > >>> > > > If Dr. Elephant is only *used* as a dependency by an Apache >>> project, no >>> > > > SGA is needed. >>> > > > >>> > > > Craig >>> > > > >>> > > > > On Mar 7, 2018, at 5:51 AM, Kevin A. McGrail < >>> kmcgr...@apache.org> >>> > > > wrote: >>> > > > > >>> > > > > I do not believe an SGA is needed as Dr. Elephant is licensed >>> under >>> > > ASF. >>> > > > > https://github.com/linkedin/dr-elephant/blob/master/LICENSE >>> > > > > >>> > > > > Regards, >>> > > > > KAM >>> > > > > >>> > > > > -- >>> > > > > Kevin A. McGrail >>> > > > > Asst. Treasurer & VP Fundraising, Apache Software Foundation >>> > > > > Chair Emeritus Apache SpamAssassin Project >>> > > > > https://www.linkedin.com/in/kmcgrail - 703.798.0171 >>> > <(703)%20798-0171> >>> > > > > >>> > > > > On Wed, Mar 7, 2018 at 6:59 AM, Bertrand Delacretaz < >>> > > > > bdelacre...@codeconsult.ch> wrote: >>> > > > > >>> > > > >> Hi, >>> > > > >> >>> > > > >> On Wed, Mar 7, 2018 at 12:08 AM, Carl Steinbach >> > >>> > > wrote: >>> > > > >>> = Source and Intellectual Property Submission Plan = >>> > > > >>> ...The Dr. Elephant source code is already licensed under >>> > > > >>> Apache License Version 2.0. Going forward, we will continue to >>> have >>> > > > >>> all the contributions licensed directly to the Apache Software >>> > > > >>> Foundation through our signed Individual Contributor License >>> > > > >>> Agreements for all of the committers on the project >>> > > > >> >>> > > > >> Note that whoever owns the code (LinkedIn IIUC) will have to >>> submit >>> > a >>> > > > >> Software Grant to donate it to the ASF: >>> > > > >> >>> > > > >> https://www.apache.org/licenses/software-grant.txt >>> > > > >> >>> > > > >> I think it's prudent to verify that the owners of the code are >>> ready >>> > > > >> to sign and submit that document, and mention that in the above >>> > > > >> section, before entering incubation. >>> > > > >> >>> > > > >> -Bertrand >>> > > > >> >>> > > > >> >>> > - >>> > > > >> To unsubscribe, e-mail: general-unsubscribe@incubator. >>> apache.org >>> > > > >> For additional commands, e-mail: general-help@incubator.apache. >>> org >>> > > > >> >>> > > > >> >>> > > > >>> > > > Craig L Russell >>> > > > Secretary, Apache Software Foundation >>> > > > c...@apache.org http://db.apache.org/jdo >>> > > > >>> > > > >>> > > > >>> - >>> > > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org >>> > > > For additional c
Re: [DISCUSS] Dr. Elephant Incubator Proposal
I also wanted to add that we are looking for more mentors. Please email me if you are interested. Thanks. - Carl On Wed, Mar 7, 2018 at 12:46 PM, Carl Steinbach wrote: > I will followup with LinkedIn's legal team regarding getting an SGA. I > don't > think this will be a problem since the same team has already reviewed Dr. > Elephant > and approved it for contribution to the Apache incubator. > > - Carl > > On Wed, Mar 7, 2018 at 11:20 AM, Kevin A. McGrail > wrote: > >> Sorry, I missed the copyright and checked only the LICENSE. Agree >> completely with you and Craig an SGA is needed. >> >> -- >> Kevin A. McGrail >> Asst. Treasurer & VP Fundraising, Apache Software Foundation >> Chair Emeritus Apache SpamAssassin Project >> https://www.linkedin.com/in/kmcgrail - 703.798.0171 >> >> On Wed, Mar 7, 2018 at 2:19 PM, John D. Ament >> wrote: >> >> > On Wed, Mar 7, 2018 at 2:17 PM Kevin A. McGrail >> > wrote: >> > >> > > Fair enough but it would be procedural not legal. Who would sign said >> > > SGA? LI or representatives of the GH project? >> > > >> > >> > LinkedIn. And it is a legal need. Right now, the source files have >> > Copyright LinkedIn on them. The SGA grants us the ability to remove >> that >> > copyright header. The CCLA would allow the individual contributors to >> > submit the code to us with the appropriate header. Hence why either >> works >> > in this case. >> > >> > >> > > >> > > -- >> > > Kevin A. McGrail >> > > Asst. Treasurer & VP Fundraising, Apache Software Foundation >> > > Chair Emeritus Apache SpamAssassin Project >> > > https://www.linkedin.com/in/kmcgrail - 703.798.0171 >> <(703)%20798-0171> >> > > >> > > On Wed, Mar 7, 2018 at 1:55 PM, Craig Russell >> > > wrote: >> > > >> > > > If Dr. Elephant *becomes* an Apache project, it needs a SGA. This is >> > part >> > > > of the incubation process, although as Bertrand notes, it's good to >> > know >> > > > ahead of time whether all of the current owners of the code are >> willing >> > > to >> > > > grant an explicit license to Apache. >> > > > >> > > > Please see http://www.apache.org/licenses/#provenance for details. >> > > > >> > > > If Dr. Elephant is only *used* as a dependency by an Apache >> project, no >> > > > SGA is needed. >> > > > >> > > > Craig >> > > > >> > > > > On Mar 7, 2018, at 5:51 AM, Kevin A. McGrail > > >> > > > wrote: >> > > > > >> > > > > I do not believe an SGA is needed as Dr. Elephant is licensed >> under >> > > ASF. >> > > > > https://github.com/linkedin/dr-elephant/blob/master/LICENSE >> > > > > >> > > > > Regards, >> > > > > KAM >> > > > > >> > > > > -- >> > > > > Kevin A. McGrail >> > > > > Asst. Treasurer & VP Fundraising, Apache Software Foundation >> > > > > Chair Emeritus Apache SpamAssassin Project >> > > > > https://www.linkedin.com/in/kmcgrail - 703.798.0171 >> > <(703)%20798-0171> >> > > > > >> > > > > On Wed, Mar 7, 2018 at 6:59 AM, Bertrand Delacretaz < >> > > > > bdelacre...@codeconsult.ch> wrote: >> > > > > >> > > > >> Hi, >> > > > >> >> > > > >> On Wed, Mar 7, 2018 at 12:08 AM, Carl Steinbach >> > > wrote: >> > > > >>> = Source and Intellectual Property Submission Plan = >> > > > >>> ...The Dr. Elephant source code is already licensed under >> > > > >>> Apache License Version 2.0. Going forward, we will continue to >> have >> > > > >>> all the contributions licensed directly to the Apache Software >> > > > >>> Foundation through our signed Individual Contributor License >> > > > >>> Agreements for all of the committers on the project >> > > > >> >> > > > >> Note that whoever owns the code (LinkedIn IIUC) will have to >> submit >> > a >> > > > >> Software Grant to donate it to the ASF: >> > > > >> >> > > > >> https://www.apache.org/licenses/software-grant.txt >> > > > >> >> > > > >> I think it's prudent to verify that the owners of the code are >> ready >> > > > >> to sign and submit that document, and mention that in the above >> > > > >> section, before entering incubation. >> > > > >> >> > > > >> -Bertrand >> > > > >> >> > > > >> >> > - >> > > > >> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org >> > > > >> For additional commands, e-mail: general-help@incubator.apache. >> org >> > > > >> >> > > > >> >> > > > >> > > > Craig L Russell >> > > > Secretary, Apache Software Foundation >> > > > c...@apache.org http://db.apache.org/jdo >> > > > >> > > > >> > > > >> - >> > > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org >> > > > For additional commands, e-mail: general-h...@incubator.apache.org >> > > > >> > > > >> > > >> > >> > >
Re: [DISCUSS] Dr. Elephant Incubator Proposal
I will followup with LinkedIn's legal team regarding getting an SGA. I don't think this will be a problem since the same team has already reviewed Dr. Elephant and approved it for contribution to the Apache incubator. - Carl On Wed, Mar 7, 2018 at 11:20 AM, Kevin A. McGrail wrote: > Sorry, I missed the copyright and checked only the LICENSE. Agree > completely with you and Craig an SGA is needed. > > -- > Kevin A. McGrail > Asst. Treasurer & VP Fundraising, Apache Software Foundation > Chair Emeritus Apache SpamAssassin Project > https://www.linkedin.com/in/kmcgrail - 703.798.0171 > > On Wed, Mar 7, 2018 at 2:19 PM, John D. Ament > wrote: > > > On Wed, Mar 7, 2018 at 2:17 PM Kevin A. McGrail > > wrote: > > > > > Fair enough but it would be procedural not legal. Who would sign said > > > SGA? LI or representatives of the GH project? > > > > > > > LinkedIn. And it is a legal need. Right now, the source files have > > Copyright LinkedIn on them. The SGA grants us the ability to remove that > > copyright header. The CCLA would allow the individual contributors to > > submit the code to us with the appropriate header. Hence why either > works > > in this case. > > > > > > > > > > -- > > > Kevin A. McGrail > > > Asst. Treasurer & VP Fundraising, Apache Software Foundation > > > Chair Emeritus Apache SpamAssassin Project > > > https://www.linkedin.com/in/kmcgrail - 703.798.0171 <(703)%20798-0171> > > > > > > On Wed, Mar 7, 2018 at 1:55 PM, Craig Russell > > > wrote: > > > > > > > If Dr. Elephant *becomes* an Apache project, it needs a SGA. This is > > part > > > > of the incubation process, although as Bertrand notes, it's good to > > know > > > > ahead of time whether all of the current owners of the code are > willing > > > to > > > > grant an explicit license to Apache. > > > > > > > > Please see http://www.apache.org/licenses/#provenance for details. > > > > > > > > If Dr. Elephant is only *used* as a dependency by an Apache project, > no > > > > SGA is needed. > > > > > > > > Craig > > > > > > > > > On Mar 7, 2018, at 5:51 AM, Kevin A. McGrail > > > > wrote: > > > > > > > > > > I do not believe an SGA is needed as Dr. Elephant is licensed under > > > ASF. > > > > > https://github.com/linkedin/dr-elephant/blob/master/LICENSE > > > > > > > > > > Regards, > > > > > KAM > > > > > > > > > > -- > > > > > Kevin A. McGrail > > > > > Asst. Treasurer & VP Fundraising, Apache Software Foundation > > > > > Chair Emeritus Apache SpamAssassin Project > > > > > https://www.linkedin.com/in/kmcgrail - 703.798.0171 > > <(703)%20798-0171> > > > > > > > > > > On Wed, Mar 7, 2018 at 6:59 AM, Bertrand Delacretaz < > > > > > bdelacre...@codeconsult.ch> wrote: > > > > > > > > > >> Hi, > > > > >> > > > > >> On Wed, Mar 7, 2018 at 12:08 AM, Carl Steinbach > > > wrote: > > > > >>> = Source and Intellectual Property Submission Plan = > > > > >>> ...The Dr. Elephant source code is already licensed under > > > > >>> Apache License Version 2.0. Going forward, we will continue to > have > > > > >>> all the contributions licensed directly to the Apache Software > > > > >>> Foundation through our signed Individual Contributor License > > > > >>> Agreements for all of the committers on the project > > > > >> > > > > >> Note that whoever owns the code (LinkedIn IIUC) will have to > submit > > a > > > > >> Software Grant to donate it to the ASF: > > > > >> > > > > >> https://www.apache.org/licenses/software-grant.txt > > > > >> > > > > >> I think it's prudent to verify that the owners of the code are > ready > > > > >> to sign and submit that document, and mention that in the above > > > > >> section, before entering incubation. > > > > >> > > > > >> -Bertrand > > > > >> > > > > >> > > - > > > > >> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > > > >> For additional commands, e-mail: general-help@incubator.apache. > org > > > > >> > > > > >> > > > > > > > > Craig L Russell > > > > Secretary, Apache Software Foundation > > > > c...@apache.org http://db.apache.org/jdo > > > > > > > > > > > > > - > > > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > > > For additional commands, e-mail: general-h...@incubator.apache.org > > > > > > > > > > > > > >
Re: [DISCUSS] Dr. Elephant Incubator Proposal
Hi Roman, Currently Dr. Elephant only supports YARN, but we are excited at the prospect of extending it to support other schedulers likes Mesos. - Carl On Tue, Mar 6, 2018 at 3:33 PM, Roman Shaposhnik wrote: > On Tue, Mar 6, 2018 at 3:17 PM, Mike Drob wrote: > > Why does Dr. Elephant make sense as a separate project instead of > > contributing to Hadoop directly? > > > > What is the relationship between Dr. Elephant and the (now seemingly > > defunct) Hadoop Vaidya? > > A different way to ask the same question would be: how closely is it tied > to YARN as a scheduler? Does it support other schedulers (as in running > Spark on Mesos for example)? > > Thanks, > Roman. > > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > >
Re: [DISCUSS] Dr. Elephant Incubator Proposal
Sorry, I missed the copyright and checked only the LICENSE. Agree completely with you and Craig an SGA is needed. -- Kevin A. McGrail Asst. Treasurer & VP Fundraising, Apache Software Foundation Chair Emeritus Apache SpamAssassin Project https://www.linkedin.com/in/kmcgrail - 703.798.0171 On Wed, Mar 7, 2018 at 2:19 PM, John D. Ament wrote: > On Wed, Mar 7, 2018 at 2:17 PM Kevin A. McGrail > wrote: > > > Fair enough but it would be procedural not legal. Who would sign said > > SGA? LI or representatives of the GH project? > > > > LinkedIn. And it is a legal need. Right now, the source files have > Copyright LinkedIn on them. The SGA grants us the ability to remove that > copyright header. The CCLA would allow the individual contributors to > submit the code to us with the appropriate header. Hence why either works > in this case. > > > > > > -- > > Kevin A. McGrail > > Asst. Treasurer & VP Fundraising, Apache Software Foundation > > Chair Emeritus Apache SpamAssassin Project > > https://www.linkedin.com/in/kmcgrail - 703.798.0171 <(703)%20798-0171> > > > > On Wed, Mar 7, 2018 at 1:55 PM, Craig Russell > > wrote: > > > > > If Dr. Elephant *becomes* an Apache project, it needs a SGA. This is > part > > > of the incubation process, although as Bertrand notes, it's good to > know > > > ahead of time whether all of the current owners of the code are willing > > to > > > grant an explicit license to Apache. > > > > > > Please see http://www.apache.org/licenses/#provenance for details. > > > > > > If Dr. Elephant is only *used* as a dependency by an Apache project, no > > > SGA is needed. > > > > > > Craig > > > > > > > On Mar 7, 2018, at 5:51 AM, Kevin A. McGrail > > > wrote: > > > > > > > > I do not believe an SGA is needed as Dr. Elephant is licensed under > > ASF. > > > > https://github.com/linkedin/dr-elephant/blob/master/LICENSE > > > > > > > > Regards, > > > > KAM > > > > > > > > -- > > > > Kevin A. McGrail > > > > Asst. Treasurer & VP Fundraising, Apache Software Foundation > > > > Chair Emeritus Apache SpamAssassin Project > > > > https://www.linkedin.com/in/kmcgrail - 703.798.0171 > <(703)%20798-0171> > > > > > > > > On Wed, Mar 7, 2018 at 6:59 AM, Bertrand Delacretaz < > > > > bdelacre...@codeconsult.ch> wrote: > > > > > > > >> Hi, > > > >> > > > >> On Wed, Mar 7, 2018 at 12:08 AM, Carl Steinbach > > wrote: > > > >>> = Source and Intellectual Property Submission Plan = > > > >>> ...The Dr. Elephant source code is already licensed under > > > >>> Apache License Version 2.0. Going forward, we will continue to have > > > >>> all the contributions licensed directly to the Apache Software > > > >>> Foundation through our signed Individual Contributor License > > > >>> Agreements for all of the committers on the project > > > >> > > > >> Note that whoever owns the code (LinkedIn IIUC) will have to submit > a > > > >> Software Grant to donate it to the ASF: > > > >> > > > >> https://www.apache.org/licenses/software-grant.txt > > > >> > > > >> I think it's prudent to verify that the owners of the code are ready > > > >> to sign and submit that document, and mention that in the above > > > >> section, before entering incubation. > > > >> > > > >> -Bertrand > > > >> > > > >> > - > > > >> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > > >> For additional commands, e-mail: general-h...@incubator.apache.org > > > >> > > > >> > > > > > > Craig L Russell > > > Secretary, Apache Software Foundation > > > c...@apache.org http://db.apache.org/jdo > > > > > > > > > - > > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > > For additional commands, e-mail: general-h...@incubator.apache.org > > > > > > > > >
Re: [DISCUSS] Dr. Elephant Incubator Proposal
On Wed, Mar 7, 2018 at 2:17 PM Kevin A. McGrail wrote: > Fair enough but it would be procedural not legal. Who would sign said > SGA? LI or representatives of the GH project? > LinkedIn. And it is a legal need. Right now, the source files have Copyright LinkedIn on them. The SGA grants us the ability to remove that copyright header. The CCLA would allow the individual contributors to submit the code to us with the appropriate header. Hence why either works in this case. > > -- > Kevin A. McGrail > Asst. Treasurer & VP Fundraising, Apache Software Foundation > Chair Emeritus Apache SpamAssassin Project > https://www.linkedin.com/in/kmcgrail - 703.798.0171 <(703)%20798-0171> > > On Wed, Mar 7, 2018 at 1:55 PM, Craig Russell > wrote: > > > If Dr. Elephant *becomes* an Apache project, it needs a SGA. This is part > > of the incubation process, although as Bertrand notes, it's good to know > > ahead of time whether all of the current owners of the code are willing > to > > grant an explicit license to Apache. > > > > Please see http://www.apache.org/licenses/#provenance for details. > > > > If Dr. Elephant is only *used* as a dependency by an Apache project, no > > SGA is needed. > > > > Craig > > > > > On Mar 7, 2018, at 5:51 AM, Kevin A. McGrail > > wrote: > > > > > > I do not believe an SGA is needed as Dr. Elephant is licensed under > ASF. > > > https://github.com/linkedin/dr-elephant/blob/master/LICENSE > > > > > > Regards, > > > KAM > > > > > > -- > > > Kevin A. McGrail > > > Asst. Treasurer & VP Fundraising, Apache Software Foundation > > > Chair Emeritus Apache SpamAssassin Project > > > https://www.linkedin.com/in/kmcgrail - 703.798.0171 <(703)%20798-0171> > > > > > > On Wed, Mar 7, 2018 at 6:59 AM, Bertrand Delacretaz < > > > bdelacre...@codeconsult.ch> wrote: > > > > > >> Hi, > > >> > > >> On Wed, Mar 7, 2018 at 12:08 AM, Carl Steinbach > wrote: > > >>> = Source and Intellectual Property Submission Plan = > > >>> ...The Dr. Elephant source code is already licensed under > > >>> Apache License Version 2.0. Going forward, we will continue to have > > >>> all the contributions licensed directly to the Apache Software > > >>> Foundation through our signed Individual Contributor License > > >>> Agreements for all of the committers on the project > > >> > > >> Note that whoever owns the code (LinkedIn IIUC) will have to submit a > > >> Software Grant to donate it to the ASF: > > >> > > >> https://www.apache.org/licenses/software-grant.txt > > >> > > >> I think it's prudent to verify that the owners of the code are ready > > >> to sign and submit that document, and mention that in the above > > >> section, before entering incubation. > > >> > > >> -Bertrand > > >> > > >> - > > >> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > >> For additional commands, e-mail: general-h...@incubator.apache.org > > >> > > >> > > > > Craig L Russell > > Secretary, Apache Software Foundation > > c...@apache.org http://db.apache.org/jdo > > > > > > - > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > For additional commands, e-mail: general-h...@incubator.apache.org > > > > >
Re: [DISCUSS] Dr. Elephant Incubator Proposal
Fair enough but it would be procedural not legal. Who would sign said SGA? LI or representatives of the GH project? -- Kevin A. McGrail Asst. Treasurer & VP Fundraising, Apache Software Foundation Chair Emeritus Apache SpamAssassin Project https://www.linkedin.com/in/kmcgrail - 703.798.0171 On Wed, Mar 7, 2018 at 1:55 PM, Craig Russell wrote: > If Dr. Elephant *becomes* an Apache project, it needs a SGA. This is part > of the incubation process, although as Bertrand notes, it's good to know > ahead of time whether all of the current owners of the code are willing to > grant an explicit license to Apache. > > Please see http://www.apache.org/licenses/#provenance for details. > > If Dr. Elephant is only *used* as a dependency by an Apache project, no > SGA is needed. > > Craig > > > On Mar 7, 2018, at 5:51 AM, Kevin A. McGrail > wrote: > > > > I do not believe an SGA is needed as Dr. Elephant is licensed under ASF. > > https://github.com/linkedin/dr-elephant/blob/master/LICENSE > > > > Regards, > > KAM > > > > -- > > Kevin A. McGrail > > Asst. Treasurer & VP Fundraising, Apache Software Foundation > > Chair Emeritus Apache SpamAssassin Project > > https://www.linkedin.com/in/kmcgrail - 703.798.0171 > > > > On Wed, Mar 7, 2018 at 6:59 AM, Bertrand Delacretaz < > > bdelacre...@codeconsult.ch> wrote: > > > >> Hi, > >> > >> On Wed, Mar 7, 2018 at 12:08 AM, Carl Steinbach wrote: > >>> = Source and Intellectual Property Submission Plan = > >>> ...The Dr. Elephant source code is already licensed under > >>> Apache License Version 2.0. Going forward, we will continue to have > >>> all the contributions licensed directly to the Apache Software > >>> Foundation through our signed Individual Contributor License > >>> Agreements for all of the committers on the project > >> > >> Note that whoever owns the code (LinkedIn IIUC) will have to submit a > >> Software Grant to donate it to the ASF: > >> > >> https://www.apache.org/licenses/software-grant.txt > >> > >> I think it's prudent to verify that the owners of the code are ready > >> to sign and submit that document, and mention that in the above > >> section, before entering incubation. > >> > >> -Bertrand > >> > >> - > >> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > >> For additional commands, e-mail: general-h...@incubator.apache.org > >> > >> > > Craig L Russell > Secretary, Apache Software Foundation > c...@apache.org http://db.apache.org/jdo > > > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > >
Re: [DISCUSS] Dr. Elephant Incubator Proposal
Also note that if rights to Dr. Elephant are completely owned by LinkedIn, either an SGA or CCLA with Dr. Elephant named in Schedule B can be used. Craig > On Mar 7, 2018, at 10:55 AM, Craig Russell wrote: > > If Dr. Elephant *becomes* an Apache project, it needs a SGA. This is part of > the incubation process, although as Bertrand notes, it's good to know ahead > of time whether all of the current owners of the code are willing to grant an > explicit license to Apache. > > Please see http://www.apache.org/licenses/#provenance for details. > > If Dr. Elephant is only *used* as a dependency by an Apache project, no SGA > is needed. > > Craig > >> On Mar 7, 2018, at 5:51 AM, Kevin A. McGrail wrote: >> >> I do not believe an SGA is needed as Dr. Elephant is licensed under ASF. >> https://github.com/linkedin/dr-elephant/blob/master/LICENSE >> >> Regards, >> KAM >> >> -- >> Kevin A. McGrail >> Asst. Treasurer & VP Fundraising, Apache Software Foundation >> Chair Emeritus Apache SpamAssassin Project >> https://www.linkedin.com/in/kmcgrail - 703.798.0171 >> >> On Wed, Mar 7, 2018 at 6:59 AM, Bertrand Delacretaz < >> bdelacre...@codeconsult.ch> wrote: >> >>> Hi, >>> >>> On Wed, Mar 7, 2018 at 12:08 AM, Carl Steinbach wrote: = Source and Intellectual Property Submission Plan = ...The Dr. Elephant source code is already licensed under Apache License Version 2.0. Going forward, we will continue to have all the contributions licensed directly to the Apache Software Foundation through our signed Individual Contributor License Agreements for all of the committers on the project >>> >>> Note that whoever owns the code (LinkedIn IIUC) will have to submit a >>> Software Grant to donate it to the ASF: >>> >>> https://www.apache.org/licenses/software-grant.txt >>> >>> I think it's prudent to verify that the owners of the code are ready >>> to sign and submit that document, and mention that in the above >>> section, before entering incubation. >>> >>> -Bertrand >>> >>> - >>> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org >>> For additional commands, e-mail: general-h...@incubator.apache.org >>> >>> > > Craig L Russell > Secretary, Apache Software Foundation > c...@apache.org http://db.apache.org/jdo > Craig L Russell Secretary, Apache Software Foundation c...@apache.org http://db.apache.org/jdo - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [DISCUSS] Dr. Elephant Incubator Proposal
If Dr. Elephant *becomes* an Apache project, it needs a SGA. This is part of the incubation process, although as Bertrand notes, it's good to know ahead of time whether all of the current owners of the code are willing to grant an explicit license to Apache. Please see http://www.apache.org/licenses/#provenance for details. If Dr. Elephant is only *used* as a dependency by an Apache project, no SGA is needed. Craig > On Mar 7, 2018, at 5:51 AM, Kevin A. McGrail wrote: > > I do not believe an SGA is needed as Dr. Elephant is licensed under ASF. > https://github.com/linkedin/dr-elephant/blob/master/LICENSE > > Regards, > KAM > > -- > Kevin A. McGrail > Asst. Treasurer & VP Fundraising, Apache Software Foundation > Chair Emeritus Apache SpamAssassin Project > https://www.linkedin.com/in/kmcgrail - 703.798.0171 > > On Wed, Mar 7, 2018 at 6:59 AM, Bertrand Delacretaz < > bdelacre...@codeconsult.ch> wrote: > >> Hi, >> >> On Wed, Mar 7, 2018 at 12:08 AM, Carl Steinbach wrote: >>> = Source and Intellectual Property Submission Plan = >>> ...The Dr. Elephant source code is already licensed under >>> Apache License Version 2.0. Going forward, we will continue to have >>> all the contributions licensed directly to the Apache Software >>> Foundation through our signed Individual Contributor License >>> Agreements for all of the committers on the project >> >> Note that whoever owns the code (LinkedIn IIUC) will have to submit a >> Software Grant to donate it to the ASF: >> >> https://www.apache.org/licenses/software-grant.txt >> >> I think it's prudent to verify that the owners of the code are ready >> to sign and submit that document, and mention that in the above >> section, before entering incubation. >> >> -Bertrand >> >> - >> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org >> For additional commands, e-mail: general-h...@incubator.apache.org >> >> Craig L Russell Secretary, Apache Software Foundation c...@apache.org http://db.apache.org/jdo - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [DISCUSS] Dr. Elephant Incubator Proposal
I do not believe an SGA is needed as Dr. Elephant is licensed under ASF. https://github.com/linkedin/dr-elephant/blob/master/LICENSE Regards, KAM -- Kevin A. McGrail Asst. Treasurer & VP Fundraising, Apache Software Foundation Chair Emeritus Apache SpamAssassin Project https://www.linkedin.com/in/kmcgrail - 703.798.0171 On Wed, Mar 7, 2018 at 6:59 AM, Bertrand Delacretaz < bdelacre...@codeconsult.ch> wrote: > Hi, > > On Wed, Mar 7, 2018 at 12:08 AM, Carl Steinbach wrote: > > = Source and Intellectual Property Submission Plan = > > ...The Dr. Elephant source code is already licensed under > > Apache License Version 2.0. Going forward, we will continue to have > > all the contributions licensed directly to the Apache Software > > Foundation through our signed Individual Contributor License > > Agreements for all of the committers on the project > > Note that whoever owns the code (LinkedIn IIUC) will have to submit a > Software Grant to donate it to the ASF: > > https://www.apache.org/licenses/software-grant.txt > > I think it's prudent to verify that the owners of the code are ready > to sign and submit that document, and mention that in the above > section, before entering incubation. > > -Bertrand > > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > >
Re: [DISCUSS] Dr. Elephant Incubator Proposal
Hi, On Wed, Mar 7, 2018 at 12:08 AM, Carl Steinbach wrote: > = Source and Intellectual Property Submission Plan = > ...The Dr. Elephant source code is already licensed under > Apache License Version 2.0. Going forward, we will continue to have > all the contributions licensed directly to the Apache Software > Foundation through our signed Individual Contributor License > Agreements for all of the committers on the project Note that whoever owns the code (LinkedIn IIUC) will have to submit a Software Grant to donate it to the ASF: https://www.apache.org/licenses/software-grant.txt I think it's prudent to verify that the owners of the code are ready to sign and submit that document, and mention that in the above section, before entering incubation. -Bertrand - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [DISCUSS] Dr. Elephant Incubator Proposal
+1 as well, I think the work Dr. Elephant is doing can also be potentially applied to more than Spark and Hadoop. Tim On Tue, Mar 6, 2018 at 8:38 PM, Kevin A. McGrail wrote: > I'm intrigued by the proposal and the product. I'm a 0.5+. > > I'd love to know more about why LI put it on GitHub and what problems it's > having that are leading to a foundation. > > -- > Kevin A. McGrail > Asst. Treasurer & VP Fundraising, Apache Software Foundation > Chair Emeritus Apache SpamAssassin Project > https://www.linkedin.com/in/kmcgrail - 703.798.0171 > > On Tue, Mar 6, 2018 at 8:27 PM, Gangumalla, Uma > wrote: > >> I would +1 to have as a separate project instead of pushing under Hadoop. >> When a project can sustain by having potential to build community on its >> own and can run logically as independent module, I feel that’s good enough >> to start as separate project. >> >> I could not recall the discussions on removal of Vaidya package from >> Hadoop. If someone remembers, it would be great to know the reasons for >> removal of that package from Hadoop base. [ probably at the time of >> mavenization ? ] >> >> Regards, >> Uma >> >> On 3/6/18, 3:17 PM, "md...@cloudera.com on behalf of Mike Drob" < >> md...@cloudera.com on behalf of md...@apache.org> wrote: >> >> Why does Dr. Elephant make sense as a separate project instead of >> contributing to Hadoop directly? >> >> What is the relationship between Dr. Elephant and the (now seemingly >> defunct) Hadoop Vaidya? >> >> On Tue, Mar 6, 2018 at 5:08 PM, Carl Steinbach wrote: >> >> > Hi, >> > >> > I would like to propose Dr. Elephant as an Apache Incubator >> > project. The proposal is available as a draft at >> > https://wiki.apache.org/incubator/DrElephantProposal. I have also >> > included the text of the proposal below. >> > >> > Any feedback from the community is much appreciated. >> > >> > Thanks. >> > >> > - Carl >> > >> > >> > = ABSTRACT = >> > >> > Dr. Elephant is a performance monitoring and tuning service for >> Apache >> > Hadoop and Apache Spark jobs and workflows. While the system is >> > primarily aimed at developers, we have discovered that it is also >> > popular with cluster operators who use it to monitor the health of >> > workloads running on their clusters. >> > >> > = PROPOSAL = >> > >> > Dr. Elephant was open sourced by LinkedIn in 2016 and is currently >> > hosted on GitHub. We believe that being a part of the Apache Software >> > Foundation will improve the diversity and help form a strong >> community >> > around the project. >> > >> > LinkedIn submits this proposal to donate the code base to the Apache >> > Software Foundation. The code is already under Apache License 2.0. >> > Both the source code and documentation are hosted on Github. >> > >> > * Code: http://github.com/linkedin/dr-elephant >> > * Documentation: https://github.com/linkedin/dr-elephant/wiki >> > >> > = Background = >> > >> > Dr. Elephant is a service that helps users of Apache Hadoop and >> Apache >> > Spark understand, analyze, and improve the performance of jobs and >> > workflows running on their clusters. It automatically gathers >> metrics, >> > performs analysis, and presents the results along with actionable >> > advice. The goal of the project is to improve developer productivity >> > and increase cluster efficiency by reducing the time and domain >> > expertise required to diagnose and treat sick jobs. It analyzes >> Hadoop >> > and Spark jobs using a set of configurable, extensible, rule-based >> > heuristics that provide insights on job performance, and then uses >> > this information to provide recommendations about how to tune jobs to >> > make them run more efficiently. >> > >> > Dr. Elephant was open sourced in 2016 after two years of >> > successful production use at Linkedin. In the time since many new >> > features have been added including support for the Oozie and Airflow >> > workflow schedulers, improved metrics, and enhancements to the Spark >> > history fetcher and Spark heuristics. It is also important to note >> > that many of these contributions came from developers outside of >> > LinkedIn. We have also been happy to see that many people have been >> > able to benefit from running Dr. Elephant including companies like >> > Airbnb, Foursquare, Hulu, and Pinterest. >> > >> > = RATIONALE = >> > >> > Dr. Elephant's entry to the ASF will be beneficial to both the >> > Dr. Elephant and Apache communities. Dr. Elephant has greatly >> > benefited from its open source roots. Its community and adoption has >> > grown greatly as a result. More importantly, the feedback from the >> > community, whether through interactions at meetups or through the >> > mailing list
Re: [DISCUSS] Dr. Elephant Incubator Proposal
I'm intrigued by the proposal and the product. I'm a 0.5+. I'd love to know more about why LI put it on GitHub and what problems it's having that are leading to a foundation. -- Kevin A. McGrail Asst. Treasurer & VP Fundraising, Apache Software Foundation Chair Emeritus Apache SpamAssassin Project https://www.linkedin.com/in/kmcgrail - 703.798.0171 On Tue, Mar 6, 2018 at 8:27 PM, Gangumalla, Uma wrote: > I would +1 to have as a separate project instead of pushing under Hadoop. > When a project can sustain by having potential to build community on its > own and can run logically as independent module, I feel that’s good enough > to start as separate project. > > I could not recall the discussions on removal of Vaidya package from > Hadoop. If someone remembers, it would be great to know the reasons for > removal of that package from Hadoop base. [ probably at the time of > mavenization ? ] > > Regards, > Uma > > On 3/6/18, 3:17 PM, "md...@cloudera.com on behalf of Mike Drob" < > md...@cloudera.com on behalf of md...@apache.org> wrote: > > Why does Dr. Elephant make sense as a separate project instead of > contributing to Hadoop directly? > > What is the relationship between Dr. Elephant and the (now seemingly > defunct) Hadoop Vaidya? > > On Tue, Mar 6, 2018 at 5:08 PM, Carl Steinbach wrote: > > > Hi, > > > > I would like to propose Dr. Elephant as an Apache Incubator > > project. The proposal is available as a draft at > > https://wiki.apache.org/incubator/DrElephantProposal. I have also > > included the text of the proposal below. > > > > Any feedback from the community is much appreciated. > > > > Thanks. > > > > - Carl > > > > > > = ABSTRACT = > > > > Dr. Elephant is a performance monitoring and tuning service for > Apache > > Hadoop and Apache Spark jobs and workflows. While the system is > > primarily aimed at developers, we have discovered that it is also > > popular with cluster operators who use it to monitor the health of > > workloads running on their clusters. > > > > = PROPOSAL = > > > > Dr. Elephant was open sourced by LinkedIn in 2016 and is currently > > hosted on GitHub. We believe that being a part of the Apache Software > > Foundation will improve the diversity and help form a strong > community > > around the project. > > > > LinkedIn submits this proposal to donate the code base to the Apache > > Software Foundation. The code is already under Apache License 2.0. > > Both the source code and documentation are hosted on Github. > > > > * Code: http://github.com/linkedin/dr-elephant > > * Documentation: https://github.com/linkedin/dr-elephant/wiki > > > > = Background = > > > > Dr. Elephant is a service that helps users of Apache Hadoop and > Apache > > Spark understand, analyze, and improve the performance of jobs and > > workflows running on their clusters. It automatically gathers > metrics, > > performs analysis, and presents the results along with actionable > > advice. The goal of the project is to improve developer productivity > > and increase cluster efficiency by reducing the time and domain > > expertise required to diagnose and treat sick jobs. It analyzes > Hadoop > > and Spark jobs using a set of configurable, extensible, rule-based > > heuristics that provide insights on job performance, and then uses > > this information to provide recommendations about how to tune jobs to > > make them run more efficiently. > > > > Dr. Elephant was open sourced in 2016 after two years of > > successful production use at Linkedin. In the time since many new > > features have been added including support for the Oozie and Airflow > > workflow schedulers, improved metrics, and enhancements to the Spark > > history fetcher and Spark heuristics. It is also important to note > > that many of these contributions came from developers outside of > > LinkedIn. We have also been happy to see that many people have been > > able to benefit from running Dr. Elephant including companies like > > Airbnb, Foursquare, Hulu, and Pinterest. > > > > = RATIONALE = > > > > Dr. Elephant's entry to the ASF will be beneficial to both the > > Dr. Elephant and Apache communities. Dr. Elephant has greatly > > benefited from its open source roots. Its community and adoption has > > grown greatly as a result. More importantly, the feedback from the > > community, whether through interactions at meetups or through the > > mailing list, have allowed for a rich exchange of ideas. We believe a > > partnership with the Apache Foundation is the logical next step. The > > Dr. Elephant community will greatly benefit from the established > > development and consensus processes that have worked well for other > > projec
Re: [DISCUSS] Dr. Elephant Incubator Proposal
I would +1 to have as a separate project instead of pushing under Hadoop. When a project can sustain by having potential to build community on its own and can run logically as independent module, I feel that’s good enough to start as separate project. I could not recall the discussions on removal of Vaidya package from Hadoop. If someone remembers, it would be great to know the reasons for removal of that package from Hadoop base. [ probably at the time of mavenization ? ] Regards, Uma On 3/6/18, 3:17 PM, "md...@cloudera.com on behalf of Mike Drob" wrote: Why does Dr. Elephant make sense as a separate project instead of contributing to Hadoop directly? What is the relationship between Dr. Elephant and the (now seemingly defunct) Hadoop Vaidya? On Tue, Mar 6, 2018 at 5:08 PM, Carl Steinbach wrote: > Hi, > > I would like to propose Dr. Elephant as an Apache Incubator > project. The proposal is available as a draft at > https://wiki.apache.org/incubator/DrElephantProposal. I have also > included the text of the proposal below. > > Any feedback from the community is much appreciated. > > Thanks. > > - Carl > > > = ABSTRACT = > > Dr. Elephant is a performance monitoring and tuning service for Apache > Hadoop and Apache Spark jobs and workflows. While the system is > primarily aimed at developers, we have discovered that it is also > popular with cluster operators who use it to monitor the health of > workloads running on their clusters. > > = PROPOSAL = > > Dr. Elephant was open sourced by LinkedIn in 2016 and is currently > hosted on GitHub. We believe that being a part of the Apache Software > Foundation will improve the diversity and help form a strong community > around the project. > > LinkedIn submits this proposal to donate the code base to the Apache > Software Foundation. The code is already under Apache License 2.0. > Both the source code and documentation are hosted on Github. > > * Code: http://github.com/linkedin/dr-elephant > * Documentation: https://github.com/linkedin/dr-elephant/wiki > > = Background = > > Dr. Elephant is a service that helps users of Apache Hadoop and Apache > Spark understand, analyze, and improve the performance of jobs and > workflows running on their clusters. It automatically gathers metrics, > performs analysis, and presents the results along with actionable > advice. The goal of the project is to improve developer productivity > and increase cluster efficiency by reducing the time and domain > expertise required to diagnose and treat sick jobs. It analyzes Hadoop > and Spark jobs using a set of configurable, extensible, rule-based > heuristics that provide insights on job performance, and then uses > this information to provide recommendations about how to tune jobs to > make them run more efficiently. > > Dr. Elephant was open sourced in 2016 after two years of > successful production use at Linkedin. In the time since many new > features have been added including support for the Oozie and Airflow > workflow schedulers, improved metrics, and enhancements to the Spark > history fetcher and Spark heuristics. It is also important to note > that many of these contributions came from developers outside of > LinkedIn. We have also been happy to see that many people have been > able to benefit from running Dr. Elephant including companies like > Airbnb, Foursquare, Hulu, and Pinterest. > > = RATIONALE = > > Dr. Elephant's entry to the ASF will be beneficial to both the > Dr. Elephant and Apache communities. Dr. Elephant has greatly > benefited from its open source roots. Its community and adoption has > grown greatly as a result. More importantly, the feedback from the > community, whether through interactions at meetups or through the > mailing list, have allowed for a rich exchange of ideas. We believe a > partnership with the Apache Foundation is the logical next step. The > Dr. Elephant community will greatly benefit from the established > development and consensus processes that have worked well for other > projects. The Apache process has served many other open source > projects well and we believe that the Dr. Elephant community will > greatly benefit from these practices as well. > > = CURRENT STATUS = > > Dr. Elephant is currently open sourced under the Apache License > Version 2.0 and is available at github.com/linkedin/dr-elephant. All > of the development is done using GitHub Pull Requests. > > We are aware of at least 10 organizations that are running > Dr. Elephant, and many of these organizations have also contributed > code. Dr. Elephant has also been integrated into commercial pr
Re: [DISCUSS] Dr. Elephant Incubator Proposal
Thanks for explaining your thoughts, Carl! Those answers all sound great to me. Best of luck! On Tue, Mar 6, 2018, 5:58 PM Carl Steinbach wrote: > Hi Mike, > > Why does Dr. Elephant make sense as a separate project instead of > > contributing to Hadoop directly? > > > > Here are a couple reasons why I think Dr. Elephant is more likely to > succeed as a separate project: > > * Dr. Elephant supports Hadoop *and* Spark, and may support other > execution layers in the future. If we make Dr. Elephant a part of > Hadoop I expect that it will discourage contributions from people > who are interested mainly in Spark support, and vice versa. > > * If Dr. Elephant is added to Hadoop it will be necessary for the > Hadoop project to declare a dependency on Spark. I doubt this change > will get approved. > > * We don't want to tie Dr. Elephant to a specific version of Hadoop or > Spark, or tie the Dr. Elephant release cycle to the Hadoop or Spark > release cycles. > > * None of the current Dr. Elephant committers are Hadoop committers, > and I doubt that the Hadoop PMC is going to give them a commit bit > just to work on Dr. Elephant. As a result the existing committers > would be effectively forfeiting their right to continue maintaining > their own project. I think this is one of the reasons why many > Hadoop contrib projects are poorly maintained. > > > > > What is the relationship between Dr. Elephant and the (now seemingly > > defunct) Hadoop Vaidya? > > > > Vaidya was a command line tool for tuning Hadoop jobs. Dr. Elephant is > an always-on service for tuning Hadoop and Spark jobs. We were unaware > of Vaidya when we started working on Dr. Elephant. > > - Carl >
Re: [DISCUSS] Dr. Elephant Incubator Proposal
Hi Mike, Why does Dr. Elephant make sense as a separate project instead of > contributing to Hadoop directly? > Here are a couple reasons why I think Dr. Elephant is more likely to succeed as a separate project: * Dr. Elephant supports Hadoop *and* Spark, and may support other execution layers in the future. If we make Dr. Elephant a part of Hadoop I expect that it will discourage contributions from people who are interested mainly in Spark support, and vice versa. * If Dr. Elephant is added to Hadoop it will be necessary for the Hadoop project to declare a dependency on Spark. I doubt this change will get approved. * We don't want to tie Dr. Elephant to a specific version of Hadoop or Spark, or tie the Dr. Elephant release cycle to the Hadoop or Spark release cycles. * None of the current Dr. Elephant committers are Hadoop committers, and I doubt that the Hadoop PMC is going to give them a commit bit just to work on Dr. Elephant. As a result the existing committers would be effectively forfeiting their right to continue maintaining their own project. I think this is one of the reasons why many Hadoop contrib projects are poorly maintained. > What is the relationship between Dr. Elephant and the (now seemingly > defunct) Hadoop Vaidya? > Vaidya was a command line tool for tuning Hadoop jobs. Dr. Elephant is an always-on service for tuning Hadoop and Spark jobs. We were unaware of Vaidya when we started working on Dr. Elephant. - Carl
Re: [DISCUSS] Dr. Elephant Incubator Proposal
On Tue, Mar 6, 2018 at 3:17 PM, Mike Drob wrote: > Why does Dr. Elephant make sense as a separate project instead of > contributing to Hadoop directly? > > What is the relationship between Dr. Elephant and the (now seemingly > defunct) Hadoop Vaidya? A different way to ask the same question would be: how closely is it tied to YARN as a scheduler? Does it support other schedulers (as in running Spark on Mesos for example)? Thanks, Roman. - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [DISCUSS] Dr. Elephant Incubator Proposal
Why does Dr. Elephant make sense as a separate project instead of contributing to Hadoop directly? What is the relationship between Dr. Elephant and the (now seemingly defunct) Hadoop Vaidya? On Tue, Mar 6, 2018 at 5:08 PM, Carl Steinbach wrote: > Hi, > > I would like to propose Dr. Elephant as an Apache Incubator > project. The proposal is available as a draft at > https://wiki.apache.org/incubator/DrElephantProposal. I have also > included the text of the proposal below. > > Any feedback from the community is much appreciated. > > Thanks. > > - Carl > > > = ABSTRACT = > > Dr. Elephant is a performance monitoring and tuning service for Apache > Hadoop and Apache Spark jobs and workflows. While the system is > primarily aimed at developers, we have discovered that it is also > popular with cluster operators who use it to monitor the health of > workloads running on their clusters. > > = PROPOSAL = > > Dr. Elephant was open sourced by LinkedIn in 2016 and is currently > hosted on GitHub. We believe that being a part of the Apache Software > Foundation will improve the diversity and help form a strong community > around the project. > > LinkedIn submits this proposal to donate the code base to the Apache > Software Foundation. The code is already under Apache License 2.0. > Both the source code and documentation are hosted on Github. > > * Code: http://github.com/linkedin/dr-elephant > * Documentation: https://github.com/linkedin/dr-elephant/wiki > > = Background = > > Dr. Elephant is a service that helps users of Apache Hadoop and Apache > Spark understand, analyze, and improve the performance of jobs and > workflows running on their clusters. It automatically gathers metrics, > performs analysis, and presents the results along with actionable > advice. The goal of the project is to improve developer productivity > and increase cluster efficiency by reducing the time and domain > expertise required to diagnose and treat sick jobs. It analyzes Hadoop > and Spark jobs using a set of configurable, extensible, rule-based > heuristics that provide insights on job performance, and then uses > this information to provide recommendations about how to tune jobs to > make them run more efficiently. > > Dr. Elephant was open sourced in 2016 after two years of > successful production use at Linkedin. In the time since many new > features have been added including support for the Oozie and Airflow > workflow schedulers, improved metrics, and enhancements to the Spark > history fetcher and Spark heuristics. It is also important to note > that many of these contributions came from developers outside of > LinkedIn. We have also been happy to see that many people have been > able to benefit from running Dr. Elephant including companies like > Airbnb, Foursquare, Hulu, and Pinterest. > > = RATIONALE = > > Dr. Elephant's entry to the ASF will be beneficial to both the > Dr. Elephant and Apache communities. Dr. Elephant has greatly > benefited from its open source roots. Its community and adoption has > grown greatly as a result. More importantly, the feedback from the > community, whether through interactions at meetups or through the > mailing list, have allowed for a rich exchange of ideas. We believe a > partnership with the Apache Foundation is the logical next step. The > Dr. Elephant community will greatly benefit from the established > development and consensus processes that have worked well for other > projects. The Apache process has served many other open source > projects well and we believe that the Dr. Elephant community will > greatly benefit from these practices as well. > > = CURRENT STATUS = > > Dr. Elephant is currently open sourced under the Apache License > Version 2.0 and is available at github.com/linkedin/dr-elephant. All > of the development is done using GitHub Pull Requests. > > We are aware of at least 10 organizations that are running > Dr. Elephant, and many of these organizations have also contributed > code. Dr. Elephant has also been integrated into commercial products > such as Pepperdata's Application Profiler. > > = INITIAL GOALS = > > Our initial goals are as follows: > > * Migrate the existing codebase to Apache > * Study and integrate with the Apache development process > * Ensure all dependencies are compliant with Apache License version 2.0 > * Incremental development and releases per Apache guidelines > * Diversify the set of core developers and committers > > = MERITOCRACY = > > Following the Apache meritocracy model, we intend to build an open and > diverse community around Dr. Elephant. We will encourage the community to > contribute to discussions and the codebase. > > = COMMUNITY = > > The need for a simple and understandable performance monitoring and > tuning service for Hadoop and Spark is tremendous. Dr. Elephant is > currently being used by at least 10 organizations worldwide (some > examples are listed here). We hope to extend the contributor base > significantly
