Cool! Ian, could you copy the branches over? Is there something else we need to do to finalize the migration of the code from GC to the ASF repositories? (Obviously we still have to deal with the bugs and the Wiki Content after the code is in.)
Cheers, Till > On Apr 22, 2015, at 21:42, Henry Saputra <[email protected]> wrote: > > Yes, lets do this =) > >> On Wed, Apr 22, 2015 at 9:35 PM, Till Westmann <[email protected]> wrote: >> Sounds good to me as well. >> Can we simply import the code into the repository now? >> >> Thanks, >> Till >> >>> On Apr 22, 2015, at 8:19 AM, Henry Saputra <[email protected]> wrote: >>> >>> This is similar to Apache Flink where there was a project developed >>> that depends on Flink. >>> >>> It finally came to Flink as separate contributions and also bring new >>> committers to the community that helps shows growth of the project. >>> >>> If Pregelix could wait lets bring AsterixDB first and see where it >>> could fit later once the git settle in the Apache Git repo. >>> >>> - Henry >>> >>>> On Wed, Apr 22, 2015 at 12:41 AM, Till Westmann <[email protected]> wrote: >>>> I think that there are a few ways to go about this >>>> 1) just import it with everything else >>>> 2) donate it later in an explicit step >>>> 3) incubate it in separate project. >>>> I think that >>>> 1) is not ideal, as Pregelix wasn’t part of the incubation proposal that >>>> was voted on. However, I also don’t see any harm being caused by importing >>>> it now. >>>> 2) would be a little cleaner as we could have a separate vote on this. >>>> 3) would be possible as well, but since the Pregelix community is a >>>> subcommunity of the AsterixDB community and as the projects are >>>> technically very closely related it seems to make sense to have the same >>>> PMC managing them. >>>> >>>> Other thoughts? >>>> >>>> Thanks, >>>> Till >>>> >>>>> On Apr 21, 2015, at 8:53 AM, Michael Carey <[email protected]> wrote: >>>>> >>>>> Retrying minus the attachment (which is available anyway as the first >>>>> publication on the Pregelix site's publications page). >>>>> >>>>> >>>>> -------- Forwarded Message -------- >>>>> Subject: Re: Migration of git repository >>>>> Date: Tue, 21 Apr 2015 08:49:59 -0700 >>>>> From: Michael Carey <[email protected]> >>>>> To: Mattmann, Chris A (3980) <[email protected]>, Till >>>>> Westmann <[email protected]> >>>>> CC: Chris Hillery <[email protected]>, Ian Maxon <[email protected]>, >>>>> Yingyi Bu <[email protected]>, [email protected] >>>>> >>>>> >>>>> >>>>> Sure! Let me clarify the issue for everyone (and broaden the question). >>>>> >>>>> One of the technical by-products of the AsterixDB project is a graph >>>>> analytics package called Pregelix - as the name suggests, it is a "knock >>>>> off" of Pregel, as are packages like Giraph. What's unique about Pregelix >>>>> is that it actually scales without OOM'ing - under the covers it uses >>>>> database join processing techniques. You can find out more about it by >>>>> visiting http://pregelix.ics.uci.edu/ and/or by skimming the attached >>>>> paper - check out the experimental results compared to other popular >>>>> alternatives. Anyway, we have made it freely available (as we do all of >>>>> our AsterixDB-related research products) and we were thinking that we >>>>> should simply include it under the AsterixDB project - kind of like Spark >>>>> has subprojects for SQL, streams, graphs, etc. As a result, I listed it >>>>> on the list of transferred artifacts when I sent in the licensing form >>>>> the other day. (So we at least have that step done.) Its code >>>>> conntributors have been a small subset of the AsterixDB team; it was a >>>>> small sub-project, basically. (Mostly just Yingyi Bu!) >>>>> >>>>> Pregelix is kind of a sibling of Apache VXQuery in that its runtime is >>>>> based on Hyracks but it hasn't otherwise been AsterixDB-dependent. >>>>> However, we have just finished teaching it to read/write directly from >>>>> AsterixDB native storage - instead of just HDFS - so now it has an >>>>> AsterixDB dependency, and we are using it as a driving example of how to >>>>> couple AsterixDB to other analytic engines. >>>>> >>>>> Rather than going through another exercise to open-source this >>>>> separately, it seemed like we could take this approach. >>>>> >>>>> Thoughts? >>>>> Cheers, >>>>> Mike >>>>> >>>>> >>>>>> On 4/21/15 7:45 AM, Mattmann, Chris A (3980) wrote: >>>>>> Yes, in fact, this whole conversations should be happening on >>>>>> the dev list. OK for me to CC them on my reply? >>>>>> >>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>>>> Chris Mattmann, Ph.D. >>>>>> Chief Architect >>>>>> Instrument Software and Science Data Systems Section (398) >>>>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA >>>>>> Office: 168-519, Mailstop: 168-527 >>>>>> Email:[email protected] >>>>>> WWW:http://sunset.usc.edu/~mattmann/ >>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>>>> Adjunct Associate Professor, Computer Science Department >>>>>> University of Southern California, Los Angeles, CA 90089 USA >>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -----Original Message----- >>>>>> From: "Michael J. Carey"<[email protected]> >>>>>> Date: Tuesday, April 21, 2015 at 3:13 AM >>>>>> To: Till Westmann<[email protected]> >>>>>> Cc: Chris Hillery<[email protected]>, Ian Maxon<[email protected]>, Yingyi >>>>>> Bu<[email protected]>, Chris Mattmann<[email protected]> >>>>>> Subject: Re: Migration of git repository >>>>>> >>>>>>> + Yingyi on the Pregelix Q. Should we also ask Chris M for advice on >>>>>>> that? >>>>>>> On Apr 20, 2015 4:23 PM, "Till Westmann"<[email protected]> wrote: >>>>>>> >>>>>>> Hi Ian, >>>>>>> >>>>>>> >>>>>>> That’s a good question - and I don’t know the answer. >>>>>>> We’ve got 2 repos so far: >>>>>>> https://issues.apache.org/jira/browse/INFRA-9212 >>>>>>> https://issues.apache.org/jira/browse/INFRA-9306 >>>>>>> so we should have space for Hyracks and AsterixDB. >>>>>>> >>>>>>> >>>>>>> I think that there’s an open questions about Pregelix, but maybe that >>>>>>> shouldn’t keep us from going ahead. >>>>>>> >>>>>>> >>>>>>> I further think that it would be great if you could send an e-mail to >>>>>>> [email protected] >>>>>>> <mailto:[email protected]> and ask if it’s ok to >>>>>>> import >>>>>>> our git repo(s) or if something else needs to be done first. (I could >>>>>>> send that e-mail as well, but it would be great if there were more >>>>>>> non-Till e0mails on the list :) ) >>>>>>> >>>>>>> >>>>>>> Cheers, >>>>>>> Till >>>>>>> >>>>>>> >>>>>>> On Apr 20, 2015, at 4:07 PM, Ian Maxon<[email protected]> wrote: >>>>>>> >>>>>>> Hi Mike, Chris and Till, >>>>>>> >>>>>>> >>>>>>> Since (I think?) the paperwork for the software grant is done now, >>>>>>> should >>>>>>> I copy our GC branches over to the ASF git repositories now ( as well as >>>>>>> making it a mirror in the Gerrit commit hook script)? >>>>>>> >>>>>>> >>>>>>> Thanks, >>>>>>> - Ian >>
