Okay w/me to wait, then.
On 4/22/15 8:19 AM, Henry Saputra wrote:
This is similar to Apache Flink where there was a project developed
that depends on Flink.
It finally came to Flink as separate contributions and also bring new
committers to the community that helps shows growth of the project.
If Pregelix could wait lets bring AsterixDB first and see where it
could fit later once the git settle in the Apache Git repo.
- Henry
On Wed, Apr 22, 2015 at 12:41 AM, Till Westmann <[email protected]> wrote:
I think that there are a few ways to go about this
1) just import it with everything else
2) donate it later in an explicit step
3) incubate it in separate project.
I think that
1) is not ideal, as Pregelix wasn’t part of the incubation proposal that was
voted on. However, I also don’t see any harm being caused by importing it now.
2) would be a little cleaner as we could have a separate vote on this.
3) would be possible as well, but since the Pregelix community is a
subcommunity of the AsterixDB community and as the projects are technically
very closely related it seems to make sense to have the same PMC managing them.
Other thoughts?
Thanks,
Till
On Apr 21, 2015, at 8:53 AM, Michael Carey <[email protected]> wrote:
Retrying minus the attachment (which is available anyway as the first
publication on the Pregelix site's publications page).
-------- Forwarded Message --------
Subject: Re: Migration of git repository
Date: Tue, 21 Apr 2015 08:49:59 -0700
From: Michael Carey <[email protected]>
To: Mattmann, Chris A (3980) <[email protected]>, Till Westmann
<[email protected]>
CC: Chris Hillery <[email protected]>, Ian Maxon <[email protected]>, Yingyi Bu
<[email protected]>, [email protected]
Sure! Let me clarify the issue for everyone (and broaden the question).
One of the technical by-products of the AsterixDB project is a graph analytics package
called Pregelix - as the name suggests, it is a "knock off" of Pregel, as are
packages like Giraph. What's unique about Pregelix is that it actually scales without
OOM'ing - under the covers it uses database join processing techniques. You can find out
more about it by visiting http://pregelix.ics.uci.edu/ and/or by skimming the attached
paper - check out the experimental results compared to other popular alternatives.
Anyway, we have made it freely available (as we do all of our AsterixDB-related research
products) and we were thinking that we should simply include it under the AsterixDB
project - kind of like Spark has subprojects for SQL, streams, graphs, etc. As a result,
I listed it on the list of transferred artifacts when I sent in the licensing form the
other day. (So we at least have that step done.) Its code conntributors have been a
small subset of the AsterixDB team; it was a small sub-project, basically. (Mostly just
Yingyi Bu!)
Pregelix is kind of a sibling of Apache VXQuery in that its runtime is based on
Hyracks but it hasn't otherwise been AsterixDB-dependent. However, we have
just finished teaching it to read/write directly from AsterixDB native storage
- instead of just HDFS - so now it has an AsterixDB dependency, and we are
using it as a driving example of how to couple AsterixDB to other analytic
engines.
Rather than going through another exercise to open-source this separately, it
seemed like we could take this approach.
Thoughts?
Cheers,
Mike
On 4/21/15 7:45 AM, Mattmann, Chris A (3980) wrote:
Yes, in fact, this whole conversations should be happening on
the dev list. OK for me to CC them on my reply?
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Chief Architect
Instrument Software and Science Data Systems Section (398)
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 168-519, Mailstop: 168-527
Email:[email protected]
WWW:http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Associate Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
-----Original Message-----
From: "Michael J. Carey"<[email protected]>
Date: Tuesday, April 21, 2015 at 3:13 AM
To: Till Westmann<[email protected]>
Cc: Chris Hillery<[email protected]>, Ian Maxon<[email protected]>, Yingyi
Bu<[email protected]>, Chris Mattmann<[email protected]>
Subject: Re: Migration of git repository
+ Yingyi on the Pregelix Q. Should we also ask Chris M for advice on
that?
On Apr 20, 2015 4:23 PM, "Till Westmann"<[email protected]> wrote:
Hi Ian,
That’s a good question - and I don’t know the answer.
We’ve got 2 repos so far:
https://issues.apache.org/jira/browse/INFRA-9212
https://issues.apache.org/jira/browse/INFRA-9306
so we should have space for Hyracks and AsterixDB.
I think that there’s an open questions about Pregelix, but maybe that
shouldn’t keep us from going ahead.
I further think that it would be great if you could send an e-mail to
[email protected]
<mailto:[email protected]> and ask if it’s ok to import
our git repo(s) or if something else needs to be done first. (I could
send that e-mail as well, but it would be great if there were more
non-Till e0mails on the list :) )
Cheers,
Till
On Apr 20, 2015, at 4:07 PM, Ian Maxon<[email protected]> wrote:
Hi Mike, Chris and Till,
Since (I think?) the paperwork for the software grant is done now, should
I copy our GC branches over to the ASF git repositories now ( as well as
making it a mirror in the Gerrit commit hook script)?
Thanks,
- Ian
