Retrying minus the attachment (which is available anyway as the first
publication on the Pregelix site's publications page).
-------- Forwarded Message --------
Subject: Re: Migration of git repository
Date: Tue, 21 Apr 2015 08:49:59 -0700
From: Michael Carey <[email protected]>
To: Mattmann, Chris A (3980) <[email protected]>, Till
Westmann <[email protected]>
CC: Chris Hillery <[email protected]>, Ian Maxon <[email protected]>,
Yingyi Bu <[email protected]>, [email protected]
Sure! Let me clarify the issue for everyone (and broaden the question).
One of the technical by-products of the AsterixDB project is a graph
analytics package called Pregelix - as the name suggests, it is a "knock
off" of Pregel, as are packages like Giraph. What's unique about
Pregelix is that it actually scales without OOM'ing - under the covers
it uses database join processing techniques. You can find out more
about it by visiting http://pregelix.ics.uci.edu/ and/or by skimming the
attached paper - check out the experimental results compared to other
popular alternatives. Anyway, we have made it freely available (as we do
all of our AsterixDB-related research products) and we were thinking
that we should simply include it under the AsterixDB project - kind of
like Spark has subprojects for SQL, streams, graphs, etc. As a result,
I listed it on the list of transferred artifacts when I sent in the
licensing form the other day. (So we at least have that step done.)
Its code conntributors have been a small subset of the AsterixDB team;
it was a small sub-project, basically. (Mostly just Yingyi Bu!)
Pregelix is kind of a sibling of Apache VXQuery in that its runtime is
based on Hyracks but it hasn't otherwise been AsterixDB-dependent.
However, we have just finished teaching it to read/write directly from
AsterixDB native storage - instead of just HDFS - so now it has an
AsterixDB dependency, and we are using it as a driving example of how to
couple AsterixDB to other analytic engines.
Rather than going through another exercise to open-source this
separately, it seemed like we could take this approach.
Thoughts?
Cheers,
Mike
On 4/21/15 7:45 AM, Mattmann, Chris A (3980) wrote:
Yes, in fact, this whole conversations should be happening on
the dev list. OK for me to CC them on my reply?
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Chief Architect
Instrument Software and Science Data Systems Section (398)
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 168-519, Mailstop: 168-527
Email:[email protected]
WWW:http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Associate Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
-----Original Message-----
From: "Michael J. Carey"<[email protected]>
Date: Tuesday, April 21, 2015 at 3:13 AM
To: Till Westmann<[email protected]>
Cc: Chris Hillery<[email protected]>, Ian Maxon<[email protected]>, Yingyi
Bu<[email protected]>, Chris Mattmann<[email protected]>
Subject: Re: Migration of git repository
+ Yingyi on the Pregelix Q. Should we also ask Chris M for advice on
that?
On Apr 20, 2015 4:23 PM, "Till Westmann"<[email protected]> wrote:
Hi Ian,
That’s a good question - and I don’t know the answer.
We’ve got 2 repos so far:
https://issues.apache.org/jira/browse/INFRA-9212
https://issues.apache.org/jira/browse/INFRA-9306
so we should have space for Hyracks and AsterixDB.
I think that there’s an open questions about Pregelix, but maybe that
shouldn’t keep us from going ahead.
I further think that it would be great if you could send an e-mail to
[email protected]
<mailto:[email protected]> and ask if it’s ok to import
our git repo(s) or if something else needs to be done first. (I could
send that e-mail as well, but it would be great if there were more
non-Till e0mails on the list :) )
Cheers,
Till
On Apr 20, 2015, at 4:07 PM, Ian Maxon<[email protected]> wrote:
Hi Mike, Chris and Till,
Since (I think?) the paperwork for the software grant is done now, should
I copy our GC branches over to the ASF git repositories now ( as well as
making it a mirror in the Gerrit commit hook script)?
Thanks,
- Ian
