Your understanding is accurate. Our integration strategy with Neo4j has been
designed to be non-intrusive.
For deeper integration, we have initiated efforts to adopt GraphAr as the
primary format for importing and exporting in GraphScope, which has led to
considerable performance improvements. You can find more details here:
https://graphar.apache.org/docs/libraries/cpp/examples/graphscope
<https://graphar.apache.org/docs/libraries/cpp/examples/graphscope >
Furthermore, we have explored mechanisms to support certain pushdown operations
tailored for graph querying scenarios, which reduces the necessity of loading
the entire graph into memory. However, these features are still in the
experimental phase and have not yet been incorporated into our main branch.
As for integrating GraphAr with TinkerPop for OLAP use cases, my main concern
is the potential impact on the execution engine. Such integration may require
notable changes of the TinkerPop codebase, according to our experience with
GraphScope.
Despite these challenges, we are enthusiastic about engaging with the TinkerPop
community. We would like to provide the necessary functionalities and any
assistance regarding GraphAr support.
------------------------------------------------------------------
发件人：Stephen Mallette <spmalle...@gmail.com>
发送时间：2024年5月23日(星期四) 19:15
收件人：dev<dev@graphar.apache.org>
主 题：Re: Apache TinkerPop and GraphAr
From what I understand from your documentation, it looks as though you
provide ways to directly connect to Neo4j through a spark job. I assume
there might be something similar you could do with Gremlin Server. That
might be nice. In that way, users could convert any TinkerPop graph to
GraphAr format.
I suppose my main question though is whether or not it would be a good idea
for TinkerPop to use GraphAr more directly as an input/output format for
OLAP use cases? TinkerPop currently prefers use of Gryo, it's own format
based on Kryo, but I feel like GraphAr could be a better choice going
forward potentially. I'd be interested to hear what GraphAr experts think
about this use case.
On Tue, May 21, 2024 at 9:20 PM 李雪(有理) <youli...@alibaba-inc.com.invalid>
wrote:
> Hello, Stephen
> Thank you for bringing up this interesting discussion point. As far as I
> am aware, there have not been any formal discussions regarding a direct
> collaboration between TinkerPop and GraphAr to this date. However, I
> believe a collaborative effort in this area could lead to improvements in
> how graph data is managed and processed.
> Drawing from our experiences with integrating Neo4j and NebulaGraph, we
> have gleaned insights that could prove invaluable in this context.
> We are keenly interested in delving deeper into this conversation between
> TinkerPop and GraphAr.
> ------------------------------------------------------------------
> 发件人：Stephen Mallette <spmalle...@gmail.com>
> 发送时间：2024年5月21日(星期二) 21:02
> 收件人：dev<dev@graphar.apache.org>
> 主 题：Apache TinkerPop and GraphAr
> Hello - I was just wondering if there have been any discussions about how
> TinkerPop and GraphAr might work together a bit. TinkerPop's file system
> formats have grown a bit dated to some degree and GraphAr seems like it
> could be useful there as a replacement to internal formats, particularly
> Gryo. Looking forward to hearing thoughts on this topic. Thanks!
> Stephen
>
