Could you please share what you think are the main changes you would think TinkerPop would have to make?
I also wonder a bit about multi/meta-properties and how they might fit into the future of GraphAr. I don't find that a lack of support for either multi/metaproperties is a huge blocker for adoption but i don't see those things going away i the long term. I suppose multiproperties could be coerced to List but I suppose that would preclude use of multiproperties that are themselves of List type. On Thu, May 23, 2024 at 9:28 PM 李雪(有理) <youli...@alibaba-inc.com.invalid> wrote: > Your understanding is accurate. Our integration strategy with Neo4j has > been designed to be non-intrusive. > For deeper integration, we have initiated efforts to adopt GraphAr as the > primary format for importing and exporting in GraphScope, which has led to > considerable performance improvements. You can find more details here: > https://graphar.apache.org/docs/libraries/cpp/examples/graphscope < > https://graphar.apache.org/docs/libraries/cpp/examples/graphscope > > Furthermore, we have explored mechanisms to support certain pushdown > operations tailored for graph querying scenarios, which reduces the > necessity of loading the entire graph into memory. However, these features > are still in the experimental phase and have not yet been incorporated into > our main branch. > As for integrating GraphAr with TinkerPop for OLAP use cases, my main > concern is the potential impact on the execution engine. Such integration > may require notable changes of the TinkerPop codebase, according to our > experience with GraphScope. > Despite these challenges, we are enthusiastic about engaging with the > TinkerPop community. We would like to provide the necessary functionalities > and any assistance regarding GraphAr support. > ------------------------------------------------------------------ > 发件人：Stephen Mallette <spmalle...@gmail.com> > 发送时间：2024年5月23日(星期四) 19:15 > 收件人：dev<dev@graphar.apache.org> > 主 题：Re: Apache TinkerPop and GraphAr > From what I understand from your documentation, it looks as though you > provide ways to directly connect to Neo4j through a spark job. I assume > there might be something similar you could do with Gremlin Server. That > might be nice. In that way, users could convert any TinkerPop graph to > GraphAr format. > I suppose my main question though is whether or not it would be a good idea > for TinkerPop to use GraphAr more directly as an input/output format for > OLAP use cases? TinkerPop currently prefers use of Gryo, it's own format > based on Kryo, but I feel like GraphAr could be a better choice going > forward potentially. I'd be interested to hear what GraphAr experts think > about this use case. > On Tue, May 21, 2024 at 9:20 PM 李雪(有理) <youli...@alibaba-inc.com.invalid> > wrote: > > Hello, Stephen > > Thank you for bringing up this interesting discussion point. As far as I > > am aware, there have not been any formal discussions regarding a direct > > collaboration between TinkerPop and GraphAr to this date. However, I > > believe a collaborative effort in this area could lead to improvements in > > how graph data is managed and processed. > > Drawing from our experiences with integrating Neo4j and NebulaGraph, we > > have gleaned insights that could prove invaluable in this context. > > We are keenly interested in delving deeper into this conversation between > > TinkerPop and GraphAr. > > ------------------------------------------------------------------ > > 发件人：Stephen Mallette <spmalle...@gmail.com> > > 发送时间：2024年5月21日(星期二) 21:02 > > 收件人：dev<dev@graphar.apache.org> > > 主 题：Apache TinkerPop and GraphAr > > Hello - I was just wondering if there have been any discussions about how > > TinkerPop and GraphAr might work together a bit. TinkerPop's file system > > formats have grown a bit dated to some degree and GraphAr seems like it > > could be useful there as a replacement to internal formats, particularly > > Gryo. Looking forward to hearing thoughts on this topic. Thanks! > > Stephen > > >
