Re: SparkGraph review process

2020-02-23 Thread kant kodali
Hi Sean, In that case, Can we have Graphframes as part of spark release? or separate release is also fine. Currently, I don't see any releases w.r.t Graphframes. Thanks On Fri, Feb 14, 2020 at 9:06 AM Sean Owen wrote: > This will not be Spark 3.0, no. > > On Fri, Feb 14, 2020 at 1:12 AM kant

Re: SparkGraph review process

2020-02-14 Thread Sean Owen
This will not be Spark 3.0, no. On Fri, Feb 14, 2020 at 1:12 AM kant kodali wrote: > > any update on this? Is spark graph going to make it into Spark or no? > > On Mon, Oct 14, 2019 at 12:26 PM Holden Karau wrote: >> >> Maybe let’s ask the folks from Lightbend who helped with the previous scala

Re: SparkGraph review process

2020-02-13 Thread kant kodali
any update on this? Is spark graph going to make it into Spark or no? On Mon, Oct 14, 2019 at 12:26 PM Holden Karau wrote: > Maybe let’s ask the folks from Lightbend who helped with the previous > scala upgrade for their thoughts? > > On Mon, Oct 14, 2019 at 8:24 PM Xiao Li wrote: > >> 1. On th

Re: SparkGraph review process

2019-10-14 Thread Holden Karau
Maybe let’s ask the folks from Lightbend who helped with the previous scala upgrade for their thoughts? On Mon, Oct 14, 2019 at 8:24 PM Xiao Li wrote: > 1. On the technical side, my main concern is the runtime dependency on >> org.opencypher:okapi-shade. okapi depends on several Scala libraries.

Re: SparkGraph review process

2019-10-14 Thread Xiao Li
> > 1. On the technical side, my main concern is the runtime dependency on > org.opencypher:okapi-shade. okapi depends on several Scala libraries. We > came out with the solution to shade a few Scala libraries to avoid > pollution. However, I'm not super confident that the approach is > sustainable

Re: SparkGraph review process

2019-10-04 Thread Xiangrui Meng
Hi all, I want to clarify my role first to avoid misunderstanding. I'm an individual contributor here. My work on the graph SPIP as well as other Spark features I contributed to are not associated with my employer. It became quite challenging for me to keep track of the graph SPIP work due to less

SparkGraph review process

2019-10-04 Thread Mats Rydberg
Hello dear Spark community We are the developers behind the SparkGraph SPIP, which is a project created out of our work on openCypher Morpheus ( https://github.com/opencypher/morpheus). During this year we have collaborated with mainly Xiangrui Meng of Databricks to define and develop a new SparkG