Hello Apache Spark community, I would like to start a discussion about merging the GraphFrames project into the Apache Spark project.
SPIP: https://docs.google.com/document/d/1v8OEV5Qqk5LE1XID4ZiPF5rLkAk-Zz6fp0tns9Z_TA8/edit?usp=sharing Shepherd: Ruifeng Zheng Following the deprecation of GraphX, there is no public, non-deprecated API for working with graph-like data. At the same time, the GraphFrames project (https://github.com/graphframes/graphframes) provides a solid foundation for representing and processing connected data as Spark's DataFrames, as well as a rich standard library of ready-to-use graph algorithms such as PageRank, Connected Components and Node Embeddings. The proposal suggests moving the GraphFrames code (Apache 2.0 licence) to the Apache Spark project as an in-tree module. Please reply to this thread. A [VOTE] will follow once the discussion has concluded. Best regards, Sem --------------------------------------------------------------------- To unsubscribe e-mail: [email protected]
