Hello! It's difficult to say with any certainty, as it was 10 years ago. However, from some old code comments in the GraphFrames codebase, I can infer that the intention was to stabilize the API before merging it with the upstream.
Best regards, Sem On Sun, 2026-11-08 at 18:16 -0500, Nicholas Chammas wrote: > Great to see this proposal. GraphFrames has long been a very useful > library, and I have used it many times. > > One historical curiosity: Why was this not originally a part of the > project? Was it just a historical accident, or was there some > original blocker which has since been resolved? > > NIck > > > > On Nov 8, 2026, at 2:39 PM, Sem via dev <[email protected]> > > wrote: > > > > Hello Apache Spark community, > > > > I would like to start a discussion about merging the GraphFrames > > project into the Apache Spark project. > > > > SPIP: > > https://docs.google.com/document/d/1v8OEV5Qqk5LE1XID4ZiPF5rLkAk-Zz6fp0tns9Z_TA8/edit?usp=sharing > > > > Shepherd: Ruifeng Zheng > > > > Following the deprecation of GraphX, there is no public, non- > > deprecated > > API for working with graph-like data. At the same time, the > > GraphFrames > > project (https://github.com/graphframes/graphframes) provides a > > solid > > foundation for representing and processing connected data as > > Spark's > > DataFrames, as well as a rich standard library of ready-to-use > > graph > > algorithms such as PageRank, Connected Components and Node > > Embeddings. > > > > The proposal suggests moving the GraphFrames code (Apache 2.0 > > licence) > > to the Apache Spark project as an in-tree module. > > > > Please reply to this thread. A [VOTE] will follow once the > > discussion > > has concluded. > > > > Best regards, > > Sem > > > > ------------------------------------------------------------------- > > -- > > To unsubscribe e-mail: [email protected] > > > > > --------------------------------------------------------------------- > To unsubscribe e-mail: [email protected] --------------------------------------------------------------------- To unsubscribe e-mail: [email protected]
