Checkpointing Pregel

o("Pregel finished iteration " + i) Best Regards, Jeffrey Picard signature.asc Description: Message signed with OpenPGP using GPGMail

Re: Graphx seems to be broken while Creating a large graph(6B nodes in my case)

I’m seeing this issue also. I have graph with with 5828339535 vertices and 7398447992 edges, graph.numVertices returns 1533266498 and graph.numEdges is correct and returns 7398447992. I also am having an issue that I’m beginning to suspect is caused by the same underlying problem where connected

Graphx GraphLoader Coalesce Shuffle

Hey all, I’ve often found that my spark programs run much more stable with a higher number of partitions, and a lot of the graphs I deal with will have a few hundred large part files. I was wondering if having a parameter in GraphLoader, defaulting to false, to set the shuffle parameter in coal