Graphx connectComponents API

2014-10-22 Thread Manoj Awasthi
Hi Guys, I am trying something very basic. I am using GraphX to load a graph from an edge list file which is like this: *220 224* *400 401* *220 221* So it has following nodes (just for the sake of understanding - bear with me for drawing): *220 = 224 400 = 401 * * ||* * v 221*

Re: Graphx connectComponents API

2014-10-22 Thread Manoj Awasthi
Well - resolved. The problem was in my understanding. It returns the graph with vertex data set to the connected components. Thanks. On Wed, Oct 22, 2014 at 6:56 PM, Manoj Awasthi awasthi.ma...@gmail.com wrote: Hi Guys, I am trying something very basic. I am using GraphX to load a graph

Re: special case of custom partitioning

2014-03-07 Thread Manoj Awasthi
. On Thu, Mar 6, 2014 at 4:09 AM, Manoj Awasthi awasthi.ma...@gmail.com wrote: Hi All, I have a three machine cluster. I have two RDDs each consisting of (K,V) pairs. RDDs have just three keys 'a', 'b' and 'c'. // list1 - List(('a',1), ('b',2), val rdd1

special case of custom partitioning

2014-03-06 Thread Manoj Awasthi
Hi All, I have a three machine cluster. I have two RDDs each consisting of (K,V) pairs. RDDs have just three keys 'a', 'b' and 'c'. // list1 - List(('a',1), ('b',2), val rdd1 = sc.parallelize(list1).groupByKey(new HashPartitioner(3)) // list2 - List(('a',2), ('b',7),