Spark Kryo read method never called before reducing

2015-05-06 Thread amine_901
ect = kryo.readObject(input, Event.class); queue.add(leaf.add(object)); eol--; } return root; } } Thanks you -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Kryo-read-method-never-called-before-reducing-tp22

Kryo read method never called before reducing

2015-05-06 Thread Florian Hussonnois
Hi, We use Spark to build graphs of events after querying cassandra. We use mapPartition for both aggregating events and building two graphs per partition. Graphs are returned as Tuple2 as follows : val nodes = events.mapPartitions(part => { var nodeLeft : Node = null var nodeR