When I see the storage details of the rdd in the webUI, I find that each block is replicated twice and not on a single node. All the nodes in the cluster are hosting some block or the other.
Why is this difference?? The trace of replicate() method shows only one node. But, webUI shows multiple nodes. Can someone correct me if my understanding is not correct. -Karthik -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/replicate-method-in-BlockManager-scala-choosing-only-one-node-for-replication-tp14059p14072.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
