I want to evaluate spark performance by measuring the running time of transformation operations such as map and join. To do so, do I need to materialize merely count action? because As far as I know, transformations are lazy operations and don't do any computation until we action on them but when I use an action to run them I don't want to include the running time of that count action in my measurement. How could I do it? Thank you
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/evaluate-spark-tp4508.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
