You can find the information from the spark UI
---Original--- From: "SRK"<swethakasire...@gmail.com> Date: 2017/6/28 02:36:37 To: "user"<user@spark.apache.org>; Subject: How do I find the time taken by each step in a stage in a Spark Job Hi, How do I find the time taken by each step in a stage in spark job? Also, how do I find the bottleneck in each step and if a stage is skipped because of the RDDs being persisted in streaming? I am trying to identify which step in a job is taking time in my Streaming job. Thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-do-I-find-the-time-taken-by-each-step-in-a-stage-in-a-Spark-Job-tp28796.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
