Hi, all i have some questions about debug in spark: 1) when application finished, application UI is shut down, i can not see the details about the app, like shuffle size, duration time, stage information... there are not sufficient informations in the master UI. do i need to hang the application on?
2) how to get details about each task the executor run? like memory usage... 3) since i'am not familiar with JVM. do i need to run the program step by step or hang on the program to use JVM utilities like jstack, jmap... -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/questions-about-debugging-a-spark-application-tp4891.html Sent from the Apache Spark User List mailing list archive at Nabble.com.