Hi, I am analysing the application processing on Spark(GraphX), but feeling a little confused on some items of webUI.
1) what is the difference between "Duration"(Stages -> Completed Stages) and "Task Time"(Executors) ? for instance, "43s" VS. "5.6 m" "Task Time" is approximated to "Duration" multiplied with "Total Tasks"? 2) what are the exact meanings of "Shuffle Read/Shuffle Write"? Best, Yifan LI