ajithme edited a comment on issue #23920: [SPARK-27012] Storage tab shows rdd details even after executor ended URL: https://github.com/apache/spark/pull/23920#issuecomment-468391528 The storage tab populates UI based on the rdd's available partitions. UI i provides a link to see how these partitions are distributed among executors which are alive. When executor goes away we should remove it from rdd available partition so that it doesn't show up in UI. right ? The patch handles two scenarios 1. All available partitions executors are lost 2. Some of the partitions executors are lost In case 1, we remove complete storage information In case 2, we show the storage information, but only with available partitions(executors)
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
