planga82 commented on issue #26082: [SPARK-29431][WebUI] Improve Web UI / Sql tab visualization with cached dataframes. URL: https://github.com/apache/spark/pull/26082#issuecomment-546634480 Hi @joshrosen-stripe It's very interesting what are you talking about. I have done some tests on it. I think the results are coherent but I'm not sure if enough clear. First job with cached dataframe (full cached)  Second job using the same cached dataframe  At the second job thre is no data processed at the cached dataframe. First job with partial cached dataframe  Second job that uses the previous dataframe but need to cache all the dataframe.  For me is enough clear if you know how cached dataframes are. ¿What do you think?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
