squito commented on issue #26633: [SPARK-29994][CORE] Add WILDCARD task location URL: https://github.com/apache/spark/pull/26633#issuecomment-564242162 >> In fact this may be against the wishes of of one particular spark application, but still best for the cluster as a whole. In that case, you really might want a 3s wait on LocalShuffledRowRDD > Actually, as I stated in previous comments, the only difference LocalShuffledRowRDD bears from other RDDs is the fact that it has been optimized from ShuffledRowRDD and there comes a worse case guarantee that this new RDD cannot perform any worse than the original ShuffledRowRDD, both to the application and to the cluster. I think you're comparing LocalShuffledRowRDD vs. ShuffledRowRDD; I'm comparing LocalShuffledRowRDD with this change vs. LocalShuffledRowRDD without it.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
