idanz commented on issue #23067: [SPARK-26097][Web UI] Add the new partitioning description to the exchange node name URL: https://github.com/apache/spark/pull/23067#issuecomment-503379073 Hey, I tend to disagree with the above. 1. this change is super minimal, you already have a mechanism to change the name to add the coordinator so it's already not "name only" and this is only handling the other case. 2. In my company we have an ETL framework based on spark, people submit complex SQL that could have 20-30 shuffle operations, the only way to debug which one is causing the skew is by adding and removing joins and trying again, it takes hours, this solves it in seconds. 3. I don't mind hovering instead, but this change is harmless and already written, just needs agreement, we can always have a nicer way to display later but this 100% solves the problem right now
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
