planga82 commented on a change in pull request #25319: [SPARK-28585][WebUI]
Improve WebUI DAG information: Add extra info to rdd from spark plan
URL: https://github.com/apache/spark/pull/25319#discussion_r310187345
##########
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/basicPhysicalOperators.scala
##########
@@ -616,8 +616,13 @@ case class UnionExec(children: Seq[SparkPlan]) extends
SparkPlan {
}
}
- protected override def doExecute(): RDD[InternalRow] =
+ def addExtraInfo: RDD[InternalRow] => RDD[InternalRow] = {
Review comment:
Different nodes must implement diferent versions of addExtra info because
the structure of the nodes and the interesting informatión to show is different.
Of course we could move this function to SparkPlan, with a predefined empty
behavior and implement it in the different exec nodes that we want to add extra
info. Do you think it would be better?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
