[
https://issues.apache.org/jira/browse/SPARK-26139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16697513#comment-16697513
]
Apache Spark commented on SPARK-26139:
--------------------------------------
User 'xuanyuanking' has created a pull request for this issue:
https://github.com/apache/spark/pull/23128
> Support passing shuffle metrics to exchange operator
> ----------------------------------------------------
>
> Key: SPARK-26139
> URL: https://issues.apache.org/jira/browse/SPARK-26139
> Project: Spark
> Issue Type: New Feature
> Components: SQL
> Affects Versions: 2.4.0
> Reporter: Reynold Xin
> Assignee: Reynold Xin
> Priority: Major
>
> Due to the way Spark's architected (SQL is defined on top of the RDD API),
> there are two separate metrics system used in core vs SQL. Ideally, we'd want
> to be able to get the shuffle metrics for each of the exchange operator
> independently, e.g. blocks read, number of records.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
