Reynold Xin created SPARK-26139:
-----------------------------------
Summary: Support passing shuffle metrics to exchange operator
Key: SPARK-26139
URL: https://issues.apache.org/jira/browse/SPARK-26139
Project: Spark
Issue Type: New Feature
Components: SQL
Affects Versions: 2.4.0
Reporter: Reynold Xin
Assignee: Reynold Xin
Due to the way Spark's architected (SQL is defined on top of the RDD API),
there are two separate metrics system used in core vs SQL. Ideally, we'd want
to be able to get the shuffle metrics for each of the exchange operator
independently, e.g. blocks read, number of records.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
