Eric Liang created SPARK-15259:
----------------------------------
Summary: Sort time metric
Key: SPARK-15259
URL: https://issues.apache.org/jira/browse/SPARK-15259
Project: Spark
Issue Type: Bug
Components: SQL
Reporter: Eric Liang
Priority: Minor
After SPARK-14669 it seems the sort time metric includes both spill and record
insertion time. This makes it not very useful since the metric becomes close to
the total execution time of the node.
We should track just the time spent for in-memory sort, as before.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
