[jira] [Assigned] (SPARK-15259) Sort time metric should not include spill and record insertion time
[ https://issues.apache.org/jira/browse/SPARK-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15259: Assignee: Apache Spark > Sort time metric should not include spill and record insertion time > --- > > Key: SPARK-15259 > URL: https://issues.apache.org/jira/browse/SPARK-15259 > Project: Spark > Issue Type: Bug > Components: SQL >Reporter: Eric Liang >Assignee: Apache Spark >Priority: Minor > > After SPARK-14669 it seems the sort time metric includes both spill and > record insertion time. This makes it not very useful since the metric becomes > close to the total execution time of the node. > We should track just the time spent for in-memory sort, as before. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-15259) Sort time metric should not include spill and record insertion time
[ https://issues.apache.org/jira/browse/SPARK-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15259: Assignee: (was: Apache Spark) > Sort time metric should not include spill and record insertion time > --- > > Key: SPARK-15259 > URL: https://issues.apache.org/jira/browse/SPARK-15259 > Project: Spark > Issue Type: Bug > Components: SQL >Reporter: Eric Liang >Priority: Minor > > After SPARK-14669 it seems the sort time metric includes both spill and > record insertion time. This makes it not very useful since the metric becomes > close to the total execution time of the node. > We should track just the time spent for in-memory sort, as before. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
