[ https://issues.apache.org/jira/browse/SPARK-20136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Reynold Xin updated SPARK-20136: -------------------------------- Description: We currently do not include explicitly metadata operation timing and number of files in data source metrics. Those would be useful to include for performance profiling. (was: We currently do not include metadata operation timing and number of files in data source metrics. Those would be useful to include for performance profiling.) > Add num files and metadata operation timing to scan metrics > ----------------------------------------------------------- > > Key: SPARK-20136 > URL: https://issues.apache.org/jira/browse/SPARK-20136 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 2.1.0 > Reporter: Reynold Xin > Assignee: Reynold Xin > > We currently do not include explicitly metadata operation timing and number > of files in data source metrics. Those would be useful to include for > performance profiling. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org