[jira] [Updated] (SPARK-8381) reuse typeConvert when convert Seq[Row] to catalyst type
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8381: -- Issue Type: Improvement (was: Bug) reuse typeConvert when convert Seq[Row] to catalyst type Key: SPARK-8381 URL: https://issues.apache.org/jira/browse/SPARK-8381 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 1.4.0 Reporter: Lianhui Wang Fix For: 1.5.0 This method CatalystTypeConverters.convertToCatalyst is slow, so for batch conversion we should be using converter produced by createToCatalystConverter. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-8381) reuse typeConvert when convert Seq[Row] to catalyst type
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8381: -- Assignee: Lianhui Wang reuse typeConvert when convert Seq[Row] to catalyst type Key: SPARK-8381 URL: https://issues.apache.org/jira/browse/SPARK-8381 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 1.4.0 Reporter: Lianhui Wang Assignee: Lianhui Wang Fix For: 1.5.0 This method CatalystTypeConverters.convertToCatalyst is slow, so for batch conversion we should be using converter produced by createToCatalystConverter. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-8381) reuse typeConvert when convert Seq[Row] to catalyst type
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-8381: Description: This method CatalystTypeConverters.convertToCatalyst is slow, so for batch conversion we should be using converter produced by createToCatalystConverter. (was: This method CatalystTypeConverters.convertToCatalyst is slow, and for batch conversion we should be using converter produced by createToCatalystConverter.) reuse typeConvert when convert Seq[Row] to catalyst type Key: SPARK-8381 URL: https://issues.apache.org/jira/browse/SPARK-8381 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 1.4.0 Reporter: Lianhui Wang This method CatalystTypeConverters.convertToCatalyst is slow, so for batch conversion we should be using converter produced by createToCatalystConverter. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-8381) reuse typeConvert when convert Seq[Row] to catalyst type
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-8381: Summary: reuse typeConvert when convert Seq[Row] to catalyst type (was: reuse-typeConvert when convert Seq[Row] to catalyst type) reuse typeConvert when convert Seq[Row] to catalyst type Key: SPARK-8381 URL: https://issues.apache.org/jira/browse/SPARK-8381 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 1.4.0 Reporter: Lianhui Wang This method CatalystTypeConverters.convertToCatalyst is slow, and for batch conversion we should be using converter produced by createToCatalystConverter. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-8381) reuse-typeConvert when convert Seq[Row] to catalyst type
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-8381: Summary: reuse-typeConvert when convert Seq[Row] to catalyst type (was: reuse-typeConvert when convert Seq[Row] to CatalystType) reuse-typeConvert when convert Seq[Row] to catalyst type Key: SPARK-8381 URL: https://issues.apache.org/jira/browse/SPARK-8381 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 1.4.0 Reporter: Lianhui Wang This method CatalystTypeConverters.convertToCatalyst is slow, and for batch conversion we should be using converter produced by createToCatalystConverter. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org