[jira] [Commented] (SPARK-19700) Design an API for pluggable scheduler implementations

2017-02-27 Thread Hamel Ajay Kothari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885715#comment-15885715 ] Hamel Ajay Kothari commented on SPARK-19700: Throwing this here for consistency. It looks

[jira] (SPARK-18278) Support native submission of spark jobs to a kubernetes cluster

2017-01-31 Thread Hamel Ajay Kothari (JIRA)
Title: Message Title Hamel Ajay Kothari commented on SPARK-18278

[jira] [Commented] (SPARK-18479) spark.sql.shuffle.partitions defaults should be a prime number

2016-11-17 Thread Hamel Ajay Kothari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673800#comment-15673800 ] Hamel Ajay Kothari commented on SPARK-18479: Hi [~sowen], thanks for the quick response. What

[jira] [Created] (SPARK-18479) spark.sql.shuffle.partitions defaults should be a prime number

2016-11-16 Thread Hamel Ajay Kothari (JIRA)
Hamel Ajay Kothari created SPARK-18479: -- Summary: spark.sql.shuffle.partitions defaults should be a prime number Key: SPARK-18479 URL: https://issues.apache.org/jira/browse/SPARK-18479 Project:

[jira] [Commented] (SPARK-17006) WithColumn Performance Degrades with Number of Invocations

2016-08-10 Thread Hamel Ajay Kothari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416463#comment-15416463 ] Hamel Ajay Kothari commented on SPARK-17006: The unrolled code doesn't really make a

[jira] [Updated] (SPARK-17006) WithColumn Performance Degrades with Number of Invocations

2016-08-10 Thread Hamel Ajay Kothari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hamel Ajay Kothari updated SPARK-17006: --- Description: Consider the following test case. We create a dataframe with 100

[jira] [Created] (SPARK-17006) WithColumn Performance Degrades with Number of Invocations

2016-08-10 Thread Hamel Ajay Kothari (JIRA)
Hamel Ajay Kothari created SPARK-17006: -- Summary: WithColumn Performance Degrades with Number of Invocations Key: SPARK-17006 URL: https://issues.apache.org/jira/browse/SPARK-17006 Project: Spark

[jira] [Created] (SPARK-5494) SparkSqlSerializer Ignores KryoRegistrators

2015-01-29 Thread Hamel Ajay Kothari (JIRA)
Hamel Ajay Kothari created SPARK-5494: - Summary: SparkSqlSerializer Ignores KryoRegistrators Key: SPARK-5494 URL: https://issues.apache.org/jira/browse/SPARK-5494 Project: Spark Issue

[jira] [Commented] (SPARK-5097) Adding data frame APIs to SchemaRDD

2015-01-19 Thread Hamel Ajay Kothari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282978#comment-14282978 ] Hamel Ajay Kothari commented on SPARK-5097: --- Thanks for the response [~rxin],

[jira] [Commented] (SPARK-5097) Adding data frame APIs to SchemaRDD

2015-01-15 Thread Hamel Ajay Kothari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14278819#comment-14278819 ] Hamel Ajay Kothari commented on SPARK-5097: --- Am I correct in interpreting that