[jira] [Updated] (SPARK-8786) Create a wrapper for BinaryType

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8786: - Assignee: Josh Rosen > Create a wrapper for BinaryType > --- > >

[jira] [Updated] (SPARK-6632) Optimize the parquetSchema to metastore schema reconciliation, so that the process is delegated to each map task itself

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6632: - Assignee: Michael Armbrust > Optimize the parquetSchema to metastore schema reconciliation, so that the >

[jira] [Updated] (SPARK-5397) Assigning aliases to several return values of an UDF

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5397: - Assignee: Michael Armbrust > Assigning aliases to several return values of an UDF > --

[jira] [Updated] (SPARK-5314) java.lang.OutOfMemoryError in SparkSQL with GROUP BY

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5314: - Assignee: Michael Armbrust > java.lang.OutOfMemoryError in SparkSQL with GROUP BY > --

[jira] [Updated] (SPARK-5302) Add support for SQLContext "partition" columns

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5302: - Assignee: Cheng Lian > Add support for SQLContext "partition" columns > --

[jira] [Updated] (SPARK-5421) SparkSql throw OOM at shuffle

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5421: - Assignee: Michael Armbrust > SparkSql throw OOM at shuffle > - > >

[jira] [Updated] (SPARK-5109) Loading multiple parquet files into a single SchemaRDD

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5109: - Assignee: Michael Armbrust > Loading multiple parquet files into a single SchemaRDD >

[jira] [Updated] (SPARK-4273) Providing ExternalSet to avoid OOM when count(distinct)

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4273: - Assignee: Michael Armbrust > Providing ExternalSet to avoid OOM when count(distinct) > ---

[jira] [Updated] (SPARK-4559) Adding support for ucase and lcase

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4559: - Assignee: Michael Armbrust > Adding support for ucase and lcase > -- > >

[jira] [Updated] (SPARK-3804) Output of Generator expressions is not stable after serialization.

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3804: - Assignee: Michael Armbrust > Output of Generator expressions is not stable after serialization. >

[jira] [Updated] (SPARK-5823) Reuse mutable rows for inner structures when parsing JSON objects

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5823: - Assignee: Yanbo Liang > Reuse mutable rows for inner structures when parsing JSON objects > --

[jira] [Updated] (SPARK-5738) Reuse mutable row for each record at jsonStringToRow

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5738: - Assignee: Yanbo Liang > Reuse mutable row for each record at jsonStringToRow > ---

[jira] [Updated] (SPARK-3700) Improve the performance of scanning JSON datasets

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3700: - Assignee: Yanbo Liang > Improve the performance of scanning JSON datasets > --

[jira] [Updated] (SPARK-3833) Allow Spark SQL SchemaRDDs to be merged

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3833: - Assignee: Michael Armbrust > Allow Spark SQL SchemaRDDs to be merged > ---

[jira] [Updated] (SPARK-3978) Schema change on Spark-Hive (Parquet file format) table not working

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3978: - Assignee: Alex Rovner > Schema change on Spark-Hive (Parquet file format) table not working >

[jira] [Updated] (SPARK-3231) select on a table in parquet format containing smallint as a field type does not work

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3231: - Assignee: Alex Rovner > select on a table in parquet format containing smallint as a field type does > no

[jira] [Updated] (SPARK-3617) Configurable case sensitivity

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3617: - Assignee: Michael Armbrust > Configurable case sensitivity > - > >

[jira] [Updated] (SPARK-2824) Allow saving Parquet files to the HiveMetastore

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2824: - Assignee: Michael Armbrust > Allow saving Parquet files to the HiveMetastore > ---

[jira] [Updated] (SPARK-2695) Figure out a good way to handle NullType columns.

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2695: - Assignee: Michael Armbrust > Figure out a good way to handle NullType columns. > -

[jira] [Comment Edited] (SPARK-10485) IF expression is not correctly resolved when one of the options have NullType

2015-09-16 Thread Antonio Jesus Navarro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14747089#comment-14747089 ] Antonio Jesus Navarro edited comment on SPARK-10485 at 9/16/15 7:32 AM: ---

[jira] [Commented] (SPARK-10485) IF expression is not correctly resolved when one of the options have NullType

2015-09-16 Thread Antonio Jesus Navarro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14747089#comment-14747089 ] Antonio Jesus Navarro commented on SPARK-10485: --- Now, the bug is into the c

[jira] [Commented] (SPARK-10629) Gradient boosted trees: mapPartitions input size increasing

2015-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14747088#comment-14747088 ] Sean Owen commented on SPARK-10629: --- That sounds like the same issue in SPARK-10433; it

[jira] [Commented] (SPARK-10577) [PySpark] DataFrame hint for broadcast join

2015-09-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14747058#comment-14747058 ] Maciej BryƄski commented on SPARK-10577: Tested this patch today on a 1.5.0. Work

<    1   2   3