[jira] [Closed] (SPARK-24256) ExpressionEncoder should support user-defined types as fields of Scala case class and tuple

[ https://issues.apache.org/jira/browse/SPARK-24256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li closed SPARK-24256. -- > ExpressionEncoder should support user-defined types as fields of Scala case > class and tuple >

[jira] [Resolved] (SPARK-24256) ExpressionEncoder should support user-defined types as fields of Scala case class and tuple

[ https://issues.apache.org/jira/browse/SPARK-24256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li resolved SPARK-24256. Resolution: Won't Fix > ExpressionEncoder should support user-defined types as fields of Scala

[jira] [Commented] (SPARK-24256) ExpressionEncoder should support user-defined types as fields of Scala case class and tuple

[ https://issues.apache.org/jira/browse/SPARK-24256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603800#comment-16603800 ] Fangshi Li commented on SPARK-24256: To summarize our discussion for this pr: Spark-avro is now

[jira] [Updated] (SPARK-24287) Spark -packages option should support classifier, no-transitive, and custom conf

[ https://issues.apache.org/jira/browse/SPARK-24287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li updated SPARK-24287: --- Summary: Spark -packages option should support classifier, no-transitive, and custom conf (was:

[jira] [Updated] (SPARK-24287) Spark 2.x -packages option should support classifier, no-transitive, and custom conf

[ https://issues.apache.org/jira/browse/SPARK-24287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li updated SPARK-24287: --- Description: We should extend Spark's -package option to support: # Turn-off transitive dependency

[jira] [Updated] (SPARK-24287) Spark 2.x -packages option should support classifier, no-transitive, and custom conf

[ https://issues.apache.org/jira/browse/SPARK-24287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li updated SPARK-24287: --- Description: We should extend Spark's -package option to support: # Turn-off transitive dependency

[jira] [Created] (SPARK-24287) Spark 2.x -packages option should support classifier, no-transitive, and custom conf

Fangshi Li created SPARK-24287: -- Summary: Spark 2.x -packages option should support classifier, no-transitive, and custom conf Key: SPARK-24287 URL: https://issues.apache.org/jira/browse/SPARK-24287

[jira] [Updated] (SPARK-24256) ExpressionEncoder should support user-defined types as fields of Scala case class and tuple

[ https://issues.apache.org/jira/browse/SPARK-24256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li updated SPARK-24256: --- Description: Right now, ExpressionEncoder supports ser/de of primitive types, as well as scala case

[jira] [Updated] (SPARK-24256) ExpressionEncoder should support user-defined types as fields of Scala case class and tuple

[ https://issues.apache.org/jira/browse/SPARK-24256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li updated SPARK-24256: --- Description: Right now, ExpressionEncoder supports ser/de of primitive types, as well as scala case

[jira] [Updated] (SPARK-24256) ExpressionEncoder should support user-defined types as fields of Scala case class and tuple

[ https://issues.apache.org/jira/browse/SPARK-24256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li updated SPARK-24256: --- Description: Right now, ExpressionEncoder supports ser/de of primitive types, as well as scala case

[jira] [Created] (SPARK-24256) ExpressionEncoder should support user-defined types as fields of Scala case class and tuple

Fangshi Li created SPARK-24256: -- Summary: ExpressionEncoder should support user-defined types as fields of Scala case class and tuple Key: SPARK-24256 URL: https://issues.apache.org/jira/browse/SPARK-24256

[jira] [Updated] (SPARK-24216) Spark TypedAggregateExpression uses getSimpleName that is not safe in scala

[ https://issues.apache.org/jira/browse/SPARK-24216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li updated SPARK-24216: --- Description: When user create a aggregator object in scala and pass the aggregator to Spark

[jira] [Updated] (SPARK-23862) Spark ExpressionEncoder should support java enum type in scala

[ https://issues.apache.org/jira/browse/SPARK-23862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li updated SPARK-23862: --- Issue Type: Bug (was: Improvement) > Spark ExpressionEncoder should support java enum type in scala

[jira] [Updated] (SPARK-24216) Spark TypedAggregateExpression uses getSimpleName that is not safe in scala

[ https://issues.apache.org/jira/browse/SPARK-24216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li updated SPARK-24216: --- Description: When we create a aggregator object within a function in scala and pass the aggregator

[jira] [Updated] (SPARK-24216) Spark TypedAggregateExpression uses getSimpleName that is not safe in scala

[ https://issues.apache.org/jira/browse/SPARK-24216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li updated SPARK-24216: --- Description: When we create a aggregator object within a function in scala and pass the aggregator

[jira] [Created] (SPARK-24216) Spark TypedAggregateExpression uses getSimpleName that is not safe in scala

Fangshi Li created SPARK-24216: -- Summary: Spark TypedAggregateExpression uses getSimpleName that is not safe in scala Key: SPARK-24216 URL: https://issues.apache.org/jira/browse/SPARK-24216 Project:

[jira] [Updated] (SPARK-23815) Spark writer dynamic partition overwrite mode fails to write output on multi level partition

[ https://issues.apache.org/jira/browse/SPARK-23815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li updated SPARK-23815: --- Priority: Major (was: Minor) > Spark writer dynamic partition overwrite mode fails to write output

[jira] [Updated] (SPARK-23815) Spark writer dynamic partition overwrite mode fails to write output on multi level partition

[ https://issues.apache.org/jira/browse/SPARK-23815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li updated SPARK-23815: --- Description: Spark introduced new writer mode to overwrite only related partitions in SPARK-20236.

[jira] [Commented] (SPARK-21255) NPE when creating encoder for enum

[ https://issues.apache.org/jira/browse/SPARK-21255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425832#comment-16425832 ] Fangshi Li commented on SPARK-21255: created a follow up issue to add the java enum support in scala

[jira] [Comment Edited] (SPARK-21255) NPE when creating encoder for enum

[ https://issues.apache.org/jira/browse/SPARK-21255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425832#comment-16425832 ] Fangshi Li edited comment on SPARK-21255 at 4/4/18 4:44 PM: created a follow

[jira] [Created] (SPARK-23862) Spark ExpressionEncoder should support java enum type in scala

Fangshi Li created SPARK-23862: -- Summary: Spark ExpressionEncoder should support java enum type in scala Key: SPARK-23862 URL: https://issues.apache.org/jira/browse/SPARK-23862 Project: Spark

[jira] [Created] (SPARK-23815) Spark writer dynamic partition overwrite mode fails to write output on multi level partition

Fangshi Li created SPARK-23815: -- Summary: Spark writer dynamic partition overwrite mode fails to write output on multi level partition Key: SPARK-23815 URL: https://issues.apache.org/jira/browse/SPARK-23815