Hyukjin Kwon created SPARK-17388:
------------------------------------
Summary: Support for inferring type date/timestamp for partition
column
Key: SPARK-17388
URL: https://issues.apache.org/jira/browse/SPARK-17388
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 2.0.0
Reporter: Hyukjin Kwon
Priority: Minor
Currently, Spark only supports to infer {{IntegerType}}, {{LongType}},
{{DoubleType}} and {{StringType}}.
{{DecimalType}} is being tried but it seems it never infers type as
{{DecimalType}} as {{DoubleType}} is being tried first.
Also, {{DateType}} and {{TimestampType}} can be inferred. It seems it is a
pretty common to use both for a partition column.
It'd be great if they can be inferred as both rather than just {{StringType}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
