[
https://issues.apache.org/jira/browse/SPARK-17226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15436158#comment-15436158
]
Hyukjin Kwon commented on SPARK-17226:
--------------------------------------
Codes to reproduce and suggestion maybe rather than just pointing the codes? I
guess it is arguable how to deal with this. There is actually already an issue
about this in external CSV library,
https://github.com/databricks/spark-csv/pull/359
> Allow defining multiple date formats per column in csv
> ------------------------------------------------------
>
> Key: SPARK-17226
> URL: https://issues.apache.org/jira/browse/SPARK-17226
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.0.0
> Reporter: Robert Kruszewski
> Priority: Minor
>
> Useful to have fallbacks in case of messy input and different columns can
> have different formats.
> https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVOptions.scala#L106
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]