[
https://issues.apache.org/jira/browse/SPARK-13866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197595#comment-15197595
]
Ruslan Dautkhanov commented on SPARK-13866:
-------------------------------------------
Would be great to have this fix in.
It makes schema inference not useful in some cases
https://github.com/databricks/spark-csv/issues/292
Thank you.
> Handle decimal type in CSV inference
> ------------------------------------
>
> Key: SPARK-13866
> URL: https://issues.apache.org/jira/browse/SPARK-13866
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Reporter: Hossein Falaki
>
> CSV Schema Inference does not check for decimal type. As a result large
> integers are cast as double. This is not desired outcome for many ID columns
> in real data scenarios.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
