[ https://issues.apache.org/jira/browse/SPARK-13866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197595#comment-15197595 ]
Ruslan Dautkhanov commented on SPARK-13866: ------------------------------------------- Would be great to have this fix in. It makes schema inference not useful in some cases https://github.com/databricks/spark-csv/issues/292 Thank you. > Handle decimal type in CSV inference > ------------------------------------ > > Key: SPARK-13866 > URL: https://issues.apache.org/jira/browse/SPARK-13866 > Project: Spark > Issue Type: Sub-task > Components: SQL > Reporter: Hossein Falaki > > CSV Schema Inference does not check for decimal type. As a result large > integers are cast as double. This is not desired outcome for many ID columns > in real data scenarios. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org