Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/21363#discussion_r189489932
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVInferSchema.scala
---
@@ -140,14 +141,23 @@ private[csv] object CSVInferSchema {
private def tryParseDouble(field: String, options: CSVOptions): DataType
= {
if ((allCatch opt field.toDouble).isDefined || isInfOrNan(field,
options)) {
DoubleType
+ } else {
+ tryParseDate(field, options)
--- End diff --
Is this a behavior change? Previously timestamp type, now date
type/timestamp type?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
