MaxGekk commented on code in PR #37147:
URL: https://github.com/apache/spark/pull/37147#discussion_r925897675
##########
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:
##########
@@ -111,6 +111,17 @@ private[sql] class JSONOptions(
val timestampNTZFormatInWrite: String =
parameters.getOrElse("timestampNTZFormat",
s"${DateFormatter.defaultPattern}'T'HH:mm:ss[.SSS]")
+ // SPARK-39731: Enables the backward compatible parsing behavior.
+ // Generally, this config should be set to false to avoid producing
potentially incorrect results
+ // which is the current default (see UnivocityParser).
Review Comment:
Don't think that we should refer to internal CSV parser from JSON options.
Could you rewrite this, please.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
