Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20774#discussion_r175335072
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -479,6 +479,15 @@ object SQLConf {
.checkValues(HiveCaseSensitiveInferenceMode.values.map(_.toString))
.createWithDefault(HiveCaseSensitiveInferenceMode.INFER_AND_SAVE.toString)
+ val HIVE_COMPARE_DATE_TIMESTAMP_IN_TIMESTAMP =
+ buildConf("spark.sql.hive.compareDateTimestampInTimestamp")
+ .doc("When true (default), compare Date with Timestamp after
converting both sides to " +
+ "Timestamp. This behavior is compatible with Hive 2.2 or later.
See HIVE-15236. " +
+ "When false, restore the behavior prior to Spark 2.4. Compare Date
with Timestamp after " +
+ "converting both sides to string.")
+ .booleanConf
--- End diff --
perhaps mention this config will be removed in spark 3.0.
(on a related note we should look at those configs for backward
compatibility and consider removing them in 3.0)
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
