MaxGekk commented on a change in pull request #27092: [SPARK-30416][SQL] Log a
warning for deprecated SQL config in `set()` and `unset()`
URL: https://github.com/apache/spark/pull/27092#discussion_r364185675
##########
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
##########
@@ -200,6 +200,38 @@ object SQLConf {
Map(configs.map { cfg => cfg.key -> cfg } : _*)
}
+ /**
+ * Holds information about keys that have been deprecated.
+ *
+ * @param key The deprecated key.
+ * @param version Version of Spark where key was deprecated.
+ * @param comment Additional info regarding to the removed config. For
example,
+ * reasons of config deprecation, what users should use
instead of it.
+ */
+ case class DeprecatedConfig(key: String, version: String, comment: String)
+
+ /**
+ * Maps deprecated SQL config keys to information about the deprecation.
+ *
+ * The extra information is logged as a warning when the SQL config is
present
+ * in the user's configuration.
+ */
+ val deprecatedSQLConfigs: Map[String, DeprecatedConfig] = {
+ val configs = Seq(
+ DeprecatedConfig("spark.sql.hive.verifyPartitionPath", "3.0.0",
Review comment:
I added others
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
