HyukjinKwon commented on code in PR #58613:
URL: https://github.com/apache/spark/pull/58613#discussion_r3962605432
##########
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##########
@@ -3913,6 +3913,19 @@ object SQLConf {
.booleanConf
.createWithDefault(false)
+ val KAFKA_DISALLOWED_OPTIONS =
+ buildConf("spark.sql.kafka.disallowedOptions")
+ .internal()
+ .doc("A comma-separated list of Kafka client option names (without the
'kafka.' prefix) " +
+ "that are not allowed to be set through Kafka source/sink options.
Empty by default, " +
+ "which allows all options and preserves the previous behavior; when
non-empty, setting a " +
+ "listed option raises an error.")
+ .version("4.3.0")
Review Comment:
Yes, this is intentionally targeting 4.3.0 rather than 4.4.0. The rationale
is being discussed on a private channel, so I can't share the details here --
happy to follow up offline. Thanks for checking.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
