tgravescs commented on a change in pull request #30210:
URL: https://github.com/apache/spark/pull/30210#discussion_r520592244
##########
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
##########
@@ -1382,6 +1382,17 @@ object SQLConf {
.booleanConf
.createWithDefault(true)
+ val STATEFUL_OPERATOR_CORRECTNESS_CHECK_ENABLED =
+ buildConf("spark.sql.streaming.statefulOperator.correctnessCheck")
+ .internal()
+ .doc("When true, the stateful operators for streaming query will be
checked for possible " +
+ "correctness issue. Once the issue is detected, Spark will throw
analysis exception. " +
Review comment:
this should have more information about the correctness issue or point
to somewhere that does so users can properly make a decision.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
