viirya commented on pull request #30162: URL: https://github.com/apache/spark/pull/30162#issuecomment-717666167
> either 1) make it as a configuration but prevent the value to be changed after the query starts (like we do in state store formats) Btw, out of curiosity, I check two state format configs `spark.sql.streaming.join.stateFormatVersion` and `spark.sql.streaming.aggregation.stateFormatVersion`. Their docs just explicitly claims that `state format version shouldn't be modified after running.`, and I don't find related code to prevent the values to be changed after the query starts. Maybe I miss it. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
