HeartSaVioR commented on code in PR #47104:
URL: https://github.com/apache/spark/pull/47104#discussion_r1671425939
##########
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/IncrementalExecution.scala:
##########
@@ -212,6 +212,7 @@ class IncrementalExecution(
case stateStoreWriter: StateStoreWriter =>
val metadata = stateStoreWriter.operatorStateMetadata()
// TODO: [SPARK-48849] Populate metadata with stateSchemaPaths if
metadata version is v2
+ // https://github.com/apache/spark/pull/47273
Review Comment:
Sorry, I meant Github PR comment. This code is going to be "committed" and
the PR is "proposal". Different level of confidence. Please remove these PR
links from code but leave them as Github PR comment.
##########
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/TransformWithStateExec.scala:
##########
@@ -384,6 +384,7 @@ case class TransformWithStateExec(
hadoopConf, stateSchemaDirPath(StateStoreId.DEFAULT_STORE_NAME).toString)
// TODO: [SPARK-48849] Read the schema path from the OperatorStateMetadata
file
// and validate it with the new schema
+ // https://github.com/apache/spark/pull/47273
Review Comment:
Same here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
