Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/19467#discussion_r144406113
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/statefulOperators.scala
---
@@ -239,7 +240,7 @@ case class StateStoreRestoreExec(
if (keyExpressions.isEmpty) {
AllTuples :: Nil
} else {
- ClusteredDistribution(keyExpressions) :: Nil
+ ClusteredDistribution(keyExpressions,
stateInfo.map(_.numPartitions)) :: Nil
--- End diff --
need tests for these
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
