HeartSaVioR commented on PR #37026: URL: https://github.com/apache/spark/pull/37026#issuecomment-1170842397
Hello, I see it's more likely ease of tests for flatMapGroupsWithState. We added the utility class in Spark 3.2.0 which allows end users to test the user function of flatMapGroupsWithState with test-purpose GroupState implementation. With this approach, end users don't even need to run the streaming query - they just need to call their user function with the TestGroupState. https://spark.apache.org/docs/latest/api/scala/org/apache/spark/sql/streaming/TestGroupState.html Could you please check whether this utility class fulfills your requirement? Thanks in advance. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
