dbatomic commented on PR #45951: URL: https://github.com/apache/spark/pull/45951#issuecomment-2045206195
> What about disallowing this first? It's not only streaming aggregation. We will need to do the same approach for every stateful operator. Before we see the clear path forward, let's prevent the correctness issue for now. Yeah, let's go with this change. Once hash agg support change goes in we can try to enable the streaming code. Btw, thank you for adding the test! We will use that as the starting point. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
