anishshri-db commented on PR #49630: URL: https://github.com/apache/spark/pull/49630#issuecomment-2611059427
cc - @HeartSaVioR - PTAL there are a couple different ways to fix this: - document the existing behavior as a limitation - add a new flag and change the behavior if the feature is enabled (which is a moderate'ish change) Also, with the new `transformWithState` operator not having this issue - I wonder whether we should just document this case as such -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
