Yikun commented on PR #36699: URL: https://github.com/apache/spark/pull/36699#issuecomment-1143095923
@gatorsmile Thanks for post review, it's not a breaking change for pandas on spark behavior, no breaking changes from the user's point of view. It's just keep the behavior of Panda 1.3. Did you notice any other behavior changes after this PR? Of course, we can simply mention something like: `After Spark 3.4, the infer schema process of groupby.apply in Pandas on Spark, will first infer the pandas type to ensure the accuracy of the pandas dtype as much as possible`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
