awdavidson commented on PR #36120: URL: https://github.com/apache/spark/pull/36120#issuecomment-1094124683
> @awdavidson would you say `mapInPandas` should be made behave similarly to `applyInPandas` or rather not touch existing relaxation on DataFrame schema constraints? To summarize, `mapInPandas` does not raise error when returned DataFrame has more columns than specified in schema argument, while `applyInPandas` does raise an error. I guess I would expect the output to have the specified schema so IMO it would make sense to raise an error when the result is different. It’ll be good to see what others say -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
