dongjoon-hyun commented on PR #57040: URL: https://github.com/apache/spark/pull/57040#issuecomment-4898208593
> We can't do this unconditionally just because the latest 3.11.x supports it. For python users, it's very common to stay at a lower micro level (Python does not auto-upgrade). For those users, this will become an installation failure. They wouldn't know how to fix it. They would just blame spark. > > We need to either > > 1. Wait until all the supported python version supports it (we don't have restriction on micro versions) > 2. Check python version first before using the extra argument or has a fallback for the exception In general, you are right. However, I'm not sure that is still a valid assumption for this improvement JIRA issue for Apache Spark 5.0.0. Could you elaborate the mentioned comment environments a little more, please, @gaogaotiantian ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
