grundprinzip commented on PR #40525: URL: https://github.com/apache/spark/pull/40525#issuecomment-1501127314
Actually even today Pandas on Spark users have to install specific dependencies that are not part of the default PySpark installation. See https://github.com/apache/spark/blob/master/python/setup.py Now, the quickest fix is to simply add grpcio to the pandas on spark dependency list. Given that we're forcing Pandas users into specific Java versions etc adding grpcio does not make it worse in my opinion. The user surface remains the same. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
