HyukjinKwon commented on issue #24521: [SPARK-27629][PySpark] Prevent Unpickler from intervening each unpickling URL: https://github.com/apache/spark/pull/24521#issuecomment-490333684 Shouldn't be a big diff and I don't think there's other ways to fix this issue even if there's perf diff. But yes, let's quickly run a simple job and check before/after to clarify the doubt. This was pointed out by @srowen too.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
