HyukjinKwon edited a comment on issue #24521: [SPARK-27629][PySpark] Prevent Unpickler from intervening each unpickling URL: https://github.com/apache/spark/pull/24521#issuecomment-489270294 Nice try. My impression was that it somehow wrongly reuses that `memo` (and can't close the input stream - I overlooked) so was thinking we need a manual control after upgrading to 4.17 (so that we can access to `memo`) but looking into this again the fix looks correct.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
