Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/20373
I think it's fine in cloudpickle but Spark has the hijacking for regular
pickling. I was thinking of a possibility for a deduplicated fix but might have
to be investigated separately.
Let's hold this on a bit until the release of 2.3.0 as it's going to go
into master anyway (I think). Seems it's been delayed unexpectedly and we
better keep the diff small between master and branch-2.3 for now. Will keep my
eyes on this PR anyway.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
