Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21157
To keep the current behaviour without the workaround above (using
CloudPickler), the weird fix is required
(https://github.com/apache/spark/pull/21180) where some private methods should
be used. I also gave few quick tries but looks not quite easy to fix.
It is a hack to remove and looks difficult to remove without any behaviour
change but still now a rough workaround looked possible (CloudPickler) so I
inclined to get rid of it at Spark 3.0 for now.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
