Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/20373
@holdenk @HyukjinKwon it seemed like mostly straightforward fixes/cleanups
to match cloudpickle 0.4.2 but you two are way more experienced here than me.
Are there any concerns over these updates or additional tests to run?
I did test that namedtuple pickling works with the new fix in cloudpickle,
but since the standard pickle still fails we still need the hijack workaround
in Spark.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]