HyukjinKwon commented on issue #20691: [SPARK-18161] [Python] Allow pickle to
serialize >4 GB objects when possible (Python 3.4+)
URL: https://github.com/apache/spark/pull/20691#issuecomment-455579458
That's cool. Looks fine so far. Do you mind if I ask to update PR title and
description
HyukjinKwon commented on issue #20691: [SPARK-18161] [Python] Allow pickle to
serialize >4 GB objects when possible (Python 3.4+)
URL: https://github.com/apache/spark/pull/20691#issuecomment-454352558
Just for clarification, @inpefess, this is kind of core fix that we all
should put a lot
HyukjinKwon commented on issue #20691: [SPARK-18161] [Python] Allow pickle to
serialize >4 GB objects when possible (Python 3.4+)
URL: https://github.com/apache/spark/pull/20691#issuecomment-453973722
Looks the test failures related. In the current master, it all passes fine.
HyukjinKwon commented on issue #20691: [SPARK-18161] [Python] Allow pickle to
serialize >4 GB objects when possible (Python 3.4+)
URL: https://github.com/apache/spark/pull/20691#issuecomment-453914324
retest this please
This
HyukjinKwon commented on issue #20691: [SPARK-18161] [Python] Allow pickle to
serialize >4 GB objects when possible (Python 3.4+)
URL: https://github.com/apache/spark/pull/20691#issuecomment-453800408
Let's give a shot for this in 3.0.0. Cloudpickle also changed its protocol a
long ago
HyukjinKwon commented on issue #20691: [SPARK-18161] [Python] Allow pickle to
serialize >4 GB objects when possible (Python 3.4+)
URL: https://github.com/apache/spark/pull/20691#issuecomment-453800378
ok to test
This is an
