[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20691 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20691 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87852/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20691 **[Test build #87852 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87852/testReport)** for PR 20691 at commit [`e15eb63`](https://github.com/apache/spark/commit/e15eb636ef421656df817612b1900d2e953e545a). * This patch **fails PySpark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20691 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20691 **[Test build #87852 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87852/testReport)** for PR 20691 at commit [`e15eb63`](https://github.com/apache/spark/commit/e15eb636ef421656df817612b1900d2e953e545a). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user inpefess commented on the issue: https://github.com/apache/spark/pull/20691 Well, actually I just wanted to simply merge an older seemingly straightforward PR https://github.com/apache/spark/pull/15670 :) And @holdenk warned me that "it _should_ just be fixing the merge conflicts". So now I will fix this unit-tests failure and add a (disabled by default) test that @hvanhovell suggested. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20691 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20691 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/8/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20691 **[Test build #8 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/8/testReport)** for PR 20691 at commit [`e08fcae`](https://github.com/apache/spark/commit/e08fcaeae14c709ddeaee54820c0578e18ecbb2e). * This patch **fails PySpark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/20691 I am not sure that adding such a test is very good for test stability, but we could disable it by default. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20691 **[Test build #8 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/8/testReport)** for PR 20691 at commit [`e08fcae`](https://github.com/apache/spark/commit/e08fcaeae14c709ddeaee54820c0578e18ecbb2e). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/20691 good point, it would be good to add test case for > 4GB object. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/20691 Have you tried serializing an array larger than 2GB? There is a pretty big chance that we do not support on the Spark side. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/20691 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/20691 hmmm - jenkins seems not to be playing ball --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20691 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20691 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB o...
Github user inpefess commented on the issue: https://github.com/apache/spark/pull/20691 @holdenk review needed --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
