[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/5218#issuecomment-86807495 LGTM pending jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5218#issuecomment-86823849 [Test build #29277 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29277/consoleFull) for PR 5218 at commit

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5218#issuecomment-86823880 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5218#issuecomment-86807377 [Test build #29277 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29277/consoleFull) for PR 5218 at commit

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5218#issuecomment-86817620 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5218#issuecomment-86805660 [Test build #29273 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29273/consoleFull) for PR 5218 at commit

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/5218#issuecomment-86834844 LGTM - merged into master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5218 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5218#issuecomment-86817610 [Test build #29273 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29273/consoleFull) for PR 5218 at commit

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5218#issuecomment-86803042 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/5218#discussion_r27274352 --- Diff: core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala --- @@ -49,10 +49,20 @@ class KryoSerializer(conf: SparkConf) with

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5218#discussion_r27274319 --- Diff: core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala --- @@ -49,10 +49,20 @@ class KryoSerializer(conf: SparkConf) with

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5218#issuecomment-86772772 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5218#issuecomment-86772747 [Test build #29260 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29260/consoleFull) for PR 5218 at commit

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5218#issuecomment-86775680 [Test build #29262 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29262/consoleFull) for PR 5218 at commit

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5218#issuecomment-86775705 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5218#issuecomment-86753012 [Test build #29262 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29262/consoleFull) for PR 5218 at commit

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5218#issuecomment-86751037 [Test build #29260 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29260/consoleFull) for PR 5218 at commit

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread mccheah
GitHub user mccheah opened a pull request: https://github.com/apache/spark/pull/5218 [SPARK-6405] Limiting the maximum Kryo buffer size to be 2GB. Kryo buffers are backed by byte arrays, but primitive arrays can only be up to 2GB in size. It is misleading to allow users to set

[GitHub] spark pull request: [SPARK-6405] Limiting the maximum Kryo buffer ...

2015-03-26 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5218#discussion_r27271009 --- Diff: core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala --- @@ -49,10 +49,20 @@ class KryoSerializer(conf: SparkConf) with