[GitHub] spark pull request: SPARK-4044 [CORE] Thriftserver fails to start ...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4981#issuecomment-78287031 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2669] [yarn] Distribute client configur...

2015-03-11 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/4142#discussion_r26227193 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala --- @@ -120,6 +121,8 @@ class YarnClusterSuite extends FunSuite with

[GitHub] spark pull request: [SPARK-2669] [yarn] Distribute client configur...

2015-03-11 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/4142#discussion_r26231839 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala --- @@ -120,6 +121,8 @@ class YarnClusterSuite extends FunSuite with

[GitHub] spark pull request: SPARK-4044 [CORE] Thriftserver fails to start ...

2015-03-11 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/4981#issuecomment-78294531 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-5124][Core] A standard RPC interface an...

2015-03-11 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/4588#discussion_r26228790 --- Diff: core/src/main/scala/org/apache/spark/rpc/RpcEnv.scala --- @@ -0,0 +1,370 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: Dotname

2015-03-11 Thread mgdadv
GitHub user mgdadv opened a pull request: https://github.com/apache/spark/pull/4982 Dotname Check for . in data frame schame/column name, print a warning and replace the . with an _. The . is used as class/method separator in Python . You can merge this pull request into

[GitHub] spark pull request: Dotname

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4982#issuecomment-78286884 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5845] Time to cleanup spilled shuffle f...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4965#issuecomment-78305952 [Test build #28475 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28475/consoleFull) for PR 4965 at commit

[GitHub] spark pull request: [SPARK-5845] Time to cleanup spilled shuffle f...

2015-03-11 Thread ilganeli
Github user ilganeli commented on the pull request: https://github.com/apache/spark/pull/4965#issuecomment-78305887 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-4044 [CORE] Thriftserver fails to start ...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4981#issuecomment-78287009 [Test build #28474 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28474/consoleFull) for PR 4981 at commit

[GitHub] spark pull request: [SPARK-5845] Time to cleanup spilled shuffle f...

2015-03-11 Thread ilganeli
Github user ilganeli commented on a diff in the pull request: https://github.com/apache/spark/pull/4965#discussion_r26230494 --- Diff: core/src/main/scala/org/apache/spark/shuffle/sort/SortShuffleWriter.scala --- @@ -88,7 +88,13 @@ private[spark] class SortShuffleWriter[K, V, C](

[GitHub] spark pull request: [SPARK-6284][MESOS] Add mesos role, principal ...

2015-03-11 Thread tnachen
Github user tnachen commented on the pull request: https://github.com/apache/spark/pull/4960#issuecomment-78305260 @srowen Sorry missed your notification, opened a JIRA now --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-5987] [MLlib] Save/load for GaussianMix...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4986#issuecomment-78360647 [Test build #28481 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28481/consoleFull) for PR 4986 at commit

[GitHub] spark pull request: [SPARK-4894][mllib] Added Bernoulli option to ...

2015-03-11 Thread leahmcguire
Github user leahmcguire commented on a diff in the pull request: https://github.com/apache/spark/pull/4087#discussion_r26256579 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/classification/NaiveBayes.scala --- @@ -35,26 +39,30 @@ import org.apache.spark.sql.{DataFrame,

[GitHub] spark pull request: [SPARK-5814][MLLIB][GRAPHX] Remove JBLAS from ...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4699#issuecomment-78374902 [Test build #28484 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28484/consoleFull) for PR 4699 at commit

[GitHub] spark pull request: [SPARK-5987] [MLlib] Save/load for GaussianMix...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4986#issuecomment-78377018 [Test build #28481 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28481/consoleFull) for PR 4986 at commit

[GitHub] spark pull request: [SPARK-4894][mllib] Added Bernoulli option to ...

2015-03-11 Thread leahmcguire
Github user leahmcguire commented on a diff in the pull request: https://github.com/apache/spark/pull/4087#discussion_r26258688 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/classification/NaiveBayes.scala --- @@ -262,4 +303,58 @@ object NaiveBayes { def

[GitHub] spark pull request: [SPARK-3533] Add saveAsTextFileByKey() method ...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4895#issuecomment-78364659 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3533] Add saveAsTextFileByKey() method ...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4895#issuecomment-78370068 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5987] [MLlib] Save/load for GaussianMix...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4986#issuecomment-78377037 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4894][mllib] Added Bernoulli option to ...

2015-03-11 Thread leahmcguire
Github user leahmcguire commented on the pull request: https://github.com/apache/spark/pull/4087#issuecomment-78381145 @jkbradley thanks for the comments! I have implemented everything except the two inline comments that I replied to directly. I'm not clear about how you want the

[GitHub] spark pull request: [SPARK-3533] Add saveAsTextFileByKey() method ...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4895#issuecomment-78364402 [Test build #28479 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28479/consoleFull) for PR 4895 at commit

[GitHub] spark pull request: [SPARK-3533] Add saveAsTextFileByKey() method ...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4895#issuecomment-78364419 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5186, SPARK-5050, SPARK-4797][branch-1....

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4985#issuecomment-78372979 [Test build #28482 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28482/consoleFull) for PR 4985 at commit

[GitHub] spark pull request: [SPARK-5987] [MLlib] Save/load for GaussianMix...

2015-03-11 Thread MechCoder
GitHub user MechCoder opened a pull request: https://github.com/apache/spark/pull/4986 [SPARK-5987] [MLlib] Save/load for GaussianMixtureModels Should be self explanatory. You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: [SPARK-5987] [MLlib] Save/load for GaussianMix...

2015-03-11 Thread MechCoder
Github user MechCoder commented on the pull request: https://github.com/apache/spark/pull/4986#issuecomment-78360616 cc: @mengxr @jkbradley --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Added import for Spark Context

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4983#issuecomment-78314331 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5186][branch-1.2] Vector.hashCode is no...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4985#issuecomment-78346565 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3533] Add saveAsTextFileByKey() method ...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4895#issuecomment-78370048 [Test build #28480 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28480/consoleFull) for PR 4895 at commit

[GitHub] spark pull request: [SPARK-6209] Clean up connections in ExecutorC...

2015-03-11 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/4944#discussion_r26256855 --- Diff: repl/src/main/scala/org/apache/spark/repl/ExecutorClassLoader.scala --- @@ -71,30 +73,54 @@ class ExecutorClassLoader(conf: SparkConf, classUri:

[GitHub] spark pull request: [SPARK-5186][branch-1.2] Vector.hashCode is no...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4985#issuecomment-78373938 [Test build #28483 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28483/consoleFull) for PR 4985 at commit

[GitHub] spark pull request: [SPARK-6209] Clean up connections in ExecutorC...

2015-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4944#discussion_r26260907 --- Diff: repl/src/main/scala/org/apache/spark/repl/ExecutorClassLoader.scala --- @@ -71,30 +73,54 @@ class ExecutorClassLoader(conf: SparkConf, classUri:

[GitHub] spark pull request: [SPARK-5205][Streaming]:Inconsistent behaviour...

2015-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4135#discussion_r26236670 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala --- @@ -23,7 +23,9 @@ import scala.language.existentials

[GitHub] spark pull request: [SPARK-5186][branch-1.2] Vector.hashCode is no...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4985#issuecomment-78316744 [Test build #28476 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28476/consoleFull) for PR 4985 at commit

[GitHub] spark pull request: [SPARK-6222][STREAMING] Make sure batches are ...

2015-03-11 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/4964#issuecomment-78319536 I was just discussing this w/ Hari a bit, the one issue w/ this PR is having a test case to demonstrate the old problem, verify the fix, prevent regression. We have our

[GitHub] spark pull request: [SPARK-6128][Streaming][Documentation] Updates...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4956#issuecomment-78342013 [Test build #28477 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28477/consoleFull) for PR 4956 at commit

[GitHub] spark pull request: Added import for Spark Context

2015-03-11 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/4983#issuecomment-78315442 The code plainly compiles in master, as you can see from Jenkins builds. What are you compiling? --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: Added import for Spark Context

2015-03-11 Thread ChetanBhasin
Github user ChetanBhasin commented on the pull request: https://github.com/apache/spark/pull/4983#issuecomment-78317616 Right away. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [MESOS][SPARK-6287] Add dynamic allocation to ...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4984#issuecomment-78315443 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5205][Streaming]:Inconsistent behaviour...

2015-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4135#discussion_r26237198 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/ReceiverSuite.scala --- @@ -296,6 +332,27 @@ class ReceiverSuite extends TestSuiteBase with

[GitHub] spark pull request: Added import for Spark Context

2015-03-11 Thread ChetanBhasin
Github user ChetanBhasin closed the pull request at: https://github.com/apache/spark/pull/4983 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: [SPARK-5845] Time to cleanup spilled shuffle f...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4965#issuecomment-78335321 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6209] Clean up connections in ExecutorC...

2015-03-11 Thread mccheah
Github user mccheah commented on the pull request: https://github.com/apache/spark/pull/4944#issuecomment-78342955 This looks like the right thing to do. Thanks for submitting this! @ash211 @MingyuKim care to take a look? --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-5205][Streaming]:Inconsistent behaviour...

2015-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4135#discussion_r26236576 --- Diff: core/src/main/scala/org/apache/spark/TaskContextImpl.scala --- @@ -66,8 +66,21 @@ private[spark] class TaskContextImpl( /** Marks the task

[GitHub] spark pull request: [SPARK-6128][Streaming][Documentation] Updates...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4956#issuecomment-78356360 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: Added import for Spark Context

2015-03-11 Thread ChetanBhasin
GitHub user ChetanBhasin opened a pull request: https://github.com/apache/spark/pull/4983 Added import for Spark Context Added import for Spark Context so that methods such as reduceByKey may work. You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: Added import for Spark Context

2015-03-11 Thread ChetanBhasin
Github user ChetanBhasin commented on the pull request: https://github.com/apache/spark/pull/4983#issuecomment-78316490 Oh! I see. I might have messed up a few files between different versions on my end. I'll recheck the code on my end. Sorry for the useless request. --- If

[GitHub] spark pull request: [SPARK-3533] Add saveAsTextFileByKey() method ...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4895#issuecomment-78347963 [Test build #28478 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28478/consoleFull) for PR 4895 at commit

[GitHub] spark pull request: Added import for Spark Context

2015-03-11 Thread ChetanBhasin
Github user ChetanBhasin commented on the pull request: https://github.com/apache/spark/pull/4983#issuecomment-78315245 Actually no, it doesn't. This is what I got when I tried it without imports: /mllib/fpm/FPGrowth.scala:131: value reduceByKey is not a member of

[GitHub] spark pull request: [MESOS][SPARK-6287] Add dynamic allocation to ...

2015-03-11 Thread dragos
GitHub user dragos opened a pull request: https://github.com/apache/spark/pull/4984 [MESOS][SPARK-6287] Add dynamic allocation to the coarse-grained Mesos scheduler This is largely based on extracting the dynamic allocation parts from @tnachen's #3861. You can merge this

[GitHub] spark pull request: [SPARK-5205][Streaming]:Inconsistent behaviour...

2015-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4135#discussion_r26236828 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/ReceiverSuite.scala --- @@ -129,6 +130,41 @@ class ReceiverSuite extends TestSuiteBase with

[GitHub] spark pull request: [SPARK-5205][Streaming]:Inconsistent behaviour...

2015-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4135#discussion_r26236688 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala --- @@ -295,6 +297,14 @@ class ReceiverTracker(ssc:

[GitHub] spark pull request: Added import for Spark Context

2015-03-11 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/4983#issuecomment-78317327 OK. Mind closing this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-5845] Time to cleanup spilled shuffle f...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4965#issuecomment-78334698 [Test build #28475 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28475/consoleFull) for PR 4965 at commit

[GitHub] spark pull request: [SPARK-3533] Add saveAsTextFileByKey() method ...

2015-03-11 Thread ilganeli
Github user ilganeli commented on the pull request: https://github.com/apache/spark/pull/4895#issuecomment-78348599 Hi @nchammas, I believe I've resolved the issues I had with the code and I've added a test case to the RDDPairFunctionsSuite that checks that the files were created and

[GitHub] spark pull request: [SPARK-3533] Add saveAsTextFileByKey() method ...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4895#issuecomment-78353494 [Test build #28480 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28480/consoleFull) for PR 4895 at commit

[GitHub] spark pull request: [SPARK-5205][Streaming]:Inconsistent behaviour...

2015-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4135#discussion_r26237173 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/ReceiverSuite.scala --- @@ -129,6 +130,41 @@ class ReceiverSuite extends TestSuiteBase with

[GitHub] spark pull request: [SPARK-5186][branch-1.2] Vector.hashCode is no...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4985#issuecomment-78389759 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6269] Use a different implementation of...

2015-03-11 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/4972#discussion_r26265216 --- Diff: core/src/main/scala/org/apache/spark/util/ArrayReflect.java --- @@ -0,0 +1,357 @@ +/* --- End diff -- Hm, yes we could. Scala

[GitHub] spark pull request: [SPARK-6297] EventLog permissions are always s...

2015-03-11 Thread lustefaniak
GitHub user lustefaniak opened a pull request: https://github.com/apache/spark/pull/4989 [SPARK-6297] EventLog permissions are always set to 770 which causes problems By default permissions are set to 770, which in some cases is more problematic than relying on umask. If

[GitHub] spark pull request: [SPARK-6030][CORE] Using simulated field layou...

2015-03-11 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/4783#issuecomment-78407056 @advancedxy Do the tests pass on your local machine ? It looks the ExternalSorter uses a size-tracking hash map which in turn depends on the SizeEstimator. So I am

[GitHub] spark pull request: [SPARK-6294] fix hang when call take() in JVM ...

2015-03-11 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/4987 [SPARK-6294] fix hang when call take() in JVM on PythonRDD The Thread.interrupt() can not terminate the thread in some cases, so we should not wait for the writerThread of PythonRDD. This

[GitHub] spark pull request: [SPARK-6296] Added equals to Column

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4988#issuecomment-78404792 [Test build #28488 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28488/consoleFull) for PR 4988 at commit

[GitHub] spark pull request: [SPARK-6297] EventLog permissions are always s...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4989#issuecomment-78406084 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6030][CORE] Using simulated field layou...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4783#issuecomment-78406716 [Test build #28486 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28486/consoleFull) for PR 4783 at commit

[GitHub] spark pull request: [SPARK-6030][CORE] Using simulated field layou...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4783#issuecomment-78406725 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5484] Checkpoint every 25 iterations in...

2015-03-11 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/4273#issuecomment-78384266 Mind tagging this [GRAPHX] so it can get sorted properly? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-3976] Added repartitioning for BlockMat...

2015-03-11 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/4286#issuecomment-78384187 @brkyvz mind tagging this [MLLIB] so it can get sorted properly? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-6209] Clean up connections in ExecutorC...

2015-03-11 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/4944#discussion_r26262063 --- Diff: repl/src/main/scala/org/apache/spark/repl/ExecutorClassLoader.scala --- @@ -71,30 +73,54 @@ class ExecutorClassLoader(conf: SparkConf, classUri:

[GitHub] spark pull request: [SPARK-3382] GradientDescent convergence toler...

2015-03-11 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/3636#issuecomment-78386542 @Lewuathe mind placing [MLLIB] in the title so that this can get sorted properly? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-4950] Delete obsolete mapReduceTripelet...

2015-03-11 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/3782#issuecomment-78386436 @maropu mind including [GRAPHX] in the title so that this can get sorted properly? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-03-11 Thread industrial-sloth
Github user industrial-sloth commented on the pull request: https://github.com/apache/spark/pull/3858#issuecomment-78387422 @sryza No problem, done. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-6128][Streaming][Documentation] Updates...

2015-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4956#discussion_r26262942 --- Diff: docs/streaming-programming-guide.md --- @@ -1327,6 +1420,178 @@ Note that the connections in the pool should be lazily created on demand and tim

[GitHub] spark pull request: [SPARK-3665] Java API for GraphX

2015-03-11 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/3234#issuecomment-78388389 Mind tagging this with [GRAPHX] so it can get sorted properly? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-4894][mllib] Added Bernoulli option to ...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4087#issuecomment-78389593 [Test build #28485 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28485/consoleFull) for PR 4087 at commit

[GitHub] spark pull request: [SPARK-5186][branch-1.2] Vector.hashCode is no...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4985#issuecomment-78389755 [Test build #28482 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28482/consoleFull) for PR 4985 at commit

[GitHub] spark pull request: [SPARK-6030][CORE] Using simulated field layou...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4783#issuecomment-78401317 [Test build #28486 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28486/consoleFull) for PR 4783 at commit

[GitHub] spark pull request: [SPARK-6294] fix hang when call take() in JVM ...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4987#issuecomment-78402380 [Test build #28487 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28487/consoleFull) for PR 4987 at commit

[GitHub] spark pull request: SPARK-4226: Add support for subqueries in wher...

2015-03-11 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/3888#issuecomment-78385690 @saucam if this is going to stay open, mind tagging it with [SQL] so it gets sorted properly? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-6128][Streaming][Documentation] Updates...

2015-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4956#discussion_r26262224 --- Diff: docs/streaming-programming-guide.md --- @@ -1327,6 +1420,178 @@ Note that the connections in the pool should be lazily created on demand and tim

[GitHub] spark pull request: [SPARK-6079] Use index to speed up StatusTrack...

2015-03-11 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/4830#discussion_r26263292 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/JobProgressListener.scala --- @@ -109,7 +111,8 @@ class JobProgressListener(conf: SparkConf) extends

[GitHub] spark pull request: [SPARK-5814][MLLIB][GRAPHX] Remove JBLAS from ...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4699#issuecomment-78388981 [Test build #28484 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28484/consoleFull) for PR 4699 at commit

[GitHub] spark pull request: [SPARK-5814][MLLIB][GRAPHX] Remove JBLAS from ...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4699#issuecomment-78388992 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4894][mllib] Added Bernoulli option to ...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4087#issuecomment-78400178 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4894][mllib] Added Bernoulli option to ...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4087#issuecomment-78400160 [Test build #28485 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28485/consoleFull) for PR 4087 at commit

[GitHub] spark pull request: [SPARK-6185][SQL] Deltele repeated TOKEN. TOK...

2015-03-11 Thread DoingDone9
Github user DoingDone9 closed the pull request at: https://github.com/apache/spark/pull/4907 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-6185][SQL] Deltele repeated TOKEN. TOK...

2015-03-11 Thread DoingDone9
Github user DoingDone9 commented on the pull request: https://github.com/apache/spark/pull/4907#issuecomment-78404973 yes i will close it @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6128][Streaming][Documentation] Updates...

2015-03-11 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4956#discussion_r26271367 --- Diff: docs/streaming-programming-guide.md --- @@ -1327,6 +1420,178 @@ Note that the connections in the pool should be lazily created on demand and tim

[GitHub] spark pull request: [SPARK-6209] Clean up connections in ExecutorC...

2015-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4944#discussion_r26261715 --- Diff: repl/src/main/scala/org/apache/spark/repl/ExecutorClassLoader.scala --- @@ -71,30 +73,54 @@ class ExecutorClassLoader(conf: SparkConf, classUri:

[GitHub] spark pull request: [SPARK-5186][branch-1.2] Vector.hashCode is no...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4985#issuecomment-78389244 [Test build #28483 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28483/consoleFull) for PR 4985 at commit

[GitHub] spark pull request: [SPARK-5186][branch-1.2] Vector.hashCode is no...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4985#issuecomment-78389258 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6296] Added equals to Column

2015-03-11 Thread vlyubin
GitHub user vlyubin opened a pull request: https://github.com/apache/spark/pull/4988 [SPARK-6296] Added equals to Column You can merge this pull request into a Git repository by running: $ git pull https://github.com/vlyubin/spark columncomp Alternatively you can review and

[GitHub] spark pull request: [SPARK-6274][Streaming][Examples] Added exampl...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4975#issuecomment-78209601 [Test build #28463 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28463/consoleFull) for PR 4975 at commit

[GitHub] spark pull request: [SPARK-5205][Streaming]:Inconsistent behaviour...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4135#issuecomment-78209607 **[Test build #28459 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28459/consoleFull)** for PR 4135 at commit

[GitHub] spark pull request: [SPARK-5205][Streaming]:Inconsistent behaviour...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4135#issuecomment-78209621 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6211][Streaming] Add Python Kafka API u...

2015-03-11 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/4961#issuecomment-78214522 Looks like it is a difference between Maven and SBT, `run-tests` script package the jars using maven do not generate kafka-assembly fat jar. I'm going to find out a

[GitHub] spark pull request: [SPARK-6025] [MLlib] Add helper method evaluat...

2015-03-11 Thread MechCoder
Github user MechCoder commented on a diff in the pull request: https://github.com/apache/spark/pull/4906#discussion_r26192410 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/tree/loss/Loss.scala --- @@ -49,4 +49,14 @@ trait Loss extends Serializable { */ def

[GitHub] spark pull request: [SPARK-6278][MLLIB] Mention the change of obje...

2015-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4978#issuecomment-78218757 [Test build #28465 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28465/consoleFull) for PR 4978 at commit

[GitHub] spark pull request: [SPARK-4924] Add a library for launching Spark...

2015-03-11 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/3916#issuecomment-78219718 Okay cool - LGTM I will pull this in. I just did some local sanity tests, built with Maven and ran (a few) Maven tests. We'll need to keep any eye on the Maven build

[GitHub] spark pull request: [SPARK-6274][Streaming][Examples] Added exampl...

2015-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4975#issuecomment-78216043 Test PASSed. Refer to this link for build results (access rights to CI server needed):

  1   2   3   >