[GitHub] spark pull request: [SPARK-1332] Improve Spark Streaming's Network...

2014-04-16 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/300#discussion_r11721049 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/receiver/NetworkReceiver.scala --- @@ -0,0 +1,209 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: [SPARK-1506][MLLIB] Documentation improvements...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/422#issuecomment-40686088 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14200/ --- If your project is set up for it, you can r

[GitHub] spark pull request: [SPARK-1506][MLLIB] Documentation improvements...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/422#issuecomment-40686086 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1382: Fix NPE in DStream.slice

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/365#issuecomment-40686035 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1382: Fix NPE in DStream.slice

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/365#issuecomment-40686031 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-1382: Fix NPE in DStream.slice

2014-04-16 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/365#issuecomment-40685935 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [WIP] SPARK-1192: The document for most of the...

2014-04-16 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/85#issuecomment-40685792 @CodingCat do you mind submitting a separate PR for the Scala files? We can update documentation changes anytime we want. --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-1332] Improve Spark Streaming's Network...

2014-04-16 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/300#discussion_r11720795 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/receiver/NetworkReceiver.scala --- @@ -0,0 +1,209 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: [SPARK-1332] Improve Spark Streaming's Network...

2014-04-16 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/300#discussion_r11720775 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/receiver/NetworkReceiver.scala --- @@ -0,0 +1,209 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-1462: Examples of ML algorithms are usin...

2014-04-16 Thread techaddict
Github user techaddict commented on the pull request: https://github.com/apache/spark/pull/416#issuecomment-40685643 @pwendell :smile: i think this also closes SPARK-1464 ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: SPARK-1382: Fix NPE in DStream.slice

2014-04-16 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/365#issuecomment-40685083 Changing to `SparkExcepation` should not break the API since `SparkExcepation` is a subclass of `Exception`. --- If your project is set up for it, you can reply to this e

[GitHub] spark pull request: SPARK-1462: Examples of ML algorithms are usin...

2014-04-16 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/416#issuecomment-40684649 @techaddict thanks for doing this! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11720277 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala --- @@ -333,15 +325,29 @@ trait ClientBase extends Logging { if (u

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11720287 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -123,6 +142,14 @@ object SparkSubmit { val options = List[OptionAssi

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11720264 --- Diff: docs/configuration.md --- @@ -666,13 +696,7 @@ The following variables can be set in `spark-env.sh`: * `JAVA_HOME`, the location where Java is i

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11720122 --- Diff: yarn/stable/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala --- @@ -42,6 +42,9 @@ import org.apache.spark.deploy.SparkHadoopU

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11720118 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala --- @@ -424,29 +431,29 @@ object ClientBase { } }

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11720080 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala --- @@ -333,15 +325,29 @@ trait ClientBase extends Logging { if

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11720047 --- Diff: docs/configuration.md --- @@ -666,13 +696,7 @@ The following variables can be set in `spark-env.sh`: * `JAVA_HOME`, the location where Java is

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11720017 --- Diff: docs/configuration.md --- @@ -643,6 +646,34 @@ Apart from these, the following properties are also available, and may be useful Number of

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11719981 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/SparkDeploySchedulerBackend.scala --- @@ -42,11 +42,21 @@ private[spark] class SparkDeploy

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11719922 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -123,6 +142,14 @@ object SparkSubmit { val options = List[Optio

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11719892 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -108,6 +112,21 @@ object SparkSubmit { val sysProps = new HashMap[Str

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11719879 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -17,14 +17,17 @@ package org.apache.spark.deploy -import

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11719873 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -17,14 +17,17 @@ package org.apache.spark.deploy -import

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11719747 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -208,6 +208,81 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with Loggin

[GitHub] spark pull request: [SPARK-1506][MLLIB] Documentation improvements...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/422#issuecomment-40682760 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1506][MLLIB] Documentation improvements...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/422#issuecomment-40682753 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-1483: Rename minSplits to minPartitions ...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/430#issuecomment-40682524 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1483: Rename minSplits to minPartitions ...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/430#issuecomment-40682518 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-1483: Rename minSplits to minPartitions ...

2014-04-16 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/430#issuecomment-40682308 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: SPARK-1483: Rename minSplits to minPartitions ...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/430#issuecomment-40681911 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1483: Rename minSplits to minPartitions ...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/430#issuecomment-40681913 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14199/ --- If your project is set up for it, you can r

[GitHub] spark pull request: [WIP][SPARK-1506][MLLIB] Documentation improve...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/422#issuecomment-40681856 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [WIP][SPARK-1506][MLLIB] Documentation improve...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/422#issuecomment-40681854 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11718975 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -208,6 +208,81 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with Logging {

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11718991 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -208,6 +208,81 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with Logging {

[GitHub] spark pull request: Clean up and simplify Spark configuration

2014-04-16 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/299#discussion_r11718962 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -123,6 +142,14 @@ object SparkSubmit { val options = List[OptionAssi

[GitHub] spark pull request: SPARK-1483: Rename minSplits to minPartitions ...

2014-04-16 Thread CodingCat
Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/430#issuecomment-40678433 @rxin thanks for the comments, just addressed that and wait for Jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on G

[GitHub] spark pull request: SPARK-1483: Rename minSplits to minPartitions ...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/430#issuecomment-40678230 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-1483: Rename minSplits to minPartitions ...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/430#issuecomment-40678240 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: pyspark need Py2 to work, graceful and helping...

2014-04-16 Thread abhishekkr
Github user abhishekkr commented on the pull request: https://github.com/apache/spark/pull/392#issuecomment-40677223 @rxin sure Gets Fixed via #399 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: pyspark need Py2 to work, graceful and helping...

2014-04-16 Thread abhishekkr
Github user abhishekkr closed the pull request at: https://github.com/apache/spark/pull/392 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] spark pull request: Add role and checkpoint support for Mesos back...

2014-04-16 Thread iven
Github user iven commented on the pull request: https://github.com/apache/spark/pull/60#issuecomment-40677116 I run SparkPi serveral times, and get different results: 1. With slices < 200, the executors all succeeds, and the framework gives correct result. 2. With slices > 400,

[GitHub] spark pull request: SPARK-1382: Fix NPE in DStream.slice

2014-04-16 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/365#discussion_r11717029 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/DStream.scala --- @@ -725,6 +725,9 @@ abstract class DStream[T: ClassTag] ( * Return

[GitHub] spark pull request: SPARK-1382: Fix NPE in DStream.slice

2014-04-16 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/365#discussion_r11716967 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/DStream.scala --- @@ -725,6 +725,9 @@ abstract class DStream[T: ClassTag] ( * Ret

[GitHub] spark pull request: [python alternative] pyspark require Python2, ...

2014-04-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/399 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: SPARK-1311 Map side distinct in collect vertex...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/21#issuecomment-40675112 Build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: improve the readability of SparkContext.scala

2014-04-16 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/414#issuecomment-40675137 From the side of the life cycle for component, only stop method is incomplete, and the initialize code , start code written separately is better --- If your project is set

[GitHub] spark pull request: [Streaming] SPARK-1510: Add Spark Streaming me...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/424#issuecomment-40675113 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [Streaming] SPARK-1510: Add Spark Streaming me...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/424#issuecomment-40675114 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14197/ --- If your project is set up for it, you can r

[GitHub] spark pull request: SPARK-1311 Map side distinct in collect vertex...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/21#issuecomment-40675115 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14198/ --- If your project i

[GitHub] spark pull request: SPARK-1470: Spark logger moving to use scala-l...

2014-04-16 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/332#issuecomment-40674103 ``` scala // inline while (i < 100) { if (log.isInfoEnabled) // will only perform here more than micro println("" + Thread.currentThread.getStackTra

[GitHub] spark pull request: [SPARK-1332] Improve Spark Streaming's Network...

2014-04-16 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/300#issuecomment-40673583 Let me look at the failed unit tests. Should not affect PR too much, I think. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [python alternative] pyspark require Python2, ...

2014-04-16 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/399#issuecomment-40673509 Thanks. Merged. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark pull request: [SPARK-1332] Improve Spark Streaming's Network...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/300#issuecomment-40673438 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14193/ --- If your project is set up for it, you can r

[GitHub] spark pull request: [WIP][SPARK-1506][MLLIB] Documentation improve...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/422#issuecomment-40673440 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14195/ --- If your project

[GitHub] spark pull request: SPARK-1382: Fix NPE in DStream.slice

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/365#issuecomment-40673436 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14194/ --- If your project

[GitHub] spark pull request: [SPARK-1332] Improve Spark Streaming's Network...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/300#issuecomment-40673431 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1311 Map side distinct in collect vertex...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/21#issuecomment-40673442 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: Handle empty partition iterators

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/367#issuecomment-40673439 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14191/ --- If your project is set up for it, you can r

[GitHub] spark pull request: [WIP][SPARK-1506][MLLIB] Documentation improve...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/422#issuecomment-40673435 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: SPARK-1382: Fix NPE in DStream.slice

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/365#issuecomment-40673433 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [python alternative] pyspark require Python2, ...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/399#issuecomment-40673432 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: Handle empty partition iterators

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/367#issuecomment-40673434 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [python alternative] pyspark require Python2, ...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/399#issuecomment-40673437 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14192/ --- If your project

[GitHub] spark pull request: SPARK-1462: Examples of ML algorithms are usin...

2014-04-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/416 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: Include stack trace for exceptions thrown by u...

2014-04-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/409 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: misleading task number of groupByKey

2014-04-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/403 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: Update ReducedWindowedDStream.scala

2014-04-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/425 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: SPARK-1242 Add aggregate to python rdd

2014-04-16 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/139#issuecomment-40672235 @mateiz : Do you still think we should try and get this in for 1.0 / is it in a good state to merge? --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-1512] improve spark sql to support tabl...

2014-04-16 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/428#issuecomment-40672184 ok, i will update the doc to indicate this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark pull request: [SPARK-1512] improve spark sql to support tabl...

2014-04-16 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/428#issuecomment-40671798 The upcoming Scala 2.11 now supports case classes with more than 22 fields https://issues.scala-lang.org/browse/SI-7296 --- If your project is set up for it, you can re

[GitHub] spark pull request: SPARK-1462: Examples of ML algorithms are usin...

2014-04-16 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/416#issuecomment-40671448 Merged this, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: SPARK-1311 Map side distinct in collect vertex...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/21#issuecomment-40670904 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: Include stack trace for exceptions thrown by u...

2014-04-16 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/409#issuecomment-40670865 thanks. merged. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark pull request: SPARK-1311 Map side distinct in collect vertex...

2014-04-16 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/21#issuecomment-40670833 Jenkins, add to whitelist. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: Update ReducedWindowedDStream.scala

2014-04-16 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/425#issuecomment-40670648 I merged this. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [Streaming] SPARK-1510: Add Spark Streaming me...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/424#issuecomment-40670381 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [Streaming] SPARK-1510: Add Spark Streaming me...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/424#issuecomment-40670377 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: Add unit test to spark_ec2 script

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/134#issuecomment-40670366 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Add unit test to spark_ec2 script

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/134#issuecomment-40670367 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14196/ --- If your project is set up for it, you can r

[GitHub] spark pull request: Add unit test to spark_ec2 script

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/134#issuecomment-40670316 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Update ReducedWindowedDStream.scala

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/425#issuecomment-40670315 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14190/ --- If your project

[GitHub] spark pull request: Update ReducedWindowedDStream.scala

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/425#issuecomment-40670314 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: misleading task number of groupByKey

2014-04-16 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/403#issuecomment-40670132 Thanks I've merged this. But in general we have changed numTasks to numPartitions in the code. We should change all documentations to use numPartitions instead. Do you mind s

[GitHub] spark pull request: SPARK-1329: Create pid2vid with correct number...

2014-04-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/368 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: Rebuild routing table after Graph.reverse

2014-04-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/431 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: Fixing a race condition in event listener unit...

2014-04-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/401 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: remove unnecessary brace and semicolon in 'put...

2014-04-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/411 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: Add Shortest-path computations to graphx.lib w...

2014-04-16 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10#issuecomment-40669952 Sorry it took us a while to respond... there are too many open pull requests! --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: Add Shortest-path computations to graphx.lib w...

2014-04-16 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10#issuecomment-40669939 It would be great to not having to introduce algebird. Do you mind updating the PR? cc @jegonzal and @ankurdave --- If your project is set up for it, you can reply t

[GitHub] spark pull request: SPARK-1382: Fix NPE in DStream.slice

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/365#issuecomment-40669892 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [WIP][SPARK-1506][MLLIB] Documentation improve...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/422#issuecomment-40669891 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Add unit test to spark_ec2 script

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/134#issuecomment-40669877 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-1382: Fix NPE in DStream.slice

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/365#issuecomment-40669874 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [WIP][SPARK-1506][MLLIB] Documentation improve...

2014-04-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/422#issuecomment-40669872 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-1382: Fix NPE in DStream.slice

2014-04-16 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/365#issuecomment-40669866 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-1382: Fix NPE in DStream.slice

2014-04-16 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/365#discussion_r11714952 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/BasicOperationsSuite.scala --- @@ -396,6 +396,16 @@ class BasicOperationsSuite extends TestSuiteBas

[GitHub] spark pull request: Add unit test to spark_ec2 script

2014-04-16 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/134#issuecomment-40669823 @shivaram can you take a look at this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

  1   2   3   >