[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-02 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/268#discussion_r11193497 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/rdd/VectorRDDFunctions.scala --- @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-1133] Add whole text files reader in ML...

2014-04-02 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/252#issuecomment-39291772 BTW if you are okay with this, Xiangrui, I can merge it -- the code looks good to me. But let me know if you have other ideas on names, I don't 100% like this name either.

[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-02 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/268#discussion_r11193525 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/rdd/VectorRDDFunctions.scala --- @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-02 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/268#discussion_r11193583 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/rdd/VectorRDDFunctions.scala --- @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [WIP] Clean up and simplify Spark configuratio...

2014-04-02 Thread pwendell
GitHub user pwendell opened a pull request: https://github.com/apache/spark/pull/299 [WIP] Clean up and simplify Spark configuration Over time as we've added more deployment modes, this have gotten a bit unwieldy with user-facing configuration options in Spark. Going forward we'll

[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-02 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/268#discussion_r11193626 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/rdd/VectorRDDFunctions.scala --- @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-02 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/268#discussion_r11193650 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/rdd/VectorRDDFunctionsSuite.scala --- @@ -0,0 +1,87 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [WIP] Clean up and simplify Spark configuratio...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/299#issuecomment-39292232 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1133] Add whole text files reader in ML...

2014-04-02 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/252#discussion_r11193654 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -372,6 +373,37 @@ class SparkContext( } /** + * Read a

[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-02 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/268#discussion_r11193678 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/rdd/VectorRDDFunctionsSuite.scala --- @@ -0,0 +1,87 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-1332] Improve Spark Streaming's Network...

2014-04-02 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/300 [SPARK-1332] Improve Spark Streaming's Network Receiver and InputDStream API [WIP] The current Network Receiver API makes it slightly complicated to right a new receiver as one needs to create an

[GitHub] spark pull request: [SPARK-1133] Add whole text files reader in ML...

2014-04-02 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/252#discussion_r11193752 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -372,6 +373,37 @@ class SparkContext( } /** + * Read a

[GitHub] spark pull request: [SPARK-1332] Improve Spark Streaming's Network...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/300#issuecomment-39292703 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SQL] SPARK-1371 Hash Aggregation Improvements

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/295#issuecomment-39292787 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13664/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-1332] Improve Spark Streaming's Network...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/300#issuecomment-39292788 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SQL] SPARK-1371 Hash Aggregation Improvements

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/295#issuecomment-39292783 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1360] Add Timestamp Support for SQL

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/275#issuecomment-39292938 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13665/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-1360] Add Timestamp Support for SQL

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/275#issuecomment-39292937 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1133] Add whole text files reader in ML...

2014-04-02 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/252#issuecomment-39293084 @mateiz I agree that neither `wholeTextFile` nor `wholeTextFiles` is a good name. Shall we wait for a day or two and see whether there are better suggestions? This PR is

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/158#issuecomment-39293201 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/158#issuecomment-39293197 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1133] Add whole text files reader in ML...

2014-04-02 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/252#issuecomment-39293384 `sc.textFileRecords(...)`, `sc.textFileElements()`? Guess that's not great either :P --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/158#issuecomment-39293478 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Remove * from test case golden filename.

2014-04-02 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/297#issuecomment-39294062 merged. thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-1133] Add whole text files reader in ML...

2014-04-02 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/252#issuecomment-39294300 How about textFiles() ? @liancheng recommended it just now. 2014-4-2 PM2:40ÓÚ Patrick Wendell notificati...@github.comдµÀ£º sc.textFileRecords(...),

[GitHub] spark pull request: Remove * from test case golden filename.

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/297#issuecomment-39294686 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-1357] [MLLIB] [WIP] Annotate developer ...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39294687 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13668/ --- If your project

[GitHub] spark pull request: Remove * from test case golden filename.

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/297#issuecomment-39294688 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13667/ --- If your project

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/158#issuecomment-39294689 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/158#discussion_r11194622 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -21,12 +21,11 @@ import java.io._ import java.net.URI import

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/158#discussion_r11194637 --- Diff: core/src/main/scala/org/apache/spark/storage/TachyonBlockManager.scala --- @@ -0,0 +1,155 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: SPARK-1338 scala style for explicitly specifie...

2014-04-02 Thread ScrapCodes
Github user ScrapCodes commented on a diff in the pull request: https://github.com/apache/spark/pull/284#discussion_r11194651 --- Diff: project/spark-style/src/main/scala/org/apache/spark/scalastyle/SpaceAfterColonStyleCheck.scala --- @@ -0,0 +1,39 @@ +/* + * Licensed to

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread haoyuan
Github user haoyuan commented on a diff in the pull request: https://github.com/apache/spark/pull/158#discussion_r11194656 --- Diff: core/pom.xml --- @@ -206,6 +206,53 @@ scopetest/scope /dependency dependency +

[GitHub] spark pull request: [SPARK-1332] Improve Spark Streaming's Network...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/300#issuecomment-39295721 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: Spark 1162 Implemented takeOrdered in pyspark.

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/97#issuecomment-39295724 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13669/ --- If your project is set up for it, you can

[GitHub] spark pull request: Spark 1162 Implemented takeOrdered in pyspark.

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/97#issuecomment-39295722 Build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [WIP] Clean up and simplify Spark configuratio...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/299#issuecomment-39295723 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1332] Improve Spark Streaming's Network...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/300#issuecomment-39295725 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13671/ --- If your project

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/158#discussion_r11194776 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -59,6 +57,17 @@ private[spark] class BlockManager(

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/158#issuecomment-39295925 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/158#discussion_r11194943 --- Diff: core/src/main/scala/org/apache/spark/storage/TachyonStore.scala --- @@ -0,0 +1,143 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/158#discussion_r11194937 --- Diff: core/src/main/scala/org/apache/spark/storage/TachyonStore.scala --- @@ -0,0 +1,143 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/158#discussion_r11194950 --- Diff: core/src/main/scala/org/apache/spark/storage/TachyonStore.scala --- @@ -0,0 +1,143 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/158#discussion_r11195032 --- Diff: core/src/main/scala/org/apache/spark/storage/TachyonStore.scala --- @@ -0,0 +1,143 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: Remove * from test case golden filename.

2014-04-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/297 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Renamed stageIdToActiveJob to jobIdToActiveJob...

2014-04-02 Thread kayousterhout
GitHub user kayousterhout opened a pull request: https://github.com/apache/spark/pull/301 Renamed stageIdToActiveJob to jobIdToActiveJob. This data structure was misused and, as a result, later renamed to an incorrect name. This data structure seems to have gotten into

[GitHub] spark pull request: Renamed stageIdToActiveJob to jobIdToActiveJob...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/301#issuecomment-39297208 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Renamed stageIdToActiveJob to jobIdToActiveJob...

2014-04-02 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/301#issuecomment-39297297 lgtm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/158#discussion_r11195271 --- Diff: core/src/main/scala/org/apache/spark/storage/TachyonStore.scala --- @@ -0,0 +1,143 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/158#discussion_r11195315 --- Diff: core/src/main/scala/org/apache/spark/storage/TachyonStore.scala --- @@ -0,0 +1,143 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-02 Thread kayousterhout
Github user kayousterhout commented on the pull request: https://github.com/apache/spark/pull/246#issuecomment-39297535 Hey @sundeepn, so there's one other problem with your change which is that the code you added in the UI to clean up the stages for a cancelled job doesn't quite

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/158#discussion_r11195342 --- Diff: core/src/main/scala/org/apache/spark/storage/TachyonStore.scala --- @@ -0,0 +1,143 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/158#discussion_r11195474 --- Diff: core/src/main/scala/org/apache/spark/storage/TachyonStore.scala --- @@ -0,0 +1,143 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/158#discussion_r11195556 --- Diff: project/SparkBuild.scala --- @@ -277,11 +277,18 @@ object SparkBuild extends Build { val slf4jVersion = 1.7.5 val excludeNetty =

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/158#issuecomment-39298583 Build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/158#issuecomment-39298584 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13673/ --- If your project

[GitHub] spark pull request: SPARK-1305: Support persisting RDD's directly ...

2014-04-02 Thread aarondav
Github user aarondav commented on the pull request: https://github.com/apache/spark/pull/158#issuecomment-39298749 Left some minor comments and a couple higher level questions -- it's likely these questions have been discussed before, I just want to make sure because they could

[GitHub] spark pull request: [SPARK-1212, Part II] Support sparse data in M...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/245#issuecomment-39299309 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1212, Part II] Support sparse data in M...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/245#issuecomment-39299299 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1360] Add Timestamp Support for SQL

2014-04-02 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/275#issuecomment-39300410 Can you start a new test please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-1133] Add whole text files reader in ML...

2014-04-02 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/252#issuecomment-39300760 `swallowFiles`? It seems to me `wholeTextFiles` is still the best candidate, which also reminds me Whole Foods and makes me feel hungry ... This is why I recommended

[GitHub] spark pull request: [SPARK-1360] Add Timestamp Support for SQL

2014-04-02 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/275#issuecomment-39300850 Jenkins, retest this please, --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1360] Add Timestamp Support for SQL

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/275#issuecomment-39301237 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1360] Add Timestamp Support for SQL

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/275#issuecomment-39301253 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1154: Clean up app folders in worker nod...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/288#issuecomment-39301776 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1154: Clean up app folders in worker nod...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/288#issuecomment-39301788 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Fix org.scala-lang: * inconsistent versions

2014-04-02 Thread witgo
Github user witgo closed the pull request at: https://github.com/apache/spark/pull/234 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Renamed stageIdToActiveJob to jobIdToActiveJob...

2014-04-02 Thread mridulm
Github user mridulm commented on the pull request: https://github.com/apache/spark/pull/301#issuecomment-39301994 lgtm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: Renamed stageIdToActiveJob to jobIdToActiveJob...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/301#issuecomment-39303096 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-1303] [MLLIB] Added discretization capa...

2014-04-02 Thread LIDIAgroup
Github user LIDIAgroup commented on a diff in the pull request: https://github.com/apache/spark/pull/216#discussion_r11196809 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/discretization/ArrayAccumulator.scala --- @@ -0,0 +1,32 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-02 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/268#discussion_r11196822 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/rdd/VectorRDDFunctionsSuite.scala --- @@ -0,0 +1,87 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Spark parquet improvements

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/195#issuecomment-39304970 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Spark parquet improvements

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/195#issuecomment-39304956 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-02 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/268#discussion_r11197597 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/rdd/VectorRDDFunctions.scala --- @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-1212, Part II] Support sparse data in M...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/245#issuecomment-39308190 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13676/ --- If your project is set up for it, you can

[GitHub] spark pull request: SPARK-1154: Clean up app folders in worker nod...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/288#issuecomment-39308221 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-1360] Add Timestamp Support for SQL

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/275#issuecomment-39308189 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13677/ --- If your project

[GitHub] spark pull request: [SPARK-1212, Part II] Support sparse data in M...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/245#issuecomment-39308187 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1360] Add Timestamp Support for SQL

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/275#issuecomment-39308188 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: SPARK-1154: Clean up app folders in worker nod...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/288#issuecomment-39308222 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13678/ --- If your project

[GitHub] spark pull request: Spark 1162 Implemented takeOrdered in pyspark.

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/97#issuecomment-39309710 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Spark 1162 Implemented takeOrdered in pyspark.

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/97#issuecomment-39309694 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Spark 1162 Implemented takeOrdered in pyspark.

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/97#issuecomment-39309937 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13680/ --- If your project is set up for it, you can

[GitHub] spark pull request: Spark 1162 Implemented takeOrdered in pyspark.

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/97#issuecomment-39309936 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Spark 1162 Implemented takeOrdered in pyspark.

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/97#issuecomment-39310264 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Spark 1162 Implemented takeOrdered in pyspark.

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/97#issuecomment-39310274 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1371][WIP] Compression support for Spar...

2014-04-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/285#discussion_r11198762 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/columnar/ColumnTypeSuite.scala --- @@ -55,10 +56,8 @@ class ColumnTypeSuite extends FunSuite {

[GitHub] spark pull request: fix computePreferredLocations signature to not...

2014-04-02 Thread mridulm
GitHub user mridulm opened a pull request: https://github.com/apache/spark/pull/302 fix computePreferredLocations signature to not depend on underlying implementation Change to Map and Set - not mutable HashMap and HashSet You can merge this pull request into a Git

[GitHub] spark pull request: fix computePreferredLocations signature to not...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/302#issuecomment-39313191 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1371] fix computePreferredLocations sig...

2014-04-02 Thread mridulm
Github user mridulm commented on the pull request: https://github.com/apache/spark/pull/302#issuecomment-39313257 Jenkins, this is ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1371] fix computePreferredLocations sig...

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/302#issuecomment-39314000 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Do not re-use objects in the EdgePartition/Edg...

2014-04-02 Thread darabos
Github user darabos commented on a diff in the pull request: https://github.com/apache/spark/pull/276#discussion_r11199524 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/EdgePartition.scala --- @@ -84,19 +87,13 @@ class EdgePartition[@specialized(Char, Int, Boolean,

[GitHub] spark pull request: Spark parquet improvements

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/195#issuecomment-39314778 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13679/ --- If your project is set up for it, you can

[GitHub] spark pull request: Spark parquet improvements

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/195#issuecomment-39314774 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Spark 1162 Implemented takeOrdered in pyspark.

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/97#issuecomment-39315675 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13681/ --- If your project is set up for it, you can

[GitHub] spark pull request: Spark 1162 Implemented takeOrdered in pyspark.

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/97#issuecomment-39315674 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Spark 1162 Implemented takeOrdered in pyspark.

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/97#issuecomment-39316766 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Spark 1162 Implemented takeOrdered in pyspark.

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/97#issuecomment-39316778 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: DAGScheduler NullPointerException bug fix

2014-04-02 Thread CodingCat
Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/273#issuecomment-39319966 I noticed that you added explicit return type to all public methods...I think there is a PR about this (but I cannot find it now.)en...is that merged? @pwendell

[GitHub] spark pull request: Spark 1162 Implemented takeOrdered in pyspark.

2014-04-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/97#issuecomment-39321329 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13683/ --- If your project

  1   2   3   4   5   >