[GitHub] spark pull request: SPARK-1407 drain event queue before stopping e...

2014-04-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/366#discussion_r11423681 --- Diff: core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala --- @@ -36,6 +36,7 @@ private[spark] class LiveListenerBus extends

[GitHub] spark pull request: SPARK-1407 drain event queue before stopping e...

2014-04-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/366#discussion_r11423695 --- Diff: examples/src/main/scala/org/apache/spark/examples/SparkHdfsLR.scala --- @@ -73,6 +73,7 @@ object SparkHdfsLR { }

[GitHub] spark pull request: SPARK-1407 drain event queue before stopping e...

2014-04-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/366#discussion_r11423705 --- Diff: examples/src/main/scala/org/apache/spark/examples/SparkHdfsLR.scala --- @@ -73,6 +73,7 @@ object SparkHdfsLR { }

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39931230 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1428: MLlib should convert non-float64 N...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/356#issuecomment-39931222 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39931223 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1407 drain event queue before stopping e...

2014-04-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/366#discussion_r11423726 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -884,6 +883,7 @@ class SparkContext( cleaner.foreach(_.stop())

[GitHub] spark pull request: SPARK-1428: MLlib should convert non-float64 N...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/356#issuecomment-39931229 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Handle empty partition iterators

2014-04-09 Thread ankurdave
GitHub user ankurdave opened a pull request: https://github.com/apache/spark/pull/367 Handle empty partition iterators Empty edge partitions sometimes appear in the output of zipPartitions for unknown reasons, causing calls to Iterator#next to fail. This PR checks these cases,

[GitHub] spark pull request: Handle empty partition iterators

2014-04-09 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/367#issuecomment-39931411 I know you said unknown, but any guesses on why they appear? Seems like they shouldn't. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: Handle empty partition iterators

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/367#issuecomment-39931468 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Handle empty partition iterators

2014-04-09 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/367#issuecomment-39931485 I don't have any ideas. cc @jegonzal @dcrankshaw --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Handle empty partition iterators

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/367#issuecomment-39931459 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1407 drain event queue before stopping e...

2014-04-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/366#issuecomment-39931703 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread sundeepn
Github user sundeepn commented on the pull request: https://github.com/apache/spark/pull/246#issuecomment-39931844 @kayousterhout ah! cleaned up. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1407 drain event queue before stopping e...

2014-04-09 Thread concretevitamin
Github user concretevitamin commented on the pull request: https://github.com/apache/spark/pull/366#issuecomment-39931839 This does look much simpler. Also, free free to use the test there ;) --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/246#issuecomment-39931898 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/246#issuecomment-39931895 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1407 drain event queue before stopping e...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/366#issuecomment-39931899 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/246#issuecomment-39931974 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/246#issuecomment-39931975 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13936/ --- If your project is set up for it, you can

[GitHub] spark pull request: SPARK-1093: Annotate developer and experimenta...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/274#issuecomment-39932758 Build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-1093: Annotate developer and experimenta...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/274#issuecomment-39932759 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13931/ --- If your project

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread kayousterhout
Github user kayousterhout commented on the pull request: https://github.com/apache/spark/pull/246#issuecomment-39932952 Jenkins is reporting a failure due to 100char lines: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13936/console Can you fix these?

[GitHub] spark pull request: SPARK-1329: Create pid2vid with correct number...

2014-04-09 Thread ankurdave
GitHub user ankurdave opened a pull request: https://github.com/apache/spark/pull/368 SPARK-1329: Create pid2vid with correct number of partitions Each vertex partition is co-located with a pid2vid array created in RoutingTable.scala. This array maps edge partition IDs to the list

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/246#discussion_r11424258 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1028,6 +1028,16 @@ class SparkContext( dagScheduler.cancelAllJobs()

[GitHub] spark pull request: SPARK-1428: MLlib should convert non-float64 N...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/356#issuecomment-39933137 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/246#discussion_r11424318 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -991,11 +1001,23 @@ class DAGScheduler( } }

[GitHub] spark pull request: SPARK-1329: Create pid2vid with correct number...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/368#issuecomment-39933208 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/246#discussion_r11424341 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/JobProgressListener.scala --- @@ -61,6 +61,7 @@ private[ui] class JobProgressListener(conf:

[GitHub] spark pull request: SPARK-1329: Create pid2vid with correct number...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/368#issuecomment-39933214 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/246#discussion_r11424350 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/JobProgressUI.scala --- @@ -56,5 +57,5 @@ private[ui] class JobProgressUI(parent: SparkUI) {

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread kayousterhout
Github user kayousterhout commented on the pull request: https://github.com/apache/spark/pull/246#issuecomment-39933343 Just a few small comments -- other than those this looks good --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: Fix SPARK-1413: Parquet messes up stdout and s...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/325#issuecomment-39933461 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Fix SPARK-1413: Parquet messes up stdout and s...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/325#issuecomment-39933469 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1390] Refactoring of matrices backed by...

2014-04-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/296 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Handle empty partition iterators

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/367#issuecomment-39934216 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13934/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39934217 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13933/ --- If your project

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39934213 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: Handle empty partition iterators

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/367#issuecomment-39934212 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: PySpark API for SparkSQL

2014-04-09 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/363#discussion_r11424723 --- Diff: python/pyspark/context.py --- @@ -460,6 +463,189 @@ def sparkUser(self): return self._jsc.sc().sparkUser()

[GitHub] spark pull request: SPARK-1407 drain event queue before stopping e...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/366#issuecomment-39935451 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1407 drain event queue before stopping e...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/366#issuecomment-39935453 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13935/ --- If your project is set up for it, you can

[GitHub] spark pull request: SPARK-1093: Annotate developer and experimenta...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/274#issuecomment-39935489 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1093: Annotate developer and experimenta...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/274#issuecomment-39935480 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Fix SPARK-1413: Parquet messes up stdout and s...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/325#issuecomment-39935838 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Fix SPARK-1413: Parquet messes up stdout and s...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/325#issuecomment-39935839 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13938/ --- If your project is set up for it, you can

[GitHub] spark pull request: Fix SPARK-1413: Parquet messes up stdout and s...

2014-04-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/325#issuecomment-39936344 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Fix SPARK-1413: Parquet messes up stdout and s...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/325#issuecomment-39936420 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1407 drain event queue before stopping e...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/366#issuecomment-39936421 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Fix SPARK-1413: Parquet messes up stdout and s...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/325#issuecomment-39936414 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1407 drain event queue before stopping e...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/366#issuecomment-39936412 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: PySpark API for SparkSQL

2014-04-09 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/363#discussion_r11425374 --- Diff: python/pyspark/context.py --- @@ -460,6 +463,189 @@ def sparkUser(self): return self._jsc.sc().sparkUser()

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/246#discussion_r11425473 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1028,6 +1028,16 @@ class SparkContext( dagScheduler.cancelAllJobs()

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39936790 @mengxr I'm just waiting for tests to pass on the other PR, but you can assume that's the final format if you want to update this. --- If your project is set up for it,

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39937050 I need to wait until your PR gets merged to use the annotation, but maybe I can try adding annotations blindly. --- If your project is set up for it, you can reply to

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/246#discussion_r11425917 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala --- @@ -71,15 +71,28 @@ private[ui] class StageTable(stages: Seq[StageInfo], parent:

[GitHub] spark pull request: SPARK-1093: Annotate developer and experimenta...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/274#issuecomment-39937900 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: PySpark API for SparkSQL

2014-04-09 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/363#discussion_r11425946 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala --- @@ -284,6 +286,42 @@ private[spark] object PythonRDD { file.close()

[GitHub] spark pull request: SPARK-1093: Annotate developer and experimenta...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/274#issuecomment-39937902 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13939/ --- If your project

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/204#issuecomment-39937975 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/204#issuecomment-39937983 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: PySpark API for SparkSQL

2014-04-09 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/363#discussion_r11426010 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala --- @@ -284,6 +286,42 @@ private[spark] object PythonRDD { file.close()

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/246#discussion_r11426048 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala --- @@ -71,15 +71,28 @@ private[ui] class StageTable(stages: Seq[StageInfo], parent:

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/246#discussion_r11426078 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala --- @@ -31,11 +31,21 @@ private[ui] class StagePage(parent: JobProgressUI) {

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/246#discussion_r11426142 --- Diff: core/src/main/scala/org/apache/spark/ui/SparkUI.scala --- @@ -46,6 +46,7 @@ private[spark] class SparkUI( val live = sc != null

[GitHub] spark pull request: SPARK-1202 - Add a cancel button in the UI f...

2014-04-09 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/246#discussion_r11426135 --- Diff: core/src/main/scala/org/apache/spark/ui/SparkUI.scala --- @@ -46,6 +46,7 @@ private[spark] class SparkUI( val live = sc != null

[GitHub] spark pull request: SPARK-1093: Annotate developer and experimenta...

2014-04-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/274#issuecomment-39938964 Just merged this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-1407 drain event queue before stopping e...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/366#issuecomment-39939019 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13940/ --- If your project

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/204#discussion_r11426437 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala --- @@ -0,0 +1,265 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/204#discussion_r11426483 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala --- @@ -0,0 +1,265 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: SPARK-1093: Annotate developer and experimenta...

2014-04-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/274 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39939696 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39939704 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Fix SPARK-1413: Parquet messes up stdout and s...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/325#issuecomment-39940056 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13941/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39940066 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39940075 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/204#issuecomment-39940453 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39940468 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/204#issuecomment-39940470 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39940450 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/204#issuecomment-39940524 Build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/204#issuecomment-39940525 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13942/ --- If your project

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/204#issuecomment-39940616 This looks good, I want to do a full pass tomorrow morning but in general I think this is in good shape. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39940863 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39940864 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13944/ --- If your project is set up for it, you can

[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-09 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/268#issuecomment-39941590 @yinxusen #296 was merged. Could you move the method `computeSummaryStatistics` to `RowMatrix`? The return type should be renamed to either

[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-09 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/268#discussion_r11427570 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/rdd/VectorRDDFunctions.scala --- @@ -0,0 +1,208 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-09 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/268#issuecomment-39941843 Sure, I'll do it now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-09 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/268#discussion_r11427699 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/rdd/VectorRDDFunctions.scala --- @@ -0,0 +1,208 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39942727 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39942728 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13943/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39943767 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39943841 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39943842 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13945/ --- If your project

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39944044 Thanks! Merged. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39944099 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/204#issuecomment-39945708 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13946/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39947285 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13947/ --- If your project

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/298 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

  1   2   3   4   5   >