[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4325#issuecomment-72601441 [Test build #26617 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26617/consoleFull) for PR 4325 at commit [`096e20d`](https://githu

[GitHub] spark pull request: [SPARK-5549] Define TaskContext interface in S...

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4324#discussion_r23985360 --- Diff: core/src/main/scala/org/apache/spark/TaskContext.scala --- @@ -15,112 +15,116 @@ * limitations under the License. */ -package

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-02-02 Thread adrian-wang
GitHub user adrian-wang opened a pull request: https://github.com/apache/spark/pull/4325 [SPARK-4508] [SQL] build native date type to conform behavior to Hive The previous #3732 is reverted due to some test failure. Have fixed that. You can merge this pull request into a Git rep

[GitHub] spark pull request: [SPARK-5414] Add SparkFirehoseListener class f...

2015-02-02 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/4210#issuecomment-72601030 lgtm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark pull request: [SPARK-5414] Add SparkFirehoseListener class f...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4210#issuecomment-72600859 [Test build #26616 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26616/consoleFull) for PR 4210 at commit [`223f579`](https://githu

[GitHub] spark pull request: [SPARK-5341] Use maven coordinates as dependen...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4215#issuecomment-72600720 [Test build #26615 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26615/consoleFull) for PR 4215 at commit [`9dae87f`](https://githu

[GitHub] spark pull request: [SPARK-5475][CORE] Java 8 tests are like maint...

2015-02-02 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/spark/pull/4264#issuecomment-72600510 I can not get these tests to run, not sure if there is a way to run them that I do not know. Please see jira for related comment. --- If your project is set up for it

[GitHub] spark pull request: [SPARK-5414] Add SparkFirehoseListener class f...

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4210#issuecomment-72600391 Based on a suggestion from @rxin, I've expanded the Javadoc comment to explain why this needs to be a _Java_ concrete class and not a Scala one (the problem is that def

[GitHub] spark pull request: [SPARK-5549] Define TaskContext interface in S...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4324#issuecomment-72600182 [Test build #26614 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26614/consoleFull) for PR 4324 at commit [`87dd537`](https://gith

[GitHub] spark pull request: [SPARK-5549] Define TaskContext interface in S...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4324#issuecomment-72600186 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5549] Define TaskContext interface in S...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4324#issuecomment-72600044 [Test build #26614 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26614/consoleFull) for PR 4324 at commit [`87dd537`](https://githu

[GitHub] spark pull request: [SPARK-5341] Use maven coordinates as dependen...

2015-02-02 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/4215#discussion_r23985067 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -475,6 +501,195 @@ object SparkSubmit { } } +/** Provides u

[GitHub] spark pull request: [SPARK-1405] [mllib] Latent Dirichlet Allocati...

2015-02-02 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/4047#issuecomment-72600046 @jkbradley Both setter and getter are public methods and hence both of them should have JavaDoc. I prefer doc the default value in setter because it is used when a user wa

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-02 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/3779#issuecomment-72599896 cc scheduler czars also... @kayousterhout @markhamstra --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If yo

[GitHub] spark pull request: [SPARK-1405] [mllib] Latent Dirichlet Allocati...

2015-02-02 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4047#discussion_r23985029 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/impl/PeriodicGraphCheckpointer.scala --- @@ -0,0 +1,168 @@ +/* + * Licensed to the Apache Softwa

[GitHub] spark pull request: [SPARK-5549] Define TaskContext interface in S...

2015-02-02 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4324#discussion_r23984946 --- Diff: core/src/test/java/test/org/apache/spark/JavaTaskCompletionListenerImpl.java --- @@ -15,9 +15,10 @@ * limitations under the License. */

[GitHub] spark pull request: [SPARK-5549] Define TaskContext interface in S...

2015-02-02 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/4324 [SPARK-5549] Define TaskContext interface in Scala. So the interface documentation shows up in ScalaDoc. You can merge this pull request into a Git repository by running: $ git pull https://github

[GitHub] spark pull request: [SPARK-5341] Use maven coordinates as dependen...

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4215#discussion_r23984864 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -475,6 +501,195 @@ object SparkSubmit { } } +/** Provide

[GitHub] spark pull request: [SPARK-5341] Use maven coordinates as dependen...

2015-02-02 Thread brkyvz
Github user brkyvz commented on the pull request: https://github.com/apache/spark/pull/4215#issuecomment-72598548 @JoshRosen I actually don't know what we are missing. I think it only requires testing, because the directory structure (backslashes instead of slashes) and command-line p

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-02 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/3779#issuecomment-72598196 For any resource, it will try from the highest locality. TaskSetManager checks the current lowest locality level's wait is non-zero to determine the allowed lowest localit

[GitHub] spark pull request: [SPARK-5341] Use maven coordinates as dependen...

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4215#issuecomment-72597824 @brkyvz I see that one of the TODOS is for adding Windows compatibility. Beyond the additions to the shell script command-line parsing, what features are we missing fo

[GitHub] spark pull request: [SPARK-5521] PCA wrapper for easy transform ve...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4304#issuecomment-72597489 [Test build #26613 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26613/consoleFull) for PR 4304 at commit [`d2a22cf`](https://githu

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3779#issuecomment-72597256 I took a pass through this, but I'll admit that I'm a little out of my depth w.r.t. scheduler internals here. I think that I understand the goals / invariants of the s

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3779#issuecomment-72597115 [Test build #26612 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26612/consoleFull) for PR 3779 at commit [`6b13824`](https://githu

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-02 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r23984210 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( * Get the

[GitHub] spark pull request: [SPARK-5521] PCA wrapper for easy transform ve...

2015-02-02 Thread catap
Github user catap commented on a diff in the pull request: https://github.com/apache/spark/pull/4304#discussion_r23984199 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/feature/PCA.scala --- @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Software Foundation (ASF) und

[GitHub] spark pull request: [SPARK-5498][SQL]fix bug when query the data w...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4289#issuecomment-72596740 [Test build #26611 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26611/consoleFull) for PR 4289 at commit [`12d800d`](https://githu

[GitHub] spark pull request: [SPARK-4939] revive offers periodically in Loc...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4147#issuecomment-72596551 [Test build #26610 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26610/consoleFull) for PR 4147 at commit [`6cf5972`](https://gith

[GitHub] spark pull request: [SPARK-4939] revive offers periodically in Loc...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4147#issuecomment-72596553 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5545][STREAMING] DStream#saveAs**Files ...

2015-02-02 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/4322#issuecomment-72596428 Was already fixed by #3832 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: [SPARK-4939] revive offers periodically in Loc...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4147#issuecomment-72596416 [Test build #26610 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26610/consoleFull) for PR 4147 at commit [`6cf5972`](https://githu

[GitHub] spark pull request: [SPARK-5414] Add SparkFirehoseListener class f...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4210#issuecomment-72596412 [Test build #26609 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26609/consoleFull) for PR 4210 at commit [`ecdfaed`](https://githu

[GitHub] spark pull request: [SPARK-5545][STREAMING] DStream#saveAs**Files ...

2015-02-02 Thread harishreedharan
Github user harishreedharan closed the pull request at: https://github.com/apache/spark/pull/4322 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark pull request: [SPARK-4795][Core] Redesign the "primitive typ...

2015-02-02 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/3642#issuecomment-72596330 @zsxwing if we merge this one, are there any other usecases for importing SparkContext._ ? --- If your project is set up for it, you can reply to this email and have your r

[GitHub] spark pull request: [SPARK-5411] Allow SparkListeners to be specif...

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4111#issuecomment-72596355 I'm going to merge this in a little bit unless there's any additional feedback. --- If your project is set up for it, you can reply to this email and have your reply a

[GitHub] spark pull request: [SPARK-5414] Add SparkFirehoseListener class f...

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4210#issuecomment-72596303 Since nobody seems to have any objections to the naming, and since it's an easy API to support going forward, I'm going to merge this soon. --- If your project is set

[GitHub] spark pull request: [SPARK-5498][SQL]fix bug when query the data w...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4289#issuecomment-72596283 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5414] Add SparkFirehoseListener class f...

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4210#issuecomment-72596241 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-5498][SQL]fix bug when query the data w...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4289#issuecomment-72596278 [Test build #26602 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26602/consoleFull) for PR 4289 at commit [`63d170a`](https://gith

[GitHub] spark pull request: [SPARK-4795][Core] Redesign the "primitive typ...

2015-02-02 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3642#discussion_r23983874 --- Diff: graphx/src/test/scala/org/apache/spark/graphx/lib/ShortestPathsSuite.scala --- @@ -40,7 +40,7 @@ class ShortestPathsSuite extends FunSuite with LocalS

[GitHub] spark pull request: [SPARK-5219][Core] Add locks to avoid scheduli...

2015-02-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4019 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-5501][SPARK-5420][SQL] Write support fo...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4294#issuecomment-72596059 [Test build #26608 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26608/consoleFull) for PR 4294 at commit [`3db1539`](https://githu

[GitHub] spark pull request: [SPARK-5219][Core] Add locks to avoid scheduli...

2015-02-02 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/4019#issuecomment-72596001 Thanks. I'm merging this into master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: [SPARK-5182] [SPARK-5528] [SPARK-5509] [SPARK-...

2015-02-02 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4308#discussion_r23983783 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala --- @@ -262,8 +262,14 @@ class SQLContext(@transient val sparkContext: SparkContext)

[GitHub] spark pull request: [SPARK-5182] [SPARK-5528] [SPARK-5509] [SPARK-...

2015-02-02 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4308#discussion_r23983767 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -175,7 +175,10 @@ case class EqualTo(left: Expression, r

[GitHub] spark pull request: [SPARK-5012][MLLib][PySpark]Python API for Gau...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4059#issuecomment-72595692 [Test build #26607 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26607/consoleFull) for PR 4059 at commit [`c973ab3`](https://githu

[GitHub] spark pull request: [SPARK-5475][CORE] Java 8 tests are like maint...

2015-02-02 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/4264#issuecomment-72595661 @ScrapCodes can we close this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-5501][SPARK-5420][SQL] Write support fo...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4294#issuecomment-72595427 [Test build #26605 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26605/consoleFull) for PR 4294 at commit [`1c98881`](https://gith

[GitHub] spark pull request: [SPARK-5501][SPARK-5420][SQL] Write support fo...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4294#issuecomment-72595431 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5182] [SPARK-5528] [SPARK-5509] [SPARK-...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4308#issuecomment-72595205 [Test build #26601 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26601/consoleFull) for PR 4308 at commit [`bcb3ad6`](https://gith

[GitHub] spark pull request: [SPARK-5182] [SPARK-5528] [SPARK-5509] [SPARK-...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4308#issuecomment-72595209 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5501][SPARK-5420][SQL] Write support fo...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4294#issuecomment-72595153 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5501][SPARK-5420][SQL] Write support fo...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4294#issuecomment-72595151 [Test build #26604 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26604/consoleFull) for PR 4294 at commit [`142372a`](https://gith

[GitHub] spark pull request: [SPARK-5545][STREAMING] DStream#saveAs**Files ...

2015-02-02 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/4322#issuecomment-72594903 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5545][STREAMING] DStream#saveAs**Files ...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4322#issuecomment-72595073 [Test build #26606 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26606/consoleFull) for PR 4322 at commit [`ea2d490`](https://githu

[GitHub] spark pull request: [SPARK-1405] [mllib] Latent Dirichlet Allocati...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4047#issuecomment-72595022 [Test build #574 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/574/consoleFull) for PR 4047 at commit [`589728b`](https://github

[GitHub] spark pull request: [SPARK-1405] [mllib] Latent Dirichlet Allocati...

2015-02-02 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/4047#issuecomment-72594975 Test failure with system...will test again --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark pull request: [branch-1.0][SPARK-4355] ColumnStatisticsAggre...

2015-02-02 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/3850#issuecomment-72594814 What do we do with this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-5501][SPARK-5420][SQL] Write support fo...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4294#issuecomment-72594750 [Test build #26605 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26605/consoleFull) for PR 4294 at commit [`1c98881`](https://githu

[GitHub] spark pull request: [SPARK-4987] [SQL] parquet timestamp type supp...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3820#issuecomment-72594576 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-4987] [SQL] parquet timestamp type supp...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3820#issuecomment-72594570 [Test build #26597 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26597/consoleFull) for PR 3820 at commit [`b1e2a0d`](https://gith

[GitHub] spark pull request: [WIP][SPARK-5501][SPARK-5420][SQL] Write suppo...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4294#issuecomment-72594425 [Test build #26604 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26604/consoleFull) for PR 4294 at commit [`142372a`](https://githu

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23983277 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala --- @@ -144,4 +150,174 @@ object KafkaUtils { createStrea

[GitHub] spark pull request: [SPARK-1405] [mllib] Latent Dirichlet Allocati...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4047#issuecomment-72594403 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5182] [SPARK-5528] [SPARK-5509] [SPARK-...

2015-02-02 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4308#discussion_r23983233 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTypes.scala --- @@ -490,4 +489,55 @@ private[parquet] object ParquetTypesConverter extends

[GitHub] spark pull request: [Doc] Minor: Fixes several formatting issues

2015-02-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4316 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [Doc] Minor: Fixes several formatting issues

2015-02-02 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/4316#issuecomment-72594192 Thanks. I've merged this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-4979][MLLIB] Streaming logisitic regres...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4306#issuecomment-72594005 [Test build #26599 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26599/consoleFull) for PR 4306 at commit [`5c2c70b`](https://gith

[GitHub] spark pull request: [SPARK-4979][MLLIB] Streaming logisitic regres...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4306#issuecomment-72594009 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: SPARK-3996: Add jetty servlet and continuation...

2015-02-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4323 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: SPARK-5542: Decouple publishing, packaging, an...

2015-02-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4319 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: SPARK-3996: Add jetty servlet and continuation...

2015-02-02 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/4323#issuecomment-72593339 @JoshRosen sounds good. In the mean time I'll likely still pull this in, since it's blocking perf testing and some other stuff. --- If your project is set up for it, yo

[GitHub] spark pull request: [SPARK-5012][MLLib][PySpark]Python API for Gau...

2015-02-02 Thread FlytxtRnD
Github user FlytxtRnD commented on a diff in the pull request: https://github.com/apache/spark/pull/4059#discussion_r23982975 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/api/python/PythonMLLibAPI.scala --- @@ -285,6 +286,59 @@ class PythonMLLibAPI extends Serializable {

[GitHub] spark pull request: [SPARK-1405] [mllib] Latent Dirichlet Allocati...

2015-02-02 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/4047#issuecomment-72593275 @mengxr Oops, that commit hid some of my responses to your feedback above. The 2 issues remaining are (1) Who is responsible for materializing graphs? and (2) Where s

[GitHub] spark pull request: SPARK-5542: Decouple publishing, packaging, an...

2015-02-02 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/4319#issuecomment-72593258 Just an internal clean-up, so I'm gonna pull this in. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-5536] replace old ALS implementation by...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4321#issuecomment-72593149 [Test build #26598 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26598/consoleFull) for PR 4321 at commit [`e840acf`](https://gith

[GitHub] spark pull request: [SPARK-5536] replace old ALS implementation by...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4321#issuecomment-72593154 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5093] Set spark.network.timeout to 120s...

2015-02-02 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/3903#discussion_r23982799 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterActor.scala --- @@ -52,11 +52,7 @@ class BlockManagerMasterActor(val isLocal: Boo

[GitHub] spark pull request: [SPARK-5012][MLLib][PySpark]Python API for Gau...

2015-02-02 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/4059#discussion_r23982793 --- Diff: python/pyspark/mllib/clustering.py --- @@ -86,6 +89,98 @@ def train(cls, rdd, k, maxIterations=100, runs=1, initializationMode="k-means||"

[GitHub] spark pull request: [WIP] [SPARK-4587] [mllib] ML model import/exp...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4233#issuecomment-72592738 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [WIP] [SPARK-4587] [mllib] ML model import/exp...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4233#issuecomment-72592729 [Test build #26600 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26600/consoleFull) for PR 4233 at commit [`ee99228`](https://gith

[GitHub] spark pull request: [SPARK-5182] [SPARK-5528] [SPARK-5509] [SPARK-...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4308#issuecomment-72592529 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: SPARK-5542: Decouple publishing, packaging, an...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4319#issuecomment-72592475 [Test build #26594 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26594/consoleFull) for PR 4319 at commit [`dfe7ed9`](https://gith

[GitHub] spark pull request: [SPARK-5182] [SPARK-5528] [SPARK-5509] [SPARK-...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4308#issuecomment-72592525 [Test build #26591 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26591/consoleFull) for PR 4308 at commit [`a760555`](https://gith

[GitHub] spark pull request: SPARK-5542: Decouple publishing, packaging, an...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4319#issuecomment-72592486 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-72592281 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-72592274 [Test build #26593 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26593/consoleFull) for PR 3798 at commit [`8991017`](https://gith

[GitHub] spark pull request: [SPARK-1405] [mllib] Latent Dirichlet Allocati...

2015-02-02 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/4047#issuecomment-72591879 @mengxr Almost done with updating per your feedback, but 1 question: Do you recommend doc only in the setter methods, or in both the getters and setters? --- If your

[GitHub] spark pull request: [SPARK-5498][SQL]fix bug when query the data w...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4289#issuecomment-72591570 [Test build #26602 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26602/consoleFull) for PR 4289 at commit [`63d170a`](https://githu

[GitHub] spark pull request: [SQL] Improve DataFrame API error reporting

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4296#issuecomment-72591497 [Test build #26587 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26587/consoleFull) for PR 4296 at commit [`6527b86`](https://gith

[GitHub] spark pull request: [SQL] Improve DataFrame API error reporting

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4296#issuecomment-72591503 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-1405] [mllib] Latent Dirichlet Allocati...

2015-02-02 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/4047#discussion_r23982202 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/LDA.scala --- @@ -0,0 +1,477 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-3996: Add jetty servlet and continuation...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4323#issuecomment-72590948 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5536] replace old ALS implementation by...

2015-02-02 Thread coderxiang
Github user coderxiang commented on the pull request: https://github.com/apache/spark/pull/4321#issuecomment-72590922 @mengxr LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-5383][SQL] Support alias for udtfs

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4186#issuecomment-72590949 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: SPARK-3996: Add jetty servlet and continuation...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4323#issuecomment-72590944 [Test build #26589 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26589/consoleFull) for PR 4323 at commit [`d8669da`](https://gith

[GitHub] spark pull request: [SPARK-5383][SQL] Support alias for udtfs

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4186#issuecomment-72590945 [Test build #26586 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26586/consoleFull) for PR 4186 at commit [`adc8311`](https://gith

[GitHub] spark pull request: [SPARK-1405] [mllib] Latent Dirichlet Allocati...

2015-02-02 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/4047#discussion_r23982107 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/impl/PeriodicGraphCheckpointer.scala --- @@ -0,0 +1,168 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: [SPARK-5383][SQL] Support alias for udtfs

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4186#issuecomment-72590366 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5383][SQL] Support alias for udtfs

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4186#issuecomment-72590357 [Test build #26584 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26584/consoleFull) for PR 4186 at commit [`2783aed`](https://gith

<    1   2   3   4   5   6   7   8   9   >