[GitHub] spark pull request: [SPARK-4979][MLLIB] Streaming logisitic regres...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4306#issuecomment-72572876 [Test build #26567 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26567/consoleFull) for PR 4306 at commit [`275f8bd`](https://githu

[GitHub] spark pull request: [SPARK-4979][MLLIB] Streaming logisitic regres...

2015-02-02 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/4306#issuecomment-72572634 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-1405] [mllib] Latent Dirichlet Allocati...

2015-02-02 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/4047#issuecomment-72572519 I just rebased after the checkpoint fix in [https://github.com/apache/spark/pull/4253]. I also added a test suite for PeriodicGraphCheckpointer. I'll rebase on [http

[GitHub] spark pull request: [SPARK-5534] [graphx] Graph getStorageLevel fi...

2015-02-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4317 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-5534] [graphx] Graph getStorageLevel fi...

2015-02-02 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/4317#issuecomment-72572309 Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-1405] [mllib] Latent Dirichlet Allocati...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4047#issuecomment-72572315 [Test build #26565 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26565/consoleFull) for PR 4047 at commit [`e391474`](https://githu

[GitHub] spark pull request: [SQL] Improve DataFrame API error reporting

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4296#issuecomment-72572314 [Test build #26564 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26564/consoleFull) for PR 4296 at commit [`6527b86`](https://githu

[GitHub] spark pull request: [SPARK-3778] newAPIHadoopRDD doesn't properly ...

2015-02-02 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/4292#issuecomment-72572163 LGTM and seems very straightforward. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-5182] [SPARK-5528] [SPARK-5509] [SPARK-...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4308#issuecomment-72571757 [Test build #26562 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26562/consoleFull) for PR 4308 at commit [`87689d5`](https://githu

[GitHub] spark pull request: SPARK-4687. [WIP] Add an addDirectory API

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3670#issuecomment-72571745 [Test build #26563 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26563/consoleFull) for PR 3670 at commit [`f9fc77f`](https://githu

[GitHub] spark pull request: SPARK-4687. [WIP] Add an addDirectory API

2015-02-02 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/3670#issuecomment-72571612 Updated patch addresses @JoshRosen 's comments --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark pull request: [SPARK-5514] DataFrame.collect should call exe...

2015-02-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4313 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-5514] DataFrame.collect should call exe...

2015-02-02 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/4313#issuecomment-72571455 Merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-4979][MLLIB] Streaming logisitic regres...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4306#issuecomment-72571137 **[Test build #26550 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26550/consoleFull)** for PR 4306 at commit [`275f8bd`](https://git

[GitHub] spark pull request: [WIP][SPARK-5501][SPARK-5420][SQL] Write suppo...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4294#issuecomment-72571153 [Test build #26561 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26561/consoleFull) for PR 4294 at commit [`1682ca6`](https://githu

[GitHub] spark pull request: [SPARK-4979][MLLIB] Streaming logisitic regres...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4306#issuecomment-72571147 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: SPARK-5542: Decouple publishing, packaging, an...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4319#issuecomment-72570621 [Test build #26560 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26560/consoleFull) for PR 4319 at commit [`dfe7ed9`](https://githu

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23973769 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -0,0 +1,338 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-5540] hide ALS.solveLeastSquares

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4318#issuecomment-72570325 [Test build #26557 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26557/consoleFull) for PR 4318 at commit [`586ade6`](https://gith

[GitHub] spark pull request: [SPARK-5540] hide ALS.solveLeastSquares

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4318#issuecomment-72570331 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: SPARK-5542: Decouple publishing, packaging, an...

2015-02-02 Thread pwendell
GitHub user pwendell opened a pull request: https://github.com/apache/spark/pull/4319 SPARK-5542: Decouple publishing, packaging, and tagging in release script These are some changes to the build script to allow parts of it to be run independently. This has already been tested durin

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23973547 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DeterministicKafkaInputDStream.scala --- @@ -0,0 +1,150 @@ +/* + * Licensed to

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23973375 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -0,0 +1,338 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23973371 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -0,0 +1,338 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23973357 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -0,0 +1,338 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23973351 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -0,0 +1,338 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23973330 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -0,0 +1,338 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23973281 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -0,0 +1,338 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23973191 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -0,0 +1,338 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23973072 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -0,0 +1,338 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: Spark 3883: SSL support for HttpServer and Akk...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3571#issuecomment-72569177 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: Spark 3883: SSL support for HttpServer and Akk...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3571#issuecomment-72569171 [Test build #26556 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26556/consoleFull) for PR 3571 at commit [`9ef4ed1`](https://gith

[GitHub] spark pull request: [SPARK-5414] Add SparkFirehoseListener class f...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4210#issuecomment-72569051 [Test build #26559 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26559/consoleFull) for PR 4210 at commit [`ecdfaed`](https://githu

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23972979 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -0,0 +1,338 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23972944 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -0,0 +1,338 @@ +/* + * Licensed to the Apache So

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23972917 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -0,0 +1,338 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-5414] Add SparkFirehoseListener class f...

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4210#issuecomment-72568729 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [MLLIB] [spark-2352] Implementation of an Arti...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1290#issuecomment-72568400 [Test build #26555 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26555/consoleFull) for PR 1290 at commit [`5de5bad`](https://gith

[GitHub] spark pull request: [SPARK-4987] [SQL] parquet timestamp type supp...

2015-02-02 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/3820#discussion_r23972716 --- Diff: pom.xml --- @@ -149,6 +149,7 @@ 2.10 ${scala.version} org.scala-lang +3.5.2 --- End diff -- To ke

[GitHub] spark pull request: [MLLIB] [spark-2352] Implementation of an Arti...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1290#issuecomment-72568405 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: SPARK-4687. [WIP] Add an addDirectory API

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/3670#discussion_r23972698 --- Diff: core/src/test/scala/org/apache/spark/SparkContextSuite.scala --- @@ -72,4 +77,85 @@ class SparkContextSuite extends FunSuite with LocalSparkContex

[GitHub] spark pull request: [SPARK-4945] [SQL] Add overwrite option suppor...

2015-02-02 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/3780#issuecomment-72568306 OK, I will close this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: SPARK-4687. [WIP] Add an addDirectory API

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/3670#discussion_r23972657 --- Diff: core/src/test/scala/org/apache/spark/SparkContextSuite.scala --- @@ -72,4 +77,85 @@ class SparkContextSuite extends FunSuite with LocalSparkContex

[GitHub] spark pull request: [SPARK-4945] [SQL] Add overwrite option suppor...

2015-02-02 Thread chenghao-intel
Github user chenghao-intel closed the pull request at: https://github.com/apache/spark/pull/3780 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: [SPARK-5364] [SQL] HiveQL transform doesn't su...

2015-02-02 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/4158#issuecomment-72568272 Closing this since #4014 has been merged. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23972610 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DeterministicKafkaInputDStream.scala --- @@ -0,0 +1,150 @@ +/* + * License

[GitHub] spark pull request: [SPARK-5364] [SQL] HiveQL transform doesn't su...

2015-02-02 Thread chenghao-intel
Github user chenghao-intel closed the pull request at: https://github.com/apache/spark/pull/4158 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: Add a config option to print DAG.

2015-02-02 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/4257#issuecomment-72568187 Fair, but the issue is in some cases (e.g. GraphX) the printed representation of the DAG can be many hundreds of lines long. could that potentially explode the output?

[GitHub] spark pull request: [SPARK-5341] Use maven coordinates as dependen...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4215#issuecomment-72567980 [Test build #26558 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26558/consoleFull) for PR 4215 at commit [`71c374d`](https://githu

[GitHub] spark pull request: [SPARK-5231][WebUI] History Server shows wrong...

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4029#discussion_r23972545 --- Diff: core/src/main/scala/org/apache/spark/util/JsonProtocol.scala --- @@ -32,6 +32,7 @@ import org.apache.spark.executor._ import org.apache.spark.

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23972523 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -0,0 +1,338 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: SPARK-4687. [WIP] Add an addDirectory API

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/3670#discussion_r23972439 --- Diff: core/src/test/scala/org/apache/spark/SparkContextSuite.scala --- @@ -72,4 +77,85 @@ class SparkContextSuite extends FunSuite with LocalSparkContex

[GitHub] spark pull request: [SPARK-5534] [graphx] Graph getStorageLevel fi...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4317#issuecomment-72567821 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5534] [graphx] Graph getStorageLevel fi...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4317#issuecomment-72567818 [Test build #26554 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26554/consoleFull) for PR 4317 at commit [`1c21e49`](https://gith

[GitHub] spark pull request: [SPARK-5231][WebUI] History Server shows wrong...

2015-02-02 Thread nightwolfzor
Github user nightwolfzor commented on a diff in the pull request: https://github.com/apache/spark/pull/4029#discussion_r23972387 --- Diff: core/src/main/scala/org/apache/spark/util/JsonProtocol.scala --- @@ -32,6 +32,7 @@ import org.apache.spark.executor._ import org.apache.spa

[GitHub] spark pull request: [SPARK-1406] Mllib pmml model export

2015-02-02 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3062#issuecomment-72567721 @srowen Yes, the implementation would live under the `mllib.pmml` package and we add `toPMML` to models that we support. For the return type, exposing third-party APIs is

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23972368 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -0,0 +1,338 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-5195][sql]Update HiveMetastoreCatalog.s...

2015-02-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3898 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: SPARK-4687. [WIP] Add an addDirectory API

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/3670#discussion_r23972230 --- Diff: core/src/test/scala/org/apache/spark/SparkContextSuite.scala --- @@ -72,4 +74,87 @@ class SparkContextSuite extends FunSuite with LocalSparkContex

[GitHub] spark pull request: [SPARK-4987] [SQL] parquet timestamp type supp...

2015-02-02 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/3820#issuecomment-72567388 Dependency looks fine to me, thanks for running it by. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-5534] [graphx] Graph getStorageLevel fi...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4317#issuecomment-72567312 [Test build #26552 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26552/consoleFull) for PR 4317 at commit [`18d64ca`](https://gith

[GitHub] spark pull request: [SPARK-5534] [graphx] Graph getStorageLevel fi...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4317#issuecomment-72567319 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5341] Use maven coordinates as dependen...

2015-02-02 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/4215#discussion_r23972143 --- Diff: core/src/test/scala/org/apache/spark/deploy/SparkSubmitUtilsSuite.scala --- @@ -0,0 +1,100 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] spark pull request: SPARK-4687. [WIP] Add an addDirectory API

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/3670#discussion_r23972092 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -555,17 +586,42 @@ private[spark] object Utils extends Logging { uc.setRe

[GitHub] spark pull request: [SPARK-4987] [SQL] parquet timestamp type supp...

2015-02-02 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3820#discussion_r23972062 --- Diff: pom.xml --- @@ -149,6 +149,7 @@ 2.10 ${scala.version} org.scala-lang +3.5.2 --- End diff -- Any reas

[GitHub] spark pull request: [SPARK-5195][sql]Update HiveMetastoreCatalog.s...

2015-02-02 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/3898#issuecomment-72566902 Ahhh, I just noticed this was not made against master. Please make all PRs against master in the future. --- If your project is set up for it, you can reply to this em

[GitHub] spark pull request: [SPARK-1406] Mllib pmml model export

2015-02-02 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/3062#issuecomment-72566799 @srowen I expect us to have 2 model formats (PMML, plus a Spark-specific one supporting distributed models). +1 for returning a String or some type which lets us hide

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23971976 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DeterministicKafkaInputDStream.scala --- @@ -0,0 +1,150 @@ +/* + * Licensed to

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23972007 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DeterministicKafkaInputDStream.scala --- @@ -0,0 +1,150 @@ +/* + * Licensed to

[GitHub] spark pull request: [SPARK-5472][SQL] A JDBC data source for Spark...

2015-02-02 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/4261#issuecomment-72566713 Thanks for working on this @tmyklebu, I'm excited to have this feature! I'm going to merge as is since we are close to the deadline for 1.3. We can do style fixes afte

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23971905 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DeterministicKafkaInputDStream.scala --- @@ -0,0 +1,150 @@ +/* + * Licensed to

[GitHub] spark pull request: [SPARK-5195][sql]Update HiveMetastoreCatalog.s...

2015-02-02 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/3898#issuecomment-72566522 Thanks for fixing this! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark pull request: [SPARK-5195][sql]Update HiveMetastoreCatalog.s...

2015-02-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/3898#discussion_r23971853 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -427,6 +427,13 @@ private[hive] case class MetastoreRelation

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23971788 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DeterministicKafkaInputDStream.scala --- @@ -0,0 +1,150 @@ +/* + * Licensed to

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23971703 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DeterministicKafkaInputDStream.scala --- @@ -0,0 +1,150 @@ +/* + * Licensed to

[GitHub] spark pull request: [SQL] Improve DataFrame API error reporting

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4296#issuecomment-72566144 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SQL] Improve DataFrame API error reporting

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4296#issuecomment-72566140 [Test build #26553 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26553/consoleFull) for PR 4296 at commit [`5afe1ff`](https://gith

[GitHub] spark pull request: [SPARK-5540] hide ALS.solveLeastSquares

2015-02-02 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/4318#issuecomment-72566004 Yes, I think it can just be hidden. This is unlikely to be called by anyone, and a quick search of github didn't turn up any obvious callers. --- If your project is set u

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23971474 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DeterministicKafkaInputDStream.scala --- @@ -0,0 +1,150 @@ +/* + * Licensed to

[GitHub] spark pull request: [SPARK-2309][MLlib] Multinomial Logistic Regre...

2015-02-02 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3833#issuecomment-72565507 Merged into master. Thanks for contributing MLOR! I created https://issues.apache.org/jira/browse/SPARK-5537 for the user guide and assigned to you. --- If your project

[GitHub] spark pull request: [SPARK-1406] Mllib pmml model export

2015-02-02 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/3062#issuecomment-72565380 @mengxr I like keeping the export together in one package. Since I imagine there will likely only ever be 1 or 2 model export formats (really, I imagine 1) I think using a

[GitHub] spark pull request: SPARK-4687. [WIP] Add an addDirectory API

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/3670#discussion_r23971392 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -513,13 +516,44 @@ private[spark] object Utils extends Logging { Files.move

[GitHub] spark pull request: [SPARK-2199] [mllib] topic modeling

2015-02-02 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/1269#issuecomment-72565428 @IlyaKozlov Would you like your email included in the git commit for the initial LDA PR? If so, please let me (or @mengxr ) know ASAP. Thanks! --- If your project i

[GitHub] spark pull request: [SPARK-2309][MLlib] Multinomial Logistic Regre...

2015-02-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3833 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-5540] hide ALS.solveLeastSquares

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4318#issuecomment-72565036 [Test build #26557 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26557/consoleFull) for PR 4318 at commit [`586ade6`](https://githu

[GitHub] spark pull request: SPARK-4687. [WIP] Add an addDirectory API

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/3670#discussion_r23971078 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -437,9 +438,11 @@ private[spark] object Utils extends Logging { private def dow

[GitHub] spark pull request: [SPARK-5513][MLLIB] Add nonnegative option to ...

2015-02-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4302 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-5205][Streaming]:Inconsistent behaviour...

2015-02-02 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/4135#issuecomment-72564809 @pwendell This should be a good addition to TaskContext, take a look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-5540] hide ALS.solveLeastSquares

2015-02-02 Thread mengxr
GitHub user mengxr opened a pull request: https://github.com/apache/spark/pull/4318 [SPARK-5540] hide ALS.solveLeastSquares This method survived the code review and it has been there since v1.1.0. It exposes jblas types. Let's remove it from the public API. I think no one calls it

[GitHub] spark pull request: [SPARK-2309][MLlib] Multinomial Logistic Regre...

2015-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3833#issuecomment-72564212 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-2309][MLlib] Multinomial Logistic Regre...

2015-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3833#issuecomment-72564203 [Test build #26549 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26549/consoleFull) for PR 3833 at commit [`4e2f354`](https://gith

[GitHub] spark pull request: SPARK-4687. [WIP] Add an addDirectory API

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/3670#discussion_r23970751 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -996,12 +1004,49 @@ class SparkContext(config: SparkConf) extends Logging with Exec

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-02-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3732 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: SPARK-4687. [WIP] Add an addDirectory API

2015-02-02 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/3670#discussion_r23970615 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -996,12 +1004,49 @@ class SparkContext(config: SparkConf) extends Logging with Executor

[GitHub] spark pull request: [SPARK-5513][MLLIB] Add nonnegative option to ...

2015-02-02 Thread coderxiang
Github user coderxiang commented on the pull request: https://github.com/apache/spark/pull/4302#issuecomment-72563925 @mengxr LGTM, should be good to merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-02-02 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/3732#issuecomment-72563968 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-4687. [WIP] Add an addDirectory API

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/3670#discussion_r23970458 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -996,12 +1004,49 @@ class SparkContext(config: SparkConf) extends Logging with Exec

[GitHub] spark pull request: [SPARK-5264][SQL] Support `drop temporary tabl...

2015-02-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/4060#discussion_r23970286 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/ddl.scala --- @@ -231,6 +241,32 @@ private [sql] case class CreateTempTableUsing( }

[GitHub] spark pull request: [SPARK-5324][SQL] Results of describe can't be...

2015-02-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/4249#discussion_r23970344 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveQl.scala --- @@ -54,13 +54,8 @@ private[hive] case object NativePlaceholder extends Command

[GitHub] spark pull request: SPARK-4687. [WIP] Add an addDirectory API

2015-02-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/3670#discussion_r23970320 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -996,12 +1004,49 @@ class SparkContext(config: SparkConf) extends Logging with Exec

<    1   2   3   4   5   6   7   8   9   >