[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread techaddict
Github user techaddict commented on the pull request: https://github.com/apache/spark/pull/13101#issuecomment-220497162 @mengxr @andrewor14 @srowen Addressed all comments. Thanks for reviewing. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-14261][SQL] Memory leak in Spark Thrift...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12932#issuecomment-220497098 **[Test build #58930 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58930/consoleFull)** for PR 12932 at commit

[GitHub] spark pull request: [SPARK-15321] Fix bug where Array[Timestamp] c...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/13108#issuecomment-220497073 @smungee sorry to have this gone stale. Do you mind bringing it up to date? This seems useful to fix. --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13101#issuecomment-220497012 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13101#issuecomment-220497011 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15321] Fix bug where Array[Timestamp] c...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13108#issuecomment-220497014 **[Test build #2999 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2999/consoleFull)** for PR 13108 at commit

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220496978 **[Test build #58919 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58919/consoleFull)** for PR 13200 at commit

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220496850 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13101#issuecomment-220496921 **[Test build #58924 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58924/consoleFull)** for PR 13101 at commit

[GitHub] spark pull request: [SPARK-14261][SQL] Memory leak in Spark Thrift...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12932#issuecomment-220496823 **[Test build #2998 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2998/consoleFull)** for PR 12932 at commit

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220496856 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220496707 **[Test build #58918 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58918/consoleFull)** for PR 13200 at commit

[GitHub] spark pull request: [SPARK-14261][SQL] Memory leak in Spark Thrift...

2016-05-19 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/12932#issuecomment-220496773 @dosoft Thank you for the PR. What is the memory footprint of a leaked driver? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-14261][SQL] Memory leak in Spark Thrift...

2016-05-19 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/12932#issuecomment-220496577 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13101#issuecomment-220496492 **[Test build #58928 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58928/consoleFull)** for PR 13101 at commit

[GitHub] spark pull request: [SPARK-14990][SQL] Fix checkForSameTypeInputEx...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13208#issuecomment-220496476 **[Test build #58927 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58927/consoleFull)** for PR 13208 at commit

[GitHub] spark pull request: SPARK-13335 Use declarative aggregate for coll...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11688#issuecomment-220496380 @mccheah can you close this one now https://github.com/apache/spark/pull/12874 is merged? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-14990][SQL] nvl, coalesce, array with p...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/12768#issuecomment-220496098 FYI I created https://github.com/apache/spark/pull/13208 It fixed a bug in this code and added a test case. --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-14990][SQL] Fix checkForSameTypeInputEx...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/13208#issuecomment-220496051 cc @yhuai for review --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-14990][SQL] Fix checkForSameTypeInputEx...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/13208#issuecomment-220496022 cc @dosoft --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-14990][SQL] Fix checkForSameTypeInputEx...

2016-05-19 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/13208 [SPARK-14990][SQL] Fix checkForSameTypeInputExpr (ignore nullability) ## What changes were proposed in this pull request? This patch fixes a bug in TypeUtils.checkForSameTypeInputExpr. Previously

[GitHub] spark pull request: [SPARK-15416][SQL]Display a better message for...

2016-05-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13201 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-15416][SQL]Display a better message for...

2016-05-19 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/13201#issuecomment-220495636 Thanks! Merging to master and 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-15416][SQL]Display a better message for...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13201#issuecomment-220495541 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15416][SQL]Display a better message for...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13201#issuecomment-220495544 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15416][SQL]Display a better message for...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13201#issuecomment-220495359 **[Test build #58917 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58917/consoleFull)** for PR 13201 at commit

[GitHub] spark pull request: [SPARK-15360][Spark-Submit]Should print spark-...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13163#issuecomment-220494834 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15360][Spark-Submit]Should print spark-...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13163#issuecomment-220494836 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15360][Spark-Submit]Should print spark-...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13163#issuecomment-220494714 **[Test build #58914 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58914/consoleFull)** for PR 13163 at commit

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220494664 **[Test build #58926 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58926/consoleFull)** for PR 13188 at commit

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/13101#discussion_r63978870 --- Diff: mllib/src/test/java/org/apache/spark/SharedSparkSession.java --- @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [MINOR][ML] Use Datasets (to improve internal ...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11915#issuecomment-220494307 @jaceklaskowski can you close this and reopen when you think it is ready? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/13101#discussion_r63978864 --- Diff: mllib/src/test/java/org/apache/spark/SharedSparkSession.java --- @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/13101#discussion_r63978848 --- Diff: mllib/src/test/java/org/apache/spark/SharedSparkSession.java --- @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-12978][SQL] Skip unnecessary final grou...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10896#issuecomment-220494208 cc @hvanhovell can you review this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/13101#discussion_r63978717 --- Diff: mllib/src/test/java/org/apache/spark/SharedSparkSession.java --- @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220494012 but not the builder, which still uses `SQLContext.getOrCreate`:

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220493901 Ah, yes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-15395][Core]Use getHostString to create...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13196#issuecomment-220493923 **[Test build #2994 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2994/consoleFull)** for PR 13196 at commit

[GitHub] spark pull request: SPARK-14139 Dataset loses nullability in opera...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11980#issuecomment-220493938 @koertkuipers this can be closed now right? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220493679 That's been updated? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-15417][SQL][Python] PySpark shell alway...

2016-05-19 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/13203#issuecomment-220493600 @davies yes that was the old issue. Do you mean a warning for `SparkSession.getOrCreate` in general? I think it's not necessary because that's just the behavior of

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220493033 We should fix `session.py` to use the new scala thing as well. Also tests are failing because python is still trying to call `wrapped`. --- If your project is set

[GitHub] spark pull request: [SPARK-11753][SQL] Make allowNonNumericNumbers...

2016-05-19 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9759#issuecomment-220492281 OK, you're really resolving SPARK-14989 here then as well. You can use 2.7.4 it seems. Yeah the issue is not jackson-core but any other jackson modules

[GitHub] spark pull request: [SPARK-15420] [SQL] Add repartition and sort t...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13206#issuecomment-220492228 **[Test build #58925 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58925/consoleFull)** for PR 13206 at commit

[GitHub] spark pull request: [Minor] [ML] [PySpark] ml.evaluation Scala and...

2016-05-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13195 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13101#issuecomment-220491675 **[Test build #58924 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58924/consoleFull)** for PR 13101 at commit

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread techaddict
Github user techaddict commented on a diff in the pull request: https://github.com/apache/spark/pull/13101#discussion_r63977568 --- Diff: mllib/src/test/java/org/apache/spark/SharedSparkSession.java --- @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-15341] [Doc] [ML] Add documentation for...

2016-05-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13131 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [Minor] [ML] [PySpark] ml.evaluation Scala and...

2016-05-19 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/13195#issuecomment-220491522 LGTM. Merged into master and branch-2.0. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15341] [Doc] [ML] Add documentation for...

2016-05-19 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/13131#issuecomment-220491339 LGTM. Merged into master and branch-2.0. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15341] [Doc] [ML] Add documentation for...

2016-05-19 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/13131#discussion_r63977325 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -137,6 +137,13 @@ class GaussianMixtureModel private[ml] (

[GitHub] spark pull request: SPARK-12920. [SQL]. Spark thrift server can ru...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10846#issuecomment-220491198 @rajeshbalamohan is this still a problem on master? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-15322][SQL][FOLLOW-UP] Update deprecate...

2016-05-19 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/13187#issuecomment-220491134 @srowen Ah, I will keep in mind that I should read comments more carefully. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread techaddict
Github user techaddict commented on a diff in the pull request: https://github.com/apache/spark/pull/13101#discussion_r63977203 --- Diff: mllib/src/test/java/org/apache/spark/SharedSparkSession.java --- @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13101#discussion_r63976971 --- Diff: mllib/src/test/java/org/apache/spark/SharedSparkSession.java --- @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13101#discussion_r63976948 --- Diff: mllib/src/test/java/org/apache/spark/SharedSparkSession.java --- @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-10903] [SPARKR] R - Simplify SQLContext...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9192#issuecomment-220490142 Actually I'd love to have this...! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-15420] [SQL] Add repartition and sort t...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13206#issuecomment-220490181 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15420] [SQL] Add repartition and sort t...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13206#issuecomment-220490179 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15375][SQL][Streaming] Add ConsoleSink ...

2016-05-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13162 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-15420] [SQL] Add repartition and sort t...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13206#issuecomment-220490100 **[Test build #58915 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58915/consoleFull)** for PR 13206 at commit

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220490045 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15424][SQL] Revert SPARK-14807 Create a...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13207#issuecomment-220490030 **[Test build #2997 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2997/consoleFull)** for PR 13207 at commit

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220490047 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15424][SQL] Revert SPARK-14807 Create a...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13207#issuecomment-220490007 **[Test build #2996 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2996/consoleFull)** for PR 13207 at commit

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220489946 **[Test build #58913 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58913/consoleFull)** for PR 13200 at commit

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13101#issuecomment-220489852 **[Test build #58923 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58923/consoleFull)** for PR 13101 at commit

[GitHub] spark pull request: [SPARK-15375][SQL][Streaming] Add ConsoleSink ...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/13162#issuecomment-220489803 Merging in master/2.0. Thanks @jerryshao! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-15322][SQL][FOLLOW-UP] Update deprecate...

2016-05-19 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/13187#issuecomment-220489424 I think he was saying that you using `LongAccumulator` for `Accumulator[Int]`. I don't see anything that suggests this isn't the replacement. It could have been done

[GitHub] spark pull request: [SPARK-15424][SQL] Revert SPARK-14807 Create a...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13207#issuecomment-220489093 **[Test build #2995 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2995/consoleFull)** for PR 13207 at commit

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread sameeragarwal
Github user sameeragarwal commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220488738 Thanks, comments addressed! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220488546 **[Test build #58922 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58922/consoleFull)** for PR 13188 at commit

[GitHub] spark pull request: [SPARK-15341] [Doc] [ML] Add documentation for...

2016-05-19 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/13131#issuecomment-220488159 I'm making a pass. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220487878 **[Test build #58921 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58921/consoleFull)** for PR 13200 at commit

[GitHub] spark pull request: [SPARK-15414][MLlib] Make the mllib,ml linalg ...

2016-05-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13202 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-15424][SQL] Revert SPARK-14807 Create a...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13207#issuecomment-220487675 **[Test build #2995 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2995/consoleFull)** for PR 13207 at commit

[GitHub] spark pull request: [SPARK-15414][MLlib] Make the mllib,ml linalg ...

2016-05-19 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/13202#issuecomment-220487463 LGTM. Merged into master and branch-2.0. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220487194 OK I've pushed a commit to handle sql listener properly. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220486612 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220486610 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220486609 **[Test build #58920 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58920/consoleFull)** for PR 13188 at commit

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220486512 **[Test build #58920 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58920/consoleFull)** for PR 13188 at commit

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220485808 **[Test build #58919 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58919/consoleFull)** for PR 13200 at commit

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220485088 **[Test build #58918 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58918/consoleFull)** for PR 13200 at commit

[GitHub] spark pull request: [SPARK-15416][SQL]Display a better message for...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13201#issuecomment-220485090 **[Test build #58917 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58917/consoleFull)** for PR 13201 at commit

[GitHub] spark pull request: [SPARK-15424][SQL] Revert SPARK-14807 Create a...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13207#issuecomment-220484919 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15424][SQL] Revert SPARK-14807 Create a...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13207#issuecomment-220484922 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15424][SQL] Revert SPARK-14807 Create a...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13207#issuecomment-220484903 **[Test build #58916 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58916/consoleFull)** for PR 13207 at commit

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13188#discussion_r63973393 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/tpcds/queries/ss_max.sql --- @@ -0,0 +1,14 @@ +SELECT --- End

[GitHub] spark pull request: [SPARK-15421][SQL] Validate DDL property value...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13205#issuecomment-220484314 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15421][SQL] Validate DDL property value...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13205#issuecomment-220484311 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15421][SQL] Validate DDL property value...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13205#issuecomment-220484167 **[Test build #58912 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58912/consoleFull)** for PR 13205 at commit

[GitHub] spark pull request: [SPARK-15416][SQL]Display a better message for...

2016-05-19 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/13201#discussion_r63973282 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -93,26 +101,45 @@ case class DataSource(

[GitHub] spark pull request: [SPARK-15075][SPARK-15345][SQL] Clean up Spark...

2016-05-19 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/13200#discussion_r63973275 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala --- @@ -738,26 +734,127 @@ object SparkSession { * Gets an existing

[GitHub] spark pull request: [SPARK-15416][SQL]Display a better message for...

2016-05-19 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/13201#discussion_r63973212 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -93,26 +101,45 @@ case class DataSource(

[GitHub] spark pull request: [SPARK-15424][SQL] Revert SPARK-14807 Create a...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13207#issuecomment-220483667 **[Test build #58916 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58916/consoleFull)** for PR 13207 at commit

[GitHub] spark pull request: [SPARK-15424][SQL] Revert SPARK-14807 Create a...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/13207#issuecomment-220483378 cc @srowen @yhuai @marmbrus --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-15424][SQL] Revert SPARK-14807 Create a...

2016-05-19 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/13207 [SPARK-15424][SQL] Revert SPARK-14807 Create a hivecontext-compatibility module ## What changes were proposed in this pull request? I initially asked to create a hivecontext-compatibility module

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/13188#discussion_r63971900 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/tpcds/TPCDSQueryBenchmark.scala --- @@ -0,0 +1,132 @@ +/* + *

<    1   2   3   4   5   6   7   8   9   >