[GitHub] spark pull request: [CORE][SQL][MINOR] Scaladoc fixes + string int...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13329#issuecomment-221974375 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [CORE][SQL][MINOR] Scaladoc fixes + string int...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13329#issuecomment-221974106 **[Test build #59395 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59395/consoleFull)** for PR 13329 at commit [`2e794dc`](https://g

[GitHub] spark pull request: [SPARK-15515] [SQL] Error Handling in Running ...

2016-05-26 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13283#discussion_r64807974 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -448,6 +448,14 @@ class Analyzer( }

[GitHub] spark pull request: [SPARK-15576] Add back hive tests blacklisted ...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13334#issuecomment-221972267 **[Test build #59407 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59407/consoleFull)** for PR 13334 at commit [`6361ac5`](https://gi

[GitHub] spark pull request: [SPARK-15576] Add back hive tests blacklisted ...

2016-05-26 Thread techaddict
GitHub user techaddict opened a pull request: https://github.com/apache/spark/pull/13334 [SPARK-15576] Add back hive tests blacklisted by SPARK-15539 ## What changes were proposed in this pull request? Add back hive tests blacklisted by SPARK-15539 ## How was this patch

[GitHub] spark pull request: [SPARK-15162][SPARK-15164][PySpark][DOCS][ML] ...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12938#issuecomment-221971534 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15162][SPARK-15164][PySpark][DOCS][ML] ...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12938#issuecomment-221971527 **[Test build #59406 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59406/consoleFull)** for PR 12938 at commit [`4111b2d`](https://g

[GitHub] spark pull request: [SPARK-15162][SPARK-15164][PySpark][DOCS][ML] ...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12938#issuecomment-221971531 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15552][SQL] Remove unnecessary private[...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13319#issuecomment-221971263 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15552][SQL] Remove unnecessary private[...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13319#issuecomment-221971262 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15162][SPARK-15164][PySpark][DOCS][ML] ...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12938#issuecomment-221971129 **[Test build #59406 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59406/consoleFull)** for PR 12938 at commit [`4111b2d`](https://gi

[GitHub] spark pull request: [SPARK-15552][SQL] Remove unnecessary private[...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13319#issuecomment-221970787 **[Test build #59394 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59394/consoleFull)** for PR 13319 at commit [`f0f6e85`](https://g

[GitHub] spark pull request: [SPARK-13148] [YARN] document zero-keytab Oozi...

2016-05-26 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/11033#issuecomment-221970852 thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-10530] [CORE] Kill other task attempts ...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11996#issuecomment-221970385 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-10530] [CORE] Kill other task attempts ...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11996#issuecomment-221970378 **[Test build #59404 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59404/consoleFull)** for PR 11996 at commit [`db93d17`](https://g

[GitHub] spark pull request: [SPARK-10530] [CORE] Kill other task attempts ...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11996#issuecomment-221970389 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15550][SQL][WIP] Dataset.show() should ...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13331#issuecomment-221970260 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15550][SQL][WIP] Dataset.show() should ...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13331#issuecomment-221970262 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15550][SQL][WIP] Dataset.show() should ...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13331#issuecomment-221969986 **[Test build #59396 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59396/consoleFull)** for PR 13331 at commit [`a1baec5`](https://g

[GitHub] spark pull request: [SPARK-15391] [SQL] manage the temporary memor...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13318#issuecomment-221969935 **[Test build #59405 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59405/consoleFull)** for PR 13318 at commit [`f651956`](https://gi

[GitHub] spark pull request: [SPARK-15495][SQL][WIP] Improve the explain ou...

2016-05-26 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/spark/pull/13271#issuecomment-221969548 @rxin I have moved the changes about innerChildren to another PR. I also have updated the description based on your comment (add SQL query). Please t

[GitHub] spark pull request: [SPARK-15391] [SQL] manage the temporary memor...

2016-05-26 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/13318#discussion_r64805207 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleInMemorySorter.java --- @@ -101,14 +94,17 @@ public void expandPointerArray(LongArray newArr

[GitHub] spark pull request: [SPARK-10530] [CORE] Kill other task attempts ...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11996#issuecomment-221968760 **[Test build #59404 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59404/consoleFull)** for PR 11996 at commit [`db93d17`](https://gi

[GitHub] spark pull request: [SPARK-15495][SQL][WIP] Improve the explain ou...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13271#issuecomment-221968745 **[Test build #59403 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59403/consoleFull)** for PR 13271 at commit [`27328f9`](https://gi

[GitHub] spark pull request: [SPARK-13445][SQL]Improves error message and a...

2016-05-26 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/1#issuecomment-221968733 lgtm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request: [SPARK-10530] [CORE] Kill other task attempts ...

2016-05-26 Thread devaraj-kavali
Github user devaraj-kavali commented on the pull request: https://github.com/apache/spark/pull/11996#issuecomment-221968586 @kayousterhout Thanks a lot for your review and comments. I have fixed them, please have a look into this. --- If your project is set up for it, you can reply t

[GitHub] spark pull request: [SPARK-6320][SQL] Move planLater method into G...

2016-05-26 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/13147#issuecomment-221968384 Unfortunately, I don't have the code anymore, but I can try to sketch out what I think the right solution looks like. Basically, the problem is that `planLater` is a

[GitHub] spark pull request: [SPARK-15236][SQL][SPARK SHELL] Add spark-defa...

2016-05-26 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/13088#issuecomment-221968007 @xwu0226 thanks for working on this. This patch currently exposes too much to the user. The config is internal and should be kept that way; that's the reason why it'

[GitHub] spark pull request: [SPARK-12922][SparkR][WIP] Implement gapply() ...

2016-05-26 Thread NarineK
Github user NarineK commented on a diff in the pull request: https://github.com/apache/spark/pull/12836#discussion_r64804537 --- Diff: R/pkg/R/DataFrame.R --- @@ -1268,6 +1268,82 @@ setMethod("dapplyCollect", ldf }) +#' gapply +#' +#

[GitHub] spark pull request: [SPARK-15236][SQL][SPARK SHELL] Add spark-defa...

2016-05-26 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/13088#discussion_r64804303 --- Diff: conf/spark-defaults.conf.template --- @@ -25,3 +25,4 @@ # spark.serializer org.apache.spark.serializer.KryoSerializer

[GitHub] spark pull request: [SPARK-12922][SparkR][WIP] Implement gapply() ...

2016-05-26 Thread NarineK
Github user NarineK commented on a diff in the pull request: https://github.com/apache/spark/pull/12836#discussion_r64803994 --- Diff: R/pkg/R/DataFrame.R --- @@ -1268,6 +1268,82 @@ setMethod("dapplyCollect", ldf }) +#' gapply +#' +#

[GitHub] spark pull request: [SPARK-15186][ML][DOCS] Add user guide for gen...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13139#issuecomment-221967254 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15186][ML][DOCS] Add user guide for gen...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13139#issuecomment-221967104 **[Test build #59402 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59402/consoleFull)** for PR 13139 at commit [`a00a470`](https://g

[GitHub] spark pull request: [SPARK-15186][ML][DOCS] Add user guide for gen...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13139#issuecomment-221967252 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15236][SQL][SPARK SHELL] Add spark-defa...

2016-05-26 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/13088#discussion_r64804173 --- Diff: repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkILoop.scala --- @@ -43,6 +43,10 @@ class SparkILoop(in0: Option[BufferedReader], out:

[GitHub] spark pull request: [SPARK-15236][SQL][SPARK SHELL] Add spark-defa...

2016-05-26 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/13088#discussion_r64803892 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala --- @@ -585,6 +585,18 @@ class SparkSession private( sparkContext.stop(

[GitHub] spark pull request: [SPARK-15236][SQL][SPARK SHELL] Add spark-defa...

2016-05-26 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/13088#discussion_r64803748 --- Diff: repl/scala-2.11/src/main/scala/org/apache/spark/repl/Main.scala --- @@ -88,10 +88,22 @@ object Main extends Logging { }

[GitHub] spark pull request: [SPARK-15236][SQL][SPARK SHELL] Add spark-defa...

2016-05-26 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/13088#discussion_r64803716 --- Diff: repl/scala-2.11/src/main/scala/org/apache/spark/repl/Main.scala --- @@ -88,10 +88,22 @@ object Main extends Logging { }

[GitHub] spark pull request: [SPARK-14543] [SQL] Improve InsertIntoTable co...

2016-05-26 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/12313#issuecomment-221966605 @rdblue Thank you for this PR. Those improvements sound good. I chatted with others. Here are two questions. 1. `sqlContext.table("source").write.byName.insertInto("de

[GitHub] spark pull request: [SPARK-12922][SparkR][WIP] Implement gapply() ...

2016-05-26 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/12836#issuecomment-221966464 Thanks for the update @NarineK - The R changes are looking pretty good to me. Had some minor documentation comments. @sun-rui Could you take one more look ?

[GitHub] spark pull request: [SPARK-15100][DOC] Modified user guide and exa...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13176#issuecomment-221966410 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15100][DOC] Modified user guide and exa...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13176#issuecomment-221966408 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15100][DOC] Modified user guide and exa...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13176#issuecomment-221966136 **[Test build #59399 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59399/consoleFull)** for PR 13176 at commit [`39d3dfb`](https://g

[GitHub] spark pull request: [SPARK-12922][SparkR][WIP] Implement gapply() ...

2016-05-26 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/12836#discussion_r64803396 --- Diff: R/pkg/R/DataFrame.R --- @@ -1268,6 +1268,82 @@ setMethod("dapplyCollect", ldf }) +#' gapply +#' +

[GitHub] spark pull request: [SPARK-12922][SparkR][WIP] Implement gapply() ...

2016-05-26 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/12836#discussion_r64803455 --- Diff: R/pkg/R/DataFrame.R --- @@ -1268,6 +1268,82 @@ setMethod("dapplyCollect", ldf }) +#' gapply +#' +

[GitHub] spark pull request: [SPARK-15186][ML][DOCS] Add user guide for gen...

2016-05-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/13139#discussion_r64803173 --- Diff: docs/ml-classification-regression.md --- @@ -374,6 +374,137 @@ regression model and extracting model summary statistics. +## G

[GitHub] spark pull request: [MINOR][DOCS] Typo fixes in Dataset scaladoc

2016-05-26 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/13330#discussion_r64802782 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1665,7 +1665,7 @@ class Dataset[T] private[sql]( } /**

[GitHub] spark pull request: [SPARK-15186][ML][DOCS] Add user guide for gen...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13139#issuecomment-221965040 **[Test build #59402 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59402/consoleFull)** for PR 13139 at commit [`a00a470`](https://gi

[GitHub] spark pull request: [SPARK-15520] [SQL] Also set sparkContext conf...

2016-05-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13309 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-15186][ML][DOCS] Add user guide for gen...

2016-05-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/13139#discussion_r64802567 --- Diff: docs/ml-classification-regression.md --- @@ -374,6 +374,137 @@ regression model and extracting model summary statistics. +## G

[GitHub] spark pull request: [SPARK-15539][SQL] DROP TABLE throw exception ...

2016-05-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13307 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-15186][ML][DOCS] Add user guide for gen...

2016-05-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/13139#discussion_r64802545 --- Diff: docs/ml-classification-regression.md --- @@ -374,6 +374,137 @@ regression model and extracting model summary statistics. +## G

[GitHub] spark pull request: [SPARK-15520] [SQL] Also set sparkContext conf...

2016-05-26 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/13309#issuecomment-221964506 Merging into master 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-15539][SQL] DROP TABLE throw exception ...

2016-05-26 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/13307#issuecomment-221964196 https://issues.apache.org/jira/browse/SPARK-15576 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-15495][SQL][WIP] Improve the explain ou...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13271#issuecomment-221962010 **[Test build #59391 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59391/consoleFull)** for PR 13271 at commit [`296159a`](https://g

[GitHub] spark pull request: [SPARK-15539][SQL] DROP TABLE throw exception ...

2016-05-26 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/13307#issuecomment-221963953 OK, let's do that in a follow-up patch. Thanks, merging into master 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-13445][SQL]Improves error message and a...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1#issuecomment-221963853 **[Test build #59400 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59400/consoleFull)** for PR 1 at commit [`5a71f89`](https://gi

[GitHub] spark pull request: [SPARK-15538][SPARK-15539][SQL] Truncate table...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13315#issuecomment-221963878 **[Test build #59401 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59401/consoleFull)** for PR 13315 at commit [`d994460`](https://gi

[GitHub] spark pull request: [SPARK-13445][SQL]Improves error message and a...

2016-05-26 Thread clockfly
GitHub user clockfly opened a pull request: https://github.com/apache/spark/pull/1 [SPARK-13445][SQL]Improves error message and add test coverage for Window function ## What changes were proposed in this pull request? Add more verbose error message when order by clause

[GitHub] spark pull request: [SPARK-15100][DOC] Modified user guide and exa...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13176#issuecomment-221962590 **[Test build #59399 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59399/consoleFull)** for PR 13176 at commit [`39d3dfb`](https://gi

[GitHub] spark pull request: [SPARK-13148] [YARN] document zero-keytab Oozi...

2016-05-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11033 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-15551][MINOR][DOCS][SQL] Replace groupB...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13316#issuecomment-221962589 **[Test build #59398 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59398/consoleFull)** for PR 13316 at commit [`325a2ea`](https://gi

[GitHub] spark pull request: [SPARK-15569] Reduce frequency of updateBytesW...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13332#issuecomment-221962471 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-15113][PySpark][ML] Add missing num fea...

2016-05-26 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/12889#issuecomment-221962515 ping? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-15092][SPARK-15139][PYSPARK][ML] Pyspar...

2016-05-26 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/12919#issuecomment-221962428 ping? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-15495][SQL][WIP] Improve the explain ou...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13271#issuecomment-221962312 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15495][SQL][WIP] Improve the explain ou...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13271#issuecomment-221962310 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15551][MINOR][DOCS][SQL] Replace groupB...

2016-05-26 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/13316#issuecomment-221962144 jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-15569] Reduce frequency of updateBytesW...

2016-05-26 Thread sitalkedia
GitHub user sitalkedia opened a pull request: https://github.com/apache/spark/pull/13332 [SPARK-15569] Reduce frequency of updateBytesWritten function in Disk… ## What changes were proposed in this pull request? Profiling a Spark job spilling large amount of intermediate d

[GitHub] spark pull request: [SPARK-13148] [YARN] document zero-keytab Oozi...

2016-05-26 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/11033#issuecomment-221961068 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-15100][DOC] Modified user guide and exa...

2016-05-26 Thread GayathriMurali
Github user GayathriMurali commented on a diff in the pull request: https://github.com/apache/spark/pull/13176#discussion_r64799207 --- Diff: docs/ml-features.md --- @@ -145,9 +148,11 @@ for more details on the API. passed to other algorithms like LDA. During the f

[GitHub] spark pull request: [SPARK-15046] When running hive-thriftserver w...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12824#issuecomment-221958607 **[Test build #59397 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59397/consoleFull)** for PR 12824 at commit [`1c48d07`](https://gi

[GitHub] spark pull request: [SPARK-15046] When running hive-thriftserver w...

2016-05-26 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/12824#issuecomment-221958301 @trystanleftwich to clarify you get this exception because you are specifying the config in ms, or the default value is causing this exception? --- If your project

[GitHub] spark pull request: [SPARK-15046] When running hive-thriftserver w...

2016-05-26 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/12824#issuecomment-221958395 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-15517][SQL][STREAMING] Add support for ...

2016-05-26 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/13286#discussion_r64796991 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StatefulAggregate.scala --- @@ -82,40 +82,62 @@ case class StateStoreRestoreExec(

[GitHub] spark pull request: [SPARK-15517][SQL][STREAMING] Add support for ...

2016-05-26 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/13286#discussion_r64796697 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/utils.scala --- @@ -33,7 +34,7 @@ object Utils { resultExpressions: Seq[Na

[GitHub] spark pull request: [SPARK-15517][SQL][STREAMING] Add support for ...

2016-05-26 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/13286#discussion_r64796643 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala --- @@ -319,14 +362,19 @@ final class DataFrameWriter private[sql](df: DataFrame)

[GitHub] spark pull request: [SPARK-15517][SQL][STREAMING] Add support for ...

2016-05-26 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/13286#discussion_r64796289 --- Diff: python/pyspark/sql/readwriter.py --- @@ -500,6 +500,25 @@ def mode(self, saveMode): self._jwrite = self._jwrite.mode(saveMode)

[GitHub] spark pull request: [Spark-15129][R][DOC]R API changes in ML

2016-05-26 Thread GayathriMurali
Github user GayathriMurali commented on the pull request: https://github.com/apache/spark/pull/13285#issuecomment-221954150 @yanboliang Can you please help review? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-15538][SPARK-15539][SQL] Truncate table...

2016-05-26 Thread sureshthalamati
Github user sureshthalamati commented on the pull request: https://github.com/apache/spark/pull/13315#issuecomment-221953361 @andrewor14 The behavior you mentioned is the one I was expecting also. For some reason it does not work in my env. I was trying for a spark-shell . What cat

[GitHub] spark pull request: [SPARK-10903] [SPARKR] R - Simplify SQLContext...

2016-05-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9192 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-15515] [SQL] Error Handling in Running ...

2016-05-26 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/13283#discussion_r64795297 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -448,6 +448,14 @@ class Analyzer( }

[GitHub] spark pull request: [SPARK-10903] [SPARKR] R - Simplify SQLContext...

2016-05-26 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/9192#issuecomment-221952267 Merging this to master and branch-2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark pull request: [SPARK-15538][SPARK-15539][SQL] Truncate table...

2016-05-26 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/13315#discussion_r64794004 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -289,37 +289,53 @@ case class TruncateTableCommand( val c

[GitHub] spark pull request: [MINOR] Fix Typos 'a -> an'

2016-05-26 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/13317#issuecomment-221950905 So when I was skimming it last night, it looked like it also drops "a and" to "and" (which is good) but we might also want to mention. --- If your project is set up fo

[GitHub] spark pull request: [SPARK-15538][SPARK-15539][SQL] Truncate table...

2016-05-26 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/13315#discussion_r64793761 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -289,37 +289,53 @@ case class TruncateTableCommand( val c

[GitHub] spark pull request: [SPARK-15236][SQL][SPARK SHELL] Add spark-defa...

2016-05-26 Thread xwu0226
Github user xwu0226 commented on the pull request: https://github.com/apache/spark/pull/13088#issuecomment-221950494 Let me rebase and try again. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-15236][SQL][SPARK SHELL] Add spark-defa...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13088#issuecomment-221948556 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15538][SPARK-15539][SQL] Truncate table...

2016-05-26 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/13315#issuecomment-221949749 {{sql("truncate table emp16") }} should delete all partitions, right? --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] spark pull request: [SPARK-15550][SQL][WIP] Dataset.show() should ...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13331#issuecomment-221949136 **[Test build #59396 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59396/consoleFull)** for PR 13331 at commit [`a1baec5`](https://gi

[GitHub] spark pull request: [MINOR][DOCS] Typo fixes in Dataset scaladoc

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13330#issuecomment-221949059 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-15550][SQL][WIP] Dataset.show() should ...

2016-05-26 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/13331#issuecomment-221948972 LGTM, pending tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-15538][SPARK-15539][SQL] Truncate table...

2016-05-26 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/13315#issuecomment-221949078 @sureshthalamati what behavior did you expect? I would think that truncating a partitioned table without specifying the specs should just delete data from all partit

[GitHub] spark pull request: [SPARK-15550][SQL][WIP] Dataset.show() should ...

2016-05-26 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13331#discussion_r64792393 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala --- @@ -440,14 +439,16 @@ class DatasetSuite extends QueryTest with SharedSQLCon

[GitHub] spark pull request: [SPARK-15236][SQL][SPARK SHELL] Add spark-defa...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13088#issuecomment-221948560 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15236][SQL][SPARK SHELL] Add spark-defa...

2016-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13088#issuecomment-221948371 **[Test build #59390 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59390/consoleFull)** for PR 13088 at commit [`9c3bd5a`](https://g

[GitHub] spark pull request: [SPARK-15550][SQL][WIP] Dataset.show() should ...

2016-05-26 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/13331 [SPARK-15550][SQL][WIP] Dataset.show() should show contents nested products as rows ## What changes were proposed in this pull request? This PR addresses two related issues: 1.

[GitHub] spark pull request: [MINOR][DOCS] Typo fixes in Dataset scaladoc

2016-05-26 Thread xinhhuynh
GitHub user xinhhuynh opened a pull request: https://github.com/apache/spark/pull/13330 [MINOR][DOCS] Typo fixes in Dataset scaladoc ## What changes were proposed in this pull request? Minor typo fixes in Dataset scaladoc * Corrected return type as DataFrame, not DataSet

[GitHub] spark pull request: [SPARK-15552][SQL] Remove unnecessary private[...

2016-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13319#issuecomment-221945433 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15186][ML][DOCS] Add user guide for gen...

2016-05-26 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/13139#discussion_r64790223 --- Diff: docs/ml-classification-regression.md --- @@ -374,6 +374,137 @@ regression model and extracting model summary statistics. +#

<    1   2   3   4   5   6   7   8   9   >