[GitHub] spark pull request: [SPARK-15413] [ML] [MLLIB] Change `toBreeze` t...

2016-05-19 Thread dbtsai
Github user dbtsai commented on the pull request: https://github.com/apache/spark/pull/13198#issuecomment-220438703 +cc @jkbradley @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220456693 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220456688 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15114][SQL] Column name generated by ty...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13045#issuecomment-220456509 **[Test build #58896 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58896/consoleFull)** for PR 13045 at commit

[GitHub] spark pull request: [SPARK-15114][SQL] Column name generated by ty...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13045#issuecomment-220456786 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15075][SQL] Clean up dependencies betwe...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220467867 **[Test build #58907 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58907/consoleFull)** for PR 13200 at commit

[GitHub] spark pull request: [SPARK-15075][SQL] Clean up dependencies betwe...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220467898 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15075][SQL] Clean up dependencies betwe...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220467897 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15395][Core]Use getHostString to create...

2016-05-19 Thread zzcclp
Github user zzcclp commented on the pull request: https://github.com/apache/spark/pull/13196#issuecomment-220470402 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-15038][SQL] Add option to lazily broadc...

2016-05-19 Thread pwoody
Github user pwoody commented on the pull request: https://github.com/apache/spark/pull/13178#issuecomment-220473754 Hey apologies for the late reply! There are effectively two failure modes w.r.t the memory manager: 1. If you retain the SparkPlan then the broadcast

[GitHub] spark pull request: [SPARK-15365] [SQL]: When table size statistic...

2016-05-19 Thread Parth-Brahmbhatt
Github user Parth-Brahmbhatt commented on a diff in the pull request: https://github.com/apache/spark/pull/13150#discussion_r63968095 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/MetastoreRelation.scala --- @@ -114,17 +115,27 @@ private[hive] case class

[GitHub] spark pull request: [SPARK-15365] [SQL]: When table size statistic...

2016-05-19 Thread Parth-Brahmbhatt
Github user Parth-Brahmbhatt commented on a diff in the pull request: https://github.com/apache/spark/pull/13150#discussion_r63968104 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/MetastoreRelation.scala --- @@ -114,17 +115,27 @@ private[hive] case class

[GitHub] spark pull request: [SPARK-15365] [SQL]: When table size statistic...

2016-05-19 Thread Parth-Brahmbhatt
Github user Parth-Brahmbhatt commented on a diff in the pull request: https://github.com/apache/spark/pull/13150#discussion_r63968077 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/MetastoreRelation.scala --- @@ -114,17 +115,27 @@ private[hive] case class

[GitHub] spark pull request: [SPARK-15186][ML][DOCS] Add user guide for gen...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13139#issuecomment-220437291 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15186][ML][DOCS] Add user guide for gen...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13139#issuecomment-220437293 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15388][SQL] Fix spark sql CREATE FUNCTI...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13177#issuecomment-220437363 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13101#issuecomment-220441596 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13101#issuecomment-220441446 **[Test build #58893 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58893/consoleFull)** for PR 13101 at commit

[GitHub] spark pull request: [SPARK-15416][PySpark]Display a better message...

2016-05-19 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/13201 [SPARK-15416][PySpark]Display a better message for not finding classes removed in Spark 2.0 ## What changes were proposed in this pull request? If finding `NoClassDefFoundError` or

[GitHub] spark pull request: [SPARK-15416][PySpark]Display a better message...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13201#issuecomment-220443676 **[Test build #58898 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58898/consoleFull)** for PR 13201 at commit

[GitHub] spark pull request: [SPARK-15075][SQL] Cleanup dependencies betwee...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220443688 **[Test build #58899 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58899/consoleFull)** for PR 13200 at commit

[GitHub] spark pull request: [SPARK-15075][SQL] Cleanup dependencies betwee...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220446712 **[Test build #58899 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58899/consoleFull)** for PR 13200 at commit

[GitHub] spark pull request: [SPARK-15416][SQL]Display a better message for...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13201#issuecomment-220448990 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15416][SQL]Display a better message for...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13201#issuecomment-220448993 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15413] [ML] [MLLIB] Change `toBreeze` t...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13198#issuecomment-220453075 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15414][MLlib] Make the mllib,ml linalg ...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13202#issuecomment-220457855 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15417][SQL][Python] PySpark shell alway...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13203#issuecomment-220457875 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15414][MLlib] Make the mllib,ml linalg ...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13202#issuecomment-220457851 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15417][SQL][Python] PySpark shell alway...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13203#issuecomment-220457842 **[Test build #58904 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58904/consoleFull)** for PR 13203 at commit

[GitHub] spark pull request: [SPARK-15417][SQL][Python] PySpark shell alway...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13203#issuecomment-220457876 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15417][SQL][Python] PySpark shell alway...

2016-05-19 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/13203#issuecomment-220463575 @andrewor14 So the problem is that getOrCreate() is not aware of the configuration (which could be different from the existing one), should we show an warning on that?

[GitHub] spark pull request: [SPARK-15345][SQL][PYSPARK]. SparkSession's co...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/13160#issuecomment-220463295 I've done it here: https://github.com/apache/spark/pull/13200 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-15413] [ML] [MLLIB] Change `toBreeze` t...

2016-05-19 Thread dbtsai
Github user dbtsai commented on the pull request: https://github.com/apache/spark/pull/13198#issuecomment-220473337 Since this is a private API, this will not affect anything. Given that we are using 'asML' now, I believe that it worths to make them consistent. --- If your project

[GitHub] spark pull request: [SPARK-14279] Spark Version will be picked fro...

2016-05-19 Thread jodersky
Github user jodersky commented on a diff in the pull request: https://github.com/apache/spark/pull/12152#discussion_r63969372 --- Diff: core/src/main/java/org/apache/spark/VersionInfo.java --- @@ -0,0 +1,131 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: [SPARK-15395][Core]Use getHostString to create...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13196#issuecomment-220477551 **[Test build #2994 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2994/consoleFull)** for PR 13196 at commit

[GitHub] spark pull request: [SPARK-15420] [SQL] Add repartition and sort t...

2016-05-19 Thread rdblue
GitHub user rdblue opened a pull request: https://github.com/apache/spark/pull/13206 [SPARK-15420] [SQL] Add repartition and sort to prepare output data ## What changes were proposed in this pull request? * WriterContainer detects that the incoming logical plan has been

[GitHub] spark pull request: [SPARK-15075][SQL] Clean up SparkSession build...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220480244 cc @andrewor14 too who wrote some of this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-15075][SQL] Clean up SparkSession build...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220480176 **[Test build #58913 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58913/consoleFull)** for PR 13200 at commit

[GitHub] spark pull request: [SPARK-15360][Spark-Submit]Should print spark-...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13163#issuecomment-220480180 **[Test build #58914 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58914/consoleFull)** for PR 13163 at commit

[GitHub] spark pull request: [SPARK-15361] [ML] ML 2.0 QA: Scala APIs audit...

2016-05-19 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/13148#issuecomment-220442030 LGTM Merging with master and branch-2.0 Thanks! @holdenk We can discuss this Pyspark Params issue more. I agree it will be important to offer users

[GitHub] spark pull request: [SPARK-15075] [SQL] Cleanup dependencies betwe...

2016-05-19 Thread dilipbiswal
Github user dilipbiswal closed the pull request at: https://github.com/apache/spark/pull/13102 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: [SPARK-15075] [SQL] Cleanup dependencies betwe...

2016-05-19 Thread dilipbiswal
Github user dilipbiswal commented on the pull request: https://github.com/apache/spark/pull/13102#issuecomment-220448360 @rxin Thank you reynold for handling this. It was taking me a lot of time to understand the dependencies. Thanks again .. I will close this now. --- If

[GitHub] spark pull request: [SPARK-15162][SPARK-15164][PySpark][DOCS][ML] ...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12938#issuecomment-220454531 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15162][SPARK-15164][PySpark][DOCS][ML] ...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12938#issuecomment-220454535 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread sameeragarwal
Github user sameeragarwal commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220464114 cc @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-15416][SQL]Display a better message for...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13201#issuecomment-220468768 **[Test build #58902 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58902/consoleFull)** for PR 13201 at commit

[GitHub] spark pull request: [SPARK-15416][SQL]Display a better message for...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13201#issuecomment-220468954 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15416][SQL]Display a better message for...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13201#issuecomment-220468953 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15421][SQL] Validate DDL property value...

2016-05-19 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/13205#issuecomment-220471764 @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/13188#discussion_r63968907 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/tpcds/queries/ss_max.sql --- @@ -0,0 +1,14 @@ +SELECT --- End

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/13188#discussion_r63968968 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/tpcds/queries/q95.sql --- @@ -0,0 +1,28 @@ +WITH ws_wh AS

[GitHub] spark pull request: [SPARK-14279] Spark Version will be picked fro...

2016-05-19 Thread jodersky
Github user jodersky commented on a diff in the pull request: https://github.com/apache/spark/pull/12152#discussion_r63969585 --- Diff: core/src/main/java/org/apache/spark/VersionInfo.java --- @@ -0,0 +1,131 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220478082 **[Test build #58908 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58908/consoleFull)** for PR 13188 at commit

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220478261 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220478172 **[Test build #58909 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58909/consoleFull)** for PR 13188 at commit

[GitHub] spark pull request: [SPARK-15055] Remove setValue method on accumu...

2016-05-19 Thread rxin
Github user rxin closed the pull request at: https://github.com/apache/spark/pull/12837 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: explain of whole stage codegen

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13204#issuecomment-220480353 **[Test build #58910 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58910/consoleFull)** for PR 13204 at commit

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/13188#discussion_r63970987 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/tpcds/queries/q78.sql --- @@ -0,0 +1,64 @@ +WITH ws AS +(SELECT

[GitHub] spark pull request: explain of whole stage codegen

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13204#issuecomment-220480514 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: explain of whole stage codegen

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13204#issuecomment-220480521 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15411] [ML] Add @since to ml.stat.Multi...

2016-05-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13197 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13101#issuecomment-220441597 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15076][SQL] Improve ConstantFolding opt...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12850#issuecomment-220447151 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15412][PySpark][SparkR][DOCS] Improve l...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13199#issuecomment-220447421 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15412][PySpark][SparkR][DOCS] Improve l...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13199#issuecomment-220447414 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15414][MLlib] Make the mllib,ml linalg ...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13202#issuecomment-220447471 **[Test build #58900 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58900/consoleFull)** for PR 13202 at commit

[GitHub] spark pull request: [SPARK-15076][SQL] Improve ConstantFolding opt...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12850#issuecomment-220447148 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15412][PySpark][SparkR][DOCS] Improve l...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13199#issuecomment-220447086 **[Test build #5 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/5/consoleFull)** for PR 13199 at commit

[GitHub] spark pull request: [SPARK-15417][SQL][Python] PySpark shell alway...

2016-05-19 Thread andrewor14
GitHub user andrewor14 opened a pull request: https://github.com/apache/spark/pull/13203 [SPARK-15417][SQL][Python] PySpark shell always uses in-memory catalog ## What changes were proposed in this pull request? There is no way to use the Hive catalog in `pyspark-shell`.

[GitHub] spark pull request: [SPARK-15417][SQL][Python] PySpark shell alway...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13203#issuecomment-220456044 **[Test build #58904 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58904/consoleFull)** for PR 13203 at commit

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/13101#discussion_r63959615 --- Diff: mllib/src/test/java/org/apache/spark/SharedSparkSession.java --- @@ -0,0 +1,55 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: explain of whole stage codegen

2016-05-19 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/13204#issuecomment-220465870 cc @marmbrus @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-15421][SQL] Validate DDL property value...

2016-05-19 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/13205#issuecomment-220476667 lgtm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/13188#discussion_r63968750 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/tpcds/TPCDSQueryBenchmark.scala --- @@ -0,0 +1,132 @@ +/* + *

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/13188#discussion_r63970061 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/tpcds/queries/q14a.sql --- @@ -0,0 +1,121 @@ +WITH cross_items AS

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/13188#discussion_r63970138 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/tpcds/queries/q16.sql --- @@ -0,0 +1,21 @@ +SELECT count(DISTINCT

[GitHub] spark pull request: [SPARK-15420] [SQL] Add repartition and sort t...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13206#issuecomment-220480908 **[Test build #58915 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58915/consoleFull)** for PR 13206 at commit

[GitHub] spark pull request: [SPARK-15388][SQL] Fix spark sql CREATE FUNCTI...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13177#issuecomment-220437120 **[Test build #58886 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58886/consoleFull)** for PR 13177 at commit

[GitHub] spark pull request: [SPARK-15388][SQL] Fix spark sql CREATE FUNCTI...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13177#issuecomment-220437364 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15411] [ML] Add @since to ml.stat.Multi...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13197#issuecomment-220437845 **[Test build #58891 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58891/consoleFull)** for PR 13197 at commit

[GitHub] spark pull request: [SPARK-15411] [ML] Add @since to ml.stat.Multi...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13197#issuecomment-220447762 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15411] [ML] Add @since to ml.stat.Multi...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13197#issuecomment-220447765 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15414][MLlib] Make the mllib,ml linalg ...

2016-05-19 Thread techaddict
Github user techaddict commented on the pull request: https://github.com/apache/spark/pull/13202#issuecomment-220450350 cc: @jkbradley --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-15416][SQL]Display a better message for...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13201#issuecomment-220449991 **[Test build #58902 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58902/consoleFull)** for PR 13201 at commit

[GitHub] spark pull request: [SPARK-15413] [ML] [MLLIB] Change `toBreeze` t...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13198#issuecomment-220453068 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15114][SQL] Column name generated by ty...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13045#issuecomment-220456781 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/13101#discussion_r63958762 --- Diff: mllib/src/test/java/org/apache/spark/SharedSparkSession.java --- @@ -0,0 +1,55 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/13101#issuecomment-220459294 @techaddict thanks. One more comment. The rest looks pretty good. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-15367] [SQL] Add refreshTable back

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13156#issuecomment-220459388 **[Test build #58905 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58905/consoleFull)** for PR 13156 at commit

[GitHub] spark pull request: [SPARK-15367] [SQL] Add refreshTable back

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13156#issuecomment-220461429 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15367] [SQL] Add refreshTable back

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13156#issuecomment-220461395 **[Test build #58905 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58905/consoleFull)** for PR 13156 at commit

[GitHub] spark pull request: [SPARK-15367] [SQL] Add refreshTable back

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13156#issuecomment-220461425 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15296][MLlib] Refactor All Java Tests t...

2016-05-19 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/13101#issuecomment-220461336 Great to see 900 lines were removed:) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220478265 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220478319 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15078][SQL] Add all TPCDS 1.4 benchmark...

2016-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13188#issuecomment-220478320 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15075][SQL] Cleanup dependencies betwee...

2016-05-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/13200#issuecomment-220442699 Note that I still need to add some tests to cover the behavior of the new builders. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-15411] [ML] Add @since to ml.stat.Multi...

2016-05-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13197#issuecomment-220447465 **[Test build #58890 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58890/consoleFull)** for PR 13197 at commit

[GitHub] spark pull request: [SPARK-15370] [SQL] Update RewriteCorrelatedSc...

2016-05-19 Thread frreiss
Github user frreiss commented on a diff in the pull request: https://github.com/apache/spark/pull/13155#discussion_r63954767 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1648,16 +1648,56 @@ object

[GitHub] spark pull request: [SPARK-15417][SQL][Python] PySpark shell alway...

2016-05-19 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/13203#issuecomment-220456009 @davies @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

  1   2   3   4   5   6   7   8   9   >