[GitHub] spark issue #13451: [SPARK-15711][SQL][WIP]Ban CREATE TEMPORARY TABLE USING ...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13451 **[Test build #59776 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59776/consoleFull)** for PR 13451 at commit [`9bedd70`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13452: [SPARK-15718][SQL] better error message for writing buck...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13452 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59775/ Test FAILed. ---

[GitHub] spark issue #13452: [SPARK-15718][SQL] better error message for writing buck...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13452 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13452: [SPARK-15718][SQL] better error message for writing buck...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13452 **[Test build #59775 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59775/consoleFull)** for PR 13452 at commit [`814ccf6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13453: [SPARK-15715][SQL] Fix alter partition with storage info...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13453 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13453: [SPARK-15715][SQL] Fix alter partition with storage info...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13453 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59777/ Test FAILed. ---

[GitHub] spark issue #13453: [SPARK-15715][SQL] Fix alter partition with storage info...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13453 **[Test build #59777 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59777/consoleFull)** for PR 13453 at commit [`ab7df87`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-01 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13269#discussion_r65460601 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/Encoders.scala --- @@ -208,7 +209,7 @@ object Encoders { BoundReference(0, Object

[GitHub] spark issue #12850: [SPARK-15076][SQL] Add ReorderAssociativeOperator optimi...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12850 **[Test build #59788 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59788/consoleFull)** for PR 12850 at commit [`8b7a0bf`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #12850: [SPARK-15076][SQL] Add ReorderAssociativeOperator optimi...

2016-06-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/12850 I added the missing part, `e.deterministic` check in `isAssociativelyFoldable`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request #13425: [SPARK-15441][SQL] support null object in Dataset...

2016-06-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13425 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13425: [SPARK-15441][SQL] support null object in Dataset outer-...

2016-06-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13425 LGTM, merging to master and branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #12850: [SPARK-15076][SQL] Add ReorderAssociativeOperator optimi...

2016-06-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/12850 Thank you for feedback. I'm really happy with your attention! For the non-deterministic part, we can add a single condition in `isAssociativelyFoldable`. If some of operand of the expre

[GitHub] spark issue #13433: [SPARK-15692][SQL]Improves the explain output of several...

2016-06-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13433 LGTM, pending jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13269 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59772/ Test PASSed. ---

[GitHub] spark issue #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13269 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13269 **[Test build #59772 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59772/consoleFull)** for PR 13269 at commit [`c294b3b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #9162: [SPARK-10655][SQL] Adding additional data type mappings t...

2016-06-01 Thread sureshthalamati
Github user sureshthalamati commented on the issue: https://github.com/apache/spark/pull/9162 @JoshRosen @rxin Any suggestions to improve this fix to get it merged ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If you

[GitHub] spark issue #13450: [SPARK-9876] [BRANCH-2.0] Revert "[SPARK-9876][SQL] Upda...

2016-06-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13450 Merging to branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #13270: [SPARK-15269][SQL] Removes unexpected empty table...

2016-06-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13270 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13433: [SPARK-15692][SQL]Improves the explain output of several...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13433 **[Test build #59787 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59787/consoleFull)** for PR 13433 at commit [`7860982`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #13270: [SPARK-15269][SQL] Removes unexpected empty table direct...

2016-06-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13270 Merging to master and branch-2.0. @xwu0226 @yhuai Thanks for the review! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #12850: [SPARK-15076][SQL] Add ReorderAssociativeOperator optimi...

2016-06-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/12850 UDF is the first thing I came out, and yes, it must be deterministic. But as we have the `deterministic` property in `Expression`, I think it's possible for users to create non-deterministic expre

[GitHub] spark issue #13270: [SPARK-15269][SQL] Removes unexpected empty table direct...

2016-06-01 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/13270 LGTM. @liancheng Can you merge this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13428: [SPARK-12666][CORE] SparkSubmit packages fix for when 'd...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13428 **[Test build #59786 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59786/consoleFull)** for PR 13428 at commit [`b87e0c9`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #13455: [SPARK-15719][SQL] Disables writing Parquet summary file...

2016-06-01 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/13455 lgtm pending jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #13452: [SPARK-15718][SQL] better error message for writing buck...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13452 **[Test build #59785 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59785/consoleFull)** for PR 13452 at commit [`f5e56c9`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #13428: [SPARK-12666][CORE] SparkSubmit packages fix for when 'd...

2016-06-01 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/13428 Haha, no problem, I'll take a virtual high-five :P I agree `default(runtime)` does make more sense, I'll change that up. --- If your project is set up for it, you can reply to this ema

[GitHub] spark issue #13455: [SPARK-15719][SQL] Disables writing Parquet summary file...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13455 **[Test build #59783 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59783/consoleFull)** for PR 13455 at commit [`bb93f5b`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #13433: [SPARK-15692][SQL]Improves the explain output of several...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13433 **[Test build #59784 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59784/consoleFull)** for PR 13433 at commit [`dea71f7`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #13433: [SPARK-15692][SQL]Improves the explain output of ...

2016-06-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13433#discussion_r65456310 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/cache.scala --- @@ -19,15 +19,19 @@ package org.apache.spark.sql.execution.command

[GitHub] spark issue #13290: [SPARK-13484] [SQL] Prevent illegal NULL propagation whe...

2016-06-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13290 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fea

[GitHub] spark pull request #13455: [SPARK-15719][SQL] Disables writing Parquet summa...

2016-06-01 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/13455 [SPARK-15719][SQL] Disables writing Parquet summary files by default ## What changes were proposed in this pull request? This PR disables writing Parquet summary files by default (i.e., w

[GitHub] spark issue #13452: [SPARK-15718][SQL] better error message for writing buck...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13452 **[Test build #59782 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59782/consoleFull)** for PR 13452 at commit [`758ff54`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #13418: [SPARK-15677][SQL] Query with scalar sub-query in...

2016-06-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13418#discussion_r65455758 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1468,7 +1468,8 @@ object DecimalAggregates extends R

[GitHub] spark issue #13335: [SPARK-15580][SQL]Add ContinuousQueryInfo to make Contin...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13335 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13335: [SPARK-15580][SQL]Add ContinuousQueryInfo to make Contin...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13335 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59771/ Test PASSed. ---

[GitHub] spark issue #13335: [SPARK-15580][SQL]Add ContinuousQueryInfo to make Contin...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13335 **[Test build #59771 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59771/consoleFull)** for PR 13335 at commit [`8dfc105`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13428: [SPARK-12666][CORE] SparkSubmit packages fix for when 'd...

2016-06-01 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/13428 @BryanCutler Am I dreaming or is this for real. I've been trying to solve this issue for a very long time. I honestly want to give you a high five now :) `default(runtime)` makes sense to me. Some

[GitHub] spark pull request #13155: [SPARK-15370] [SQL] Update RewriteCorrelatedScala...

2016-06-01 Thread frreiss
Github user frreiss commented on a diff in the pull request: https://github.com/apache/spark/pull/13155#discussion_r65454461 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1695,16 +1695,176 @@ object RewriteCorrelatedScalarSub

[GitHub] spark issue #13285: [Spark-15129][R][DOC]R API changes in ML

2016-06-01 Thread GayathriMurali
Github user GayathriMurali commented on the issue: https://github.com/apache/spark/pull/13285 @yanboliang `$example on$` and `$example off$` needs to be included in ml.R. All the code encompassed within example on and off would be joined and a single code block will be produced in th

[GitHub] spark pull request #13399: [SPARK-15620][SQL] Fix transformed dataset attrib...

2016-06-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13399#discussion_r65454175 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala --- @@ -783,6 +783,16 @@ class DatasetSuite extends QueryTest with SharedSQLCont

[GitHub] spark issue #13399: [SPARK-15620][SQL] Fix transformed dataset attributes re...

2016-06-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13399 LGTM except a minor style comment, thanks for working on it! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request #13452: [SPARK-15718][SQL] better error message for writi...

2016-06-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/13452#discussion_r65453530 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala --- @@ -500,10 +500,10 @@ final class DataFrameWriter private[sql](df: DataF

[GitHub] spark issue #13453: [SPARK-15715][SQL] Fix alter partition with storage info...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13453 **[Test build #59781 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59781/consoleFull)** for PR 13453 at commit [`823479d`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #13450: [SPARK-9876] [BRANCH-2.0] Revert "[SPARK-9876][SQL] Upda...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13450 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59766/ Test PASSed. ---

[GitHub] spark issue #13450: [SPARK-9876] [BRANCH-2.0] Revert "[SPARK-9876][SQL] Upda...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13450 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13269 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13269 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59769/ Test PASSed. ---

[GitHub] spark issue #13451: [SPARK-15711][SQL][WIP]Ban CREATE TEMPORARY TABLE USING ...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13451 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59770/ Test FAILed. ---

[GitHub] spark issue #13451: [SPARK-15711][SQL][WIP]Ban CREATE TEMPORARY TABLE USING ...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13451 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13450: [SPARK-9876] [BRANCH-2.0] Revert "[SPARK-9876][SQL] Upda...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13450 **[Test build #59766 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59766/consoleFull)** for PR 13450 at commit [`1d52cfb`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13269 **[Test build #59769 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59769/consoleFull)** for PR 13269 at commit [`e321e4c`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13451: [SPARK-15711][SQL][WIP]Ban CREATE TEMPORARY TABLE USING ...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13451 **[Test build #59770 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59770/consoleFull)** for PR 13451 at commit [`fa1db6a`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13061: [SPARK-14279] [Build] Pick the spark version from pom

2016-06-01 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/13061 Seems like Jakob is ok with the current code; @dhruve could you resolve conflicts so we can merge this? Sorry for the delay. --- If your project is set up for it, you can reply to this email and hav

[GitHub] spark issue #13450: [SPARK-9876] [BRANCH-2.0] Revert "[SPARK-9876][SQL] Upda...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13450 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59764/ Test PASSed. ---

[GitHub] spark issue #13450: [SPARK-9876] [BRANCH-2.0] Revert "[SPARK-9876][SQL] Upda...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13450 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13450: [SPARK-9876] [BRANCH-2.0] Revert "[SPARK-9876][SQL] Upda...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13450 **[Test build #59764 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59764/consoleFull)** for PR 13450 at commit [`0c08f31`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13428: [SPARK-12666][CORE] SparkSubmit packages fix for when 'd...

2016-06-01 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/13428 Using the wildcard for the fallback conf "default(*)" has the side effect of resolving transitive dependencies from all scopes - so it will grab test jars, etc Would it be more appropriate t

[GitHub] spark issue #13342: [SPARK-15593][SQL]Add DataFrameWriter.foreach to allow t...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13342 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59768/ Test PASSed. ---

[GitHub] spark issue #13342: [SPARK-15593][SQL]Add DataFrameWriter.foreach to allow t...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13342 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13342: [SPARK-15593][SQL]Add DataFrameWriter.foreach to allow t...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13342 **[Test build #59768 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59768/consoleFull)** for PR 13342 at commit [`d6bb884`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13454: [SPARK-15714][CORE] Fix flaky o.a.s.scheduler.BlacklistI...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13454 **[Test build #59778 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59778/consoleFull)** for PR 13454 at commit [`ccb6c20`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #12000: [SPARK-14204] [SQL] register driverClass rather than use...

2016-06-01 Thread zzcclp
Github user zzcclp commented on the issue: https://github.com/apache/spark/pull/12000 @srowen @JoshRosen @holdenk could you take a look and merge this pr? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark issue #13290: [SPARK-13484] [SQL] Prevent illegal NULL propagation whe...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13290 **[Test build #59780 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59780/consoleFull)** for PR 13290 at commit [`071b670`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #13428: [SPARK-12666][CORE] SparkSubmit packages fix for when 'd...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13428 **[Test build #59779 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59779/consoleFull)** for PR 13428 at commit [`ece86f1`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #13433: [SPARK-15692][SQL]Improves the explain output of several...

2016-06-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13433 LGTM except for two minor issues, and pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #12850: [SPARK-15076][SQL] Add ReorderAssociativeOperator optimi...

2016-06-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/12850 Hi, @cloud-fan and @davies . How do you think about the above? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark pull request #13290: [SPARK-13484] [SQL] Prevent illegal NULL propagat...

2016-06-01 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/13290#discussion_r65450769 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1448,6 +1450,38 @@ class Analyzer( } /

[GitHub] spark issue #12850: [SPARK-15076][SQL] Add ReorderAssociativeOperator optimi...

2016-06-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/12850 Thank you for deep discussion on this. I think like this. For 1), there are **machine-generated** queries by BI tools. This is an important category of queries. In many cases, BIs (or

[GitHub] spark pull request #13433: [SPARK-15692][SQL]Improves the explain output of ...

2016-06-01 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13433#discussion_r65450866 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -467,9 +470,11 @@ abstract class TreeNode[BaseType <: Tre

[GitHub] spark pull request #13454: [SPARK-15714] Fix flaky o.a.s.scheduler.Blacklist...

2016-06-01 Thread squito
GitHub user squito opened a pull request: https://github.com/apache/spark/pull/13454 [SPARK-15714] Fix flaky o.a.s.scheduler.BlacklistIntegrationSuite ## What changes were proposed in this pull request? BlacklistIntegrationSuite (introduced by SPARK-10372) is a bit flaky be

[GitHub] spark issue #13453: [SPARK-15715][SQL] Fix alter partition with storage info...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13453 **[Test build #59777 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59777/consoleFull)** for PR 13453 at commit [`ab7df87`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #11461: [SPARK-13607][SQL] Improve compression performance for i...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11461 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59765/ Test PASSed. ---

[GitHub] spark issue #11461: [SPARK-13607][SQL] Improve compression performance for i...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11461 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #13433: [SPARK-15692][SQL]Improves the explain output of ...

2016-06-01 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13433#discussion_r65450329 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -424,9 +424,12 @@ abstract class TreeNode[BaseType <: Tre

[GitHub] spark issue #11461: [SPARK-13607][SQL] Improve compression performance for i...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11461 **[Test build #59765 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59765/consoleFull)** for PR 11461 at commit [`ae80adb`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13453: [SPARK-15715][SQL] Fix alter partition with stora...

2016-06-01 Thread andrewor14
GitHub user andrewor14 opened a pull request: https://github.com/apache/spark/pull/13453 [SPARK-15715][SQL] Fix alter partition with storage information in Hive ## What changes were proposed in this pull request? This command didn't work. Now it does: ``` ALTER TABLE

[GitHub] spark issue #13451: [SPARK-15711][SQL][WIP]Ban CREATE TEMPORARY TABLE USING ...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13451 **[Test build #59776 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59776/consoleFull)** for PR 13451 at commit [`9bedd70`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #13452: [SPARK-15718][SQL] better error message for writing buck...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13452 **[Test build #59775 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59775/consoleFull)** for PR 13452 at commit [`814ccf6`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #13452: [SPARK-15718][SQL] better error message for writing buck...

2016-06-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13452 cc @yhuai @andrewor14 @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #13452: [SPARK-15718][SQL] better error message for writi...

2016-06-01 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/13452 [SPARK-15718][SQL] better error message for writing bucketed data ## What changes were proposed in this pull request? Currently we don't support bucketing for `save` and `insertInto`.

[GitHub] spark issue #13433: [SPARK-15692][SQL]Improves the explain output of several...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13433 **[Test build #59774 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59774/consoleFull)** for PR 13433 at commit [`7ba2c12`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #13433: [SPARK-15692][SQL]Improves the explain output of several...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13433 **[Test build #59773 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59773/consoleFull)** for PR 13433 at commit [`c0bdfe2`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13433: [SPARK-15692][SQL]Improves the explain output of several...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13433 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13433: [SPARK-15692][SQL]Improves the explain output of several...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13433 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59773/ Test FAILed. ---

[GitHub] spark pull request #13416: [SPARK-15596][SPARK-15635][SQL] ALTER TABLE RENAM...

2016-06-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13416 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13433: [SPARK-15692][SQL]Improves the explain output of several...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13433 **[Test build #59773 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59773/consoleFull)** for PR 13433 at commit [`c0bdfe2`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #13416: [SPARK-15596][SPARK-15635][SQL] ALTER TABLE RENAME fixes

2016-06-01 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/13416 merging to master and branch 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13416: [SPARK-15596][SPARK-15635][SQL] ALTER TABLE RENAME fixes

2016-06-01 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/13416 lgtm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #8559: [SPARK-10372] [CORE] basic test framework for entire spar...

2016-06-01 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/8559 Oh thanks for pointing out the flaky test, I think I figured out the problem, opened https://issues.apache.org/jira/browse/SPARK-15714. Weird I never this running locally -- I'd expect this race to b

[GitHub] spark issue #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13269 **[Test build #59772 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59772/consoleFull)** for PR 13269 at commit [`c294b3b`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #13355: [SPARK-15606][core] Use non-blocking removeExecutor call...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13355 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13355: [SPARK-15606][core] Use non-blocking removeExecutor call...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13355 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59762/ Test PASSed. ---

[GitHub] spark issue #13355: [SPARK-15606][core] Use non-blocking removeExecutor call...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13355 **[Test build #59762 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59762/consoleFull)** for PR 13355 at commit [`4d3fc6f`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13418: [SPARK-15677][SQL] Query with scalar sub-query in...

2016-06-01 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/13418#discussion_r65441184 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1468,7 +1468,8 @@ object DecimalAggregates extends Rule

[GitHub] spark issue #12850: [SPARK-15076][SQL] Add ReorderAssociativeOperator optimi...

2016-06-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/12850 I discussed it with @davies offline and here is our conclusion: 1. This feature is not that important, as users can always do it manually, i.e. change the add/multiply order, which is not

[GitHub] spark issue #13448: [SPARK-15707][SQL] Make Code Neat - Use map instead of i...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13448 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13448: [SPARK-15707][SQL] Make Code Neat - Use map instead of i...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13448 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59759/ Test PASSed. ---

[GitHub] spark issue #13448: [SPARK-15707][SQL] Make Code Neat - Use map instead of i...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13448 **[Test build #59759 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59759/consoleFull)** for PR 13448 at commit [`010110e`](https://github.com/apache/spark/commit/

<    1   2   3   4   5   6   7   8   >