[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15168 **[Test build #65993 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65993/consoleFull)** for PR 15168 at commit

[GitHub] spark pull request #15248: [SPARK-17671] Spark 2.0 history server summary pa...

2016-09-27 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/15248#discussion_r80795551 --- Diff: core/src/main/scala/org/apache/spark/status/api/v1/ApiRootResource.scala --- @@ -222,6 +222,7 @@ private[spark] object ApiRootResource {

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15168 **[Test build #66001 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66001/consoleFull)** for PR 15168 at commit

[GitHub] spark pull request #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTIT...

2016-09-27 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15168#discussion_r80794752 --- Diff: sql/core/src/test/resources/sql-tests/inputs/describe.sql --- @@ -0,0 +1,24 @@ +CREATE TABLE t (a STRING, b INT) PARTITIONED BY (c

[GitHub] spark pull request #15238: [SPARK-17653][SQL] Remove unnecessary distincts i...

2016-09-27 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15238#discussion_r80794658 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala --- @@ -191,25 +191,34 @@ object ExtractFiltersAndInnerJoins

[GitHub] spark pull request #15238: [SPARK-17653][SQL] Remove unnecessary distincts i...

2016-09-27 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15238#discussion_r80794597 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -579,8 +579,13 @@ object InferFiltersFromConstraints

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-27 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80793355 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/CachedKafkaConsumer.scala --- @@ -0,0 +1,155 @@ +/* + * Licensed

[GitHub] spark pull request #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTIT...

2016-09-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15168#discussion_r80792407 --- Diff: sql/core/src/test/resources/sql-tests/inputs/describe.sql --- @@ -0,0 +1,24 @@ +CREATE TABLE t (a STRING, b INT) PARTITIONED BY (c STRING, d

[GitHub] spark issue #15265: [SPARK-17618] Guard against invalid comparisons between ...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15265 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15265: [SPARK-17618] Guard against invalid comparisons between ...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15265 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65991/ Test PASSed. ---

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15168 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65989/ Test PASSed. ---

[GitHub] spark issue #15265: [SPARK-17618] Guard against invalid comparisons between ...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15265 **[Test build #65991 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65991/consoleFull)** for PR 15265 at commit

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15168 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15168 **[Test build #65989 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65989/consoleFull)** for PR 15168 at commit

[GitHub] spark pull request #15248: [SPARK-17671] Spark 2.0 history server summary pa...

2016-09-27 Thread wgtmac
Github user wgtmac commented on a diff in the pull request: https://github.com/apache/spark/pull/15248#discussion_r80791402 --- Diff: core/src/main/scala/org/apache/spark/status/api/v1/ApiRootResource.scala --- @@ -222,6 +222,7 @@ private[spark] object ApiRootResource {

[GitHub] spark issue #15238: [SPARK-17653][SQL] Remove unnecessary distincts in multi...

2016-09-27 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15238 Currently, both negative and positive cases are combined in the same test case. Could you split them? Thanks! --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #15238: [SPARK-17653][SQL] Remove unnecessary distincts in multi...

2016-09-27 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15238 @viirya Could you add one more test case? ``` query1 | U - D - U - query2 | D - U - query3 | query4 ``` --- If your project is set up

[GitHub] spark issue #15208: [SPARK-17641][SQL] Collect_list/Collect_set should not c...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15208 **[Test build #66000 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66000/consoleFull)** for PR 15208 at commit

[GitHub] spark pull request #15238: [SPARK-17653][SQL] Remove unnecessary distincts i...

2016-09-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15238#discussion_r80788735 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/SetOperationSuite.scala --- @@ -76,4 +77,32 @@ class SetOperationSuite

[GitHub] spark issue #15268: [SPARK-17598] [SQL] [Web UI] User-friendly name for Spar...

2016-09-27 Thread jaceklaskowski
Github user jaceklaskowski commented on the issue: https://github.com/apache/spark/pull/15268 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #15208: [SPARK-17641][SQL] Collect_list/Collect_set should not c...

2016-09-27 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15208 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15208: [SPARK-17641][SQL] Collect_list/Collect_set should not c...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15208 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65992/ Test FAILed. ---

[GitHub] spark pull request #15238: [SPARK-17653][SQL] Remove unnecessary distincts i...

2016-09-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15238#discussion_r80787675 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/SetOperationSuite.scala --- @@ -76,4 +77,32 @@ class SetOperationSuite

[GitHub] spark issue #15208: [SPARK-17641][SQL] Collect_list/Collect_set should not c...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15208 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15208: [SPARK-17641][SQL] Collect_list/Collect_set should not c...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15208 **[Test build #65992 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65992/consoleFull)** for PR 15208 at commit

[GitHub] spark issue #14642: [SPARK-17056][Core] Fix a wrong assert regarding unroll ...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14642 **[Test build #65999 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65999/consoleFull)** for PR 14642 at commit

[GitHub] spark issue #14642: [SPARK-17056][Core] Fix a wrong assert regarding unroll ...

2016-09-27 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/14642 This looks correct to me. Let me retest and then I'll merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #14642: [SPARK-17056][Core] Fix a wrong assert regarding unroll ...

2016-09-27 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/14642 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15238: [SPARK-17653][SQL] Remove unnecessary distincts i...

2016-09-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15238#discussion_r80784941 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala --- @@ -191,25 +191,34 @@ object ExtractFiltersAndInnerJoins

[GitHub] spark pull request #15248: [SPARK-17671] Spark 2.0 history server summary pa...

2016-09-27 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/15248#discussion_r80783291 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala --- @@ -178,6 +178,23 @@ class HistoryServer(

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15168 **[Test build #65988 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65988/consoleFull)** for PR 15168 at commit

[GitHub] spark pull request #15248: [SPARK-17671] Spark 2.0 history server summary pa...

2016-09-27 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/15248#discussion_r80780845 --- Diff: core/src/main/scala/org/apache/spark/status/api/v1/ApiRootResource.scala --- @@ -222,6 +222,7 @@ private[spark] object ApiRootResource {

[GitHub] spark pull request #15248: [SPARK-17671] Spark 2.0 history server summary pa...

2016-09-27 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/15248#discussion_r80780569 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala --- @@ -178,6 +178,23 @@ class HistoryServer(

[GitHub] spark pull request #15248: [SPARK-17671] Spark 2.0 history server summary pa...

2016-09-27 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/15248#discussion_r80779108 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala --- @@ -178,6 +178,23 @@ class HistoryServer(

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15168 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15168 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65988/ Test FAILed. ---

[GitHub] spark issue #15268: [SPARK-17598] [SQL] [Web UI] User-friendly name for Spar...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15268 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15268: [SPARK-17598] [SQL] [Web UI] User-friendly name for Spar...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15268 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65995/ Test PASSed. ---

[GitHub] spark issue #15268: [SPARK-17598] [SQL] [Web UI] User-friendly name for Spar...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15268 **[Test build #65995 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65995/consoleFull)** for PR 15268 at commit

[GitHub] spark issue #15250: [SPARK-17676][CORE] FsHistoryProvider should ignore hidd...

2016-09-27 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/15250 @vanzin woudl appreciate it if you can take a look at this -- related to the change you reviewed back here https://github.com/apache/spark/pull/5886#issuecomment-99941529 --- If your project is

[GitHub] spark issue #15269: [WIP][TEST] Experiment with running Scoverage in tests

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15269 **[Test build #65998 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65998/consoleFull)** for PR 15269 at commit

[GitHub] spark issue #15269: [WIP][TEST] Experiment with running Scoverage in tests

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15269 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65998/ Test FAILed. ---

[GitHub] spark issue #15269: [WIP][TEST] Experiment with running Scoverage in tests

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15269 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15269: [WIP][TEST] Experiment with running Scoverage in tests

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15269 **[Test build #65998 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65998/consoleFull)** for PR 15269 at commit

[GitHub] spark pull request #15252: [SPARK-17677][SQL] Break WindowExec.scala into mu...

2016-09-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15252 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15269: [WIP][TEST] Experiment with running Scoverage in tests

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15269 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15269: [WIP][TEST] Experiment with running Scoverage in tests

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15269 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65996/ Test FAILed. ---

[GitHub] spark issue #15269: [WIP][TEST] Experiment with running Scoverage in tests

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15269 **[Test build #65996 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65996/consoleFull)** for PR 15269 at commit

[GitHub] spark issue #15250: [SPARK-17676][CORE] FsHistoryProvider should ignore hidd...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15250 **[Test build #65997 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65997/consoleFull)** for PR 15250 at commit

[GitHub] spark issue #15269: [WIP][TEST] Experiment with running Scoverage in tests

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15269 **[Test build #65996 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65996/consoleFull)** for PR 15269 at commit

[GitHub] spark issue #15252: [SPARK-17677][SQL] Break WindowExec.scala into multiple ...

2016-09-27 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15252 Merging to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15269: [WIP][TEST] Experiment with running Scoverage in ...

2016-09-27 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/15269 [WIP][TEST] Experiment with running Scoverage in tests WIP to test Scoverage integration in AMPLab Jenkins. You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark issue #15252: [SPARK-17677][SQL] Break WindowExec.scala into multiple ...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15252 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15252: [SPARK-17677][SQL] Break WindowExec.scala into multiple ...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15252 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65987/ Test PASSed. ---

[GitHub] spark issue #15252: [SPARK-17677][SQL] Break WindowExec.scala into multiple ...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15252 **[Test build #65987 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65987/consoleFull)** for PR 15252 at commit

[GitHub] spark issue #15268: [SPARK-17598] [SQL] [Web UI] User-friendly name for Spar...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15268 **[Test build #65995 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65995/consoleFull)** for PR 15268 at commit

[GitHub] spark pull request #15268: [SPARK-17598] [SQL] [Web UI] User-friendly name f...

2016-09-27 Thread ajbozarth
GitHub user ajbozarth opened a pull request: https://github.com/apache/spark/pull/15268 [SPARK-17598] [SQL] [Web UI] User-friendly name for Spark Thrift Server in web UI ## What changes were proposed in this pull request? The name of Spark Thrift JDBC/ODBC Server in web UI

[GitHub] spark issue #14719: [SPARK-17154][SQL] Wrong result can be returned or Analy...

2016-09-27 Thread nsyca
Github user nsyca commented on the issue: https://github.com/apache/spark/pull/14719 @sarutak, my apologies if this will upset you. I'd like to propose an alternative solution to the problems documented in SPARK-13801, 14040, 17337 and, here, 17154. The solution borrows the idea from

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15090 **[Test build #65994 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65994/consoleFull)** for PR 15090 at commit

[GitHub] spark issue #15267: [SPARK-17667] [YARN][WIP]Make locking fine grained in Ya...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15267 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSets

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15249 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSets

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15249 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65986/ Test PASSed. ---

[GitHub] spark issue #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSets

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15249 **[Test build #65986 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65986/consoleFull)** for PR 15249 at commit

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-27 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15168 Now, the PR description is also up-to-date. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTIT...

2016-09-27 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15168#discussion_r80771190 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -276,13 +276,26 @@ class SparkSqlAstBuilder(conf:

[GitHub] spark pull request #14899: [SPARK-17337][SQL] Incomplete algorithm for name ...

2016-09-27 Thread nsyca
Github user nsyca closed the pull request at: https://github.com/apache/spark/pull/14899 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14899: [SPARK-17337][SQL] Incomplete algorithm for name resolut...

2016-09-27 Thread nsyca
Github user nsyca commented on the issue: https://github.com/apache/spark/pull/14899 I am closing this PR. I will propose a general solution in SPARK-17154. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #15267: [SPARK-17667] [YARN][WIP]Make locking fine graine...

2016-09-27 Thread ashwinshankar77
GitHub user ashwinshankar77 opened a pull request: https://github.com/apache/spark/pull/15267 [SPARK-17667] [YARN][WIP]Make locking fine grained in YarnAllocator#enqueueGetLossReasonRequest ## What changes were proposed in this pull request? Following up on the discussion in

[GitHub] spark issue #15208: [SPARK-17641][SQL] Collect_list/Collect_set should not c...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15208 **[Test build #65992 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65992/consoleFull)** for PR 15208 at commit

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15168 **[Test build #65993 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65993/consoleFull)** for PR 15168 at commit

[GitHub] spark issue #15265: [SPARK-17618] Guard against invalid comparisons between ...

2016-09-27 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15265 LGTM - pending jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15208: [SPARK-17641][SQL] Collect_list/Collect_set shoul...

2016-09-27 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15208#discussion_r80767167 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/collect.scala --- @@ -65,7 +65,10 @@ abstract class Collect

[GitHub] spark issue #15266: [SPARK-17693] [SQL] Fixed Insert Failure To Data Source ...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15266 **[Test build #65990 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65990/consoleFull)** for PR 15266 at commit

[GitHub] spark issue #15265: [SPARK-17618] Guard against invalid comparisons between ...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15265 **[Test build #65991 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65991/consoleFull)** for PR 15265 at commit

[GitHub] spark pull request #15266: [SPARK-17693] [SQL] Fixed Insert Failure To Data ...

2016-09-27 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/15266 [SPARK-17693] [SQL] Fixed Insert Failure To Data Source Tables when the Schema has the Comment Field ### What changes were proposed in this pull request? ```SQL CREATE TABLE tab1(col1

[GitHub] spark pull request #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTIT...

2016-09-27 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15168#discussion_r80763632 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -276,13 +276,26 @@ class SparkSqlAstBuilder(conf:

[GitHub] spark pull request #15265: [SPARK-17618] Guard against invalid comparisons b...

2016-09-27 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/15265 [SPARK-17618] Guard against invalid comparisons between UnsafeRow and other formats This patch ports changes from #15185 to Spark 2.x. In that patch, a correctness bug in Spark 1.6.x which was

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

2016-09-27 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r80763362 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeColumnCommand.scala --- @@ -0,0 +1,180 @@ +/* + * Licensed to the

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15168 **[Test build #65989 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65989/consoleFull)** for PR 15168 at commit

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

2016-09-27 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r80761163 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeColumnCommand.scala --- @@ -0,0 +1,180 @@ +/* + * Licensed to

[GitHub] spark pull request #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTIT...

2016-09-27 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15168#discussion_r80759513 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -276,13 +276,26 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark pull request #15185: [SPARK-17618] Fix invalid comparisons between Uns...

2016-09-27 Thread JoshRosen
Github user JoshRosen closed the pull request at: https://github.com/apache/spark/pull/15185 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15168 **[Test build #65988 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65988/consoleFull)** for PR 15168 at commit

[GitHub] spark issue #15254: [SPARK-17679] [PYSPARK] remove unnecessary Py4J ListConv...

2016-09-27 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/15254 +1 on @lins05's suggestion of going further and removing any non-unnecessary explicit usages of `ListConverter`; we might as well clean up all of this in one shot, if possible. --- If your

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-27 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15168 Never mind~. Thank you for coming back! I'll check the PR description again and make up-to-date. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #15264: [SPARK-17477][SQL] SparkSQL cannot handle schema evoluti...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15264 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-27 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15168 @dongjoon-hyun sorry about that. Is the PR description (including all the exceptions) up to date? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #15264: [SPARK-17477][SQL] SparkSQL cannot handle schema ...

2016-09-27 Thread wgtmac
GitHub user wgtmac opened a pull request: https://github.com/apache/spark/pull/15264 [SPARK-17477][SQL] SparkSQL cannot handle schema evolution from Int -> Long when parquet files have Int as its type while hive metastore has Long as its type ## What changes were proposed in this

[GitHub] spark pull request #15208: [SPARK-17641][SQL] Collect_list/Collect_set shoul...

2016-09-27 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/15208#discussion_r80758062 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/collect.scala --- @@ -65,7 +65,10 @@ abstract class Collect

[GitHub] spark issue #14623: [SPARK-17044][SQL] Make test files for window functions ...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65984/ Test PASSed. ---

[GitHub] spark issue #14623: [SPARK-17044][SQL] Make test files for window functions ...

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14623 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14623: [SPARK-17044][SQL] Make test files for window functions ...

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14623 **[Test build #65984 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65984/consoleFull)** for PR 14623 at commit

[GitHub] spark issue #14897: [SPARK-17338][SQL] add global temp view

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14897 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65985/ Test FAILed. ---

[GitHub] spark issue #14897: [SPARK-17338][SQL] add global temp view

2016-09-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14897 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

2016-09-27 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r80755706 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -693,6 +701,7 @@ object HiveExternalCatalog { val

[GitHub] spark issue #14897: [SPARK-17338][SQL] add global temp view

2016-09-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14897 **[Test build #65985 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65985/consoleFull)** for PR 14897 at commit

[GitHub] spark issue #15185: [SPARK-17618] Fix invalid comparisons between UnsafeRow ...

2016-09-27 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15185 Merging to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-27 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15168 Oh, conflicts occurs due to https://github.com/apache/spark/pull/15234 . I'll resolve this soon. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request #15234: [SPARK-17660] [SQL] DESC FORMATTED for VIEW Lacks...

2016-09-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15234 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15102: [SPARK-17346][SQL] Add Kafka source for Structured Strea...

2016-09-27 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15102 We can add an option to allow the user failing the query instead of just logging the warning. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

<    1   2   3   4   5   6   >