[GitHub] spark pull request #14174: [SPARK-16524][SQL] Add RowBatch and RowBasedHashM...

2016-07-22 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14174#discussion_r71924045 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/RowBasedKeyValueBatch.java --- @@ -0,0 +1,182 @@ +/* + * Licens

[GitHub] spark pull request #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avo...

2016-07-22 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/14292#discussion_r71923960 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala --- @@ -247,6 +248,46 @@ private[sql] trait SQLTestUtils } }

[GitHub] spark pull request #14174: [SPARK-16524][SQL] Add RowBatch and RowBasedHashM...

2016-07-22 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14174#discussion_r71923918 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/RowBasedKeyValueBatch.java --- @@ -0,0 +1,182 @@ +/* + * Licens

[GitHub] spark issue #14175: [SPARK-16522][MESOS] Spark application throws exception ...

2016-07-22 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/14175 @sun-rui ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #13898: [SPARK-16197][PYSPARK] Cleanup of Status API Example

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13898 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62736/ Test PASSed. ---

[GitHub] spark issue #13898: [SPARK-16197][PYSPARK] Cleanup of Status API Example

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13898 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14101: [SPARK-16431] [ML] Add a unified method that accepts sin...

2016-07-22 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/14101 I just responded on the main JIRA. Can you please check that out and close this issue for now? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appe

[GitHub] spark issue #13898: [SPARK-16197][PYSPARK] Cleanup of Status API Example

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13898 **[Test build #62736 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62736/consoleFull)** for PR 13898 at commit [`3594ee1`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14295: [SPARK-16648][SQL] Overrides TreeNode.withNewChil...

2016-07-22 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14295#discussion_r71920301 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Last.scala --- @@ -42,6 +42,17 @@ case class Last(child: Express

[GitHub] spark issue #13898: [SPARK-16197][PYSPARK] Cleanup of Status Example and API

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13898 **[Test build #62736 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62736/consoleFull)** for PR 13898 at commit [`3594ee1`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #13898: [SPARK-16197][PYSPARK] Cleanup of Status Example and API

2016-07-22 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/13898 ping @davies , changed example to use SparkSession --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14275 **[Test build #62735 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62735/consoleFull)** for PR 14275 at commit [`be145c7`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/14275 @srowen ready for re-review --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71916241 --- Diff: dev/deps/spark-deps-hadoop-2.2 --- @@ -116,7 +116,7 @@ libfb303-0.9.2.jar libthrift-0.9.2.jar log4j-1.2.17.jar lz4-1.3.0.jar -me

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71915701 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -131,9 +140,18 @@ private[mesos] object Mesos

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71915660 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -105,16 +105,25 @@ private[mesos] object Meso

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71915307 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/MesosDriverDescription.scala --- @@ -40,24 +41,28 @@ private[spark] class MesosDriverDescriptio

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-07-22 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/11157 that test might be flaky https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62727/testReport/junit/org.apache.spark.streaming.scheduler/ExecutorAllocationManagerSuite/basic_functional

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-22 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/14079 I updated it to take into account preemption, and also noticed that `TaskKilled` and `TaskCommitDenied` weren't handled either, so I added those and a test. I also tried to clean up some of the hand

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #62734 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62734/consoleFull)** for PR 14079 at commit [`8a12adf`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14305: Spark-16669:Adding partition prunning to Metastore stati...

2016-07-22 Thread Parth-Brahmbhatt
Github user Parth-Brahmbhatt commented on the issue: https://github.com/apache/spark/pull/14305 @jaceklaskowski created https://github.com/apache/spark/pull/14306. intended to open it against 2.0 branch. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request #14305: Spark-16669:Adding partition prunning to Metastor...

2016-07-22 Thread Parth-Brahmbhatt
Github user Parth-Brahmbhatt closed the pull request at: https://github.com/apache/spark/pull/14305 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feat

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71912703 --- Diff: core/src/main/scala/org/apache/spark/TaskState.scala --- @@ -49,5 +49,6 @@ private[spark] object TaskState extends Enumeration { case Meso

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71912466 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -370,6 +370,13 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with Loggin

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71912447 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -47,7 +47,7 @@ import org.apache.spark.util.Utils * * @param loadDefaults w

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11157 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14296: [SPARK-16639][SQL] The query with having conditio...

2016-07-22 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/14296#discussion_r71912313 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1207,6 +1207,12 @@ class Analyzer(

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11157 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62730/ Test PASSed. ---

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11157 **[Test build #62730 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62730/consoleFull)** for PR 11157 at commit [`8b61dd2`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14319: [SPARK-16635][WEBUI][SQL] Provide Session support in the...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14319 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62731/ Test FAILed. ---

[GitHub] spark issue #14319: [SPARK-16635][WEBUI][SQL] Provide Session support in the...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14319 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14319: [SPARK-16635][WEBUI][SQL] Provide Session support in the...

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14319 **[Test build #62731 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62731/consoleFull)** for PR 14319 at commit [`f7741a0`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14269 **[Test build #62733 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62733/consoleFull)** for PR 14269 at commit [`889fe66`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14269 **[Test build #62732 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62732/consoleFull)** for PR 14269 at commit [`889fe66`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-22 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14269 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-22 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14269 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #14295: [SPARK-16648][SQL] Overrides TreeNode.withNewChil...

2016-07-22 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/14295#discussion_r71908714 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Last.scala --- @@ -42,6 +42,17 @@ case class Last(child: Ex

[GitHub] spark issue #14320: [SPARK-16416] [Core] force eager creation of loggers to ...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14320 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #14320: [SPARK-16416] [Core] force eager creation of logg...

2016-07-22 Thread mikaelstaldal
GitHub user mikaelstaldal opened a pull request: https://github.com/apache/spark/pull/14320 [SPARK-16416] [Core] force eager creation of loggers to avoid shutdown hook conflicts ## What changes were proposed in this pull request? Force eager creation of loggers to avoid shu

[GitHub] spark issue #14318: [TEST][minor] rename SQLTestUtils.withTempTable to withT...

2016-07-22 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14318 Let's create a jira :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[GitHub] spark issue #14318: [TEST][minor] rename SQLTestUtils.withTempTable to withT...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14318 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62729/ Test PASSed. ---

[GitHub] spark issue #14318: [TEST][minor] rename SQLTestUtils.withTempTable to withT...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14318 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14318: [TEST][minor] rename SQLTestUtils.withTempTable to withT...

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14318 **[Test build #62729 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62729/consoleFull)** for PR 14318 at commit [`3a3d28b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14259: [SPARK-16622][SQL] Fix NullPointerException when the ret...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14259 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-22 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #55 has finished](https://jenkins.test.databricks.com/job/spark-pull-request-builder/55/consoleFull)** for PR 36 at commit [`a6c6f40`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-22 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #56 has finished](https://jenkins.test.databricks.com/job/spark-pull-request-builder/56/consoleFull)** for PR 36 at commit [`bebcd1c`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #14259: [SPARK-16622][SQL] Fix NullPointerException when the ret...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14259 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62728/ Test PASSed. ---

[GitHub] spark issue #14259: [SPARK-16622][SQL] Fix NullPointerException when the ret...

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14259 **[Test build #62728 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62728/consoleFull)** for PR 14259 at commit [`7a07617`](https://github.com/apache/spark/commit/

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-22 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #56 has started](https://jenkins.test.databricks.com/job/spark-pull-request-builder/56/consoleFull)** for PR 36 at commit [`bebcd1c`](https://github.com/apache/spark/commit/be

[GitHub] spark pull request #14304: [SPARK-16668][TEST] Test parquet reader for row g...

2016-07-22 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14304#discussion_r71903616 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetEncodingSuite.scala --- @@ -78,4 +78,30 @@ class ParquetEncodi

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-22 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #55 has started](https://jenkins.test.databricks.com/job/spark-pull-request-builder/55/consoleFull)** for PR 36 at commit [`a6c6f40`](https://github.com/apache/spark/commit/a6

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-22 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #53 has finished](https://jenkins.test.databricks.com/job/spark-pull-request-builder/53/consoleFull)** for PR 36 at commit [`bf53b50`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-22 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #53 has started](https://jenkins.test.databricks.com/job/spark-pull-request-builder/53/consoleFull)** for PR 36 at commit [`bf53b50`](https://github.com/apache/spark/commit/bf

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-22 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #54 has finished](https://jenkins.test.databricks.com/job/spark-pull-request-builder/54/consoleFull)** for PR 36 at commit [`631952b`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-22 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #54 has started](https://jenkins.test.databricks.com/job/spark-pull-request-builder/54/consoleFull)** for PR 36 at commit [`631952b`](https://github.com/apache/spark/commit/63

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-22 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #52 has started](https://jenkins.test.databricks.com/job/spark-pull-request-builder/52/consoleFull)** for PR 36 at commit [`7b9f6a9`](https://github.com/apache/spark/commit/7b

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-22 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #52 has finished](https://jenkins.test.databricks.com/job/spark-pull-request-builder/52/consoleFull)** for PR 36 at commit [`7b9f6a9`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #14304: [SPARK-16668][TEST] Test parquet reader for row groups c...

2016-07-22 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14304 Two minor issues, otherwise LGTM. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14304: [SPARK-16668][TEST] Test parquet reader for row g...

2016-07-22 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14304#discussion_r71902498 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetEncodingSuite.scala --- @@ -78,4 +78,30 @@ class ParquetEncodi

[GitHub] spark pull request #14304: [SPARK-16668][TEST] Test parquet reader for row g...

2016-07-22 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14304#discussion_r71901937 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetEncodingSuite.scala --- @@ -78,4 +78,30 @@ class ParquetEncodi

[GitHub] spark pull request #14304: [SPARK-16668][TEST] Test parquet reader for row g...

2016-07-22 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14304#discussion_r71901576 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetEncodingSuite.scala --- @@ -78,4 +78,30 @@ class ParquetEncodi

[GitHub] spark issue #14319: [SPARK-16635][WEBUI][SQL] Provide Session support in the...

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14319 **[Test build #62731 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62731/consoleFull)** for PR 14319 at commit [`f7741a0`](https://github.com/apache/spark/commit/f

[GitHub] spark pull request #14319: [SPARK-16635][WEBUI][SQL] Provide Session support...

2016-07-22 Thread nblintao
GitHub user nblintao opened a pull request: https://github.com/apache/spark/pull/14319 [SPARK-16635][WEBUI][SQL] Provide Session support in the Spark UI ## What changes were proposed in this pull request? Add a Session Tab and the related Session Page in the Spark UI.

[GitHub] spark pull request #14295: [SPARK-16648][SQL] Overrides TreeNode.withNewChil...

2016-07-22 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14295#discussion_r71896054 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Last.scala --- @@ -42,6 +42,17 @@ case class Last(child: Express

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11157 **[Test build #62730 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62730/consoleFull)** for PR 11157 at commit [`8b61dd2`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14318: [TEST][minor] rename SQLTestUtils.withTempTable to withT...

2016-07-22 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14318 LGTM, pending jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-07-22 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/11157 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-07-22 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/11157 Failing test seems irrelevant. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11157 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62727/ Test FAILed. ---

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11157 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11157 **[Test build #62727 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62727/consoleFull)** for PR 11157 at commit [`8b61dd2`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-22 Thread dhruve
Github user dhruve commented on the issue: https://github.com/apache/spark/pull/14269 @vanzin, @srowen Can you kick of the Jenkins build? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark issue #14318: [TEST][minor] rename SQLTestUtils.withTempTable to withT...

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14318 **[Test build #62729 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62729/consoleFull)** for PR 14318 at commit [`3a3d28b`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #14309: [SPARK-11977][SQL] Support accessing a column con...

2016-07-22 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/14309#discussion_r7196 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -641,6 +641,10 @@ class DataFrameSuite extends QueryTest with Shar

[GitHub] spark pull request #14309: [SPARK-11977][SQL] Support accessing a column con...

2016-07-22 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/14309#discussion_r7137 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -641,6 +641,10 @@ class DataFrameSuite extends QueryTest with Shar

[GitHub] spark pull request #14309: [SPARK-11977][SQL] Support accessing a column con...

2016-07-22 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/14309#discussion_r71888979 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -641,6 +641,10 @@ class DataFrameSuite extends QueryTest with Shar

[GitHub] spark issue #14307: [SPARK-16672][SQL] SQLBuilder should not raise exception...

2016-07-22 Thread jaceklaskowski
Github user jaceklaskowski commented on the issue: https://github.com/apache/spark/pull/14307 I didn't even know such a SQL query is possible in SQL :) Lots to learn still. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #14259: [SPARK-16622][SQL] Fix NullPointerException when the ret...

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14259 **[Test build #62728 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62728/consoleFull)** for PR 14259 at commit [`7a07617`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #14305: Spark-16669:Adding partition prunning to Metastore stati...

2016-07-22 Thread jaceklaskowski
Github user jaceklaskowski commented on the issue: https://github.com/apache/spark/pull/14305 I think the PR is completely broken and should be recreated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark issue #14318: [TEST][minor] rename SQLTestUtils.withTempTable to withT...

2016-07-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14318 cc @clockfly @yhuai @liancheng @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark pull request #14318: [TEST][minor] rename SQLTestUtils.withTempTable t...

2016-07-22 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/14318 [TEST][minor] rename SQLTestUtils.withTempTable to withTempView ## What changes were proposed in this pull request? after https://github.com/apache/spark/pull/12945, we renamed the `regi

[GitHub] spark pull request #14302: [SPARK-16663][SQL] desc table should be consisten...

2016-07-22 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/14302#discussion_r71886372 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveOperatorQueryableSuite.scala --- @@ -41,13 +41,13 @@ class HiveOperatorQuer

[GitHub] spark issue #13687: [SPARK-15970][SQL]: avoid warning message for hive metas...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13687 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62726/ Test PASSed. ---

[GitHub] spark issue #13687: [SPARK-15970][SQL]: avoid warning message for hive metas...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13687 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13687: [SPARK-15970][SQL]: avoid warning message for hive metas...

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13687 **[Test build #62726 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62726/consoleFull)** for PR 13687 at commit [`f6b1717`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14259: [SPARK-16622][SQL] Fix NullPointerException when ...

2016-07-22 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14259#discussion_r71885571 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ObjectExpressionsSuite.scala --- @@ -0,0 +1,35 @@ +/* + * Licensed to

[GitHub] spark pull request #14302: [SPARK-16663][SQL] desc table should be consisten...

2016-07-22 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/14302#discussion_r71885483 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -436,11 +436,13 @@ case class DescribeTableCommand(table:

[GitHub] spark pull request #14314: [SPARK-16678] [SPARK-16677] [SQL] Fix two View-re...

2016-07-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14314#discussion_r71884535 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLViewSuite.scala --- @@ -55,6 +54,76 @@ class SQLViewSuite extends QueryTest with

[GitHub] spark pull request #14314: [SPARK-16678] [SPARK-16677] [SQL] Fix two View-re...

2016-07-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14314#discussion_r71883793 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLViewSuite.scala --- @@ -55,6 +54,76 @@ class SQLViewSuite extends QueryTest with

[GitHub] spark pull request #14259: [SPARK-16622][SQL] Fix NullPointerException when ...

2016-07-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14259#discussion_r71880582 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ObjectExpressionsSuite.scala --- @@ -0,0 +1,35 @@ +/* + * Licensed

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13990 @srowen please see https://issues.apache.org/jira/browse/SPARK-16275, there is an explaination why we wanna merge them into 2.0 --- If your project is set up for it, you can reply to this email a

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11157 **[Test build #62727 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62727/consoleFull)** for PR 11157 at commit [`8b61dd2`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14216: [SPARK-16561][MLLib] fix multivarOnlineSummary min/max b...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14216 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14216: [SPARK-16561][MLLib] fix multivarOnlineSummary min/max b...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14216 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62723/ Test PASSed. ---

[GitHub] spark issue #14216: [SPARK-16561][MLLib] fix multivarOnlineSummary min/max b...

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14216 **[Test build #62723 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62723/consoleFull)** for PR 14216 at commit [`96b2068`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14317: [SPARK-16380][EXAMPLES] Update SQL examples and programm...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14317 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14317: [SPARK-16380][EXAMPLES] Update SQL examples and programm...

2016-07-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14317 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62725/ Test PASSed. ---

[GitHub] spark issue #14317: [SPARK-16380][EXAMPLES] Update SQL examples and programm...

2016-07-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14317 **[Test build #62725 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62725/consoleFull)** for PR 14317 at commit [`ba8aae4`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14295: [SPARK-16648][SQL] Overrides TreeNode.withNewChil...

2016-07-22 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/14295#discussion_r71871902 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Last.scala --- @@ -42,6 +42,17 @@ case class Last(child: Ex

[GitHub] spark pull request #14295: [SPARK-16648][SQL] Overrides TreeNode.withNewChil...

2016-07-22 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/14295#discussion_r71871696 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Last.scala --- @@ -42,6 +42,17 @@ case class Last(child: Ex

<    1   2   3   >