[GitHub] spark issue #14185: [SPARK-16511][SUBMIT] Expose SparkLauncher's ProcessBuil...

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14185 **[Test build #62289 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62289/consoleFull)** for PR 14185 at commit [`7fe36f5`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-13 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/14022 To reduce the risk, how about changing the semantics to ``` * - spark/sparkconf/hiveconf: looks for the value in the spark config * - system: looks for the value in the system propertie

[GitHub] spark issue #14185: [SPARK-16511][SUBMIT] Expose SparkLauncher's ProcessBuil...

2016-07-13 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14185 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #14185: [SPARK-16511][SUBMIT] Expose SparkLauncher's Proc...

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14185#discussion_r70731128 --- Diff: launcher/src/main/java/org/apache/spark/launcher/SparkLauncher.java --- @@ -418,14 +414,26 @@ public SparkAppHandle startApplication(SparkAppHandle

[GitHub] spark issue #14185: [SPARK-16511][SUBMIT] Expose SparkLauncher's ProcessBuil...

2016-07-13 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14185 This PR should really be referencing SPARK-14702, which is the older bug. SPARK-16511 should be closed as a duplicate of it. --- If your project is set up for it, you can reply to this email and hav

[GitHub] spark pull request #14185: [SPARK-16511][SUBMIT] Expose SparkLauncher's Proc...

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14185#discussion_r70730228 --- Diff: launcher/src/main/java/org/apache/spark/launcher/SparkLauncher.java --- @@ -418,14 +414,26 @@ public SparkAppHandle startApplication(SparkAppHandle

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-13 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14022 > Wouldn't enabling it by default break backwards compatibility? Yes, maybe. But having a flag to disable everything would also potentially break features that rely on it... although you coul

[GitHub] spark issue #14190: [SPARK-16536][SQL][PYSPARK] Expose `sql` in PySpark Shel...

2016-07-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14190 Hi, @rxin . Could you review this trivial PR exposing `sql()` in PySpark Shell for consistency? --- If your project is set up for it, you can reply to this email and have your reply appea

[GitHub] spark pull request #14185: [SPARK-16511][SUBMIT] Expose SparkLauncher's Proc...

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14185#discussion_r70729812 --- Diff: launcher/src/main/java/org/apache/spark/launcher/SparkLauncher.java --- @@ -418,14 +414,26 @@ public SparkAppHandle startApplication(SparkAppHandle

[GitHub] spark issue #14184: [SPARK-16529][SQL][TEST] `withTempDatabase` should set `...

2016-07-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14184 Hi, @liancheng . Could you review this PR? It was made by you at https://github.com/apache/spark/commit/72981bc8f0d421e2563e2543a8c16a8cc76ad3aa#diff-e59968489e4f36f43010dd7acd6034

[GitHub] spark pull request #14185: [SPARK-16511][SUBMIT] Expose SparkLauncher's Proc...

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14185#discussion_r70729733 --- Diff: core/src/test/scala/org/apache/spark/launcher/LauncherBackendSuite.scala --- @@ -17,15 +17,16 @@ package org.apache.spark.launcher

[GitHub] spark pull request #14185: [SPARK-16511][SUBMIT] Expose SparkLauncher's Proc...

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14185#discussion_r70729726 --- Diff: core/src/test/scala/org/apache/spark/launcher/LauncherBackendSuite.scala --- @@ -17,15 +17,16 @@ package org.apache.spark.launcher

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-13 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/14022 Wouldn't enabling it by default break backwards compatibility? I agree that would be better, but it seems likely that '${...}' may be used in existing configs. --- If your project is set up for it,

[GitHub] spark issue #14177: [SPARK-16027][SPARKR] Fix R tests SparkSession init/stop

2016-07-13 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14177 Does the hive metastore not shutdown properly even if we do `sparkSession.stop()` in all the test files ? The reason I'm trying to avoid having `enableHiveMetastore=F` in most test files is that Hi

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-13 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14022 > how about a global flag for enabling config expansion I think that would be more confusing. Why would someone disable expansion? My only concern with enabling it for all options is

[GitHub] spark pull request #14022: [SPARK-16272][core] Allow config values to refere...

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14022#discussion_r70728894 --- Diff: core/src/main/scala/org/apache/spark/internal/config/ConfigEntry.scala --- @@ -99,13 +118,83 @@ private class FallbackConfigEntry[T] ( key:

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-13 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/14022 Instead of selectively enabling this for certain confs / config builders, how about a global flag for enabling config expansion? I think that would be less likely to be confusing. Also, perhaps a warn

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-13 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14079 Just some minor stuff, I'll let people more familiar with the scheduler comment further. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as wel

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14139 **[Test build #62288 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62288/consoleFull)** for PR 14139 at commit [`82d3711`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-13 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14139 @rxin I think this version is the minimal change. Since the partition discovery logic in inside HadoopFsRelation in 1.6 and the refresh is triggered by using lazy val, passing a flag down will introdu

[GitHub] spark pull request #14022: [SPARK-16272][core] Allow config values to refere...

2016-07-13 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/14022#discussion_r70728529 --- Diff: core/src/main/scala/org/apache/spark/internal/config/ConfigEntry.scala --- @@ -99,13 +118,83 @@ private class FallbackConfigEntry[T] ( key:

[GitHub] spark issue #14190: [SPARK-16536][SQL][PYSPARK] Expose `sql` in PySpark Shel...

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14190 **[Test build #62286 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62286/consoleFull)** for PR 14190 at commit [`c5dc235`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14139 **[Test build #62287 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62287/consoleFull)** for PR 14139 at commit [`5d66df7`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-13 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/13670 Follow up to my previous post, this works on yarn and the history server but not on standalone, as a user I can't figure out what's broken. --- If your project is set up for it, you can reply to

[GitHub] spark pull request #14190: [SPARK-16536][SQL][PYSPARK] Expose `sql` in PySpa...

2016-07-13 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/14190 [SPARK-16536][SQL][PYSPARK] Expose `sql` in PySpark Shell ## What changes were proposed in this pull request? This PR exposes `sql` in PySpark Shell like Scala/R Shells. **Ba

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r70728183 --- Diff: core/src/test/scala/org/apache/spark/scheduler/BlacklistTrackerSuite.scala --- @@ -0,0 +1,282 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] spark pull request #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not s...

2016-07-13 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/14139#discussion_r70727924 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -273,6 +273,22 @@ private[hive] class HiveMetastoreCatalog(val cl

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r70727964 --- Diff: core/src/test/scala/org/apache/spark/scheduler/BlacklistTrackerSuite.scala --- @@ -0,0 +1,282 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r70727854 --- Diff: core/src/test/scala/org/apache/spark/scheduler/BlacklistTrackerSuite.scala --- @@ -0,0 +1,282 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r70727727 --- Diff: core/src/test/scala/org/apache/spark/scheduler/BlacklistIntegrationSuite.scala --- @@ -51,37 +54,67 @@ class BlacklistIntegrationSuite extends Sch

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r70727301 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -611,16 +614,32 @@ private[spark] class TaskSetManager( //

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r70727231 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -292,8 +288,12 @@ private[spark] class TaskSetManager( {

[GitHub] spark issue #14189: [SPARK-16535] In pom.xml, remove groupId which is redund...

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14189 **[Test build #62285 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62285/consoleFull)** for PR 14189 at commit [`815aa05`](https://github.com/apache/spark/commit/8

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r70726798 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala --- @@ -280,11 +304,25 @@ private[spark] class TaskSchedulerImpl(

[GitHub] spark issue #14173: [SPARKR][SPARK-16507] Add a CRAN checker, fix Rd aliases

2016-07-13 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/14173 right, that line would not be necessary. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-13 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/13670 Thanks for all the fixes, I checked it out and am in the middle of looking at it. It looks great on the history server for me but the page just doesn't load or show and form of errors when i try t

[GitHub] spark issue #14189: [SPARK-16535] In pom.xml, remove groupId which is redund...

2016-07-13 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/14189 I've just changes pom.xml files in a few of sub projects, if this is a valid patch, I'll change all of the pom.xml files. --- If your project is set up for it, you can reply to this email and hav

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r70726463 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,223 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request #14189: [SPARK-16535] In pom.xml, remove groupId which is...

2016-07-13 Thread keypointt
GitHub user keypointt opened a pull request: https://github.com/apache/spark/pull/14189 [SPARK-16535] In pom.xml, remove groupId which is redundant definition and inherited from the parent https://issues.apache.org/jira/browse/SPARK-16535 ## What changes were proposed in th

[GitHub] spark issue #14173: [SPARKR][SPARK-16507] Add a CRAN checker, fix Rd aliases

2016-07-13 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14173 I managed to reproduce the issue that Jenkins was hitting. It had to do with using `@method` on a as.DataFrame that was creating an error on html generation. I just removed that and it seems to be

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r70726067 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,223 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark issue #14173: [SPARKR][SPARK-16507] Add a CRAN checker, fix Rd aliases

2016-07-13 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/14173 I ran both knitr and lintr on this, both succeeded. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r70725583 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,223 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark issue #14173: [SPARKR][SPARK-16507] Add a CRAN checker, fix Rd aliases

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14173 **[Test build #62284 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62284/consoleFull)** for PR 14173 at commit [`3299242`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #14173: [SPARKR][SPARK-16507] Add a CRAN checker, fix Rd aliases

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14173 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62283/ Test FAILed. ---

[GitHub] spark issue #14173: [SPARKR][SPARK-16507] Add a CRAN checker, fix Rd aliases

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14173 **[Test build #62283 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62283/consoleFull)** for PR 14173 at commit [`6c9309e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14173: [SPARKR][SPARK-16507] Add a CRAN checker, fix Rd aliases

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14173 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14173: [SPARKR][SPARK-16507] Add a CRAN checker, fix Rd aliases

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14173 **[Test build #62283 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62283/consoleFull)** for PR 14173 at commit [`6c9309e`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-13 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14022 I'll leave this around a little more but if I don't see more feedback I plan to push it before the weekend. --- If your project is set up for it, you can reply to this email and have your reply appe

[GitHub] spark issue #14155: [SPARK-16498][SQL][WIP] move hive hack for data source t...

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14155 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62282/ Test FAILed. ---

[GitHub] spark issue #14155: [SPARK-16498][SQL][WIP] move hive hack for data source t...

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14155 **[Test build #62282 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62282/consoleFull)** for PR 14155 at commit [`b8e0eee`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14155: [SPARK-16498][SQL][WIP] move hive hack for data source t...

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14155 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14183: [SPARK-16114] [SQL] updated structured streaming guide

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14183 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14183: [SPARK-16114] [SQL] updated structured streaming guide

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14183 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62277/ Test PASSed. ---

[GitHub] spark issue #14183: [SPARK-16114] [SQL] updated structured streaming guide

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14183 **[Test build #62277 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62277/consoleFull)** for PR 14183 at commit [`77c4a6e`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14187: [SPARK-16485][ML][DOC] Fix privacy of GLM members...

2016-07-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14187 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14187: [SPARK-16485][ML][DOC] Fix privacy of GLM members, renam...

2016-07-13 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/14187 @BryanCutler Thanks for taking a look! I'll merge this with master and branch-2.0 then --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] spark pull request #14188: .

2016-07-13 Thread mgummelt
Github user mgummelt closed the pull request at: https://github.com/apache/spark/pull/14188 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] spark pull request #14188: .

2016-07-13 Thread mgummelt
GitHub user mgummelt opened a pull request: https://github.com/apache/spark/pull/14188 . ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how this patch was

[GitHub] spark issue #14187: [SPARK-16485][ML][DOC] Fix privacy of GLM members, renam...

2016-07-13 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/14187 LGTM, I took a quick look (but didn't build the docs) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request #14148: [SPARK-16482] [SQL] Describe Table Command for Ta...

2016-07-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14148 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14148: [SPARK-16482] [SQL] Describe Table Command for Tables Re...

2016-07-13 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14148 LGTM. Merging to master and branch 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14022 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62275/ Test PASSed. ---

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14022 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14022 **[Test build #62275 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62275/consoleFull)** for PR 14022 at commit [`b928a55`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14162: [SPARK-16505][yarn] Optionally propagate error during sh...

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14162 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14162: [SPARK-16505][yarn] Optionally propagate error during sh...

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14162 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62281/ Test PASSed. ---

[GitHub] spark issue #14162: [SPARK-16505][yarn] Optionally propagate error during sh...

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14162 **[Test build #62281 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62281/consoleFull)** for PR 14162 at commit [`226a165`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14178: [SPARKR][DOCS][MINOR] R programming guide to incl...

2016-07-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14178 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #14071: [SPARK-16397][SQL] make CatalogTable more general...

2016-07-13 Thread cloud-fan
Github user cloud-fan closed the pull request at: https://github.com/apache/spark/pull/14071 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14071: [SPARK-16397][SQL] make CatalogTable more general and le...

2016-07-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14071 I'm closing it as it turns out that we still need these hive specific stuff in CatalogStorageFormat. Hiding them in properties seems don't have much benefit, what we need is just adding a 'provide

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13670 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13670 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62274/ Test PASSed. ---

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13670 **[Test build #62274 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62274/consoleFull)** for PR 13670 at commit [`faf814f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14173: [SPARKR][SPARK-16507] Add a CRAN checker, fix Rd aliases

2016-07-13 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14173 @felixcheung Can you check if you see the same error as Jenkins on your machine ? On my machine the install and tests seem to pass, so I think this is a R / roxygen / devtools version problem. -

[GitHub] spark issue #14178: [SPARKR][DOCS][MINOR] R programming guide to include csv...

2016-07-13 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14178 LGTM. Merging this to master, branch-2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14178: [SPARKR][DOCS][MINOR] R programming guide to incl...

2016-07-13 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/14178#discussion_r70717248 --- Diff: R/pkg/inst/tests/testthat/test_sparkSQL.R --- @@ -237,7 +237,7 @@ test_that("read csv as DataFrame", { "Empty,Dummy,Placeho

[GitHub] spark pull request #14178: [SPARKR][DOCS][MINOR] R programming guide to incl...

2016-07-13 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14178#discussion_r70716537 --- Diff: R/pkg/inst/tests/testthat/test_sparkSQL.R --- @@ -237,7 +237,7 @@ test_that("read csv as DataFrame", { "Empty,Dummy,Plac

[GitHub] spark pull request #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web ...

2016-07-13 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14158#discussion_r70716204 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ui/AllExecutionsPage.scala --- @@ -146,11 +158,35 @@ private[ui] abstract class Executi

[GitHub] spark pull request #14178: [SPARKR][DOCS][MINOR] R programming guide to incl...

2016-07-13 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/14178#discussion_r70715940 --- Diff: R/pkg/inst/tests/testthat/test_sparkSQL.R --- @@ -237,7 +237,7 @@ test_that("read csv as DataFrame", { "Empty,Dummy,Placeho

[GitHub] spark issue #14178: [SPARKR][DOCS][MINOR] R programming guide to include csv...

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14178 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14155: [SPARK-16498][SQL][WIP] move hive hack for data s...

2016-07-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14155#discussion_r70715360 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -313,18 +313,48 @@ class SparkSqlAstBuilder(conf: SQLConf) ext

[GitHub] spark issue #14178: [SPARKR][DOCS][MINOR] R programming guide to include csv...

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14178 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62280/ Test PASSed. ---

[GitHub] spark issue #14178: [SPARKR][DOCS][MINOR] R programming guide to include csv...

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14178 **[Test build #62280 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62280/consoleFull)** for PR 14178 at commit [`ab0af9f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14162: [SPARK-16505][yarn] Optionally propagate error during sh...

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14162 **[Test build #62281 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62281/consoleFull)** for PR 14162 at commit [`226a165`](https://github.com/apache/spark/commit/2

[GitHub] spark pull request #14155: [SPARK-16498][SQL][WIP] move hive hack for data s...

2016-07-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14155#discussion_r70715057 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -115,6 +116,9 @@ case class CatalogTablePartition(

[GitHub] spark issue #14155: [SPARK-16498][SQL][WIP] move hive hack for data source t...

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14155 **[Test build #62282 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62282/consoleFull)** for PR 14155 at commit [`b8e0eee`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #14187: [SPARK-16485][ML][DOC] Fix privacy of GLM members, renam...

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14187 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62278/ Test PASSed. ---

[GitHub] spark issue #14187: [SPARK-16485][ML][DOC] Fix privacy of GLM members, renam...

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14187 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14155: [SPARK-16498][SQL][WIP] move hive hack for data s...

2016-07-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14155#discussion_r70714896 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -49,12 +50,12 @@ case class CatalogStorageFormat(

[GitHub] spark issue #14187: [SPARK-16485][ML][DOC] Fix privacy of GLM members, renam...

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14187 **[Test build #62278 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62278/consoleFull)** for PR 14187 at commit [`4b21994`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14186: [SPARK-16530] [SQL] [TRIVIAL] Wrong Parser Keyword in AL...

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14186 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62273/ Test PASSed. ---

[GitHub] spark issue #14186: [SPARK-16530] [SQL] [TRIVIAL] Wrong Parser Keyword in AL...

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14186 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14186: [SPARK-16530] [SQL] [TRIVIAL] Wrong Parser Keyword in AL...

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14186 **[Test build #62273 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62273/consoleFull)** for PR 14186 at commit [`89a4eed`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14178: [SPARKR][DOCS][MINOR] R programming guide to include csv...

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14178 **[Test build #62280 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62280/consoleFull)** for PR 14178 at commit [`ab0af9f`](https://github.com/apache/spark/commit/a

[GitHub] spark pull request #14090: [SPARK-16112][SparkR] Programming guide for gappl...

2016-07-13 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14090#discussion_r70711218 --- Diff: docs/sparkr.md --- @@ -312,7 +310,82 @@ head(ldf, 3) Apply a function to each group of a `SparkDataFrame`. The function is to be applied t

[GitHub] spark pull request #14090: [SPARK-16112][SparkR] Programming guide for gappl...

2016-07-13 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14090#discussion_r70711263 --- Diff: docs/sparkr.md --- @@ -312,7 +310,82 @@ head(ldf, 3) Apply a function to each group of a `SparkDataFrame`. The function is to be applied t

[GitHub] spark pull request #14090: [SPARK-16112][SparkR] Programming guide for gappl...

2016-07-13 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14090#discussion_r7076 --- Diff: docs/sparkr.md --- @@ -263,7 +263,7 @@ In SparkR, we support several kinds of User-Defined Functions: # dapply Apply a function t

[GitHub] spark issue #14173: [SPARKR][SPARK-16507] Add a CRAN checker, fix Rd aliases

2016-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14173 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14173: [SPARKR][SPARK-16507] Add a CRAN checker, fix Rd aliases

2016-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14173 **[Test build #62279 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62279/consoleFull)** for PR 14173 at commit [`a2275ae`](https://github.com/apache/spark/commit/

<    1   2   3   4   5   6   7   >