[GitHub] spark issue #18003: [SparkR] Fix bad examples in DataFrame methods and style...

2017-05-19 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18003 merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17989: [SPARK-6628][SQL][Branch-1.6] Fix ClassCastException whe...

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17989 **[Test build #77101 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77101/consoleFull)** for PR 17989 at commit [`0fa2bb7`](https://github.com/apache/spark/commit/0

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117548780 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/YARNHadoopAccessManager.scala --- @@ -21,66 +21,47 @@ import scala

[GitHub] spark issue #17982: [SPARK-20395][BUILD] Update Scala to 2.11.11 and zinc to...

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17982 **[Test build #77096 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77096/testReport)** for PR 17982 at commit [`b5a7035`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #17982: [SPARK-20395][BUILD] Update Scala to 2.11.11 and zinc to...

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17982 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77096/ Test FAILed. ---

[GitHub] spark pull request #15009: [SPARK-17443][SPARK-11035] Stop Spark Application...

2017-05-19 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/15009#discussion_r117548947 --- Diff: core/src/test/java/org/apache/spark/launcher/SparkLauncherSuite.java --- @@ -183,12 +185,37 @@ public void testChildProcLauncher() throws Exception

[GitHub] spark pull request #18025: [WIP][SparkR] Update doc and examples for sql fun...

2017-05-19 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18025#discussion_r117548343 --- Diff: R/pkg/R/generics.R --- @@ -385,6 +385,7 @@ setGeneric("value", function(bcast) { standardGeneric("value") }) #' @return A SparkDataFrame.

[GitHub] spark issue #17982: [SPARK-20395][BUILD] Update Scala to 2.11.11 and zinc to...

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17982 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #18025: [WIP][SparkR] Update doc and examples for sql fun...

2017-05-19 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18025#discussion_r117548839 --- Diff: R/pkg/R/generics.R --- @@ -396,67 +397,81 @@ setGeneric("agg", function (x, ...) { standardGeneric("agg") }) #' @param object x a SparkDa

[GitHub] spark pull request #18025: [WIP][SparkR] Update doc and examples for sql fun...

2017-05-19 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18025#discussion_r117548367 --- Diff: R/pkg/R/generics.R --- @@ -396,67 +397,81 @@ setGeneric("agg", function (x, ...) { standardGeneric("agg") }) #' @param object x a SparkDa

[GitHub] spark issue #17989: [SPARK-6628][SQL][Branch-1.6] Fix ClassCastException whe...

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17989 **[Test build #77101 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77101/consoleFull)** for PR 17989 at commit [`0fa2bb7`](https://github.com/apache/spark/commit/

[GitHub] spark issue #17989: [SPARK-6628][SQL][Branch-1.6] Fix ClassCastException whe...

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17989 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77101/ Test FAILed. ---

[GitHub] spark issue #17989: [SPARK-6628][SQL][Branch-1.6] Fix ClassCastException whe...

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17989 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17996: [SPARK-20506][DOCS] 2.2 migration guide

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17996 **[Test build #77100 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77100/testReport)** for PR 17996 at commit [`fb9fb5b`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #17996: [SPARK-20506][DOCS] 2.2 migration guide

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17996 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16648: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

2017-05-19 Thread bdrillard
Github user bdrillard commented on the issue: https://github.com/apache/spark/pull/16648 @kiszk, I've updated the pull-request description to include example code generation for mutable state compaction as well (which comes from inspecting the [generated code](https://github.com/apac

[GitHub] spark issue #17996: [SPARK-20506][DOCS] 2.2 migration guide

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17996 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77100/ Test PASSed. ---

[GitHub] spark issue #18025: [WIP][SparkR] Update doc and examples for sql functions

2017-05-19 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18025 thanks for looking into this and yes it will be useful to understand better before proceeding further. how does the `?` help search or API index page work in this case? I wonder if it's

[GitHub] spark issue #16648: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16648 **[Test build #77102 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77102/testReport)** for PR 16648 at commit [`5a4a39c`](https://github.com/apache/spark/commit/5a

[GitHub] spark issue #17996: [SPARK-20506][DOCS] 2.2 migration guide

2017-05-19 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/17996 Merged to master/branch-2.2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[GitHub] spark pull request #17996: [SPARK-20506][DOCS] 2.2 migration guide

2017-05-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17996 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117551592 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/YARNHadoopAccessManager.scala --- @@ -21,66 +21,47 @@ import scala

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117553643 --- Diff: core/src/test/scala/org/apache/spark/deploy/security/ConfigurableCredentialManagerSuite.scala --- @@ -64,36 +57,22 @@ class ConfigurableCreden

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117554194 --- Diff: resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/security/YARNConfigurableCredentialManagerSuite.scala --- @@ -0,0 +1,74 @@

[GitHub] spark issue #16087: [SPARK-18656][SQL] Memory efficient implementation of th...

2017-05-19 Thread barrybecker4
Github user barrybecker4 commented on the issue: https://github.com/apache/spark/pull/16087 @rxin, what is the new aggregate function that we should be using instead of multipleApproxQuantiles? --- If your project is set up for it, you can reply to this email and have your reply app

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117558805 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/YARNConfigurableCredentialManager.scala --- @@ -0,0 +1,77 @@ +

[GitHub] spark issue #17947: [SPARK-20708][CORE] Make `addExclusionRules` up-to-date

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17947 **[Test build #77098 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77098/testReport)** for PR 17947 at commit [`6ac403a`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #17947: [SPARK-20708][CORE] Make `addExclusionRules` up-to-date

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17947 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77098/ Test FAILed. ---

[GitHub] spark issue #17947: [SPARK-20708][CORE] Make `addExclusionRules` up-to-date

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17947 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #18036: [SPARK-20813][Web UI] Fixed web ui executor page ...

2017-05-19 Thread yoonlee95
GitHub user yoonlee95 opened a pull request: https://github.com/apache/spark/pull/18036 [SPARK-20813][Web UI] Fixed web ui executor page search ## What changes were proposed in this pull request? On status column of the table, I removed the condition that forced only the displa

[GitHub] spark issue #18036: [SPARK-20813][Web UI] Fixed Web UI executor page tab sea...

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18036 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #18036: [SPARK-20813][Web UI] Fixed Web UI executor page tab sea...

2017-05-19 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/18036 Nice catch, I'm not sure what @kishorvpatil 's original reason for blocking it from search like that was but this is good --- If your project is set up for it, you can reply to this email and hav

[GitHub] spark pull request #18013: [SPARK-20781] the location of Dockerfile in docke...

2017-05-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18013 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #17923: [SPARK-20591][WEB UI] Succeeded tasks num not equal in a...

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17923 **[Test build #3742 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3742/testReport)** for PR 17923 at commit [`d80f140`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #18025: [WIP][SparkR] Update doc and examples for sql fun...

2017-05-19 Thread actuaryzhang
Github user actuaryzhang commented on a diff in the pull request: https://github.com/apache/spark/pull/18025#discussion_r117565367 --- Diff: R/pkg/R/generics.R --- @@ -385,6 +385,7 @@ setGeneric("value", function(bcast) { standardGeneric("value") }) #' @return A SparkDataFrame

[GitHub] spark pull request #18025: [WIP][SparkR] Update doc and examples for sql fun...

2017-05-19 Thread actuaryzhang
Github user actuaryzhang commented on a diff in the pull request: https://github.com/apache/spark/pull/18025#discussion_r117566353 --- Diff: R/pkg/R/generics.R --- @@ -396,67 +397,81 @@ setGeneric("agg", function (x, ...) { standardGeneric("agg") }) #' @param object x a SparkD

[GitHub] spark issue #17947: [SPARK-20708][CORE] Make `addExclusionRules` up-to-date

2017-05-19 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17947 Retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #17947: [SPARK-20708][CORE] Make `addExclusionRules` up-to-date

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17947 **[Test build #77103 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77103/testReport)** for PR 17947 at commit [`6ac403a`](https://github.com/apache/spark/commit/6a

[GitHub] spark issue #18025: [WIP][SparkR] Update doc and examples for sql functions

2017-05-19 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/18025 @felixcheung Thanks for asking this. I should have been more clear. `@name` is the "name" of the Rd object represented, which is unique. An Rd object can have multiple aliases pointing

[GitHub] spark issue #17978: [SPARK-20736][Python] PySpark StringIndexer supports Str...

2017-05-19 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/17978 @felixcheung Would you help merge this? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18023 **[Test build #77099 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77099/testReport)** for PR 18023 at commit [`979bfb6`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18023 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77099/ Test PASSed. ---

[GitHub] spark issue #16699: [SPARK-18710][ML] Add offset in GLM

2017-05-19 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/16699 @yanboliang Thanks for the update. This is a big change, although lots of then are on the test side. Let me know if there is anything I can do to help make the review easier. --- If

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18023 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18025: [WIP][SparkR] Update doc and examples for sql functions

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18025 **[Test build #77105 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77105/testReport)** for PR 18025 at commit [`ead9781`](https://github.com/apache/spark/commit/ea

[GitHub] spark issue #18026: [SPARK-16202][SQL][DOC] Follow-up to Correct The Descrip...

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18026 **[Test build #77104 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77104/testReport)** for PR 18026 at commit [`97a691c`](https://github.com/apache/spark/commit/97

[GitHub] spark pull request #18037: [SPARK-20814][mesos] Restore support for spark.ex...

2017-05-19 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/18037 [SPARK-20814][mesos] Restore support for spark.executor.extraClassPath. Restore code that was removed as part of SPARK-17979, but instead of using the deprecated env variable name to propagate th

[GitHub] spark issue #18037: [SPARK-20814][mesos] Restore support for spark.executor....

2017-05-19 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18037 @mgummelt --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #18037: [SPARK-20814][mesos] Restore support for spark.executor....

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18037 **[Test build #77106 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77106/testReport)** for PR 18037 at commit [`d129327`](https://github.com/apache/spark/commit/d1

[GitHub] spark issue #18026: [SPARK-16202][SQL][DOC] Follow-up to Correct The Descrip...

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18026 **[Test build #77107 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77107/testReport)** for PR 18026 at commit [`88b109d`](https://github.com/apache/spark/commit/88

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117575340 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/YARNHadoopAccessManager.scala --- @@ -21,66 +21,47 @@ import scala

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117575482 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/DefaultHadoopAccessManager.scala --- @@ -0,0 +1,39 @@ +/* + * Licensed to the Apa

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117576841 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/ConfigurableCredentialManager.scala --- @@ -0,0 +1,130 @@ +/* + * Licensed to the

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117576880 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/ConfigurableCredentialManager.scala --- @@ -0,0 +1,130 @@ +/* + * Licensed to the

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117577161 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/DefaultHadoopAccessManager.scala --- @@ -0,0 +1,39 @@ +/* + * Licensed to the Apa

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117578243 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/HadoopDelegationTokenProvider.scala --- @@ -0,0 +1,57 @@ +/* + * Licensed to the

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117578662 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/HadoopDelegationTokenProvider.scala --- @@ -0,0 +1,57 @@ +/* + * Licensed to the

[GitHub] spark issue #18025: [WIP][SparkR] Update doc and examples for sql functions

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18025 **[Test build #77105 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77105/testReport)** for PR 18025 at commit [`ead9781`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #18025: [WIP][SparkR] Update doc and examples for sql functions

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18025 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18025: [WIP][SparkR] Update doc and examples for sql functions

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18025 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77105/ Test PASSed. ---

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117579431 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/HadoopDelegationTokenProvider.scala --- @@ -0,0 +1,57 @@ +/* + * Licensed to the

[GitHub] spark issue #16648: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16648 **[Test build #77102 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77102/testReport)** for PR 16648 at commit [`5a4a39c`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #17997: [SPARK-20763][SQL]The function of `month` and `day` retu...

2017-05-19 Thread 10110346
Github user 10110346 commented on the issue: https://github.com/apache/spark/pull/17997 OK,l Will do it, thanks. @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark issue #16648: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16648 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16648: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16648 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77102/ Test PASSed. ---

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117580880 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/DefaultHadoopAccessManager.scala --- @@ -0,0 +1,39 @@ +/* + * Licensed to the Apa

[GitHub] spark issue #17967: [SPARK-14659][ML] RFormula consistent with R when handli...

2017-05-19 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/17967 @yanboliang Thanks for the question. The alphabetically ascending order in R is very convenient for display purpose. For example, when you do a summary of model results, the results wi

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117583563 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/HadoopAccessManager.scala --- @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117583724 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/HadoopAccessManager.scala --- @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117584432 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/HadoopAccessManager.scala --- @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request #17723: [SPARK-20434][YARN][CORE] Move kerberos delegatio...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17723#discussion_r117585882 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/HadoopDelegationTokenProvider.scala --- @@ -0,0 +1,57 @@ +/* + * Licensed to the

[GitHub] spark issue #18026: [SPARK-16202][SQL][DOC] Follow-up to Correct The Descrip...

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18026 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117586530 --- Diff: sql/core/src/test/resources/sql-tests/inputs/query_regex_column.sql --- @@ -0,0 +1,24 @@ +CREATE OR REPLACE TEMPORARY VIEW testData AS SELE

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117586747 --- Diff: sql/core/src/test/resources/sql-tests/inputs/query_regex_column.sql --- @@ -0,0 +1,24 @@ +CREATE OR REPLACE TEMPORARY VIEW testData AS SELE

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117587075 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1188,6 +1188,11 @@ class Dataset[T] private[sql]( def col(colName: Str

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117587110 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1188,6 +1188,11 @@ class Dataset[T] private[sql]( def col(colName: Str

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117587207 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1188,6 +1188,11 @@ class Dataset[T] private[sql]( def col(colName: Str

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117587254 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -1230,25 +1230,37 @@ class AstBuilder(conf: SQLConf)

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117587285 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -1230,25 +1230,37 @@ class AstBuilder(conf: SQLConf)

[GitHub] spark issue #17923: [SPARK-20591][WEB UI] Succeeded tasks num not equal in a...

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17923 **[Test build #3742 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3742/testReport)** for PR 17923 at commit [`d80f140`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread janewangfb
Github user janewangfb commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117587910 --- Diff: sql/core/src/test/resources/sql-tests/inputs/query_regex_column.sql --- @@ -0,0 +1,24 @@ +CREATE OR REPLACE TEMPORARY VIEW testData AS SELE

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread janewangfb
Github user janewangfb commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117588000 --- Diff: sql/core/src/test/resources/sql-tests/inputs/query_regex_column.sql --- @@ -0,0 +1,24 @@ +CREATE OR REPLACE TEMPORARY VIEW testData AS SELE

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread janewangfb
Github user janewangfb commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117588878 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1188,6 +1188,11 @@ class Dataset[T] private[sql]( def col(colName: Str

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread janewangfb
Github user janewangfb commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117588953 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1188,6 +1188,11 @@ class Dataset[T] private[sql]( def col(colName: Str

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread janewangfb
Github user janewangfb commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117588977 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1188,6 +1188,11 @@ class Dataset[T] private[sql]( def col(colName: Str

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread janewangfb
Github user janewangfb commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117589166 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -1230,25 +1230,37 @@ class AstBuilder(conf: SQLConf)

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread janewangfb
Github user janewangfb commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117589317 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -1230,25 +1230,37 @@ class AstBuilder(conf: SQLConf)

[GitHub] spark issue #18026: [SPARK-16202][SQL][DOC] Follow-up to Correct The Descrip...

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18026 **[Test build #77104 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77104/testReport)** for PR 18026 at commit [`97a691c`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #18026: [SPARK-16202][SQL][DOC] Follow-up to Correct The Descrip...

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18026 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77104/ Test PASSed. ---

[GitHub] spark issue #18026: [SPARK-16202][SQL][DOC] Follow-up to Correct The Descrip...

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18026 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18023 **[Test build #77108 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77108/testReport)** for PR 18023 at commit [`612bedf`](https://github.com/apache/spark/commit/61

[GitHub] spark issue #18026: [SPARK-16202][SQL][DOC] Follow-up to Correct The Descrip...

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18026 **[Test build #77107 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77107/testReport)** for PR 18026 at commit [`88b109d`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #18026: [SPARK-16202][SQL][DOC] Follow-up to Correct The Descrip...

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18026 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18026: [SPARK-16202][SQL][DOC] Follow-up to Correct The Descrip...

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18026 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77107/ Test PASSed. ---

[GitHub] spark issue #17947: [SPARK-20708][CORE] Make `addExclusionRules` up-to-date

2017-05-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17947 **[Test build #77103 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77103/testReport)** for PR 17947 at commit [`6ac403a`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #17947: [SPARK-20708][CORE] Make `addExclusionRules` up-to-date

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17947 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17947: [SPARK-20708][CORE] Make `addExclusionRules` up-to-date

2017-05-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17947 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77103/ Test PASSed. ---

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117591611 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala --- @@ -244,6 +244,71 @@ class DatasetSuite extends QueryTest with SharedSQLCo

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18023 LGTM pending Jenkins cc @hvanhovell @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-05-19 Thread janewangfb
Github user janewangfb commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117591864 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala --- @@ -244,6 +244,71 @@ class DatasetSuite extends QueryTest with SharedSQLCo

<    1   2   3   4   >