[GitHub] spark issue #21231: [SPARK-24119][SQL]Add interpreted execution to SortPrefi...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21231 **[Test build #90242 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90242/testReport)** for PR 21231 at commit

[GitHub] spark pull request #21217: [SPARK-24151][SQL] Fix CURRENT_DATE, CURRENT_TIME...

2018-05-04 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/21217#discussion_r186252704 --- Diff: docs/sql-programming-guide.md --- @@ -1812,6 +1812,7 @@ working with timestamps in `pandas_udf`s to get the best performance, see -

[GitHub] spark pull request #21241: [SPARK-24135][K8s] Resilience to init-container e...

2018-05-04 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/21241#discussion_r186252592 --- Diff: docs/running-on-kubernetes.md --- @@ -561,6 +561,13 @@ specific to Spark on Kubernetes. This is distinct from spark.executor.cores:

[GitHub] spark pull request #21241: [SPARK-24135][K8s] Resilience to init-container e...

2018-05-04 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/21241#discussion_r186252598 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala --- @@

[GitHub] spark issue #21245: [SPARK-24188][core] Restore "/version" API endpoint.

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21245 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90239/ Test PASSed. ---

[GitHub] spark issue #21245: [SPARK-24188][core] Restore "/version" API endpoint.

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21245 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21245: [SPARK-24188][core] Restore "/version" API endpoint.

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21245 **[Test build #90239 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90239/testReport)** for PR 21245 at commit

[GitHub] spark pull request #21228: [SPARK-24171] Adding a note for non-deterministic...

2018-05-04 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/21228#discussion_r186252477 --- Diff: R/pkg/R/functions.R --- @@ -818,6 +818,7 @@ setMethod("factorial", #' first(df$c, TRUE) #' } #' @note first(characterOrColumn)

[GitHub] spark pull request #21228: [SPARK-24171] Adding a note for non-deterministic...

2018-05-04 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/21228#discussion_r186252480 --- Diff: R/pkg/R/functions.R --- @@ -963,6 +964,7 @@ setMethod("kurtosis", #' last(df$c, TRUE) #' } #' @note last since 1.4.0 +#'

[GitHub] spark pull request #18447: [SPARK-21232][SQL][SparkR][PYSPARK] New built-in ...

2018-05-04 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18447#discussion_r186252381 --- Diff: R/pkg/R/functions.R --- @@ -679,6 +679,19 @@ setMethod("hash", column(jc) }) +#' @details +#'

[GitHub] spark pull request #18447: [SPARK-21232][SQL][SparkR][PYSPARK] New built-in ...

2018-05-04 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18447#discussion_r186252423 --- Diff: R/pkg/NAMESPACE --- @@ -236,6 +236,7 @@ exportMethods("%<=>%", "current_date", "current_timestamp",

[GitHub] spark pull request #18447: [SPARK-21232][SQL][SparkR][PYSPARK] New built-in ...

2018-05-04 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18447#discussion_r186252398 --- Diff: R/pkg/R/functions.R --- @@ -679,6 +679,19 @@ setMethod("hash", column(jc) }) +#' @details +#'

[GitHub] spark issue #21193: [SPARK-24121][SQL] Add API for handling expression code ...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21193 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2943/

[GitHub] spark issue #21193: [SPARK-24121][SQL] Add API for handling expression code ...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21193 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21193: [SPARK-24121][SQL] Add API for handling expression code ...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21193 **[Test build #90241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90241/testReport)** for PR 21193 at commit

[GitHub] spark issue #21222: [SPARK-24161][SS] Enable debug package feature on struct...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21222 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21222: [SPARK-24161][SS] Enable debug package feature on struct...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21222 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90240/ Test PASSed. ---

[GitHub] spark issue #21222: [SPARK-24161][SS] Enable debug package feature on struct...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21222 **[Test build #90240 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90240/testReport)** for PR 21222 at commit

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186251510 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186251439 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark issue #21193: [SPARK-24121][SQL] Add API for handling expression code ...

2018-05-04 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/21193 > one question: no impact on compilation time for a large expression tree? The string interpolation in `CodeBlock` is not different to default

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186251251 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186251147 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186251103 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186251067 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186250918 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186250803 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186250693 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186250678 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186250676 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186250659 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark issue #21158: [SPARK-23850][sql] Add separate config for SQL options r...

2018-05-04 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/21158 > To keep all the previous behaviour, SQL_OPTIONS_REDACTION_PATTERN can include user User names, unlike passwords, are useful for debugging. And they're not meant to be secret. They're

[GitHub] spark issue #21238: [SPARK-24137][K8s] Mount local directories as empty dir ...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21238 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21238: [SPARK-24137][K8s] Mount local directories as empty dir ...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21238 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90225/ Test PASSed. ---

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21173 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90237/ Test FAILed. ---

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21173 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186250552 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark issue #21238: [SPARK-24137][K8s] Mount local directories as empty dir ...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21238 **[Test build #90225 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90225/testReport)** for PR 21238 at commit

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21173 **[Test build #90237 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90237/testReport)** for PR 21173 at commit

[GitHub] spark issue #21108: [SPARK-24027][SQL] Support MapType with StringType for k...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21108 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90227/ Test PASSed. ---

[GitHub] spark issue #21108: [SPARK-24027][SQL] Support MapType with StringType for k...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21108 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21108: [SPARK-24027][SQL] Support MapType with StringType for k...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21108 **[Test build #90227 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90227/testReport)** for PR 21108 at commit

[GitHub] spark issue #21239: [SPARK-24040][SS] Support single partition aggregates in...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21239 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90220/ Test PASSed. ---

[GitHub] spark issue #21239: [SPARK-24040][SS] Support single partition aggregates in...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21239 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21239: [SPARK-24040][SS] Support single partition aggregates in...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21239 **[Test build #90220 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90220/testReport)** for PR 21239 at commit

[GitHub] spark issue #21240: [SPARK-21274][SQL] Add a new generator function replicat...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21240 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90219/ Test PASSed. ---

[GitHub] spark issue #21240: [SPARK-21274][SQL] Add a new generator function replicat...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21240 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21240: [SPARK-21274][SQL] Add a new generator function replicat...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21240 **[Test build #90219 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90219/testReport)** for PR 21240 at commit

[GitHub] spark issue #21122: [SPARK-24017] [SQL] Refactor ExternalCatalog to be an in...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21122 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90218/ Test PASSed. ---

[GitHub] spark issue #21122: [SPARK-24017] [SQL] Refactor ExternalCatalog to be an in...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21122 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21122: [SPARK-24017] [SQL] Refactor ExternalCatalog to be an in...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21122 **[Test build #90218 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90218/testReport)** for PR 21122 at commit

[GitHub] spark issue #21236: [SPARK-23935][SQL] Adding map_entries function

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21236 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90221/ Test PASSed. ---

[GitHub] spark issue #21236: [SPARK-23935][SQL] Adding map_entries function

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21236 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21236: [SPARK-23935][SQL] Adding map_entries function

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21236 **[Test build #90221 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90221/testReport)** for PR 21236 at commit

[GitHub] spark issue #21193: [SPARK-24121][SQL] Add API for handling expression code ...

2018-05-04 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21193 I also like this structural approach. one question: no impact on compilation time for a large expression tree? --- - To

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186247026 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186247501 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186247824 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark pull request #21193: [SPARK-24121][SQL] Add API for handling expressio...

2018-05-04 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21193#discussion_r186248265 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/javaCode.scala --- @@ -112,6 +112,112 @@ object JavaCode {

[GitHub] spark issue #21237: [SPARK-23325][WIP] Test parquet returning internal row

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21237 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90228/ Test FAILed. ---

[GitHub] spark issue #21237: [SPARK-23325][WIP] Test parquet returning internal row

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21237 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21237: [SPARK-23325][WIP] Test parquet returning internal row

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21237 **[Test build #90228 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90228/testReport)** for PR 21237 at commit

[GitHub] spark issue #21244: [SPARK-24815]add flatten function to SparkR

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21244 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21244: [SPARK-24815]add flatten function to SparkR

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21244 **[Test build #90238 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90238/testReport)** for PR 21244 at commit

[GitHub] spark issue #21244: [SPARK-24815]add flatten function to SparkR

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21244 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90238/ Test PASSed. ---

[GitHub] spark pull request #21222: [SPARK-24161][SS] Enable debug package feature on...

2018-05-04 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/spark/pull/21222#discussion_r186247474 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/debug/package.scala --- @@ -116,6 +168,30 @@ package object debug { }

[GitHub] spark issue #21222: [SPARK-24161][SS] Enable debug package feature on struct...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21222 **[Test build #90240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90240/testReport)** for PR 21222 at commit

[GitHub] spark issue #19183: [SPARK-21960][Streaming] Spark Streaming Dynamic Allocat...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19183 **[Test build #90232 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90232/testReport)** for PR 19183 at commit

[GitHub] spark issue #19183: [SPARK-21960][Streaming] Spark Streaming Dynamic Allocat...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19183 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90232/ Test PASSed. ---

[GitHub] spark issue #19183: [SPARK-21960][Streaming] Spark Streaming Dynamic Allocat...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19183 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21245: [SPARK-24188][core] Restore "/version" API endpoint.

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21245 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2942/

[GitHub] spark issue #21245: [SPARK-24188][core] Restore "/version" API endpoint.

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21245 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21195 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90233/ Test PASSed. ---

[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21195 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21195 **[Test build #90233 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90233/testReport)** for PR 21195 at commit

[GitHub] spark issue #21245: [SPARK-24188][core] Restore "/version" API endpoint.

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21245 **[Test build #90239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90239/testReport)** for PR 21245 at commit

[GitHub] spark pull request #21245: [SPARK-24188][core] Restore "/version" API endpoi...

2018-05-04 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/21245 [SPARK-24188][core] Restore "/version" API endpoint. It was missing the jax-rs annotation. You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request #21028: [SPARK-23922][SQL] Add arrays_overlap function

2018-05-04 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/21028#discussion_r186246741 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameFunctionsSuite.scala --- @@ -413,6 +413,25 @@ class DataFrameFunctionsSuite extends QueryTest

[GitHub] spark issue #16578: [SPARK-4502][SQL] Parquet nested column pruning

2018-05-04 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16578 Yeah. That is fine. Will try to review the relevant PRs ASAP. Please ping me. Thanks again! --- - To unsubscribe, e-mail:

[GitHub] spark issue #16578: [SPARK-4502][SQL] Parquet nested column pruning

2018-05-04 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/16578 > To ensure the PR and review quality, we normally avoid doing everything in a single huge PR. It would be much better if you can cut it to a few smaller PRs. I'll have a go at it. Of

[GitHub] spark issue #21214: [SPARK-23775][TEST] Make DataFrameRangeSuite not flaky

2018-05-04 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/21214 I'm fine with the current patch, will leave it open for comments during the weekend. --- - To unsubscribe, e-mail:

[GitHub] spark issue #21244: [SPARK-24815]add flatten function to SparkR

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21244 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21244: [SPARK-24815]add flatten function to SparkR

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21244 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2941/

[GitHub] spark issue #20908: [WIP][SPARK-23672][PYTHON] Document support for nested r...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20908 **[Test build #90235 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90235/testReport)** for PR 20908 at commit

[GitHub] spark issue #20908: [WIP][SPARK-23672][PYTHON] Document support for nested r...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20908 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20908: [WIP][SPARK-23672][PYTHON] Document support for nested r...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20908 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90235/ Test FAILed. ---

[GitHub] spark issue #21244: [SPARK-24815]add flatten function to SparkR

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21244 **[Test build #90238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90238/testReport)** for PR 21244 at commit

[GitHub] spark issue #21172: [SPARK-23120][PYSPARK][ML][WIP] Add basic PMML export su...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21172 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21172: [SPARK-23120][PYSPARK][ML][WIP] Add basic PMML export su...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21172 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90236/ Test FAILed. ---

[GitHub] spark issue #20345: [SPARK-23172][SQL] Expand the ReorderJoin rule to handle...

2018-05-04 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/20345 ping --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21172: [SPARK-23120][PYSPARK][ML][WIP] Add basic PMML export su...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21172 **[Test build #90236 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90236/testReport)** for PR 21172 at commit

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21173 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21240: [SPARK-21274][SQL] Add a new generator function replicat...

2018-05-04 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21240 Ah, ok. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21173 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2940/

[GitHub] spark issue #21240: [SPARK-21274][SQL] Add a new generator function replicat...

2018-05-04 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21240 https://issues.apache.org/jira/browse/HIVE-14768 did the same thing. --- - To unsubscribe, e-mail:

[GitHub] spark issue #21070: [SPARK-23972][BUILD][SQL] Update Parquet to 1.10.0.

2018-05-04 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21070 ok, give me more time to do so. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #21240: [SPARK-21274][SQL] Add a new generator function replicat...

2018-05-04 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21240 Also, ISTM this function is less useful for uses. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #21240: [SPARK-21274][SQL] Add a new generator function replicat...

2018-05-04 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21240 Why we need this? I thinks it's ok to add a new rewriting rule for `EXCEPT ALL` and `INTERSECT ALL` in analyzer? --- - To

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21173 **[Test build #90237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90237/testReport)** for PR 21173 at commit

[GitHub] spark pull request #21244: [SPARK-24815]add flatten function to SparkR

2018-05-04 Thread huaxingao
GitHub user huaxingao opened a pull request: https://github.com/apache/spark/pull/21244 [SPARK-24815]add flatten function to SparkR ## What changes were proposed in this pull request? add array flatten function to SparkR ## How was this patch tested? Unit

  1   2   3   4   5   6   >