[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27521: [SPARK-29462][SQL] The data type of "array()" should be array

2020-02-10 Thread GitBox
dongjoon-hyun commented on a change in pull request #27521: [SPARK-29462][SQL] The data type of "array()" should be array URL: https://github.com/apache/spark/pull/27521#discussion_r377270605 ## File path: docs/sql-migration-guide.md ## @@ -215,6 +215,8 @@ license: |

[GitHub] [spark] holdenk commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-10 Thread GitBox
holdenk commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-584309910 So @tooptoop4 in its present state it could help, you'd call decom instead of stop. But we'd

[GitHub] [spark] SparkQA removed a comment on issue #27521: [SPARK-29462][SQL] The data type of "array()" should be array

2020-02-10 Thread GitBox
SparkQA removed a comment on issue #27521: [SPARK-29462][SQL] The data type of "array()" should be array URL: https://github.com/apache/spark/pull/27521#issuecomment-584181382 **[Test build #118170 has

[GitHub] [spark] SparkQA commented on issue #27521: [SPARK-29462][SQL] The data type of "array()" should be array

2020-02-10 Thread GitBox
SparkQA commented on issue #27521: [SPARK-29462][SQL] The data type of "array()" should be array URL: https://github.com/apache/spark/pull/27521#issuecomment-584335957 **[Test build #118170 has

[GitHub] [spark] AmplabJenkins commented on issue #27368: [SPARK-30651][SQL] Add detailed information for Aggregate operators in EXPLAIN FORMATTED

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27368: [SPARK-30651][SQL] Add detailed information for Aggregate operators in EXPLAIN FORMATTED URL: https://github.com/apache/spark/pull/27368#issuecomment-584343890 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27368: [SPARK-30651][SQL] Add detailed information for Aggregate operators in EXPLAIN FORMATTED

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27368: [SPARK-30651][SQL] Add detailed information for Aggregate operators in EXPLAIN FORMATTED URL: https://github.com/apache/spark/pull/27368#issuecomment-584343900 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27368: [SPARK-30651][SQL] Add detailed information for Aggregate operators in EXPLAIN FORMATTED

2020-02-10 Thread GitBox
SparkQA removed a comment on issue #27368: [SPARK-30651][SQL] Add detailed information for Aggregate operators in EXPLAIN FORMATTED URL: https://github.com/apache/spark/pull/27368#issuecomment-584189531 **[Test build #118171 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27368: [SPARK-30651][SQL] Add detailed information for Aggregate operators in EXPLAIN FORMATTED

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27368: [SPARK-30651][SQL] Add detailed information for Aggregate operators in EXPLAIN FORMATTED URL: https://github.com/apache/spark/pull/27368#issuecomment-584343890 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27368: [SPARK-30651][SQL] Add detailed information for Aggregate operators in EXPLAIN FORMATTED

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27368: [SPARK-30651][SQL] Add detailed information for Aggregate operators in EXPLAIN FORMATTED URL: https://github.com/apache/spark/pull/27368#issuecomment-584343900 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] gatorsmile commented on issue #27355: [SPARK-30625][SQL] Support `escape` as third parameter of the `like` function

2020-02-10 Thread GitBox
gatorsmile commented on issue #27355: [SPARK-30625][SQL] Support `escape` as third parameter of the `like` function URL: https://github.com/apache/spark/pull/27355#issuecomment-584350304 Which systems support this syntax?

[GitHub] [spark] tgravescs commented on a change in pull request #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

2020-02-10 Thread GitBox
tgravescs commented on a change in pull request #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes URL: https://github.com/apache/spark/pull/27313#discussion_r377319560 ## File path:

[GitHub] [spark] rednaxelafx edited a comment on issue #27355: [SPARK-30625][SQL] Support `escape` as third parameter of the `like` function

2020-02-10 Thread GitBox
rednaxelafx edited a comment on issue #27355: [SPARK-30625][SQL] Support `escape` as third parameter of the `like` function URL: https://github.com/apache/spark/pull/27355#issuecomment-584344438 Sorry for posting this review post-hoc, but I strongly believe this PR should be reverted and

[GitHub] [spark] yhuai commented on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3

2020-02-10 Thread GitBox
yhuai commented on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3 URL: https://github.com/apache/spark/pull/27492#issuecomment-584375863 Also, how did

[GitHub] [spark] SparkQA commented on issue #27528: [SPARK-30779][SS]Fix some API issues found when reviewing Structured Streaming API docs

2020-02-10 Thread GitBox
SparkQA commented on issue #27528: [SPARK-30779][SS]Fix some API issues found when reviewing Structured Streaming API docs URL: https://github.com/apache/spark/pull/27528#issuecomment-584384348 **[Test build #118176 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-584386353 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-584386362 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27533: [SPARK-30783] Exclude hive-service-rpc

2020-02-10 Thread GitBox
SparkQA commented on issue #27533: [SPARK-30783] Exclude hive-service-rpc URL: https://github.com/apache/spark/pull/27533#issuecomment-584399730 **[Test build #118186 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118186/testReport)** for PR 27533 at

[GitHub] [spark] huaxingao commented on issue #27527: [SPARK-30776][ML] Support FValueRegressionSelector for continuous features and continuous labels

2020-02-10 Thread GitBox
huaxingao commented on issue #27527: [SPARK-30776][ML] Support FValueRegressionSelector for continuous features and continuous labels URL: https://github.com/apache/spark/pull/27527#issuecomment-584404980 cc @srowen @zhengruifeng

[GitHub] [spark] SparkQA removed a comment on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

2020-02-10 Thread GitBox
SparkQA removed a comment on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes URL: https://github.com/apache/spark/pull/27313#issuecomment-584373594 **[Test build #118182 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes URL: https://github.com/apache/spark/pull/27313#issuecomment-584423727 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27534: [SPARK-30731][DOCS] Refine workflow for building docs

2020-02-10 Thread GitBox
HyukjinKwon commented on a change in pull request #27534: [SPARK-30731][DOCS] Refine workflow for building docs URL: https://github.com/apache/spark/pull/27534#discussion_r377394288 ## File path: python/docs/Makefile ## @@ -4,7 +4,6 @@ # You can set these variables from

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27534: [SPARK-30731][DOCS] Refine workflow for building docs

2020-02-10 Thread GitBox
HyukjinKwon commented on a change in pull request #27534: [SPARK-30731][DOCS] Refine workflow for building docs URL: https://github.com/apache/spark/pull/27534#discussion_r377394186 ## File path: sql/mkdocs.yml ## @@ -15,5 +15,5 @@ site_name: Spark SQL, Built-in

[GitHub] [spark] AmplabJenkins commented on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes URL: https://github.com/apache/spark/pull/27313#issuecomment-584423727 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes URL: https://github.com/apache/spark/pull/27313#issuecomment-584423716 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes URL: https://github.com/apache/spark/pull/27313#issuecomment-584423716 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27528: [SPARK-30779][SS]Fix some API issues found when reviewing Structured Streaming API docs

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27528: [SPARK-30779][SS]Fix some API issues found when reviewing Structured Streaming API docs URL: https://github.com/apache/spark/pull/27528#issuecomment-584306675 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27528: [SPARK-30779][SS]Fix some API issues found when reviewing Structured Streaming API docs

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27528: [SPARK-30779][SS]Fix some API issues found when reviewing Structured Streaming API docs URL: https://github.com/apache/spark/pull/27528#issuecomment-584306675 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27528: [SPARK-30779][SS]Fix some API issues found when reviewing Structured Streaming API docs

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27528: [SPARK-30779][SS]Fix some API issues found when reviewing Structured Streaming API docs URL: https://github.com/apache/spark/pull/27528#issuecomment-584306684 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27528: [SPARK-30779][SS]Fix some API issues found when reviewing Structured Streaming API docs

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27528: [SPARK-30779][SS]Fix some API issues found when reviewing Structured Streaming API docs URL: https://github.com/apache/spark/pull/27528#issuecomment-584306684 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27494: [SPARK-30760][SQL] Port `millisToDays` and `daysToMillis` on Java 8 time API

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27494: [SPARK-30760][SQL] Port `millisToDays` and `daysToMillis` on Java 8 time API URL: https://github.com/apache/spark/pull/27494#issuecomment-584311832 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27494: [SPARK-30760][SQL] Port `millisToDays` and `daysToMillis` on Java 8 time API

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27494: [SPARK-30760][SQL] Port `millisToDays` and `daysToMillis` on Java 8 time API URL: https://github.com/apache/spark/pull/27494#issuecomment-584311821 Merged build finished. Test PASSed.

[GitHub] [spark] holdenk commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-10 Thread GitBox
holdenk commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-584312892 .@itskals so I'm not 100% sure what you want us to do in `handleFailedTask` of fetch failure, I'm

[GitHub] [spark] SparkQA commented on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0

2020-02-10 Thread GitBox
SparkQA commented on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0 URL: https://github.com/apache/spark/pull/27529#issuecomment-584320427 **[Test build #118177 has

[GitHub] [spark] SparkQA commented on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations

2020-02-10 Thread GitBox
SparkQA commented on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations URL: https://github.com/apache/spark/pull/27493#issuecomment-584320495 **[Test build #118178 has

[GitHub] [spark] AmplabJenkins commented on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters URL: https://github.com/apache/spark/pull/27524#issuecomment-584348974 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function URL: https://github.com/apache/spark/pull/27531#issuecomment-584374099 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters URL: https://github.com/apache/spark/pull/27524#issuecomment-584373443 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function URL: https://github.com/apache/spark/pull/27531#issuecomment-584374109 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes URL: https://github.com/apache/spark/pull/27313#issuecomment-584374146 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes URL: https://github.com/apache/spark/pull/27313#issuecomment-584374156 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function URL: https://github.com/apache/spark/pull/27531#issuecomment-584374099 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes URL: https://github.com/apache/spark/pull/27313#issuecomment-584374156 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function URL: https://github.com/apache/spark/pull/27531#issuecomment-584374109 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes URL: https://github.com/apache/spark/pull/27313#issuecomment-584374146 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-584386353 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables.

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables. URL: https://github.com/apache/spark/pull/27532#issuecomment-584383445 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables.

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables. URL: https://github.com/apache/spark/pull/27532#issuecomment-584383433 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-584386362 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-02-10 Thread GitBox
SparkQA commented on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-584385955 **[Test build #118184 has

[GitHub] [spark] SparkQA commented on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables.

2020-02-10 Thread GitBox
SparkQA commented on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables. URL: https://github.com/apache/spark/pull/27532#issuecomment-584385992 **[Test build #118183 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-584393843 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-584393860 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-584393843 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-584393860 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27533: [SPARK-30783] Exclude hive-service-rpc

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27533: [SPARK-30783] Exclude hive-service-rpc URL: https://github.com/apache/spark/pull/27533#issuecomment-584397472 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27533: [SPARK-30783] Exclude hive-service-rpc

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27533: [SPARK-30783] Exclude hive-service-rpc URL: https://github.com/apache/spark/pull/27533#issuecomment-584397465 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs URL: https://github.com/apache/spark/pull/27534#issuecomment-584402671 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs URL: https://github.com/apache/spark/pull/27534#issuecomment-584402671 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs URL: https://github.com/apache/spark/pull/27534#issuecomment-584402678 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs URL: https://github.com/apache/spark/pull/27534#issuecomment-584402678 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] viirya commented on a change in pull request #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression

2020-02-10 Thread GitBox
viirya commented on a change in pull request #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression URL: https://github.com/apache/spark/pull/27499#discussion_r377375821 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ##

[GitHub] [spark] javierivanov commented on a change in pull request #27498: [SPARK-30688][SQL] Week based dates not being parsed with TimestampFormatter

2020-02-10 Thread GitBox
javierivanov commented on a change in pull request #27498: [SPARK-30688][SQL] Week based dates not being parsed with TimestampFormatter URL: https://github.com/apache/spark/pull/27498#discussion_r377272702 ## File path:

[GitHub] [spark] SparkQA removed a comment on issue #27494: [SPARK-30760][SQL] Port `millisToDays` and `daysToMillis` on Java 8 time API

2020-02-10 Thread GitBox
SparkQA removed a comment on issue #27494: [SPARK-30760][SQL] Port `millisToDays` and `daysToMillis` on Java 8 time API URL: https://github.com/apache/spark/pull/27494#issuecomment-584153170 **[Test build #118166 has

[GitHub] [spark] BryanCutler opened a new pull request #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0

2020-02-10 Thread GitBox
BryanCutler opened a new pull request #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0 URL: https://github.com/apache/spark/pull/27529 ### What changes were proposed in this pull request? Fix PySpark test failures for using Pandas >= 1.0.0.

[GitHub] [spark] gengliangwang commented on a change in pull request #27521: [SPARK-29462][SQL] The data type of "array()" should be array

2020-02-10 Thread GitBox
gengliangwang commented on a change in pull request #27521: [SPARK-29462][SQL] The data type of "array()" should be array URL: https://github.com/apache/spark/pull/27521#discussion_r377278945 ## File path: docs/sql-migration-guide.md ## @@ -215,6 +215,8 @@ license: |

[GitHub] [spark] holdenk commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-10 Thread GitBox
holdenk commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-584317375 It passes tests now, I'm going to do a read through this week. If no one has any outstanding

[GitHub] [spark] SparkQA commented on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations

2020-02-10 Thread GitBox
SparkQA commented on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations URL: https://github.com/apache/spark/pull/27493#issuecomment-584317249 **[Test build #118168 has

[GitHub] [spark] SparkQA removed a comment on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations

2020-02-10 Thread GitBox
SparkQA removed a comment on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations URL: https://github.com/apache/spark/pull/27493#issuecomment-584169032 **[Test build #118168 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations URL: https://github.com/apache/spark/pull/27493#issuecomment-584321060 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0 URL: https://github.com/apache/spark/pull/27529#issuecomment-584320972 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0 URL: https://github.com/apache/spark/pull/27529#issuecomment-584320963 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations URL: https://github.com/apache/spark/pull/27493#issuecomment-584321060 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations URL: https://github.com/apache/spark/pull/27493#issuecomment-584321072 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0 URL: https://github.com/apache/spark/pull/27529#issuecomment-584320972 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0 URL: https://github.com/apache/spark/pull/27529#issuecomment-584320963 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations URL: https://github.com/apache/spark/pull/27493#issuecomment-584321072 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters URL: https://github.com/apache/spark/pull/27524#issuecomment-584348963 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters URL: https://github.com/apache/spark/pull/27524#issuecomment-584348963 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters URL: https://github.com/apache/spark/pull/27524#issuecomment-584348974 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] rednaxelafx edited a comment on issue #27355: [SPARK-30625][SQL] Support `escape` as third parameter of the `like` function

2020-02-10 Thread GitBox
rednaxelafx edited a comment on issue #27355: [SPARK-30625][SQL] Support `escape` as third parameter of the `like` function URL: https://github.com/apache/spark/pull/27355#issuecomment-584344438 Sorry for posting this review post-hoc, but I strongly believe this PR should be reverted for

[GitHub] [spark] MaxGekk commented on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function

2020-02-10 Thread GitBox
MaxGekk commented on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function URL: https://github.com/apache/spark/pull/27531#issuecomment-584372662 @rednaxelafx @gatorsmile Please, review this PR. I haven't run tests locally, let's wait for

[GitHub] [spark] SparkQA commented on issue #27527: [SPARK-30776][ML] Support FValueRegressionSelector for continuous features and continuous labels

2020-02-10 Thread GitBox
SparkQA commented on issue #27527: [SPARK-30776][ML] Support FValueRegressionSelector for continuous features and continuous labels URL: https://github.com/apache/spark/pull/27527#issuecomment-584372589 **[Test build #118174 has

[GitHub] [spark] SparkQA commented on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters

2020-02-10 Thread GitBox
SparkQA commented on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters URL: https://github.com/apache/spark/pull/27524#issuecomment-584373068 **[Test build #118175 has

[GitHub] [spark] SparkQA removed a comment on issue #27527: [SPARK-30776][ML] Support FValueRegressionSelector for continuous features and continuous labels

2020-02-10 Thread GitBox
SparkQA removed a comment on issue #27527: [SPARK-30776][ML] Support FValueRegressionSelector for continuous features and continuous labels URL: https://github.com/apache/spark/pull/27527#issuecomment-584276493 **[Test build #118174 has

[GitHub] [spark] SparkQA commented on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs

2020-02-10 Thread GitBox
SparkQA commented on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs URL: https://github.com/apache/spark/pull/27534#issuecomment-584402199 **[Test build #118187 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118187/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584407920 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584407917 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584407920 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF URL: https://github.com/apache/spark/pull/27522#issuecomment-584416712 Merged build finished. Test PASSed. This is

[GitHub] [spark] maropu commented on a change in pull request #27521: [SPARK-29462][SQL] The data type of "array()" should be array

2020-02-10 Thread GitBox
maropu commented on a change in pull request #27521: [SPARK-29462][SQL] The data type of "array()" should be array URL: https://github.com/apache/spark/pull/27521#discussion_r377386840 ## File path: docs/sql-migration-guide.md ## @@ -215,6 +215,8 @@ license: | For

[GitHub] [spark] AmplabJenkins commented on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF URL: https://github.com/apache/spark/pull/27522#issuecomment-584416714 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF URL: https://github.com/apache/spark/pull/27522#issuecomment-584416712 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF URL: https://github.com/apache/spark/pull/27522#issuecomment-584416714 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] holdenk commented on a change in pull request #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-10 Thread GitBox
holdenk commented on a change in pull request #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r377271646 ## File path:

[GitHub] [spark] MaxGekk opened a new pull request #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function

2020-02-10 Thread GitBox
MaxGekk opened a new pull request #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function URL: https://github.com/apache/spark/pull/27531 ### What changes were proposed in this pull request? In the PR, I propose to revert the commit

[GitHub] [spark] AmplabJenkins commented on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables.

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables. URL: https://github.com/apache/spark/pull/27532#issuecomment-584383445 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables.

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables. URL: https://github.com/apache/spark/pull/27532#issuecomment-584383433 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters URL: https://github.com/apache/spark/pull/27524#issuecomment-584389477 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters URL: https://github.com/apache/spark/pull/27524#issuecomment-584389466 Merged build finished. Test PASSed.

[GitHub] [spark] MaxGekk commented on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters

2020-02-10 Thread GitBox
MaxGekk commented on issue #27524: [WIP][SQL] Support `SimpleDateFormat` and `FastDateFormat` as legacy date/timestamp formatters URL: https://github.com/apache/spark/pull/27524#issuecomment-584389384 @cloud-fan @HyukjinKwon Please, look at the draft PR.

  1   2   3   4   5   6   7   8   9   10   >