[GitHub] [spark] AmplabJenkins removed a comment on issue #28006: [DO-NOT-MERGE][SPARK-31231][BUILD][2.4][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28006: [DO-NOT-MERGE][SPARK-31231][BUILD][2.4][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28006#issuecomment-603605702 Test FAILed. Refer to this link for build

[GitHub] [spark] yaooqinn commented on issue #27949: [SPARK-31150][SQL][Followup] Handle ' as escape for text

2020-03-24 Thread GitBox
yaooqinn commented on issue #27949: [SPARK-31150][SQL][Followup] Handle ' as escape for text URL: https://github.com/apache/spark/pull/27949#issuecomment-603606506 thanks This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on issue #28006: [DO-NOT-MERGE][SPARK-31231][BUILD][2.4][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28006: [DO-NOT-MERGE][SPARK-31231][BUILD][2.4][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28006#issuecomment-603609200 Merged build finished. Test PASSed.

[GitHub] [spark] rednaxelafx closed pull request #28008: [SPARK-27692][SQL] Constant fold deterministic Scala UDFs with foldable arguments

2020-03-24 Thread GitBox
rednaxelafx closed pull request #28008: [SPARK-27692][SQL] Constant fold deterministic Scala UDFs with foldable arguments URL: https://github.com/apache/spark/pull/28008 This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28005#issuecomment-603609236 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28005#issuecomment-603609241 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins removed a comment on issue #28006: [DO-NOT-MERGE][SPARK-31231][BUILD][2.4][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28006: [DO-NOT-MERGE][SPARK-31231][BUILD][2.4][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28006#issuecomment-603609203 Test PASSed. Refer to this link for build

[GitHub] [spark] rednaxelafx commented on issue #28008: [SPARK-27692][SQL] Constant fold deterministic Scala UDFs with foldable arguments

2020-03-24 Thread GitBox
rednaxelafx commented on issue #28008: [SPARK-27692][SQL] Constant fold deterministic Scala UDFs with foldable arguments URL: https://github.com/apache/spark/pull/28008#issuecomment-603609485 Closing this PR as I don't think it's going to work given the current API semantics.

[GitHub] [spark] SparkQA commented on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
SparkQA commented on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28005#issuecomment-603610962 **[Test build #120302 has

[GitHub] [spark] SparkQA commented on issue #28006: [DO-NOT-MERGE][SPARK-31231][BUILD][2.4][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
SparkQA commented on issue #28006: [DO-NOT-MERGE][SPARK-31231][BUILD][2.4][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28006#issuecomment-603610979 **[Test build #120301 has

[GitHub] [spark] SparkQA commented on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware

2020-03-24 Thread GitBox
SparkQA commented on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware URL: https://github.com/apache/spark/pull/27982#issuecomment-603610999 **[Test build #120303 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120303/testReport)** for PR

[GitHub] [spark] AmplabJenkins commented on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware URL: https://github.com/apache/spark/pull/27982#issuecomment-603611255 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware URL: https://github.com/apache/spark/pull/27982#issuecomment-603611259 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware URL: https://github.com/apache/spark/pull/27982#issuecomment-603611259 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware URL: https://github.com/apache/spark/pull/27982#issuecomment-603611255 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA commented on issue #28004: [SPARK-31204][SQL] HiveResult compatibility for DatasourceV2 command

2020-03-24 Thread GitBox
SparkQA commented on issue #28004: [SPARK-31204][SQL] HiveResult compatibility for DatasourceV2 command URL: https://github.com/apache/spark/pull/28004#issuecomment-603616063 **[Test build #120289 has

[GitHub] [spark] SparkQA removed a comment on issue #28004: [SPARK-31204][SQL] HiveResult compatibility for DatasourceV2 command

2020-03-24 Thread GitBox
SparkQA removed a comment on issue #28004: [SPARK-31204][SQL] HiveResult compatibility for DatasourceV2 command URL: https://github.com/apache/spark/pull/28004#issuecomment-603547808 **[Test build #120289 has

[GitHub] [spark] cloud-fan commented on a change in pull request #28001: [SPARK-31237][SQL][TESTS] Replace 3-letter time zones by zone offsets

2020-03-24 Thread GitBox
cloud-fan commented on a change in pull request #28001: [SPARK-31237][SQL][TESTS] Replace 3-letter time zones by zone offsets URL: https://github.com/apache/spark/pull/28001#discussion_r397588337 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #28001: [SPARK-31237][SQL][TESTS] Replace 3-letter time zones by zone offsets

2020-03-24 Thread GitBox
cloud-fan commented on a change in pull request #28001: [SPARK-31237][SQL][TESTS] Replace 3-letter time zones by zone offsets URL: https://github.com/apache/spark/pull/28001#discussion_r397588337 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #28001: [SPARK-31237][SQL][TESTS] Replace 3-letter time zones by zone offsets

2020-03-24 Thread GitBox
cloud-fan commented on a change in pull request #28001: [SPARK-31237][SQL][TESTS] Replace 3-letter time zones by zone offsets URL: https://github.com/apache/spark/pull/28001#discussion_r397588337 ## File path:

[GitHub] [spark] Eric5553 commented on issue #27685: [SPARK-30940][SQL] Remove attributeId in auto-generated arguments when Explain SQL query

2020-03-24 Thread GitBox
Eric5553 commented on issue #27685: [SPARK-30940][SQL] Remove attributeId in auto-generated arguments when Explain SQL query URL: https://github.com/apache/spark/pull/27685#issuecomment-603618760 @cloud-fan @gatorsmile @maryannxue Would you please help review this PR? Thanks so much :-)

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader

2020-03-24 Thread GitBox
HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader URL: https://github.com/apache/spark/pull/27025#discussion_r397591651 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28005#issuecomment-603626184 Test FAILed. Refer to this link for build results (access

[GitHub] [spark] SparkQA commented on issue #27972: [SPARK-31207][CORE] Ensure the total number of blocks to fetch equals to the sum of local/hostLocal/remote blocks

2020-03-24 Thread GitBox
SparkQA commented on issue #27972: [SPARK-31207][CORE] Ensure the total number of blocks to fetch equals to the sum of local/hostLocal/remote blocks URL: https://github.com/apache/spark/pull/27972#issuecomment-603628321 **[Test build #120294 has

[GitHub] [spark] SparkQA removed a comment on issue #27972: [SPARK-31207][CORE] Ensure the total number of blocks to fetch equals to the sum of local/hostLocal/remote blocks

2020-03-24 Thread GitBox
SparkQA removed a comment on issue #27972: [SPARK-31207][CORE] Ensure the total number of blocks to fetch equals to the sum of local/hostLocal/remote blocks URL: https://github.com/apache/spark/pull/27972#issuecomment-603580917 **[Test build #120294 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware URL: https://github.com/apache/spark/pull/27982#issuecomment-603629702 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware URL: https://github.com/apache/spark/pull/27982#issuecomment-603629702 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware URL: https://github.com/apache/spark/pull/27982#issuecomment-603629698 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware URL: https://github.com/apache/spark/pull/27982#issuecomment-603629698 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26942: [SPARK-30301][SQL] Fix wrong results when datetimes as fields of complex types

2020-03-24 Thread GitBox
HyukjinKwon commented on a change in pull request #26942: [SPARK-30301][SQL] Fix wrong results when datetimes as fields of complex types URL: https://github.com/apache/spark/pull/26942#discussion_r397604810 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #28007: [SPARK-31239][CORE][TEST] Increase await duration in `WorkerDecommissionSuite`.`verify a task with all workers decommissioned succeeds`

2020-03-24 Thread GitBox
dongjoon-hyun commented on issue #28007: [SPARK-31239][CORE][TEST] Increase await duration in `WorkerDecommissionSuite`.`verify a task with all workers decommissioned succeeds` URL: https://github.com/apache/spark/pull/28007#issuecomment-603638943 +1, LGTM. Thank you, @jiangxb1987 and

[GitHub] [spark] AmplabJenkins commented on issue #27861: [SPARK-30707][SQL]Window function set partitionSpec as order spec when orderSpec is empty

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #27861: [SPARK-30707][SQL]Window function set partitionSpec as order spec when orderSpec is empty URL: https://github.com/apache/spark/pull/27861#issuecomment-603639123 Merged build finished. Test PASSed.

[GitHub] [spark] dongjoon-hyun commented on issue #28006: [DO-NOT-MERGE][SPARK-31231][BUILD][2.4][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
dongjoon-hyun commented on issue #28006: [DO-NOT-MERGE][SPARK-31231][BUILD][2.4][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28006#issuecomment-603639137 Thank you for working on this.

[GitHub] [spark] AmplabJenkins commented on issue #27861: [SPARK-30707][SQL]Window function set partitionSpec as order spec when orderSpec is empty

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #27861: [SPARK-30707][SQL]Window function set partitionSpec as order spec when orderSpec is empty URL: https://github.com/apache/spark/pull/27861#issuecomment-603639129 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] dongjoon-hyun commented on issue #27996: [SPARK-31101][BUILD][3.0] Upgrade Janino to 3.0.16

2020-03-24 Thread GitBox
dongjoon-hyun commented on issue #27996: [SPARK-31101][BUILD][3.0] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27996#issuecomment-603639297 Thank you so much, @HeartSaVioR ! This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet URL: https://github.com/apache/spark/pull/27728#issuecomment-603639160 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins commented on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet URL: https://github.com/apache/spark/pull/27728#issuecomment-603639154 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27861: [SPARK-30707][SQL]Window function set partitionSpec as order spec when orderSpec is empty

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #27861: [SPARK-30707][SQL]Window function set partitionSpec as order spec when orderSpec is empty URL: https://github.com/apache/spark/pull/27861#issuecomment-603639123 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27861: [SPARK-30707][SQL]Window function set partitionSpec as order spec when orderSpec is empty

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #27861: [SPARK-30707][SQL]Window function set partitionSpec as order spec when orderSpec is empty URL: https://github.com/apache/spark/pull/27861#issuecomment-603639129 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet URL: https://github.com/apache/spark/pull/27728#issuecomment-603639154 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27943: [SPARK-31179] Fast fail the connection while last connection failed in the last retry IO wait

2020-03-24 Thread GitBox
SparkQA commented on issue #27943: [SPARK-31179] Fast fail the connection while last connection failed in the last retry IO wait URL: https://github.com/apache/spark/pull/27943#issuecomment-603639340 **[Test build #120298 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet URL: https://github.com/apache/spark/pull/27728#issuecomment-603639160 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28005#issuecomment-603643240 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28005#issuecomment-603643247 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins commented on issue #28003: [SPARK-31234][SQL] ResetCommand should reset config to sc.conf only

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #28003: [SPARK-31234][SQL] ResetCommand should reset config to sc.conf only URL: https://github.com/apache/spark/pull/28003#issuecomment-603647001 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #28003: [SPARK-31234][SQL] ResetCommand should reset config to sc.conf only

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #28003: [SPARK-31234][SQL] ResetCommand should reset config to sc.conf only URL: https://github.com/apache/spark/pull/28003#issuecomment-603646994 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #28003: [SPARK-31234][SQL] ResetCommand should reset config to sc.conf only

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28003: [SPARK-31234][SQL] ResetCommand should reset config to sc.conf only URL: https://github.com/apache/spark/pull/28003#issuecomment-603646994 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #28003: [SPARK-31234][SQL] ResetCommand should reset config to sc.conf only

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28003: [SPARK-31234][SQL] ResetCommand should reset config to sc.conf only URL: https://github.com/apache/spark/pull/28003#issuecomment-603647001 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #28003: [SPARK-31234][SQL] ResetCommand should reset config to sc.conf only

2020-03-24 Thread GitBox
SparkQA commented on issue #28003: [SPARK-31234][SQL] ResetCommand should reset config to sc.conf only URL: https://github.com/apache/spark/pull/28003#issuecomment-603646664 **[Test build #120309 has

[GitHub] [spark] maropu commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution

2020-03-24 Thread GitBox
maropu commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-603646852 Sure, I'll do that. Thanks! This is an

[GitHub] [spark] yaooqinn commented on a change in pull request #28003: [SPARK-31234][SQL] ResetCommand should reset config to sc.conf only

2020-03-24 Thread GitBox
yaooqinn commented on a change in pull request #28003: [SPARK-31234][SQL] ResetCommand should reset config to sc.conf only URL: https://github.com/apache/spark/pull/28003#discussion_r397615611 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group URL: https://github.com/apache/spark/pull/27665#issuecomment-603650851 Merged build finished. Test PASSed.

[GitHub] [spark] Ngone51 commented on a change in pull request #27943: [SPARK-31179] Fast fail the connection while last connection failed in the last retry IO wait

2020-03-24 Thread GitBox
Ngone51 commented on a change in pull request #27943: [SPARK-31179] Fast fail the connection while last connection failed in the last retry IO wait URL: https://github.com/apache/spark/pull/27943#discussion_r397618892 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group URL: https://github.com/apache/spark/pull/27665#issuecomment-603650851 Merged build finished. Test PASSed.

[GitHub] [spark] gatorsmile edited a comment on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable

2020-03-24 Thread GitBox
gatorsmile edited a comment on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable URL: https://github.com/apache/spark/pull/27815#issuecomment-603650408 There are three major reasons why I think we should keep HiveContext: - SQLContext will not be removed in

[GitHub] [spark] AmplabJenkins commented on issue #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group URL: https://github.com/apache/spark/pull/27665#issuecomment-603650859 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group

2020-03-24 Thread GitBox
SparkQA commented on issue #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group URL: https://github.com/apache/spark/pull/27665#issuecomment-603650519 **[Test build #120310 has

[GitHub] [spark] gatorsmile edited a comment on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable

2020-03-24 Thread GitBox
gatorsmile edited a comment on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable URL: https://github.com/apache/spark/pull/27815#issuecomment-603650408 There are three major reasons why I think we should keep HiveContext: - SQLContext will not be removed in

[GitHub] [spark] gatorsmile commented on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable

2020-03-24 Thread GitBox
gatorsmile commented on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable URL: https://github.com/apache/spark/pull/27815#issuecomment-603650408 There are two major reasons why I think we should keep HiveContext: - SQLContext will not be removed in the near

[GitHub] [spark] AmplabJenkins removed a comment on issue #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group URL: https://github.com/apache/spark/pull/27665#issuecomment-603650859 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] xuanyuanking commented on a change in pull request #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group

2020-03-24 Thread GitBox
xuanyuanking commented on a change in pull request #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group URL: https://github.com/apache/spark/pull/27665#discussion_r397621197 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage URL: https://github.com/apache/spark/pull/27690#issuecomment-603653210 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage URL: https://github.com/apache/spark/pull/27690#issuecomment-603653204 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage URL: https://github.com/apache/spark/pull/27690#issuecomment-603653204 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage URL: https://github.com/apache/spark/pull/27690#issuecomment-603653210 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] SparkQA removed a comment on issue #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-03-24 Thread GitBox
SparkQA removed a comment on issue #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage URL: https://github.com/apache/spark/pull/27690#issuecomment-603585031 **[Test build #120296 has

[GitHub] [spark] LantaoJin edited a comment on issue #28000: [SPARK-30494][SQL][2.4] Fix cached data leakage during replacing an existing view

2020-03-24 Thread GitBox
LantaoJin edited a comment on issue #28000: [SPARK-30494][SQL][2.4] Fix cached data leakage during replacing an existing view URL: https://github.com/apache/spark/pull/28000#issuecomment-603604136 Thank you, @dongjoon-hyun @HyukjinKwon @maropu

[GitHub] [spark] zhengruifeng commented on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware

2020-03-24 Thread GitBox
zhengruifeng commented on issue #27982: [SPARK-31222][ML] Make ANOVATest Sparsity-Aware URL: https://github.com/apache/spark/pull/27982#issuecomment-603608126 @srowen @huaxingao Thanks for reviewing! > you are only avoiding counts 0s in sum and sumSq right? not count. Yes,

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27999: [SPARK-31232][SQL][DOCS] Specify formats of `spark.sql.session.timeZone`

2020-03-24 Thread GitBox
HyukjinKwon commented on a change in pull request #27999: [SPARK-31232][SQL][DOCS] Specify formats of `spark.sql.session.timeZone` URL: https://github.com/apache/spark/pull/27999#discussion_r397581770 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28005#issuecomment-603613084 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28005#issuecomment-603613084 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28005#issuecomment-603613090 Test FAILed. Refer to this link for build results (access

[GitHub] [spark] HeartSaVioR commented on issue #27996: [SPARK-31101][BUILD][3.0] Upgrade Janino to 3.0.16

2020-03-24 Thread GitBox
HeartSaVioR commented on issue #27996: [SPARK-31101][BUILD][3.0] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27996#issuecomment-603613705 I've added the UT in the description of PR. If we would like to avoid regression I can add UT as well, but the threshold

[GitHub] [spark] AmplabJenkins commented on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #28005: [SPARK-31231][BUILD][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28005#issuecomment-603613090 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] cloud-fan commented on issue #27968: [SPARK-31202][CORE]Improve SizeEstimator for AppendOnlyMap

2020-03-24 Thread GitBox
cloud-fan commented on issue #27968: [SPARK-31202][CORE]Improve SizeEstimator for AppendOnlyMap URL: https://github.com/apache/spark/pull/27968#issuecomment-603613013 do we have this problem in SQL queries? This is an

[GitHub] [spark] cloud-fan commented on a change in pull request #28001: [SPARK-31237][SQL][TESTS] Replace 3-letter time zones by zone offsets

2020-03-24 Thread GitBox
cloud-fan commented on a change in pull request #28001: [SPARK-31237][SQL][TESTS] Replace 3-letter time zones by zone offsets URL: https://github.com/apache/spark/pull/28001#discussion_r397589266 ## File path:

[GitHub] [spark] imback82 commented on issue #28004: [SPARK-31204][SQL] HiveResult compatibility for DatasourceV2 command

2020-03-24 Thread GitBox
imback82 commented on issue #28004: [SPARK-31204][SQL] HiveResult compatibility for DatasourceV2 command URL: https://github.com/apache/spark/pull/28004#issuecomment-603623532 cc @cloud-fan @juliuszsompolski This is an

[GitHub] [spark] cloud-fan commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader

2020-03-24 Thread GitBox
cloud-fan commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader URL: https://github.com/apache/spark/pull/27025#discussion_r397597269 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #28007: [SPARK-31239][CORE][TEST] Increase await duration in `WorkerDecommissionSuite`.`verify a task with all workers decommissioned succeeds`

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #28007: [SPARK-31239][CORE][TEST] Increase await duration in `WorkerDecommissionSuite`.`verify a task with all workers decommissioned succeeds` URL: https://github.com/apache/spark/pull/28007#issuecomment-603631406 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #28007: [SPARK-31239][CORE][TEST] Increase await duration in `WorkerDecommissionSuite`.`verify a task with all workers decommissioned succeeds`

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #28007: [SPARK-31239][CORE][TEST] Increase await duration in `WorkerDecommissionSuite`.`verify a task with all workers decommissioned succeeds` URL: https://github.com/apache/spark/pull/28007#issuecomment-603631411 Test PASSed. Refer to this link for

[GitHub] [spark] srowen commented on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable

2020-03-24 Thread GitBox
srowen commented on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable URL: https://github.com/apache/spark/pull/27815#issuecomment-603631097 @gatorsmile where did you disagree with this removal originally?

[GitHub] [spark] AngersZhuuuu opened a new pull request #28010: [SPARK-26329][CORE][FOLLOW_UP] Fix some small typo

2020-03-24 Thread GitBox
AngersZh opened a new pull request #28010: [SPARK-26329][CORE][FOLLOW_UP] Fix some small typo URL: https://github.com/apache/spark/pull/28010 ### What changes were proposed in this pull request? Fix small typo ### Why are the changes needed? Fix typo ### Does this

[GitHub] [spark] SparkQA commented on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet

2020-03-24 Thread GitBox
SparkQA commented on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet URL: https://github.com/apache/spark/pull/27728#issuecomment-603631586 **[Test build #120304 has

[GitHub] [spark] dbtsai commented on a change in pull request #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet

2020-03-24 Thread GitBox
dbtsai commented on a change in pull request #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet URL: https://github.com/apache/spark/pull/27728#discussion_r397601474 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #28007: [SPARK-31239][CORE][TEST] Increase await duration in `WorkerDecommissionSuite`.`verify a task with all workers decommissioned succeeds

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28007: [SPARK-31239][CORE][TEST] Increase await duration in `WorkerDecommissionSuite`.`verify a task with all workers decommissioned succeeds` URL: https://github.com/apache/spark/pull/28007#issuecomment-603631411 Test PASSed. Refer to this

[GitHub] [spark] AmplabJenkins removed a comment on issue #28007: [SPARK-31239][CORE][TEST] Increase await duration in `WorkerDecommissionSuite`.`verify a task with all workers decommissioned succeeds

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28007: [SPARK-31239][CORE][TEST] Increase await duration in `WorkerDecommissionSuite`.`verify a task with all workers decommissioned succeeds` URL: https://github.com/apache/spark/pull/28007#issuecomment-603631406 Merged build finished. Test

[GitHub] [spark] SparkQA commented on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet

2020-03-24 Thread GitBox
SparkQA commented on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet URL: https://github.com/apache/spark/pull/27728#issuecomment-603633352 **[Test build #120305 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet URL: https://github.com/apache/spark/pull/27728#issuecomment-603633607 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet URL: https://github.com/apache/spark/pull/27728#issuecomment-603633598 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet URL: https://github.com/apache/spark/pull/27728#issuecomment-603633598 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet

2020-03-24 Thread GitBox
AmplabJenkins commented on issue #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet URL: https://github.com/apache/spark/pull/27728#issuecomment-603633607 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins removed a comment on issue #28010: [SPARK-26329][CORE][FOLLOW_UP] Fix some small typo

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28010: [SPARK-26329][CORE][FOLLOW_UP] Fix some small typo URL: https://github.com/apache/spark/pull/28010#issuecomment-603631799 Can one of the admins verify this patch? This is an

[GitHub] [spark] HyukjinKwon commented on a change in pull request #23391: [SPARK-26456][SQL] Cast date/timestamp to string by Date/TimestampFormatter

2020-03-24 Thread GitBox
HyukjinKwon commented on a change in pull request #23391: [SPARK-26456][SQL] Cast date/timestamp to string by Date/TimestampFormatter URL: https://github.com/apache/spark/pull/23391#discussion_r397603222 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #28006: [DO-NOT-MERGE][SPARK-31231][BUILD][2.4][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test

2020-03-24 Thread GitBox
AmplabJenkins removed a comment on issue #28006: [DO-NOT-MERGE][SPARK-31231][BUILD][2.4][FOLLOW-UP] Set the upper bound (before 46.1.0) for setuptools in pip package test URL: https://github.com/apache/spark/pull/28006#issuecomment-603636797 Test FAILed. Refer to this link for build

[GitHub] [spark] gatorsmile edited a comment on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable

2020-03-24 Thread GitBox
gatorsmile edited a comment on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable URL: https://github.com/apache/spark/pull/27815#issuecomment-603491190 Adoption of Spark 3.0 is much more important than removal of these deprecated methods. I strongly disagree we

[GitHub] [spark] HyukjinKwon commented on issue #28007: [SPARK-31239][CORE][TEST] Increase await duration in `WorkerDecommissionSuite`.`verify a task with all workers decommissioned succeeds`

2020-03-24 Thread GitBox
HyukjinKwon commented on issue #28007: [SPARK-31239][CORE][TEST] Increase await duration in `WorkerDecommissionSuite`.`verify a task with all workers decommissioned succeeds` URL: https://github.com/apache/spark/pull/28007#issuecomment-603637402 Merged to master.

[GitHub] [spark] HyukjinKwon commented on issue #28010: [SPARK-26329][CORE][FOLLOW_UP] Fix some small typo

2020-03-24 Thread GitBox
HyukjinKwon commented on issue #28010: [SPARK-26329][CORE][FOLLOW_UP] Fix some small typo URL: https://github.com/apache/spark/pull/28010#issuecomment-603637680 Let's don't fix a couple of nits in a separate PR. If we should, let's do it in a batch as a minor PR.

[GitHub] [spark] HyukjinKwon closed pull request #28007: [SPARK-31239][CORE][TEST] Increase await duration in `WorkerDecommissionSuite`.`verify a task with all workers decommissioned succeeds`

2020-03-24 Thread GitBox
HyukjinKwon closed pull request #28007: [SPARK-31239][CORE][TEST] Increase await duration in `WorkerDecommissionSuite`.`verify a task with all workers decommissioned succeeds` URL: https://github.com/apache/spark/pull/28007

[GitHub] [spark] viirya commented on a change in pull request #27902: [SPARK-31147][SQL] Forbid CHAR type in non-Hive-Serde tables

2020-03-24 Thread GitBox
viirya commented on a change in pull request #27902: [SPARK-31147][SQL] Forbid CHAR type in non-Hive-Serde tables URL: https://github.com/apache/spark/pull/27902#discussion_r397610129 ## File path:

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27997: [SPARK-31101][BUILD][2.4] Upgrade Janino to 3.0.16

2020-03-24 Thread GitBox
dongjoon-hyun edited a comment on issue #27997: [SPARK-31101][BUILD][2.4] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27997#issuecomment-603640642 Also, cc @gatorsmile and @cloud-fan since the situation is different from `master` and `branch-3.0`. ``` -

  1   2   3   4   5   6   7   8   9   10   >