[GitHub] [spark] AmplabJenkins removed a comment on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak URL: https://github.com/apache/spark/pull/28128#issuecomment-610763658 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak

2020-04-07 Thread GitBox
SparkQA removed a comment on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak URL: https://github.com/apache/spark/pull/28128#issuecomment-610740113 **[Test build #120948 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak URL: https://github.com/apache/spark/pull/28128#issuecomment-610763654 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak URL: https://github.com/apache/spark/pull/28128#issuecomment-610763654 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak URL: https://github.com/apache/spark/pull/28128#issuecomment-610763658 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak

2020-04-07 Thread GitBox
SparkQA commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak URL: https://github.com/apache/spark/pull/28128#issuecomment-610763575 **[Test build #120948 has

[GitHub] [spark] iRakson commented on issue #27759: [SPARK-31008][SQL] Support json_array_length function

2020-04-07 Thread GitBox
iRakson commented on issue #27759: [SPARK-31008][SQL] Support json_array_length function URL: https://github.com/apache/spark/pull/27759#issuecomment-610762829 Thank you all for patiently reviewing the PR. This is an

[GitHub] [spark] AmplabJenkins commented on issue #28148: [WIP][SPARK-31381][SPARK-29245][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28148: [WIP][SPARK-31381][SPARK-29245][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610762116 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #28148: [WIP][SPARK-31381][SPARK-29245][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28148: [WIP][SPARK-31381][SPARK-29245][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610762121 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #28148: [WIP][SPARK-31381][SPARK-29245][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28148: [WIP][SPARK-31381][SPARK-29245][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610762121 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #28148: [WIP][SPARK-31381][SPARK-29245][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28148: [WIP][SPARK-31381][SPARK-29245][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610762116 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #28148: [WIP][SPARK-31381][SPARK-29245][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
SparkQA commented on issue #28148: [WIP][SPARK-31381][SPARK-29245][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610761710 **[Test build #120952 has

[GitHub] [spark] cloud-fan commented on a change in pull request #28060: [SPARK-31291][SQL][TEST] Avoid load test data if test case not uses them

2020-04-07 Thread GitBox
cloud-fan commented on a change in pull request #28060: [SPARK-31291][SQL][TEST] Avoid load test data if test case not uses them URL: https://github.com/apache/spark/pull/28060#discussion_r405266677 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQLQueryTestSuite.scala

[GitHub] [spark] AmplabJenkins commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610756123 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610756132 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610756132 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610756123 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
SparkQA commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610755769 **[Test build #120951 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610754396 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HeartSaVioR commented on issue #28114: [SPARK-31330] Automatically label PRs based on the paths they touch

2020-04-07 Thread GitBox
HeartSaVioR commented on issue #28114: [SPARK-31330] Automatically label PRs based on the paths they touch URL: https://github.com/apache/spark/pull/28114#issuecomment-610754650 Yeah as I said it's still one huge step forward and it's still great to get this in as it is. I'm just saying

[GitHub] [spark] beliefer commented on a change in pull request #28060: [SPARK-31291][SQL][TEST] Avoid load test data if test case not uses them

2020-04-07 Thread GitBox
beliefer commented on a change in pull request #28060: [SPARK-31291][SQL][TEST] Avoid load test data if test case not uses them URL: https://github.com/apache/spark/pull/28060#discussion_r405257472 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQLQueryTestSuite.scala

[GitHub] [spark] SparkQA removed a comment on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
SparkQA removed a comment on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610753827 **[Test build #120950 has

[GitHub] [spark] SparkQA commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
SparkQA commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610754372 **[Test build #120950 has

[GitHub] [spark] AmplabJenkins commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610754396 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610754385 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610754385 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610754144 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610754144 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610754137 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610754137 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
SparkQA commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610753827 **[Test build #120950 has

[GitHub] [spark] dongjoon-hyun commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
dongjoon-hyun commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610753956 Thank you for pinging me, @cloud-fan . This

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
HyukjinKwon commented on a change in pull request #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#discussion_r405260745 ## File path: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala

[GitHub] [spark] cloud-fan commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
cloud-fan commented on issue #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150#issuecomment-610753646 cc @dongjoon-hyun @HyukjinKwon This is an

[GitHub] [spark] dongjoon-hyun edited a comment on issue #28148: [WIP][SPARK-31381][SPARK-29245][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
dongjoon-hyun edited a comment on issue #28148: [WIP][SPARK-31381][SPARK-29245][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610752890 Thank you, @wangyum . And, +1 for @HyukjinKwon 's comment.

[GitHub] [spark] cloud-fan opened a new pull request #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata

2020-04-07 Thread GitBox
cloud-fan opened a new pull request #28150: [SPARK-31327][SQL][2.4] Write Spark version into Avro file metadata URL: https://github.com/apache/spark/pull/28150 Backport https://github.com/apache/spark/commit/6b1ca886c0066f4e10534336f3fce64cdebc79a5, similar to

[GitHub] [spark] dongjoon-hyun commented on issue #28148: [WIP][SPARK-31381][SPARK-29245][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
dongjoon-hyun commented on issue #28148: [WIP][SPARK-31381][SPARK-29245][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610752890 +1 for @HyukjinKwon 's comment. (https://github.com/apache/spark/pull/28148#issuecomment-610733977)

[GitHub] [spark] beliefer commented on a change in pull request #28060: [SPARK-31291][SQL][TEST] Avoid load test data if test case not uses them

2020-04-07 Thread GitBox
beliefer commented on a change in pull request #28060: [SPARK-31291][SQL][TEST] Avoid load test data if test case not uses them URL: https://github.com/apache/spark/pull/28060#discussion_r405257472 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQLQueryTestSuite.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610749614 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610749610 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins commented on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610749614 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610749610 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
SparkQA removed a comment on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610716663 **[Test build #120947 has

[GitHub] [spark] SparkQA commented on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
SparkQA commented on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610749337 **[Test build #120947 has

[GitHub] [spark] gatorsmile commented on issue #28026: [SPARK-31257][SQL] Unify create table syntax

2020-04-07 Thread GitBox
gatorsmile commented on issue #28026: [SPARK-31257][SQL] Unify create table syntax URL: https://github.com/apache/spark/pull/28026#issuecomment-610748104 > Again, this doesn't accomplish much. It makes this only marginally smaller and introduces more work to get the feature done.

[GitHub] [spark] cloud-fan commented on issue #10577: [SPARK-12616] [SQL] Making Logical Operator `Union` Support Arbitrary Number of Children

2020-04-07 Thread GitBox
cloud-fan commented on issue #10577: [SPARK-12616] [SQL] Making Logical Operator `Union` Support Arbitrary Number of Children URL: https://github.com/apache/spark/pull/10577#issuecomment-610744118 The cache key is the logical plan. If `a` is cached, ideally `a.union(b)` should leverage

[GitHub] [spark] AmplabJenkins removed a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-610743582 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-610743586 Test PASSed. Refer to this link for

[GitHub] [spark] AmplabJenkins commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-610743586 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-610743582 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-07 Thread GitBox
SparkQA commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-610743332 **[Test build #120949 has

[GitHub] [spark] turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative ta

2020-04-07 Thread GitBox
turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405247218 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak URL: https://github.com/apache/spark/pull/28128#issuecomment-610740320 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak URL: https://github.com/apache/spark/pull/28128#issuecomment-610740323 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak URL: https://github.com/apache/spark/pull/28128#issuecomment-610740320 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak URL: https://github.com/apache/spark/pull/28128#issuecomment-610740323 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak

2020-04-07 Thread GitBox
SparkQA commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak URL: https://github.com/apache/spark/pull/28128#issuecomment-610740113 **[Test build #120948 has

[GitHub] [spark] srowen commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak

2020-04-07 Thread GitBox
srowen commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak URL: https://github.com/apache/spark/pull/28128#issuecomment-610739647 Jenkins test this please This is an automated message

[GitHub] [spark] turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative ta

2020-04-07 Thread GitBox
turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405245208 ## File path:

[GitHub] [spark] beliefer commented on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table

2020-04-07 Thread GitBox
beliefer commented on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table URL: https://github.com/apache/spark/pull/28149#issuecomment-610739191 @HyukjinKwon Thanks for your hard work. This is

[GitHub] [spark] turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative ta

2020-04-07 Thread GitBox
turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405245208 ## File path:

[GitHub] [spark] Ngone51 commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative tas

2020-04-07 Thread GitBox
Ngone51 commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405244349 ## File path:

[GitHub] [spark] turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative ta

2020-04-07 Thread GitBox
turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405243756 ## File path:

[GitHub] [spark] Ngone51 commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative tas

2020-04-07 Thread GitBox
Ngone51 commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405243713 ## File path:

[GitHub] [spark] nchammas commented on issue #28114: [SPARK-31330] Automatically label PRs based on the paths they touch

2020-04-07 Thread GitBox
nchammas commented on issue #28114: [SPARK-31330] Automatically label PRs based on the paths they touch URL: https://github.com/apache/spark/pull/28114#issuecomment-610736606 Labels are additive. That is, a single PR can be tagged with multiple labels. Here's an example from the Avro

[GitHub] [spark] turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative ta

2020-04-07 Thread GitBox
turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405241541 ## File path:

[GitHub] [spark] turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative ta

2020-04-07 Thread GitBox
turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405241847 ## File path:

[GitHub] [spark] turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative ta

2020-04-07 Thread GitBox
turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405241847 ## File path:

[GitHub] [spark] turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative ta

2020-04-07 Thread GitBox
turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405241581 ## File path:

[GitHub] [spark] turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative ta

2020-04-07 Thread GitBox
turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405241541 ## File path:

[GitHub] [spark] turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative ta

2020-04-07 Thread GitBox
turboFei commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405241600 ## File path:

[GitHub] [spark] HyukjinKwon edited a comment on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
HyukjinKwon edited a comment on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610733977 >How was this patch tested? > Exist test. Ideally we should test it out with the steps you mentioned

[GitHub] [spark] Ngone51 commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative tas

2020-04-07 Thread GitBox
Ngone51 commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405239603 ## File path:

[GitHub] [spark] HyukjinKwon commented on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
HyukjinKwon commented on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610733977 >How was this patch tested? > Exist test. Ideally we should test it out with the steps you mentioned before:

[GitHub] [spark] Ngone51 commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative tas

2020-04-07 Thread GitBox
Ngone51 commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405238111 ## File path:

[GitHub] [spark] Ngone51 commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative tas

2020-04-07 Thread GitBox
Ngone51 commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405238993 ## File path:

[GitHub] [spark] Ngone51 commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative tas

2020-04-07 Thread GitBox
Ngone51 commented on a change in pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#discussion_r405238312 ## File path:

[GitHub] [spark] HyukjinKwon commented on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-07 Thread GitBox
HyukjinKwon commented on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3.6 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610733222 @wangyum, could we test it against the actual RC - https://people.apache.org/~gates/apache-hive-2.3.7-rc0/ and

[GitHub] [spark] HyukjinKwon commented on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3 to 2.3.7

2020-04-07 Thread GitBox
HyukjinKwon commented on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610732587 Nice @wangyum. This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on issue #28125: [SPARK-31351][DOC] Migration Guide Auditing for Spark 3.0 Release

2020-04-07 Thread GitBox
HyukjinKwon commented on issue #28125: [SPARK-31351][DOC] Migration Guide Auditing for Spark 3.0 Release URL: https://github.com/apache/spark/pull/28125#issuecomment-610731904 Merged to master and branch-3.0 This is an

[GitHub] [spark] HyukjinKwon closed pull request #28125: [SPARK-31351][DOC] Migration Guide Auditing for Spark 3.0 Release

2020-04-07 Thread GitBox
HyukjinKwon closed pull request #28125: [SPARK-31351][DOC] Migration Guide Auditing for Spark 3.0 Release URL: https://github.com/apache/spark/pull/28125 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] HyukjinKwon commented on issue #28135: [SPARK-26412][PYTHON][FOLLOW-UP] Improve error messages in Scala iterator pandas UDF

2020-04-07 Thread GitBox
HyukjinKwon commented on issue #28135: [SPARK-26412][PYTHON][FOLLOW-UP] Improve error messages in Scala iterator pandas UDF URL: https://github.com/apache/spark/pull/28135#issuecomment-610731214 @WeichenXu123, mind taking another look when you're available?

[GitHub] [spark] HyukjinKwon closed pull request #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table

2020-04-07 Thread GitBox
HyukjinKwon closed pull request #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table URL: https://github.com/apache/spark/pull/28149 This is an automated message from the Apache Git Service. To

[GitHub] [spark] HyukjinKwon commented on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table

2020-04-07 Thread GitBox
HyukjinKwon commented on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table URL: https://github.com/apache/spark/pull/28149#issuecomment-610730964 Merged to master and branch-3.0. This is an

[GitHub] [spark] Ngone51 commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-07 Thread GitBox
Ngone51 commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-610728862 I see. Thanks for your explanation!

[GitHub] [spark] AngersZhuuuu edited a comment on issue #28036: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-04-07 Thread GitBox
AngersZh edited a comment on issue #28036: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab URL: https://github.com/apache/spark/pull/28036#issuecomment-610725617 > These metrics you want to add are calculated per Executor rather than per Stage.

[GitHub] [spark] AngersZhuuuu commented on issue #28036: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-04-07 Thread GitBox
AngersZh commented on issue #28036: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab URL: https://github.com/apache/spark/pull/28036#issuecomment-610725617 > These metrics you want to add are calculated per Executor rather than per Stage. > So

[GitHub] [spark] sarutak commented on issue #28036: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-04-07 Thread GitBox
sarutak commented on issue #28036: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab URL: https://github.com/apache/spark/pull/28036#issuecomment-610724928 These metrics you want to add are calculated per Executor rather than per Stage. So I don't

[GitHub] [spark] AmplabJenkins removed a comment on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table URL: https://github.com/apache/spark/pull/28149#issuecomment-610720350 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table URL: https://github.com/apache/spark/pull/28149#issuecomment-610720345 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table URL: https://github.com/apache/spark/pull/28149#issuecomment-610720350 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table URL: https://github.com/apache/spark/pull/28149#issuecomment-610720345 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table

2020-04-07 Thread GitBox
SparkQA commented on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table URL: https://github.com/apache/spark/pull/28149#issuecomment-610720234 **[Test build #120946 has

[GitHub] [spark] SparkQA removed a comment on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table

2020-04-07 Thread GitBox
SparkQA removed a comment on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table URL: https://github.com/apache/spark/pull/28149#issuecomment-610716653 **[Test build #120946 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak

2020-04-07 Thread GitBox
AmplabJenkins removed a comment on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak URL: https://github.com/apache/spark/pull/28128#issuecomment-609427703 Can one of the admins verify this patch?

[GitHub] [spark] vinooganesh commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak

2020-04-07 Thread GitBox
vinooganesh commented on issue #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak URL: https://github.com/apache/spark/pull/28128#issuecomment-610719071 Hey @srowen - could I get an "ok to test" on here? also thoughts on this approach?

[GitHub] [spark] beliefer commented on issue #28144: [SPARK-30841][SQL][FOLLOW-UP] Change 'version' of spark.sql.execution.pandas.udf.buffer.size to 3.0.0

2020-04-07 Thread GitBox
beliefer commented on issue #28144: [SPARK-30841][SQL][FOLLOW-UP] Change 'version' of spark.sql.execution.pandas.udf.buffer.size to 3.0.0 URL: https://github.com/apache/spark/pull/28144#issuecomment-610718138 @HyukjinKwon Thank you. The work of version statistics has finally come to an

[GitHub] [spark] beliefer commented on issue #28118: [SPARK-31002][CORE][DOC][3.0] Add version information to the configuration of Core

2020-04-07 Thread GitBox
beliefer commented on issue #28118: [SPARK-31002][CORE][DOC][3.0] Add version information to the configuration of Core URL: https://github.com/apache/spark/pull/28118#issuecomment-610717848 I understand now. You means I create PR to check the change is good for branch-3.0. The check PR

[GitHub] [spark] HyukjinKwon commented on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table

2020-04-07 Thread GitBox
HyukjinKwon commented on issue #28149: [SPARK-31269][DOC][FOLLOWUP][MINOR] Add version head of GraphX table URL: https://github.com/apache/spark/pull/28149#issuecomment-610717533 Thanks, @beliefer This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3 to 2.3.7

2020-04-07 Thread GitBox
AmplabJenkins commented on issue #28148: [WIP][SPARK-31381][SQL] Upgrade built-in Hive 2.3 to 2.3.7 URL: https://github.com/apache/spark/pull/28148#issuecomment-610717038 Test PASSed. Refer to this link for build results (access rights to CI server needed):

  1   2   3   4   5   6   7   8   9   >