[GitHub] [spark] AmplabJenkins commented on pull request #28834: [SPARK-31994][k8s] Docker image should use `https` urls for only deb.debian.org mirrors.

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28834: URL: https://github.com/apache/spark/pull/28834#issuecomment-644051683 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28832: [SPARK-31959][SQL][TESTS][FOLLOWUP] Adopt the test "SPARK-31959: JST -> HKT at Asia/Hong_Kong in 1945" to outdated tzdb

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28832: URL: https://github.com/apache/spark/pull/28832#issuecomment-644064207 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28832: [SPARK-31959][SQL][TESTS][FOLLOWUP] Adopt the test "SPARK-31959: JST -> HKT at Asia/Hong_Kong in 1945" to outdated tzdb

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28832: URL: https://github.com/apache/spark/pull/28832#issuecomment-644064207 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28832: [SPARK-31959][SQL][TESTS][FOLLOWUP] Adopt the test "SPARK-31959: JST -> HKT at Asia/Hong_Kong in 1945" to outdated tzdb

2020-06-15 Thread GitBox
SparkQA commented on pull request #28832: URL: https://github.com/apache/spark/pull/28832#issuecomment-644063697 **[Test build #124052 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124052/testReport)** for PR 28832 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-644077059 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-644077050 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for void column datatype

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-644092796 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for void column datatype

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-644092796 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for void column datatype

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-644092814 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #28642: [SPARK-31809][SQL] Infer IsNotNull for non null intolerant child of null intolerant in join condition

2020-06-15 Thread GitBox
SparkQA commented on pull request #28642: URL: https://github.com/apache/spark/pull/28642#issuecomment-644098962 **[Test build #124038 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124038/testReport)** for PR 28642 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28642: [SPARK-31809][SQL] Infer IsNotNull for non null intolerant child of null intolerant in join condition

2020-06-15 Thread GitBox
SparkQA removed a comment on pull request #28642: URL: https://github.com/apache/spark/pull/28642#issuecomment-643948913 **[Test build #124038 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124038/testReport)** for PR 28642 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28832: [SPARK-31959][SQL][TESTS][FOLLOWUP] Adopt the test "SPARK-31959: JST -> HKT at Asia/Hong_Kong in 1945" to outdated tzdb

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28832: URL: https://github.com/apache/spark/pull/28832#issuecomment-644050687 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28832: [SPARK-31959][SQL][TESTS][FOLLOWUP] Adopt the test "SPARK-31959: JST -> HKT at Asia/Hong_Kong in 1945" to outdated tzdb

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28832: URL: https://github.com/apache/spark/pull/28832#issuecomment-644050695 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] attilapiros commented on a change in pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

2020-06-15 Thread GitBox
attilapiros commented on a change in pull request #28619: URL: https://github.com/apache/spark/pull/28619#discussion_r440087128 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1842,6 +1842,17 @@ package object config {

[GitHub] [spark] SparkQA commented on pull request #28834: [SPARK-31994][k8s] Docker image should use `https` urls for only deb.debian.org mirrors.

2020-06-15 Thread GitBox
SparkQA commented on pull request #28834: URL: https://github.com/apache/spark/pull/28834#issuecomment-644051449 **[Test build #124050 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124050/testReport)** for PR 28834 at commit

[GitHub] [spark] attilapiros commented on a change in pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

2020-06-15 Thread GitBox
attilapiros commented on a change in pull request #28619: URL: https://github.com/apache/spark/pull/28619#discussion_r440087518 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1842,6 +1842,17 @@ package object config {

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28832: [SPARK-31959][SQL][TESTS][FOLLOWUP] Adopt the test "SPARK-31959: JST -> HKT at Asia/Hong_Kong in 1945" to outdated tzdb

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28832: URL: https://github.com/apache/spark/pull/28832#issuecomment-644050687 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28832: [SPARK-31959][SQL][TESTS][FOLLOWUP] Adopt the test "SPARK-31959: JST -> HKT at Asia/Hong_Kong in 1945" to outdated tzdb

2020-06-15 Thread GitBox
SparkQA commented on pull request #28832: URL: https://github.com/apache/spark/pull/28832#issuecomment-644050559 **[Test build #124047 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124047/testReport)** for PR 28832 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-644070471 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] WangGuangxin commented on a change in pull request #28780: [SPARK-31952][SQL]Fix incorrect memory spill metric when doing Aggregate

2020-06-15 Thread GitBox
WangGuangxin commented on a change in pull request #28780: URL: https://github.com/apache/spark/pull/28780#discussion_r440108353 ## File path: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorter.java ## @@ -104,11 +104,13 @@ public static

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-644070471 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HyukjinKwon commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for void column datatype

2020-06-15 Thread GitBox
HyukjinKwon commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-644071006 cc @maropu, @cloud-fan, @dongjoon-hyun, @hvanhovell, @gatorsmile FYI This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #28834: [SPARK-31994][k8s] Docker image should use `https` urls for only deb.debian.org mirrors.

2020-06-15 Thread GitBox
SparkQA commented on pull request #28834: URL: https://github.com/apache/spark/pull/28834#issuecomment-644074146 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/28669/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28834: [SPARK-31994][k8s] Docker image should use `https` urls for only deb.debian.org mirrors.

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28834: URL: https://github.com/apache/spark/pull/28834#issuecomment-644074165 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28834: [SPARK-31994][k8s] Docker image should use `https` urls for only deb.debian.org mirrors.

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28834: URL: https://github.com/apache/spark/pull/28834#issuecomment-644074165 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-15 Thread GitBox
SparkQA removed a comment on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-643991785 **[Test build #124045 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124045/testReport)** for PR 28710 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-644077050 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-15 Thread GitBox
SparkQA commented on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-644076601 **[Test build #124045 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124045/testReport)** for PR 28710 at commit

[GitHub] [spark] SparkQA commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for void column datatype

2020-06-15 Thread GitBox
SparkQA commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-644091950 **[Test build #124046 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124046/testReport)** for PR 28833 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for void column datatype

2020-06-15 Thread GitBox
SparkQA removed a comment on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-643995551 **[Test build #124046 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124046/testReport)** for PR 28833 at commit

[GitHub] [spark] SparkQA commented on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-06-15 Thread GitBox
SparkQA commented on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-644099322 **[Test build #124054 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124054/testReport)** for PR 28746 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-644099791 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-644099791 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28829: [SPARK-31992][SQL] Benchmark the EXCEPTION rebase mode

2020-06-15 Thread GitBox
SparkQA commented on pull request #28829: URL: https://github.com/apache/spark/pull/28829#issuecomment-644108675 **[Test build #124039 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124039/testReport)** for PR 28829 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28821: [SPARK-31981][SQL] Keep TimestampType when taking an average of a Timestamp

2020-06-15 Thread GitBox
SparkQA removed a comment on pull request #28821: URL: https://github.com/apache/spark/pull/28821#issuecomment-644037334 **[Test build #124049 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124049/testReport)** for PR 28821 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28829: [SPARK-31992][SQL] Benchmark the EXCEPTION rebase mode

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28829: URL: https://github.com/apache/spark/pull/28829#issuecomment-644109622 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #28821: [SPARK-31981][SQL] Keep TimestampType when taking an average of a Timestamp

2020-06-15 Thread GitBox
SparkQA commented on pull request #28821: URL: https://github.com/apache/spark/pull/28821#issuecomment-644109882 **[Test build #124049 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124049/testReport)** for PR 28821 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28821: [SPARK-31981][SQL] Keep TimestampType when taking an average of a Timestamp

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28821: URL: https://github.com/apache/spark/pull/28821#issuecomment-644110363 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28821: [SPARK-31981][SQL] Keep TimestampType when taking an average of a Timestamp

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28821: URL: https://github.com/apache/spark/pull/28821#issuecomment-644110363 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28834: [SPARK-31994][k8s] Docker image should use `https` urls for only deb.debian.org mirrors.

2020-06-15 Thread GitBox
SparkQA commented on pull request #28834: URL: https://github.com/apache/spark/pull/28834#issuecomment-644062357 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/28669/

[GitHub] [spark] HyukjinKwon commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-06-15 Thread GitBox
HyukjinKwon commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-644069380 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] AmplabJenkins commented on pull request #28642: [SPARK-31809][SQL] Infer IsNotNull for non null intolerant child of null intolerant in join condition

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28642: URL: https://github.com/apache/spark/pull/28642#issuecomment-644100154 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28642: [SPARK-31809][SQL] Infer IsNotNull for non null intolerant child of null intolerant in join condition

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28642: URL: https://github.com/apache/spark/pull/28642#issuecomment-644100154 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-06-15 Thread GitBox
SparkQA commented on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-644104160 **[Test build #124055 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124055/testReport)** for PR 28746 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28829: [SPARK-31992][SQL] Benchmark the EXCEPTION rebase mode

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28829: URL: https://github.com/apache/spark/pull/28829#issuecomment-644109611 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28829: [SPARK-31992][SQL] Benchmark the EXCEPTION rebase mode

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28829: URL: https://github.com/apache/spark/pull/28829#issuecomment-644109611 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28829: [SPARK-31992][SQL] Benchmark the EXCEPTION rebase mode

2020-06-15 Thread GitBox
SparkQA removed a comment on pull request #28829: URL: https://github.com/apache/spark/pull/28829#issuecomment-643952127 **[Test build #124039 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124039/testReport)** for PR 28829 at commit

[GitHub] [spark] HeartSaVioR commented on pull request #28831: [SPARK-31993][SQL] Don't split code blocks in generated code for 'concat_ws' for mixed string/array types of columns

2020-06-15 Thread GitBox
HeartSaVioR commented on pull request #28831: URL: https://github.com/apache/spark/pull/28831#issuecomment-644120378 My bad I missed the existing test, as I target on older Spark version originally. The existing UT works with this patch, because we don't create local variables for dealing

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28645: [SPARK-31826][SQL] Support composed type of case class for typed Scala UDF

2020-06-15 Thread GitBox
HyukjinKwon commented on a change in pull request #28645: URL: https://github.com/apache/spark/pull/28645#discussion_r440098735 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -2847,6 +2848,45 @@ class Analyzer( }

[GitHub] [spark] MaxGekk commented on pull request #28832: [SPARK-31959][SQL][TESTS][FOLLOWUP] Adopt the test "SPARK-31959: JST -> HKT at Asia/Hong_Kong in 1945" to outdated tzdb

2020-06-15 Thread GitBox
MaxGekk commented on pull request #28832: URL: https://github.com/apache/spark/pull/28832#issuecomment-644061874 jenkins, retest this, please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] MaxGekk commented on pull request #28832: [SPARK-31959][SQL][TESTS][FOLLOWUP] Adopt the test "SPARK-31959: JST -> HKT at Asia/Hong_Kong in 1945" to outdated tzdb

2020-06-15 Thread GitBox
MaxGekk commented on pull request #28832: URL: https://github.com/apache/spark/pull/28832#issuecomment-644061746 The issue https://github.com/apache/spark/pull/28832#issuecomment-644050559 is fixed by https://github.com/apache/spark/pull/28816

[GitHub] [spark] attilapiros commented on a change in pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

2020-06-15 Thread GitBox
attilapiros commented on a change in pull request #28619: URL: https://github.com/apache/spark/pull/28619#discussion_r440107393 ## File path: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala ## @@ -1042,7 +1046,19 @@ private[spark] class TaskSetManager(

[GitHub] [spark] SparkQA commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-06-15 Thread GitBox
SparkQA commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-644070017 **[Test build #124053 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124053/testReport)** for PR 28412 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for void column datatype

2020-06-15 Thread GitBox
HyukjinKwon commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r440111404 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/NullType.scala ## @@ -32,6 +32,11 @@ class NullType private() extends DataType {

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28834: [SPARK-31994][k8s] Docker image should use `https` urls for only deb.debian.org mirrors.

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28834: URL: https://github.com/apache/spark/pull/28834#issuecomment-644074175 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28821: [SPARK-31981][SQL] Keep TimestampType when taking an average of a Timestamp

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28821: URL: https://github.com/apache/spark/pull/28821#issuecomment-644110376 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for void column datatype

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-644123442 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for void column datatype

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-644123442 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] LantaoJin commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for void column datatype

2020-06-15 Thread GitBox
LantaoJin commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r440161409 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/NullType.scala ## @@ -32,6 +32,11 @@ class NullType private() extends DataType {

[GitHub] [spark] SparkQA commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for void column datatype

2020-06-15 Thread GitBox
SparkQA commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-644126758 **[Test build #124056 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124056/testReport)** for PR 28833 at commit

[GitHub] [spark] SparkQA commented on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-06-15 Thread GitBox
SparkQA commented on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-644130897 **[Test build #124057 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124057/testReport)** for PR 28746 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28830: [SPARK-31990][SS] Use toSet.toSeq in Dataset.dropDuplicates

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28830: URL: https://github.com/apache/spark/pull/28830#issuecomment-644133430 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28830: [SPARK-31990][SS] Use toSet.toSeq in Dataset.dropDuplicates

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28830: URL: https://github.com/apache/spark/pull/28830#issuecomment-644133430 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28807: [SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-644141806 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28807: [SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-644141806 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28784: [SPARK-31957][SQL][test-maven] Cleanup hive scratch dir for the developer api startWithContext

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28784: URL: https://github.com/apache/spark/pull/28784#issuecomment-644154231 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28784: [SPARK-31957][SQL][test-maven] Cleanup hive scratch dir for the developer api startWithContext

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28784: URL: https://github.com/apache/spark/pull/28784#issuecomment-644154215 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28832: [SPARK-31959][SQL][TESTS][FOLLOWUP] Adopt the test "SPARK-31959: JST -> HKT at Asia/Hong_Kong in 1945" to outdated tzdb

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28832: URL: https://github.com/apache/spark/pull/28832#issuecomment-644157275 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] prakharjain09 commented on a change in pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

2020-06-15 Thread GitBox
prakharjain09 commented on a change in pull request #28619: URL: https://github.com/apache/spark/pull/28619#discussion_r440206799 ## File path: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala ## @@ -1042,7 +1046,19 @@ private[spark] class TaskSetManager(

[GitHub] [spark] prakharjain09 commented on a change in pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

2020-06-15 Thread GitBox
prakharjain09 commented on a change in pull request #28619: URL: https://github.com/apache/spark/pull/28619#discussion_r440207015 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1842,6 +1842,17 @@ package object config {

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28619: URL: https://github.com/apache/spark/pull/28619#issuecomment-644164225 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28619: URL: https://github.com/apache/spark/pull/28619#issuecomment-644164225 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] prakharjain09 commented on pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

2020-06-15 Thread GitBox
prakharjain09 commented on pull request #28619: URL: https://github.com/apache/spark/pull/28619#issuecomment-644163889 @attilapiros Thanks for the review. > One more question: the checkAndSubmitSpeculatableTask checks whether the number of running copies from the task is one:

[GitHub] [spark] SparkQA commented on pull request #28830: [SPARK-31990][SS] Use toSet.toSeq in Dataset.dropDuplicates

2020-06-15 Thread GitBox
SparkQA commented on pull request #28830: URL: https://github.com/apache/spark/pull/28830#issuecomment-644130432 **[Test build #124036 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124036/testReport)** for PR 28830 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28830: [SPARK-31990][SS] Use toSet.toSeq in Dataset.dropDuplicates

2020-06-15 Thread GitBox
SparkQA removed a comment on pull request #28830: URL: https://github.com/apache/spark/pull/28830#issuecomment-643948852 **[Test build #124036 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124036/testReport)** for PR 28830 at commit

[GitHub] [spark] Ngone51 commented on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-06-15 Thread GitBox
Ngone51 commented on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-644130553 What do you guys think about the latest solution? @jiangxb1987 @gerashegalov This is an automated message from

[GitHub] [spark] SparkQA commented on pull request #28807: [SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-15 Thread GitBox
SparkQA commented on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-644139809 **[Test build #124041 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124041/testReport)** for PR 28807 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28807: [SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-15 Thread GitBox
SparkQA removed a comment on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-643965298 **[Test build #124041 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124041/testReport)** for PR 28807 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28826: [SPARK-31988][SQL] Schema pruning may discard attribute metadata

2020-06-15 Thread GitBox
SparkQA removed a comment on pull request #28826: URL: https://github.com/apache/spark/pull/28826#issuecomment-643987758 **[Test build #124044 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124044/testReport)** for PR 28826 at commit

[GitHub] [spark] SparkQA commented on pull request #28826: [SPARK-31988][SQL] Schema pruning may discard attribute metadata

2020-06-15 Thread GitBox
SparkQA commented on pull request #28826: URL: https://github.com/apache/spark/pull/28826#issuecomment-644147029 **[Test build #124044 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124044/testReport)** for PR 28826 at commit

[GitHub] [spark] guykhazma commented on pull request #28826: [SPARK-31988][SQL] Schema pruning may discard attribute metadata

2020-06-15 Thread GitBox
guykhazma commented on pull request #28826: URL: https://github.com/apache/spark/pull/28826#issuecomment-644146555 @maropu which test do you suggest to add? This is private function which is not tested anywhere also not all file formats are able to save the metadata (for example csv) so

[GitHub] [spark] srowen commented on pull request #28786: [SPARK-31925][ML] Summary.totalIterations greater than maxIters

2020-06-15 Thread GitBox
srowen commented on pull request #28786: URL: https://github.com/apache/spark/pull/28786#issuecomment-644146741 Merged to master. It could go in 3.0.1 too; I dont' feel strongly about it. This is an automated message from

[GitHub] [spark] srowen closed pull request #28786: [SPARK-31925][ML] Summary.totalIterations greater than maxIters

2020-06-15 Thread GitBox
srowen closed pull request #28786: URL: https://github.com/apache/spark/pull/28786 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] SparkQA commented on pull request #28828: [SPARK-24634][SS][FOLLOWUP] Rename the variable from "numLateInputs" to "numRowsDroppedByWatermark"

2020-06-15 Thread GitBox
SparkQA commented on pull request #28828: URL: https://github.com/apache/spark/pull/28828#issuecomment-644152195 **[Test build #124040 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124040/testReport)** for PR 28828 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28832: [SPARK-31959][SQL][TESTS][FOLLOWUP] Adopt the test "SPARK-31959: JST -> HKT at Asia/Hong_Kong in 1945" to outdated tzdb

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28832: URL: https://github.com/apache/spark/pull/28832#issuecomment-644157284 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

2020-06-15 Thread GitBox
SparkQA commented on pull request #28619: URL: https://github.com/apache/spark/pull/28619#issuecomment-644163493 **[Test build #124058 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124058/testReport)** for PR 28619 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-15 Thread GitBox
SparkQA removed a comment on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-643969029 **[Test build #124042 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124042/testReport)** for PR 28593 at commit

[GitHub] [spark] SparkQA commented on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-15 Thread GitBox
SparkQA commented on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-644173741 **[Test build #124042 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124042/testReport)** for PR 28593 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-644131514 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-644131514 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28826: [SPARK-31988][SQL] Schema pruning may discard attribute metadata

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28826: URL: https://github.com/apache/spark/pull/28826#issuecomment-644148506 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28826: [SPARK-31988][SQL] Schema pruning may discard attribute metadata

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28826: URL: https://github.com/apache/spark/pull/28826#issuecomment-644148506 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28828: [SPARK-24634][SS][FOLLOWUP] Rename the variable from "numLateInputs" to "numRowsDroppedByWatermark"

2020-06-15 Thread GitBox
SparkQA removed a comment on pull request #28828: URL: https://github.com/apache/spark/pull/28828#issuecomment-643965274 **[Test build #124040 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124040/testReport)** for PR 28828 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28828: [SPARK-24634][SS][FOLLOWUP] Rename the variable from "numLateInputs" to "numRowsDroppedByWatermark"

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28828: URL: https://github.com/apache/spark/pull/28828#issuecomment-644153619 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28784: [SPARK-31957][SQL][test-maven] Cleanup hive scratch dir for the developer api startWithContext

2020-06-15 Thread GitBox
SparkQA removed a comment on pull request #28784: URL: https://github.com/apache/spark/pull/28784#issuecomment-643948887 **[Test build #124037 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124037/testReport)** for PR 28784 at commit

[GitHub] [spark] SparkQA commented on pull request #28784: [SPARK-31957][SQL][test-maven] Cleanup hive scratch dir for the developer api startWithContext

2020-06-15 Thread GitBox
SparkQA commented on pull request #28784: URL: https://github.com/apache/spark/pull/28784#issuecomment-644153442 **[Test build #124037 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124037/testReport)** for PR 28784 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28828: [SPARK-24634][SS][FOLLOWUP] Rename the variable from "numLateInputs" to "numRowsDroppedByWatermark"

2020-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #28828: URL: https://github.com/apache/spark/pull/28828#issuecomment-644153619 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28784: [SPARK-31957][SQL][test-maven] Cleanup hive scratch dir for the developer api startWithContext

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28784: URL: https://github.com/apache/spark/pull/28784#issuecomment-644154215 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28832: [SPARK-31959][SQL][TESTS][FOLLOWUP] Adopt the test "SPARK-31959: JST -> HKT at Asia/Hong_Kong in 1945" to outdated tzdb

2020-06-15 Thread GitBox
AmplabJenkins commented on pull request #28832: URL: https://github.com/apache/spark/pull/28832#issuecomment-644157275 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28832: [SPARK-31959][SQL][TESTS][FOLLOWUP] Adopt the test "SPARK-31959: JST -> HKT at Asia/Hong_Kong in 1945" to outdated tzdb

2020-06-15 Thread GitBox
SparkQA commented on pull request #28832: URL: https://github.com/apache/spark/pull/28832#issuecomment-644156686 **[Test build #124052 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124052/testReport)** for PR 28832 at commit

<    1   2   3   4   5   6   7   8   >