[GitHub] [spark] AmplabJenkins removed a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

AmplabJenkins removed a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-497045538 Merged build finished. Test PASSed. ---

[GitHub] [spark] mwlon commented on issue #24713: [SPARK-26192][MESOS][2.4] Retrieve enableFetcherCache option from submission for driver URIs

mwlon commented on issue #24713: [SPARK-26192][MESOS][2.4] Retrieve enableFetcherCache option from submission for driver URIs URL: https://github.com/apache/spark/pull/24713#issuecomment-497046845 Ok, if we don't want the other associated changes of SPARK-26192 and only the functional part

[GitHub] [spark] AmplabJenkins removed a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

AmplabJenkins removed a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-497045554 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

AmplabJenkins commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-497045554 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

AmplabJenkins commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-497045538 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA removed a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

SparkQA removed a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-496972265 **[Test build #105916 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] SparkQA commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

SparkQA commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-497044695 **[Test build #105916 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288693711 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernet

[GitHub] [spark] liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288693711 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernet

[GitHub] [spark] liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288694830 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features

[GitHub] [spark] liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288693711 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernet

[GitHub] [spark] skonto commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

skonto commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288691773 ## File path: docs/configuration.md ## @@ -206,6 +206,13 @@ of the most common options to set

[GitHub] [spark] AmplabJenkins removed a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

AmplabJenkins removed a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-497037484 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

AmplabJenkins removed a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-497037495 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

AmplabJenkins commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-497037495 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

AmplabJenkins commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-497037484 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA removed a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

SparkQA removed a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-496964895 **[Test build #105915 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] SparkQA commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

SparkQA commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-497036774 **[Test build #105915 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] dongjoon-hyun closed pull request #24733: [SPARK-27869][CORE] Redact sensitive information in System Properties from UI

dongjoon-hyun closed pull request #24733: [SPARK-27869][CORE] Redact sensitive information in System Properties from UI URL: https://github.com/apache/spark/pull/24733 This is an automated message from the Apache Git Service

[GitHub] [spark] AmplabJenkins removed a comment on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

AmplabJenkins removed a comment on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#issuecomment-497029953 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

SparkQA removed a comment on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#issuecomment-496979565 **[Test build #105918 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] [spark] AmplabJenkins removed a comment on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

AmplabJenkins removed a comment on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#issuecomment-497029951 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

AmplabJenkins commented on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#issuecomment-497029953 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins commented on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

AmplabJenkins commented on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#issuecomment-497029951 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

SparkQA commented on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#issuecomment-497029249 **[Test build #105918 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] AmplabJenkins removed a comment on issue #23528: [SPARK-26225][SQL] Track decoding time for row-based data sources

AmplabJenkins removed a comment on issue #23528: [SPARK-26225][SQL] Track decoding time for row-based data sources URL: https://github.com/apache/spark/pull/23528#issuecomment-497027647 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] AmplabJenkins removed a comment on issue #23528: [SPARK-26225][SQL] Track decoding time for row-based data sources

AmplabJenkins removed a comment on issue #23528: [SPARK-26225][SQL] Track decoding time for row-based data sources URL: https://github.com/apache/spark/pull/23528#issuecomment-497027643 Merged build finished. Test PASSed. Thi

[GitHub] [spark] AmplabJenkins commented on issue #23528: [SPARK-26225][SQL] Track decoding time for row-based data sources

AmplabJenkins commented on issue #23528: [SPARK-26225][SQL] Track decoding time for row-based data sources URL: https://github.com/apache/spark/pull/23528#issuecomment-497027647 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] AmplabJenkins commented on issue #23528: [SPARK-26225][SQL] Track decoding time for row-based data sources

AmplabJenkins commented on issue #23528: [SPARK-26225][SQL] Track decoding time for row-based data sources URL: https://github.com/apache/spark/pull/23528#issuecomment-497027643 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497024358 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497024350 Merged build finished. Test PASSed. This is an

[GitHub] [spark] dongjoon-hyun commented on issue #24737: [SPARK-27863][SQL][BACKPORT-2.4] Metadata files and temporary files should not be counted as data files

dongjoon-hyun commented on issue #24737: [SPARK-27863][SQL][BACKPORT-2.4] Metadata files and temporary files should not be counted as data files URL: https://github.com/apache/spark/pull/24737#issuecomment-497024496 Thank you, @wangyum and @HyukjinKwon . ---

[GitHub] [spark] AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497024358 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497024350 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] dongjoon-hyun closed pull request #24737: [SPARK-27863][SQL][BACKPORT-2.4] Metadata files and temporary files should not be counted as data files

dongjoon-hyun closed pull request #24737: [SPARK-27863][SQL][BACKPORT-2.4] Metadata files and temporary files should not be counted as data files URL: https://github.com/apache/spark/pull/24737 This is an automated message f

[GitHub] [spark] SparkQA removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

SparkQA removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-496946725 **[Test build #105911 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105911/testRepor

[GitHub] [spark] SparkQA commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

SparkQA commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497023715 **[Test build #105911 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105911/testReport)** f

[GitHub] [spark] AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497020304 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

SparkQA removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-496961328 **[Test build #105913 has started](https://amplab.cs.berkeley.edu/jenkins/job/S

[GitHub] [spark] AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497020290 Merged build finished. Test FAILed. -

[GitHub] [spark] gengliangwang commented on a change in pull request #24043: [SPARK-11412][SQL] Support merge schema for ORC

gengliangwang commented on a change in pull request #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#discussion_r288671013 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcUtils.scala ###

[GitHub] [spark] AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497020290 Merged build finished. Test FAILed. -

[GitHub] [spark] AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497020304 Test FAILed. Refer to this link for build results (access rights to CI server n

[GitHub] [spark] SparkQA commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

SparkQA commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497019907 **[Test build #105913 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPul

[GitHub] [spark] squito commented on a change in pull request #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

squito commented on a change in pull request #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#discussion_r288663919 ## File path: core/src/test/scala/org/apache/spark/ExecutorAllocationManager

[GitHub] [spark] squito commented on a change in pull request #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

squito commented on a change in pull request #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#discussion_r288663030 ## File path: core/src/test/scala/org/apache/spark/ExecutorAllocationManager

[GitHub] [spark] squito commented on a change in pull request #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

squito commented on a change in pull request #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#discussion_r288664308 ## File path: core/src/test/scala/org/apache/spark/ExecutorAllocationManager

[GitHub] [spark] squito commented on a change in pull request #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

squito commented on a change in pull request #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#discussion_r288664488 ## File path: core/src/test/scala/org/apache/spark/ExecutorAllocationManager

[GitHub] [spark] igreenfield commented on a change in pull request #24736: [SPARK-27862][Build] Move to json4s 3.6.5

igreenfield commented on a change in pull request #24736: [SPARK-27862][Build] Move to json4s 3.6.5 URL: https://github.com/apache/spark/pull/24736#discussion_r288664263 ## File path: pom.xml ## @@ -762,14 +762,19 @@ org.json4s json4s-jackson_${sc

[GitHub] [spark] AmplabJenkins removed a comment on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

AmplabJenkins removed a comment on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#issuecomment-497015237 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

AmplabJenkins removed a comment on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#issuecomment-497015247 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

AmplabJenkins commented on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#issuecomment-497015247 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] AmplabJenkins commented on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

AmplabJenkins commented on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#issuecomment-497015237 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2.

AmplabJenkins removed a comment on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#issuecomment-497011937 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] SparkQA commented on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

SparkQA commented on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#issuecomment-497012890 **[Test build #105922 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105

[GitHub] [spark] AmplabJenkins removed a comment on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2.

AmplabJenkins removed a comment on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#issuecomment-497011908 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2.

AmplabJenkins commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#issuecomment-497011937 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] AmplabJenkins commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2.

AmplabJenkins commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#issuecomment-497011908 Merged build finished. Test FAILed. This is an automate

[GitHub] [spark] SparkQA removed a comment on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2.

SparkQA removed a comment on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#issuecomment-496954396 **[Test build #105912 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105912/testRepor

[GitHub] [spark] SparkQA commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2.

SparkQA commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#issuecomment-497011581 **[Test build #105912 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105912/testReport)** f

[GitHub] [spark] gengliangwang commented on a change in pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

gengliangwang commented on a change in pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#discussion_r288655850 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/data

[GitHub] [spark] rdblue commented on a change in pull request #24689: [SPARK-26946][SQL][FOLLOWUP] Require lookup function

rdblue commented on a change in pull request #24689: [SPARK-26946][SQL][FOLLOWUP] Require lookup function URL: https://github.com/apache/spark/pull/24689#discussion_r288655473 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala #

[GitHub] [spark] SparkQA commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

SparkQA commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497006810 **[Test build #105921 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105921/testReport

[GitHub] [spark] squito commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

squito commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-497006491 This is the mima error you're getting: ``` [error] * the type hierarchy of object org.apach

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

dongjoon-hyun commented on a change in pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#discussion_r288653064 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/data

[GitHub] [spark] AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497005936 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497005920 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497005936 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497005920 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] jzhuge commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

jzhuge commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497005531 No longer depend on #24689. Did a better job isolating the changes only needed for DropTable this time, so diff shoul

[GitHub] [spark] AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497002762 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497002793 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497002793 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497002762 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

dongjoon-hyun commented on a change in pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#discussion_r288646355 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/Data

[GitHub] [spark] SparkQA commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

SparkQA commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497000296 **[Test build #105920 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105920/testReport

[GitHub] [spark] gengliangwang commented on a change in pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

gengliangwang commented on a change in pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#discussion_r288644844 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/data

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

dongjoon-hyun commented on a change in pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#discussion_r288644601 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/Data

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

dongjoon-hyun commented on a change in pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#discussion_r288643208 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/Data

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

dongjoon-hyun commented on a change in pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#discussion_r288640787 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/data

[GitHub] [spark] cloud-fan commented on a change in pull request #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

cloud-fan commented on a change in pull request #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#discussion_r288638558 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/Insert

[GitHub] [spark] gengliangwang edited a comment on issue #24666: [SPARK-27482][SQL][WEBUI] Show BroadcastHashJoinExec numOutputRows statistics info on SparkSQL UI page

gengliangwang edited a comment on issue #24666: [SPARK-27482][SQL][WEBUI] Show BroadcastHashJoinExec numOutputRows statistics info on SparkSQL UI page URL: https://github.com/apache/spark/pull/24666#issuecomment-496993834 @pengbo The title is a bit confusing...I think we should make it more

[GitHub] [spark] gengliangwang commented on a change in pull request #24666: [SPARK-27482][SQL][WEBUI] Show BroadcastHashJoinExec numOutputRows statistics info on SparkSQL UI page

gengliangwang commented on a change in pull request #24666: [SPARK-27482][SQL][WEBUI] Show BroadcastHashJoinExec numOutputRows statistics info on SparkSQL UI page URL: https://github.com/apache/spark/pull/24666#discussion_r288638013 ## File path: sql/core/src/main/scala/org/apache

[GitHub] [spark] gengliangwang commented on issue #24666: [SPARK-27482][SQL][WEBUI] Show BroadcastHashJoinExec numOutputRows statistics info on SparkSQL UI page

gengliangwang commented on issue #24666: [SPARK-27482][SQL][WEBUI] Show BroadcastHashJoinExec numOutputRows statistics info on SparkSQL UI page URL: https://github.com/apache/spark/pull/24666#issuecomment-496993834 @pengbo The title is a bit confusing...I think we should make it more clear,

[GitHub] [spark] maryannxue commented on a change in pull request #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

maryannxue commented on a change in pull request #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#discussion_r288635525 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/Adapt

[GitHub] [spark] maryannxue commented on a change in pull request #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

maryannxue commented on a change in pull request #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#discussion_r288635263 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/Adapt

[GitHub] [spark] vanzin commented on a change in pull request #24627: [SPARK-27748][SS] Kafka consumer/producer password/token redaction.

vanzin commented on a change in pull request #24627: [SPARK-27748][SS] Kafka consumer/producer password/token redaction. URL: https://github.com/apache/spark/pull/24627#discussion_r288630545 ## File path: external/kafka-0-10-token-provider/src/main/scala/org/apache/spark/kafka010/K

[GitHub] [spark] vanzin commented on a change in pull request #24627: [SPARK-27748][SS] Kafka consumer/producer password/token redaction.

vanzin commented on a change in pull request #24627: [SPARK-27748][SS] Kafka consumer/producer password/token redaction. URL: https://github.com/apache/spark/pull/24627#discussion_r288626926 ## File path: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/CachedKa

[GitHub] [spark] maryannxue commented on a change in pull request #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

maryannxue commented on a change in pull request #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#discussion_r288633927 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/Adapt

[GitHub] [spark] SparkQA commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec

SparkQA commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec URL: https://github.com/apache/spark/pull/24603#issuecomment-496990121 **[Test build #105919 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuild

[GitHub] [spark] cloud-fan commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec

cloud-fan commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec URL: https://github.com/apache/spark/pull/24603#issuecomment-496988058 usually we don't add row count metrics to operators that do not change numRows. Why didn't the Fi

[GitHub] [spark] AmplabJenkins removed a comment on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec

AmplabJenkins removed a comment on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec URL: https://github.com/apache/spark/pull/24603#issuecomment-496985645 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec

AmplabJenkins removed a comment on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec URL: https://github.com/apache/spark/pull/24603#issuecomment-496985653 Test PASSed. Refer to this link for build results (access rights to CI server neede

[GitHub] [spark] AmplabJenkins commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec

AmplabJenkins commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec URL: https://github.com/apache/spark/pull/24603#issuecomment-496985645 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec

AmplabJenkins commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec URL: https://github.com/apache/spark/pull/24603#issuecomment-496985653 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec

AmplabJenkins removed a comment on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec URL: https://github.com/apache/spark/pull/24603#issuecomment-492281700 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA removed a comment on issue #24710: [MINOR] [DOC] Fix spelling mistake

SparkQA removed a comment on issue #24710: [MINOR] [DOC] Fix spelling mistake URL: https://github.com/apache/spark/pull/24710#issuecomment-496925161 **[Test build #4790 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4790/testReport)** for PR 24710 at com

[GitHub] [spark] tgravescs commented on issue #24515: [SPARK-14083][WIP] Basic bytecode analyzer to speed up Datasets

tgravescs commented on issue #24515: [SPARK-14083][WIP] Basic bytecode analyzer to speed up Datasets URL: https://github.com/apache/spark/pull/24515#issuecomment-496983351 thanks for posting this, I haven't looked at the code in detail yet, but we are also interested in this area. In part

[GitHub] [spark] cloud-fan commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec

cloud-fan commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec URL: https://github.com/apache/spark/pull/24603#issuecomment-49698 ok to test This is an automated

[GitHub] [spark] SparkQA commented on issue #24710: [MINOR] [DOC] Fix spelling mistake

SparkQA commented on issue #24710: [MINOR] [DOC] Fix spelling mistake URL: https://github.com/apache/spark/pull/24710#issuecomment-496982795 **[Test build #4790 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4790/testReport)** for PR 24710 at commit [`

<    1   2   3   4   5   6   7   8   9   10   >