[GitHub] [spark] AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487420346 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487420342 Kubernetes integration test status failure URL:

[GitHub] [spark] AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487420345 Merged build finished. Test FAILed.

[GitHub] [spark] skonto edited a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto edited a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487419487 @shaneknapp there is a weird error: ``` 9/04/28 14:34:17.480 OkHttp

[GitHub] [spark] skonto edited a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto edited a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487419487 @shaneknapp there is a weird error: ``` 9/04/28 14:34:17.480 OkHttp

[GitHub] [spark] SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487419532 Kubernetes integration test starting URL:

[GitHub] [spark] skonto commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487419487 @shaneknapp there is a weird error: ``` 2019-04-28 22:01:02 INFO MicroBatchExecution:54 -

[GitHub] [spark] skonto edited a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto edited a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487419487 @shaneknapp there is a weird error: ``` 9/04/28 14:34:17.480 OkHttp

[GitHub] [spark] SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487419066 **[Test build #104977 has

[GitHub] [spark] skonto commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487418537 jenkins test this please This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487417573 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487417571 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487417573 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487417571 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487417566 Kubernetes integration test status failure URL:

[GitHub] [spark] SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487416546 Kubernetes integration test starting URL:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487415740 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487415737 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1

SparkQA commented on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1 URL: https://github.com/apache/spark/pull/24481#issuecomment-487416038 **[Test build #104974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104974/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

SparkQA commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487416037 **[Test build #104973 has

[GitHub] [spark] SparkQA commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module)

SparkQA commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module) URL: https://github.com/apache/spark/pull/24391#issuecomment-487416048 **[Test build #104975 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1

AmplabJenkins removed a comment on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1 URL: https://github.com/apache/spark/pull/24481#issuecomment-487370780 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487416058 **[Test build #104976 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1

AmplabJenkins removed a comment on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1 URL: https://github.com/apache/spark/pull/24481#issuecomment-487370782 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module)

AmplabJenkins removed a comment on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module) URL: https://github.com/apache/spark/pull/24391#issuecomment-487415749 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module)

AmplabJenkins removed a comment on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module) URL: https://github.com/apache/spark/pull/24391#issuecomment-487415751 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module)

AmplabJenkins commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module) URL: https://github.com/apache/spark/pull/24391#issuecomment-487415749 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module)

AmplabJenkins commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module) URL: https://github.com/apache/spark/pull/24391#issuecomment-487415751 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487415740 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487415737 Merged build finished. Test PASSed.

[GitHub] [spark] linehrr commented on issue #24461: [SPARK-27434][CORE] Fix mem leak

linehrr commented on issue #24461: [SPARK-27434][CORE] Fix mem leak URL: https://github.com/apache/spark/pull/24461#issuecomment-487411885 @srowen filesystem is shared that's true, but it's shared within a spark context, so if the context.close() is called, I think we can safely remove

[GitHub] [spark] lhsvobodaj commented on issue #18127: [SPARK-6628][SQL][Branch-2.1] Fix ClassCastException when executing sql statement 'insert into' on hbase table

lhsvobodaj commented on issue #18127: [SPARK-6628][SQL][Branch-2.1] Fix ClassCastException when executing sql statement 'insert into' on hbase table URL: https://github.com/apache/spark/pull/18127#issuecomment-487407430 Hi @weiqingy @HyukjinKwon I'm also getting the

[GitHub] [spark] gatorsmile commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module)

gatorsmile commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module) URL: https://github.com/apache/spark/pull/24391#issuecomment-487394966 ping @shaneknapp Could you please help take a look at it?

[GitHub] [spark] viirya opened a new pull request #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

viirya opened a new pull request #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482 ## What changes were proposed in this pull request? Currently `countDistinct("*")` doesn't work. An analysis

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24354: [SPARK-25348][SQL] Data source for binary files

HyukjinKwon commented on a change in pull request #24354: [SPARK-25348][SQL] Data source for binary files URL: https://github.com/apache/spark/pull/24354#discussion_r279200574 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24354: [SPARK-25348][SQL] Data source for binary files

HyukjinKwon commented on a change in pull request #24354: [SPARK-25348][SQL] Data source for binary files URL: https://github.com/apache/spark/pull/24354#discussion_r279200574 ## File path:

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279198988 ## File path: docs/running-on-kubernetes.md ## @@ -208,8 +208,30

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source

HyukjinKwon commented on a change in pull request #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#discussion_r279200295 ## File path:

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279198988 ## File path: docs/running-on-kubernetes.md ## @@ -208,8 +208,30

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279198988 ## File path: docs/running-on-kubernetes.md ## @@ -208,8 +208,30

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279198988 ## File path: docs/running-on-kubernetes.md ## @@ -208,8 +208,30

[GitHub] [spark] srowen commented on issue #24467: [SPARK-27568][CORE] Fix readLock leak while calling take()/first() on a cached rdd

srowen commented on issue #24467: [SPARK-27568][CORE] Fix readLock leak while calling take()/first() on a cached rdd URL: https://github.com/apache/spark/pull/24467#issuecomment-487390617 Is there any better way to do this rather than interrogate the class of the delegate? it's a little

[GitHub] [spark] srowen commented on issue #24461: [SPARK-27434][CORE] Fix mem leak

srowen commented on issue #24461: [SPARK-27434][CORE] Fix mem leak URL: https://github.com/apache/spark/pull/24461#issuecomment-487390580 I don't think you can close `FileSystem` objects. They're shared. Why is it a memory leak?

[GitHub] [spark] srowen commented on issue #24455: [SPARK-27540][MLlib] Add 'meanAveragePrecision_at_k' metric to RankingMetrics

srowen commented on issue #24455: [SPARK-27540][MLlib] Add 'meanAveragePrecision_at_k' metric to RankingMetrics URL: https://github.com/apache/spark/pull/24455#issuecomment-487390486 How is this related to https://github.com/apache/spark/pull/24458 ? let's have only one PR

[GitHub] [spark] srowen commented on issue #24478: [Spark-27584][MLlib] Add 'Mean reciprocal rank' to RankingMetrics

srowen commented on issue #24478: [Spark-27584][MLlib] Add 'Mean reciprocal rank' to RankingMetrics URL: https://github.com/apache/spark/pull/24478#issuecomment-487390405 I don't think this is important enough to add... .mllib is a legacy API anyway.

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279199130 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala

[GitHub] [spark] srowen commented on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1

srowen commented on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1 URL: https://github.com/apache/spark/pull/24481#issuecomment-487389163 Yeah you need to use `./build/mvn` or else install 3.6.1 locally. That's always been the case.

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279199130 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1

HyukjinKwon commented on a change in pull request #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1 URL: https://github.com/apache/spark/pull/24481#discussion_r279199449 ## File path: docs/building-spark.md ## @@ -27,7 +27,7 @@ license: | ## Apache Maven The

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279198988 ## File path: docs/running-on-kubernetes.md ## @@ -208,8 +208,30

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279198988 ## File path: docs/running-on-kubernetes.md ## @@ -208,8 +208,30

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279199130 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279199130 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279199130 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279199130 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279199130 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279199130 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279199130 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279199130 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279199130 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279198988 ## File path: docs/running-on-kubernetes.md ## @@ -208,8 +208,30

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279199000 ## File path:

[GitHub] [spark] wangyum commented on a change in pull request #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1

wangyum commented on a change in pull request #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1 URL: https://github.com/apache/spark/pull/24481#discussion_r279198871 ## File path: docs/building-spark.md ## @@ -27,7 +27,7 @@ license: | ## Apache Maven The

[GitHub] [spark] mengxr commented on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected

mengxr commented on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected URL: https://github.com/apache/spark/pull/24473#issuecomment-487386980 @HyukjinKwon Thanks for the review! I'm merging this into master. I do think the suggested

[GitHub] [spark] asfgit closed pull request #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected

asfgit closed pull request #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected URL: https://github.com/apache/spark/pull/24473 This is an automated message from the Apache Git

[GitHub] [spark] srowen commented on a change in pull request #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1

srowen commented on a change in pull request #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1 URL: https://github.com/apache/spark/pull/24481#discussion_r279197653 ## File path: docs/building-spark.md ## @@ -27,7 +27,7 @@ license: | ## Apache Maven The

[GitHub] [spark] liupc commented on issue #24462: [SPARK-26268][CORE] Do not resubmit tasks when executors are lost

liupc commented on issue #24462: [SPARK-26268][CORE] Do not resubmit tasks when executors are lost URL: https://github.com/apache/spark/pull/24462#issuecomment-487382583 @gczsjdy I understand this use case, it's a common need, but the current pluggable implementation is too flexible, and

[GitHub] [spark] wangyum closed pull request #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT

wangyum closed pull request #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] wangyum commented on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT

wangyum commented on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487381436 Yes. I think so. I have tested `sbt` many times on my local machine.

[GitHub] [spark] viirya commented on a change in pull request #24442: [SPARK-27547][SQL] fix DataFrame self-join problems

viirya commented on a change in pull request #24442: [SPARK-27547][SQL] fix DataFrame self-join problems URL: https://github.com/apache/spark/pull/24442#discussion_r279149654 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ## @@ -1292,10 +1323,24

[GitHub] [spark] AmplabJenkins removed a comment on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected

AmplabJenkins removed a comment on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected URL: https://github.com/apache/spark/pull/24473#issuecomment-487376890 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected

AmplabJenkins removed a comment on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected URL: https://github.com/apache/spark/pull/24473#issuecomment-487376761 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected

AmplabJenkins commented on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected URL: https://github.com/apache/spark/pull/24473#issuecomment-487376890 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected

AmplabJenkins commented on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected URL: https://github.com/apache/spark/pull/24473#issuecomment-487376761 Merged build finished. Test PASSed.

[GitHub] [spark] wangyum commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module)

wangyum commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module) URL: https://github.com/apache/spark/pull/24391#issuecomment-487371465 retest this please

[GitHub] [spark] AmplabJenkins commented on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1

AmplabJenkins commented on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1 URL: https://github.com/apache/spark/pull/24481#issuecomment-487370780 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1

AmplabJenkins commented on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1 URL: https://github.com/apache/spark/pull/24481#issuecomment-487370782 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT

HyukjinKwon commented on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487354808 @wangyum, can I consider this that we're good with Hive 2.3.5?

[GitHub] [spark] beliefer commented on issue #24372: [SPARK-27462][SQL] Enhance insert into hive table that could choose some columns in target table flexibly.

beliefer commented on issue #24372: [SPARK-27462][SQL] Enhance insert into hive table that could choose some columns in target table flexibly. URL: https://github.com/apache/spark/pull/24372#issuecomment-487350161 cc @dongjoon-hyun

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected

HyukjinKwon commented on a change in pull request #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected URL: https://github.com/apache/spark/pull/24473#discussion_r279179784 ## File path:

<    1   2