[GitHub] [spark] mengxr commented on issue #24484: [SPARK-27472] add user guide for binary file data source

2019-04-28 Thread GitBox
mengxr commented on issue #24484: [SPARK-27472] add user guide for binary file data source URL: https://github.com/apache/spark/pull/24484#issuecomment-487456424 cc: @WeichenXu123 @HyukjinKwon @cloud-fan This is an automated

[GitHub] [spark] SparkQA removed a comment on issue #24484: [SPARK-27472] add user guide for binary file data source

2019-04-28 Thread GitBox
SparkQA removed a comment on issue #24484: [SPARK-27472] add user guide for binary file data source URL: https://github.com/apache/spark/pull/24484#issuecomment-487454719 **[Test build #104984 has

[GitHub] [spark] mengxr commented on issue #24483: [SPARK-27588] Binary file data source fails fast and doesn't attempt to read very large files

2019-04-28 Thread GitBox
mengxr commented on issue #24483: [SPARK-27588] Binary file data source fails fast and doesn't attempt to read very large files URL: https://github.com/apache/spark/pull/24483#issuecomment-487456403 cc: @WeichenXu123 @HyukjinKwon @cloud-fan

[GitHub] [spark] SparkQA commented on issue #24484: [SPARK-27472] add user guide for binary file data source

2019-04-28 Thread GitBox
SparkQA commented on issue #24484: [SPARK-27472] add user guide for binary file data source URL: https://github.com/apache/spark/pull/24484#issuecomment-487455906 **[Test build #104984 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104984/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times URL: https://github.com/apache/spark/pull/24375#issuecomment-487455166 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times

2019-04-28 Thread GitBox
SparkQA removed a comment on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times URL: https://github.com/apache/spark/pull/24375#issuecomment-487441758 **[Test build #104980 has

[GitHub] [spark] AmplabJenkins commented on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times URL: https://github.com/apache/spark/pull/24375#issuecomment-487455168 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times URL: https://github.com/apache/spark/pull/24375#issuecomment-487455166 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times

2019-04-28 Thread GitBox
SparkQA commented on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times URL: https://github.com/apache/spark/pull/24375#issuecomment-487454951 **[Test build #104980 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487454801 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #24484: [SPARK-27472] add user guide for binary file data source

2019-04-28 Thread GitBox
SparkQA commented on issue #24484: [SPARK-27472] add user guide for binary file data source URL: https://github.com/apache/spark/pull/24484#issuecomment-487454719 **[Test build #104984 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104984/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487454693 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
SparkQA removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487438204 **[Test build #104979 has

[GitHub] [spark] mengxr commented on a change in pull request #24484: [SPARK-27472] add user guide for binary file data source

2019-04-28 Thread GitBox
mengxr commented on a change in pull request #24484: [SPARK-27472] add user guide for binary file data source URL: https://github.com/apache/spark/pull/24484#discussion_r279238983 ## File path: docs/sql-data-sources.md ## @@ -54,4 +54,5 @@ goes into specific options that

[GitHub] [spark] AmplabJenkins removed a comment on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times URL: https://github.com/apache/spark/pull/24375#issuecomment-487455168 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487454798 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487454801 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487454798 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487454699 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487454699 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487454693 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
SparkQA commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487454603 **[Test build #104979 has

[GitHub] [spark] SparkQA removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
SparkQA removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487442420 **[Test build #104981 has

[GitHub] [spark] mengxr opened a new pull request #24484: [SPARK-27472] add user guide for binary file data source

2019-04-28 Thread GitBox
mengxr opened a new pull request #24484: [SPARK-27472] add user guide for binary file data source URL: https://github.com/apache/spark/pull/24484 ## What changes were proposed in this pull request? Add user guide for binary file data source.

[GitHub] [spark] SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487454473 **[Test build #104981 has

[GitHub] [spark] William1104 commented on issue #24221: [SPARK-27248][SQL] refresh table should recreate cache with same cache name

2019-04-28 Thread GitBox
William1104 commented on issue #24221: [SPARK-27248][SQL] refresh table should recreate cache with same cache name URL: https://github.com/apache/spark/pull/24221#issuecomment-487450791 Hi @cloud-fan , @gatorsmile and @srowen , Appreciate if you can take a look the PR again. I enhanced

[GitHub] [spark] SparkQA commented on issue #24483: [SPARK-27588] Binary file data source fails fast and doesn't attempt to read very large files

2019-04-28 Thread GitBox
SparkQA commented on issue #24483: [SPARK-27588] Binary file data source fails fast and doesn't attempt to read very large files URL: https://github.com/apache/spark/pull/24483#issuecomment-487450170 **[Test build #104983 has

[GitHub] [spark] mengxr opened a new pull request #24483: [SPARK-27588] Binary file data source fails fast and doesn't attempt to read very large files

2019-04-28 Thread GitBox
mengxr opened a new pull request #24483: [SPARK-27588] Binary file data source fails fast and doesn't attempt to read very large files URL: https://github.com/apache/spark/pull/24483 ## What changes were proposed in this pull request? If a file is too big (>2GB), we should fail fast

[GitHub] [spark] SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487445325 Kubernetes integration test status success URL:

[GitHub] [spark] AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487445337 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487445332 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487445332 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487445337 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] linehrr commented on issue #24461: [SPARK-27434][CORE] Fix mem leak

2019-04-28 Thread GitBox
linehrr commented on issue #24461: [SPARK-27434][CORE] Fix mem leak URL: https://github.com/apache/spark/pull/24461#issuecomment-48740 @srowen if there is indeed somewhere else that's holding that filesystem object, them this won't solve the problem you are right. but if not,

[GitHub] [spark] SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487443942 Kubernetes integration test starting URL:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24044: [WIP][test-hadoop2.7][test-maven] Test Hadoop 3.2 on jenkins

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24044: [WIP][test-hadoop2.7][test-maven] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-487442918 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #24044: [WIP][test-hadoop2.7][test-maven] Test Hadoop 3.2 on jenkins

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24044: [WIP][test-hadoop2.7][test-maven] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-487442922 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24044: [WIP][test-hadoop2.7][test-maven] Test Hadoop 3.2 on jenkins

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24044: [WIP][test-hadoop2.7][test-maven] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-487442922 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24044: [WIP][test-hadoop2.7][test-maven] Test Hadoop 3.2 on jenkins

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24044: [WIP][test-hadoop2.7][test-maven] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-487442918 Merged build finished. Test PASSed. This is an

[GitHub] [spark] wangyum commented on issue #24044: [WIP][test-hadoop2.7][test-maven] Test Hadoop 3.2 on jenkins

2019-04-28 Thread GitBox
wangyum commented on issue #24044: [WIP][test-hadoop2.7][test-maven] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-487442600 retest this please This is an automated message from the

[GitHub] [spark] SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487442420 **[Test build #104981 has

[GitHub] [spark] SparkQA commented on issue #24044: [WIP][test-hadoop2.7][test-maven] Test Hadoop 3.2 on jenkins

2019-04-28 Thread GitBox
SparkQA commented on issue #24044: [WIP][test-hadoop2.7][test-maven] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-487443066 **[Test build #104982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104982/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times URL: https://github.com/apache/spark/pull/24375#issuecomment-487442254 Merged build finished. Test PASSed.

[GitHub] [spark] skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r279230019 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times URL: https://github.com/apache/spark/pull/24375#issuecomment-487442257 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] skonto commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
skonto commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487442281 jenkins test this please This is an

[GitHub] [spark] AmplabJenkins commented on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times URL: https://github.com/apache/spark/pull/24375#issuecomment-487442254 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times URL: https://github.com/apache/spark/pull/24375#issuecomment-487442257 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times

2019-04-28 Thread GitBox
SparkQA commented on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times URL: https://github.com/apache/spark/pull/24375#issuecomment-487441758 **[Test build #104980 has

[GitHub] [spark] cloud-fan commented on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times

2019-04-28 Thread GitBox
cloud-fan commented on issue #24375: [SPARK-27474][CORE] avoid retrying a task failed with CommitDeniedException many times URL: https://github.com/apache/spark/pull/24375#issuecomment-487441589 retest this please This is an

[GitHub] [spark] cloud-fan commented on a change in pull request #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
cloud-fan commented on a change in pull request #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#discussion_r279228389 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24442: [SPARK-27547][SQL] fix DataFrame self-join problems

2019-04-28 Thread GitBox
cloud-fan commented on a change in pull request #24442: [SPARK-27547][SQL] fix DataFrame self-join problems URL: https://github.com/apache/spark/pull/24442#discussion_r279227348 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ## @@ -1292,10

[GitHub] [spark] AmplabJenkins commented on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value URL: https://github.com/apache/spark/pull/24465#issuecomment-487437861 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value URL: https://github.com/apache/spark/pull/24465#issuecomment-487437867 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value

2019-04-28 Thread GitBox
SparkQA commented on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value URL: https://github.com/apache/spark/pull/24465#issuecomment-487437686 **[Test build #104978 has

[GitHub] [spark] SparkQA removed a comment on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value

2019-04-28 Thread GitBox
SparkQA removed a comment on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value URL: https://github.com/apache/spark/pull/24465#issuecomment-487428177 **[Test build #104978 has

[GitHub] [spark] SparkQA commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
SparkQA commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487438204 **[Test build #104979 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487438065 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487438067 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487438065 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487438067 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value URL: https://github.com/apache/spark/pull/24465#issuecomment-487437867 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value URL: https://github.com/apache/spark/pull/24465#issuecomment-487437861 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module)

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module) URL: https://github.com/apache/spark/pull/24391#issuecomment-487437211 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module)

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module) URL: https://github.com/apache/spark/pull/24391#issuecomment-487437208 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module)

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module) URL: https://github.com/apache/spark/pull/24391#issuecomment-487437208 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module)

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module) URL: https://github.com/apache/spark/pull/24391#issuecomment-487437211 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] SparkQA removed a comment on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module)

2019-04-28 Thread GitBox
SparkQA removed a comment on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module) URL: https://github.com/apache/spark/pull/24391#issuecomment-487416048 **[Test build #104975 has

[GitHub] [spark] SparkQA commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module)

2019-04-28 Thread GitBox
SparkQA commented on issue #24391: [SPARK-27402][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test issue(except the hive-thriftserver module) URL: https://github.com/apache/spark/pull/24391#issuecomment-487436988 **[Test build #104975 has

[GitHub] [spark] viirya commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
viirya commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487434662 cc @dongjoon-hyun @cloud-fan

[GitHub] [spark] Ngone51 commented on issue #24467: [SPARK-27568][CORE] Fix readLock leak while calling take()/first() on a cached rdd

2019-04-28 Thread GitBox
Ngone51 commented on issue #24467: [SPARK-27568][CORE] Fix readLock leak while calling take()/first() on a cached rdd URL: https://github.com/apache/spark/pull/24467#issuecomment-487433811 @srowen Yeah, agree with that. I'm thinking of it.

[GitHub] [spark] SparkQA commented on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value

2019-04-28 Thread GitBox
SparkQA commented on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value URL: https://github.com/apache/spark/pull/24465#issuecomment-487428177 **[Test build #104978 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487427301 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487427304 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487427301 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487427304 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
SparkQA removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487419066 **[Test build #104977 has

[GitHub] [spark] SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487427206 **[Test build #104977 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487427043 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487427045 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487427045 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487427043 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
SparkQA removed a comment on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487416037 **[Test build #104973 has

[GitHub] [spark] SparkQA commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException

2019-04-28 Thread GitBox
SparkQA commented on issue #24482: [SPARK-27581][SQL] DataFrame countDistinct("*") shouldn't fail with AnalysisException URL: https://github.com/apache/spark/pull/24482#issuecomment-487426924 **[Test build #104973 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487425336 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487425333 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487425336 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487425333 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
SparkQA removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487416058 **[Test build #104976 has

[GitHub] [spark] SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487425190 **[Test build #104976 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1 URL: https://github.com/apache/spark/pull/24481#issuecomment-487423886 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1 URL: https://github.com/apache/spark/pull/24481#issuecomment-487423889 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1 URL: https://github.com/apache/spark/pull/24481#issuecomment-487423889 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1

2019-04-28 Thread GitBox
AmplabJenkins commented on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1 URL: https://github.com/apache/spark/pull/24481#issuecomment-487423886 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA commented on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1

2019-04-28 Thread GitBox
SparkQA commented on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1 URL: https://github.com/apache/spark/pull/24481#issuecomment-487423761 **[Test build #104974 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104974/testReport)** for PR

[GitHub] [spark] SparkQA removed a comment on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1

2019-04-28 Thread GitBox
SparkQA removed a comment on issue #24481: [WIP][SPARK-27467][BUILD] Upgrade Maven to 3.6.1 URL: https://github.com/apache/spark/pull/24481#issuecomment-487416038 **[Test build #104974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104974/testReport)**

[GitHub] [spark] srowen commented on issue #24461: [SPARK-27434][CORE] Fix mem leak

2019-04-28 Thread GitBox
srowen commented on issue #24461: [SPARK-27434][CORE] Fix mem leak URL: https://github.com/apache/spark/pull/24461#issuecomment-487422243 Hm your heap dump is convincing, although this `FileSystem` is just obtained from Hadoop and its cache. Generally that's not safe to close, but maybe

[GitHub] [spark] skonto removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
skonto removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487419487 @shaneknapp there is a weird error: ``` 9/04/28 14:34:17.480 OkHttp

[GitHub] [spark] AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487420346 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

2019-04-28 Thread GitBox
AmplabJenkins removed a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-487420345 Merged build finished. Test FAILed.

  1   2   >