[GitHub] [spark] turboFei edited a comment on issue #24447: [SPARK-27562][Shuffle]Complete the verification mechanism for shuffle transmitted data

turboFei edited a comment on issue #24447: [SPARK-27562][Shuffle]Complete the verification mechanism for shuffle transmitted data URL: https://github.com/apache/spark/pull/24447#issuecomment-487256025 @cloud-fan Could you help to review this? I think this pr can guarantee the accuracy of

[GitHub] [spark] turboFei commented on issue #24447: [SPARK-27562][Shuffle]Complete the verification mechanism for shuffle transmitted data

turboFei commented on issue #24447: [SPARK-27562][Shuffle]Complete the verification mechanism for shuffle transmitted data URL: https://github.com/apache/spark/pull/24447#issuecomment-487256025 @cloud-fan Could you help to review this? I think this pr can guarantee the accuracy of shuffle

[GitHub] [spark] jashgala commented on issue #23748: [SPARK-23619][DOCS] Add output description for some generator expressions / functions

jashgala commented on issue #23748: [SPARK-23619][DOCS] Add output description for some generator expressions / functions URL: https://github.com/apache/spark/pull/23748#issuecomment-487255993 Thanks I will fix the other documentation when I have some free time!

[GitHub] [spark] AmplabJenkins removed a comment on issue #24044: [WIP][test-hadoop3.2][test-maven] Test Hadoop 3.2 on jenkins

AmplabJenkins removed a comment on issue #24044: [WIP][test-hadoop3.2][test-maven] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-487254936 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24044: [WIP][test-hadoop3.2][test-maven] Test Hadoop 3.2 on jenkins

AmplabJenkins removed a comment on issue #24044: [WIP][test-hadoop3.2][test-maven] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-487254935 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #24044: [WIP][test-hadoop3.2][test-maven] Test Hadoop 3.2 on jenkins

AmplabJenkins commented on issue #24044: [WIP][test-hadoop3.2][test-maven] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-487254936 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24044: [WIP][test-hadoop3.2][test-maven] Test Hadoop 3.2 on jenkins

AmplabJenkins commented on issue #24044: [WIP][test-hadoop3.2][test-maven] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-487254935 Merged build finished. Test PASSed. This is an

[GitHub] [spark] dongjoon-hyun commented on issue #23674: [SPARK-26745][SQL][TESTS] JsonSuite test case: empty line -> 0 record count

dongjoon-hyun commented on issue #23674: [SPARK-26745][SQL][TESTS] JsonSuite test case: empty line -> 0 record count URL: https://github.com/apache/spark/pull/23674#issuecomment-487254867 Hi, @sumitsu and @HyukjinKwon . I backported this to `branch-2.4` since Spark 2.4.x will be the last

[GitHub] [spark] JoshRosen commented on issue #24461: [SPARK-27434][CORE] Fix mem leak

JoshRosen commented on issue #24461: [SPARK-27434][CORE] Fix mem leak URL: https://github.com/apache/spark/pull/24461#issuecomment-487254617 Does this component have exclusive ownership of this Hadoop `FileSystem` instance? Could we run into problems in case this ends up closing a shared

[GitHub] [spark] SparkQA commented on issue #24044: [WIP][test-hadoop3.2][test-maven] Test Hadoop 3.2 on jenkins

SparkQA commented on issue #24044: [WIP][test-hadoop3.2][test-maven] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-487254579 **[Test build #104955 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104955/testReport)**

[GitHub] [spark] wangyum commented on issue #24044: [WIP][test-hadoop3.2][test-maven] Test Hadoop 3.2 on jenkins

wangyum commented on issue #24044: [WIP][test-hadoop3.2][test-maven] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-487254535 retest this please This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials

AmplabJenkins removed a comment on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials URL: https://github.com/apache/spark/pull/24431#issuecomment-487254452 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials

AmplabJenkins removed a comment on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials URL: https://github.com/apache/spark/pull/24431#issuecomment-487254453 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials

AmplabJenkins commented on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials URL: https://github.com/apache/spark/pull/24431#issuecomment-487254453 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials

AmplabJenkins commented on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials URL: https://github.com/apache/spark/pull/24431#issuecomment-487254452 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials

SparkQA removed a comment on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials URL: https://github.com/apache/spark/pull/24431#issuecomment-487247316 **[Test build #104953 has

[GitHub] [spark] SparkQA commented on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials

SparkQA commented on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials URL: https://github.com/apache/spark/pull/24431#issuecomment-487254360 **[Test build #104953 has

[GitHub] [spark] dongjoon-hyun closed pull request #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto.

dongjoon-hyun closed pull request #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto. URL: https://github.com/apache/spark/pull/24476 This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto.

AmplabJenkins removed a comment on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto. URL: https://github.com/apache/spark/pull/24476#issuecomment-487252515 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto.

AmplabJenkins commented on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto. URL: https://github.com/apache/spark/pull/24476#issuecomment-487252515 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto.

AmplabJenkins removed a comment on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto. URL: https://github.com/apache/spark/pull/24476#issuecomment-487252514 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto.

AmplabJenkins commented on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto. URL: https://github.com/apache/spark/pull/24476#issuecomment-487252514 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto.

SparkQA removed a comment on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto. URL: https://github.com/apache/spark/pull/24476#issuecomment-487228208 **[Test build #104951 has

[GitHub] [spark] SparkQA commented on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto.

SparkQA commented on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto. URL: https://github.com/apache/spark/pull/24476#issuecomment-487252422 **[Test build #104951 has

[GitHub] [spark] viirya commented on a change in pull request #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials

viirya commented on a change in pull request #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials URL: https://github.com/apache/spark/pull/24431#discussion_r279141550 ## File path: core/src/test/scala/org/apache/spark/FileSuite.scala

[GitHub] [spark] SparkQA commented on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT

SparkQA commented on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487249036 **[Test build #104954 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT

AmplabJenkins removed a comment on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487248928 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT

AmplabJenkins removed a comment on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487248925 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT

AmplabJenkins commented on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487248928 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT

AmplabJenkins commented on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487248925 Merged build finished. Test PASSed. This is

[GitHub] [spark] wangyum commented on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT

wangyum commented on issue #24468: [WIP][TEST][test-hadoop3.2][test-maven] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487248591 retest this please This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT

AmplabJenkins removed a comment on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487248345 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT

SparkQA removed a comment on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487247320 **[Test build #104952 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT

AmplabJenkins removed a comment on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487248343 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT

AmplabJenkins commented on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487248345 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT

SparkQA commented on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487248338 **[Test build #104952 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104952/testReport)** for

[GitHub] [spark] AmplabJenkins commented on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT

AmplabJenkins commented on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487248343 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials

AmplabJenkins commented on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials URL: https://github.com/apache/spark/pull/24431#issuecomment-487247617 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials

AmplabJenkins commented on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials URL: https://github.com/apache/spark/pull/24431#issuecomment-487247618 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials

AmplabJenkins removed a comment on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials URL: https://github.com/apache/spark/pull/24431#issuecomment-487247617 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials

AmplabJenkins removed a comment on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials URL: https://github.com/apache/spark/pull/24431#issuecomment-487247618 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT

SparkQA commented on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487247320 **[Test build #104952 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104952/testReport)** for

[GitHub] [spark] SparkQA commented on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials

SparkQA commented on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials URL: https://github.com/apache/spark/pull/24431#issuecomment-487247316 **[Test build #104953 has

[GitHub] [spark] AmplabJenkins commented on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT

AmplabJenkins commented on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487247220 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT

AmplabJenkins removed a comment on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487247219 Merged build finished. Test PASSed. This is an

[GitHub] [spark] dongjoon-hyun commented on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials

dongjoon-hyun commented on issue #24431: [SPARK-27536][CORE][ML][SQL][STREAMING] Remove most use of scala.language.existentials URL: https://github.com/apache/spark/pull/24431#issuecomment-487247230 Retest this please. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT

AmplabJenkins removed a comment on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487247220 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT

AmplabJenkins commented on issue #24468: [WIP][TEST][test-hadoop3.2] Verify Hive 2.3.5-SNAPSHOT URL: https://github.com/apache/spark/pull/24468#issuecomment-487247219 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] HyukjinKwon closed pull request #23748: [SPARK-23619][DOCS] Add output description for some generator expressions / functions

HyukjinKwon closed pull request #23748: [SPARK-23619][DOCS] Add output description for some generator expressions / functions URL: https://github.com/apache/spark/pull/23748 This is an automated message from the Apache Git

[GitHub] [spark] cloud-fan closed pull request #24466: [MINOR][TEST][DOC] Execute action miss name message

cloud-fan closed pull request #24466: [MINOR][TEST][DOC] Execute action miss name message URL: https://github.com/apache/spark/pull/24466 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon commented on issue #23748: [SPARK-23619][DOCS] Add output description for some generator expressions / functions

HyukjinKwon commented on issue #23748: [SPARK-23619][DOCS] Add output description for some generator expressions / functions URL: https://github.com/apache/spark/pull/23748#issuecomment-487243731 Merged to master. This is an

[GitHub] [spark] cloud-fan commented on issue #24466: [MINOR][TEST][DOC] Execute action miss name message

cloud-fan commented on issue #24466: [MINOR][TEST][DOC] Execute action miss name message URL: https://github.com/apache/spark/pull/24466#issuecomment-487243676 thanks, merging to master! This is an automated message from the

[GitHub] [spark] beliefer commented on issue #24372: [SPARK-27462][SQL] Enhance insert into hive table that could choose some columns in target table flexibly.

beliefer commented on issue #24372: [SPARK-27462][SQL] Enhance insert into hive table that could choose some columns in target table flexibly. URL: https://github.com/apache/spark/pull/24372#issuecomment-487243349 cc @vanzin

[GitHub] [spark] AmplabJenkins removed a comment on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected

AmplabJenkins removed a comment on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected URL: https://github.com/apache/spark/pull/24473#issuecomment-487242228 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected

AmplabJenkins removed a comment on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected URL: https://github.com/apache/spark/pull/24473#issuecomment-487242227 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected

AmplabJenkins commented on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected URL: https://github.com/apache/spark/pull/24473#issuecomment-487242227 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected

AmplabJenkins commented on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected URL: https://github.com/apache/spark/pull/24473#issuecomment-487242228 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected

SparkQA removed a comment on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected URL: https://github.com/apache/spark/pull/24473#issuecomment-487218579 **[Test build #104947 has

[GitHub] [spark] SparkQA commented on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected

SparkQA commented on issue #24473: [SPARK-27534][SQL] Do not load `content` column in binary data source if it is not selected URL: https://github.com/apache/spark/pull/24473#issuecomment-487242077 **[Test build #104947 has

[GitHub] [spark] jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#discussion_r279136736 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/PlannerSuite.scala

[GitHub] [spark] jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#discussion_r279136736 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/PlannerSuite.scala

[GitHub] [spark] jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#discussion_r279136632 ## File path:

[GitHub] [spark] jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#discussion_r279136642 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/PlannerSuite.scala

[GitHub] [spark] jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#discussion_r279136626 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala ##

[GitHub] [spark] jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#discussion_r279136390 ## File path: sql/core/src/test/scala/org/apache/spark/sql/FileBasedDataSourceSuite.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-487239345 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

SparkQA removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-487220039 **[Test build #104948 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-487239343 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-487239345 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-487239343 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

SparkQA commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-487239266 **[Test build #104948 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104948/testReport)**

[GitHub] [spark] jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#discussion_r279136012 ## File path:

[GitHub] [spark] jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

jaceklaskowski commented on a change in pull request #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#discussion_r279135671 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala

[GitHub] [spark] AmplabJenkins commented on issue #24475: [SPARK-27580][SQL] Implement `doCanonicalize` in BatchScanExec for comparing query plan results

AmplabJenkins commented on issue #24475: [SPARK-27580][SQL] Implement `doCanonicalize` in BatchScanExec for comparing query plan results URL: https://github.com/apache/spark/pull/24475#issuecomment-487232257 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24475: [SPARK-27580][SQL] Implement `doCanonicalize` in BatchScanExec for comparing query plan results

AmplabJenkins removed a comment on issue #24475: [SPARK-27580][SQL] Implement `doCanonicalize` in BatchScanExec for comparing query plan results URL: https://github.com/apache/spark/pull/24475#issuecomment-487232257 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24475: [SPARK-27580][SQL] Implement `doCanonicalize` in BatchScanExec for comparing query plan results

AmplabJenkins removed a comment on issue #24475: [SPARK-27580][SQL] Implement `doCanonicalize` in BatchScanExec for comparing query plan results URL: https://github.com/apache/spark/pull/24475#issuecomment-487232256 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24475: [SPARK-27580][SQL] Implement `doCanonicalize` in BatchScanExec for comparing query plan results

AmplabJenkins commented on issue #24475: [SPARK-27580][SQL] Implement `doCanonicalize` in BatchScanExec for comparing query plan results URL: https://github.com/apache/spark/pull/24475#issuecomment-487232256 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #24475: [SPARK-27580][SQL] Implement `doCanonicalize` in BatchScanExec for comparing query plan results

SparkQA removed a comment on issue #24475: [SPARK-27580][SQL] Implement `doCanonicalize` in BatchScanExec for comparing query plan results URL: https://github.com/apache/spark/pull/24475#issuecomment-487196203 **[Test build #104945 has

[GitHub] [spark] SparkQA commented on issue #24475: [SPARK-27580][SQL] Implement `doCanonicalize` in BatchScanExec for comparing query plan results

SparkQA commented on issue #24475: [SPARK-27580][SQL] Implement `doCanonicalize` in BatchScanExec for comparing query plan results URL: https://github.com/apache/spark/pull/24475#issuecomment-487232018 **[Test build #104945 has

[GitHub] [spark] dilipbiswal commented on issue #24442: [SPARK-27547][SQL] fix DataFrame self-join problems

dilipbiswal commented on issue #24442: [SPARK-27547][SQL] fix DataFrame self-join problems URL: https://github.com/apache/spark/pull/24442#issuecomment-487229820 @cloud-fan The changes look good to me. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto.

AmplabJenkins removed a comment on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto. URL: https://github.com/apache/spark/pull/24476#issuecomment-487227907 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto.

AmplabJenkins removed a comment on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto. URL: https://github.com/apache/spark/pull/24476#issuecomment-487227901 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto.

SparkQA commented on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto. URL: https://github.com/apache/spark/pull/24476#issuecomment-487228208 **[Test build #104951 has

[GitHub] [spark] vanzin commented on a change in pull request #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value

vanzin commented on a change in pull request #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value URL: https://github.com/apache/spark/pull/24465#discussion_r279127545 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto.

AmplabJenkins commented on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto. URL: https://github.com/apache/spark/pull/24476#issuecomment-487227907 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto.

AmplabJenkins commented on issue #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto. URL: https://github.com/apache/spark/pull/24476#issuecomment-487227901 Merged build finished. Test PASSed.

[GitHub] [spark] dongjoon-hyun commented on issue #22557: [SPARK-25535][core] Work around bad error handling in commons-crypto.

dongjoon-hyun commented on issue #22557: [SPARK-25535][core] Work around bad error handling in commons-crypto. URL: https://github.com/apache/spark/pull/22557#issuecomment-487227701 Thank you so much, @vanzin and @dbtsai !

[GitHub] [spark] vanzin commented on issue #22557: [SPARK-25535][core] Work around bad error handling in commons-crypto.

vanzin commented on issue #22557: [SPARK-25535][core] Work around bad error handling in commons-crypto. URL: https://github.com/apache/spark/pull/22557#issuecomment-487227641 #24476 This is an automated message from the

[GitHub] [spark] vanzin opened a new pull request #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto.

vanzin opened a new pull request #24476: [SPARK-25535][CORE][branch-2.4] Work around bad error handling in commons-crypto. URL: https://github.com/apache/spark/pull/24476 The commons-crypto library does some questionable error handling internally, which can lead to JVM crashes if some

[GitHub] [spark] AmplabJenkins removed a comment on issue #24448: [SPARK-23299][SQL][PYSPARK] Fix __repr__ behaviour for Rows

AmplabJenkins removed a comment on issue #24448: [SPARK-23299][SQL][PYSPARK] Fix __repr__ behaviour for Rows URL: https://github.com/apache/spark/pull/24448#issuecomment-487226974 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #24448: [SPARK-23299][SQL][PYSPARK] Fix __repr__ behaviour for Rows

AmplabJenkins removed a comment on issue #24448: [SPARK-23299][SQL][PYSPARK] Fix __repr__ behaviour for Rows URL: https://github.com/apache/spark/pull/24448#issuecomment-487226976 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24448: [SPARK-23299][SQL][PYSPARK] Fix __repr__ behaviour for Rows

AmplabJenkins commented on issue #24448: [SPARK-23299][SQL][PYSPARK] Fix __repr__ behaviour for Rows URL: https://github.com/apache/spark/pull/24448#issuecomment-487226974 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24448: [SPARK-23299][SQL][PYSPARK] Fix __repr__ behaviour for Rows

AmplabJenkins commented on issue #24448: [SPARK-23299][SQL][PYSPARK] Fix __repr__ behaviour for Rows URL: https://github.com/apache/spark/pull/24448#issuecomment-487226976 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24448: [SPARK-23299][SQL][PYSPARK] Fix __repr__ behaviour for Rows

SparkQA removed a comment on issue #24448: [SPARK-23299][SQL][PYSPARK] Fix __repr__ behaviour for Rows URL: https://github.com/apache/spark/pull/24448#issuecomment-487221392 **[Test build #104949 has

[GitHub] [spark] SparkQA commented on issue #24448: [SPARK-23299][SQL][PYSPARK] Fix __repr__ behaviour for Rows

SparkQA commented on issue #24448: [SPARK-23299][SQL][PYSPARK] Fix __repr__ behaviour for Rows URL: https://github.com/apache/spark/pull/24448#issuecomment-487226778 **[Test build #104949 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104949/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value

AmplabJenkins commented on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value URL: https://github.com/apache/spark/pull/24465#issuecomment-487226559 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value

AmplabJenkins removed a comment on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value URL: https://github.com/apache/spark/pull/24465#issuecomment-487226561 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value

AmplabJenkins removed a comment on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value URL: https://github.com/apache/spark/pull/24465#issuecomment-487226559 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value

AmplabJenkins commented on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value URL: https://github.com/apache/spark/pull/24465#issuecomment-487226561 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value

SparkQA removed a comment on issue #24465: [SPARK-27575][CORE][YARN] Yarn file-related confs should merge new value with existing value URL: https://github.com/apache/spark/pull/24465#issuecomment-487198148 **[Test build #104946 has

  1   2   3   4   5   6   >