[GitHub] [spark] viirya commented on a change in pull request #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2019-05-21 Thread GitBox
viirya commented on a change in pull request #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing URL: https://github.com/apache/spark/pull/24525#discussion_r286285796 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494620477 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494620471 Merged build finished. Test PASSed.

[GitHub] [spark] rezasafi commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
rezasafi commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627509 I created this pr per @HyukjinKwon, but the cherry-pick to 2.3 was clean and

[GitHub] [spark] AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627498 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494627514 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627498 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627495 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494627506 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627495 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494627506 Merged build finished. Test PASSed.

[GitHub] [spark] viirya commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
viirya commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#discussion_r286291653 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669#issuecomment-494626363 Can one of the admins verify this patch? This

[GitHub] [spark] rezasafi edited a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
rezasafi edited a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627509 I created this pr per @HyukjinKwon comment on the jira, but the cherry-pick

[GitHub] [spark] HyukjinKwon commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
HyukjinKwon commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494627577 Oh, I was thinking we should do it 3.x only .. i thought it might be quite breaking

[GitHub] [spark] AmplabJenkins removed a comment on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494627514 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24344: [SPARK-27440][SQL] Optimize uncorrelated predicate subquery

2019-05-21 Thread GitBox
SparkQA commented on issue #24344: [SPARK-27440][SQL] Optimize uncorrelated predicate subquery URL: https://github.com/apache/spark/pull/24344#issuecomment-494646768 **[Test build #105662 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105662/testReport)**

[GitHub] [spark] HyukjinKwon closed pull request #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
HyukjinKwon closed pull request #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650 This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on issue #24344: [SPARK-27440][SQL] Optimize uncorrelated predicate subquery

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24344: [SPARK-27440][SQL] Optimize uncorrelated predicate subquery URL: https://github.com/apache/spark/pull/24344#issuecomment-494647691 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types

2019-05-21 Thread GitBox
dongjoon-hyun commented on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types URL: https://github.com/apache/spark/pull/21586#issuecomment-494647942 cc @dbtsai This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #24344: [SPARK-27440][SQL] Optimize uncorrelated predicate subquery

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24344: [SPARK-27440][SQL] Optimize uncorrelated predicate subquery URL: https://github.com/apache/spark/pull/24344#issuecomment-494647681 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
SparkQA commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494652725 **[Test build #105648 has

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
dongjoon-hyun commented on a change in pull request #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#discussion_r286313546 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-494655855 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] SparkQA commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC

2019-05-21 Thread GitBox
SparkQA commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-494655841 **[Test build #105665 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105665/testReport)** for PR

[GitHub] [spark] AmplabJenkins commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-494655860 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-494654247 **[Test build #105665 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105665/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-494655860 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24672: [SPARK-27801] InMemoryFileIndex.listLeafFiles should use listLocatedStatus for DistributedFileSystem

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24672: [SPARK-27801] InMemoryFileIndex.listLeafFiles should use listLocatedStatus for DistributedFileSystem URL: https://github.com/apache/spark/pull/24672#issuecomment-494660640 Can one of the admins verify this patch?

[GitHub] [spark] rrusso2007 opened a new pull request #24672: [SPARK-27801] InMemoryFileIndex.listLeafFiles should use listLocatedStatus for DistributedFileSystem

2019-05-21 Thread GitBox
rrusso2007 opened a new pull request #24672: [SPARK-27801] InMemoryFileIndex.listLeafFiles should use listLocatedStatus for DistributedFileSystem URL: https://github.com/apache/spark/pull/24672 ## What changes were proposed in this pull request? InMemoryFileIndex.listLeafFiles

[GitHub] [spark] dvogelbacher commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
dvogelbacher commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#issuecomment-494608872 of course, I addressed the comments @BryanCutler

[GitHub] [spark] cloud-fan commented on issue #24635: [SPARK-27762][SQL] Support user provided avro schema for writing fields with different ordering

2019-05-21 Thread GitBox
cloud-fan commented on issue #24635: [SPARK-27762][SQL] Support user provided avro schema for writing fields with different ordering URL: https://github.com/apache/spark/pull/24635#issuecomment-494621790 Hi @dbtsai , adding to release notes usually means adding an entry in the SQL

[GitHub] [spark] viirya commented on a change in pull request #24599: [SPARK-27701][SQL] Extend NestedColumnAliasing to more nested field cases

2019-05-21 Thread GitBox
viirya commented on a change in pull request #24599: [SPARK-27701][SQL] Extend NestedColumnAliasing to more nested field cases URL: https://github.com/apache/spark/pull/24599#discussion_r286286753 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-494621853 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-494621849 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing URL: https://github.com/apache/spark/pull/24525#issuecomment-494621858 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing URL: https://github.com/apache/spark/pull/24525#issuecomment-494621864 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
HyukjinKwon commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494621445 Yea, I was thinking about respecting this option but just decided to follow the existent way

[GitHub] [spark] beliefer commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
beliefer commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494626017 Based on the above discussion, we all not sure the contract whether providers are required to be stateless. So I

[GitHub] [spark] alex-lx opened a new pull request #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
alex-lx opened a new pull request #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669 3 ^ 5 should be 6 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How

[GitHub] [spark] AmplabJenkins commented on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669#issuecomment-494625916 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494630267 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494630267 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494630270 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494630270 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494629554 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] WangGuangxin commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC

2019-05-21 Thread GitBox
WangGuangxin commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-494632040 @dongjoon-hyun Thanks for your review. I've updated it according to your comments.

[GitHub] [spark] beliefer opened a new pull request #24671: [MINOR][DOCS]Improve docs about overhead.

2019-05-21 Thread GitBox
beliefer opened a new pull request #24671: [MINOR][DOCS]Improve docs about overhead. URL: https://github.com/apache/spark/pull/24671 ## What changes were proposed in this pull request? I found the docs of `spark.driver.memoryOverhead` and `spark.executor.memoryOverhead` exists a

[GitHub] [spark] AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494635494 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494635498 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
SparkQA commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494635470 **[Test build #105658 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494635494 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494633234 **[Test build #105658 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494639463 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494639469 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494639469 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494639463 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
SparkQA commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#issuecomment-494639661 **[Test build #105647 has

[GitHub] [spark] cloud-fan commented on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types

2019-05-21 Thread GitBox
cloud-fan commented on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types URL: https://github.com/apache/spark/pull/21586#issuecomment-494639610 thanks, merging to master! This is an

[GitHub] [spark] ben-manes commented on issue #24585: [Spark-27664][SQL] Performance issue while listing large number of files on an object store.

2019-05-21 Thread GitBox
ben-manes commented on issue #24585: [Spark-27664][SQL] Performance issue while listing large number of files on an object store. URL: https://github.com/apache/spark/pull/24585#issuecomment-494646554 fyi, [Caffeine](https://github.com/ben-manes/caffeine) is a rewrite of Guava's cache

[GitHub] [spark] HyukjinKwon commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
HyukjinKwon commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#issuecomment-494646437 Merged to master. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing URL: https://github.com/apache/spark/pull/24525#issuecomment-494651972 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing URL: https://github.com/apache/spark/pull/24525#issuecomment-494651969 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing URL: https://github.com/apache/spark/pull/24525#issuecomment-494651969 Merged build finished. Test PASSed. This is

[GitHub] [spark] dongjoon-hyun closed pull request #24669: [SPARK-27800][SQL][DOC] Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
dongjoon-hyun closed pull request #24669: [SPARK-27800][SQL][DOC] Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669 This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing URL: https://github.com/apache/spark/pull/24525#issuecomment-494651972 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24344: [SPARK-27440][SQL] Optimize uncorrelated predicate subquery

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24344: [SPARK-27440][SQL] Optimize uncorrelated predicate subquery URL: https://github.com/apache/spark/pull/24344#issuecomment-494655205 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24344: [SPARK-27440][SQL] Optimize uncorrelated predicate subquery

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24344: [SPARK-27440][SQL] Optimize uncorrelated predicate subquery URL: https://github.com/apache/spark/pull/24344#issuecomment-494655209 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24344: [SPARK-27440][SQL] Optimize uncorrelated predicate subquery

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24344: [SPARK-27440][SQL] Optimize uncorrelated predicate subquery URL: https://github.com/apache/spark/pull/24344#issuecomment-494655205 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #24344: [SPARK-27440][SQL] Optimize uncorrelated predicate subquery

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24344: [SPARK-27440][SQL] Optimize uncorrelated predicate subquery URL: https://github.com/apache/spark/pull/24344#issuecomment-494655209 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494608326 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494608134 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494608319 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24620: [SPARK-27737][SQL][test-hadoop3.2][test-maven] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24620: [SPARK-27737][SQL][test-hadoop3.2][test-maven] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile URL: https://github.com/apache/spark/pull/24620#issuecomment-494613361 Merged build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon closed pull request #24620: [SPARK-27737][SQL] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile

2019-05-21 Thread GitBox
HyukjinKwon closed pull request #24620: [SPARK-27737][SQL] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile URL: https://github.com/apache/spark/pull/24620 This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon commented on issue #24631: [SPARK-27774][CORE][MLLIB] Avoid hardcoded configs

2019-05-21 Thread GitBox
HyukjinKwon commented on issue #24631: [SPARK-27774][CORE][MLLIB] Avoid hardcoded configs URL: https://github.com/apache/spark/pull/24631#issuecomment-494619984 Merged to master. This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494628921 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494628930 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494628921 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494628904 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494628934 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494628904 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] JoshRosen commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
JoshRosen commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#discussion_r286292793 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494628899 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494628917 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494628934 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494628930 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494628899 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494628917 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494635498 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #24671: [MINOR][DOCS]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

2019-05-21 Thread GitBox
SparkQA commented on issue #24671: [MINOR][DOCS]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-494635896 **[Test build #105660 has

[GitHub] [spark] dongjoon-hyun commented on issue #24669: [SPARK-27800][SQL][DOC] Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
dongjoon-hyun commented on issue #24669: [SPARK-27800][SQL][DOC] Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669#issuecomment-494651201 Merged to `master/2.4/2.3`. This is an

[GitHub] [spark] dongjoon-hyun commented on issue #24669: [SPARK-27800][SQL][DOC] Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
dongjoon-hyun commented on issue #24669: [SPARK-27800][SQL][DOC] Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669#issuecomment-494651166 This is a documentation change and I verified manually. ``` spark-sql> DESCRIBE FUNCTION EXTENDED ^;

[GitHub] [spark] AmplabJenkins commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-494655855 Merged build finished. Test FAILed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494608130 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494583034 **[Test build #105644 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105644/testReport)**

[GitHub] [spark] SparkQA commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
SparkQA commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494608123 **[Test build #105646 has

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494608134 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
SparkQA commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494607968 **[Test build #105644 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105644/testReport)** for PR

[GitHub] [spark] AmplabJenkins commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494608319 Merged build finished. Test PASSed. This is an automated

  1   2   3   4   5   6   7   8   9   10   >