[GitHub] [spark] AmplabJenkins removed a comment on issue #23845: [SPARK-26941][YARN]Fix incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #23845: [SPARK-26941][YARN]Fix incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming URL: https://github.com/apache/spark/pull/23845#issuecomment-472630530 Test FAILed. Refer to this link for build results (access

[GitHub] [spark] srowen closed pull request #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters

2019-03-13 Thread GitBox
srowen closed pull request #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters URL: https://github.com/apache/spark/pull/24016 This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun commented on issue #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

2019-03-13 Thread GitBox
dongjoon-hyun commented on issue #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage URL: https://github.com/apache/spark/pull/24018#issuecomment-472602348 Ur, @srowen It's replaced with a `private` version as I mentioned before. >

[GitHub] [spark] dongjoon-hyun commented on issue #24078: [SPARK-27034][SPARK-27123][SQL][FOLLOWUP] Update Nested Schema Pruning BM result with EC2

2019-03-13 Thread GitBox
dongjoon-hyun commented on issue #24078: [SPARK-27034][SPARK-27123][SQL][FOLLOWUP] Update Nested Schema Pruning BM result with EC2 URL: https://github.com/apache/spark/pull/24078#issuecomment-472605340 Thank you so much, @dbtsai , @viirya , @HyukjinKwon , @dilipbiswal !

[GitHub] [spark] MaxGekk commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

2019-03-13 Thread GitBox
MaxGekk commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-472608155 @shahidki31 Other tests fail because they depend on a seed for random generator. And those test I

[GitHub] [spark] jzhuge commented on a change in pull request #23848: [SPARK-26946][SQL] Identifiers for multi-catalog

2019-03-13 Thread GitBox
jzhuge commented on a change in pull request #23848: [SPARK-26946][SQL] Identifiers for multi-catalog URL: https://github.com/apache/spark/pull/23848#discussion_r265336837 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 ## @@

[GitHub] [spark] maryannxue commented on a change in pull request #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntegralColumn

2019-03-13 Thread GitBox
maryannxue commented on a change in pull request #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntegralColumn URL: https://github.com/apache/spark/pull/23942#discussion_r265342226 ## File path:

[GitHub] [spark] squito commented on issue #23951: [SPARK-27038][CORE][YARN] Re-implement RackResolver to reduce resolving time

2019-03-13 Thread GitBox
squito commented on issue #23951: [SPARK-27038][CORE][YARN] Re-implement RackResolver to reduce resolving time URL: https://github.com/apache/spark/pull/23951#issuecomment-472619102 btw I just noticed that dynamic allocation may still suffer with rack resolution even after this fix, if

[GitHub] [spark] rdblue commented on a change in pull request #24029: SPARK-27108: Add parsed SQL plans for create, CTAS.

2019-03-13 Thread GitBox
rdblue commented on a change in pull request #24029: SPARK-27108: Add parsed SQL plans for create, CTAS. URL: https://github.com/apache/spark/pull/24029#discussion_r265345063 ## File path:

[GitHub] [spark] srowen commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

2019-03-13 Thread GitBox
srowen commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-472622260 @shahidki31 I'm also kind of confused by this test. I don't see how it would be affected by a

[GitHub] [spark] SparkQA removed a comment on issue #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys

2019-03-13 Thread GitBox
SparkQA removed a comment on issue #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys URL: https://github.com/apache/spark/pull/24081#issuecomment-472535253 **[Test build #103439 has

[GitHub] [spark] dongjoon-hyun commented on issue #24082: [SPARK-27123][SQL][FOLLOWUP] Use isRenaming check for limit too.

2019-03-13 Thread GitBox
dongjoon-hyun commented on issue #24082: [SPARK-27123][SQL][FOLLOWUP] Use isRenaming check for limit too. URL: https://github.com/apache/spark/pull/24082#issuecomment-472623166 Merged to master. This is an automated message

[GitHub] [spark] shaneknapp commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

2019-03-13 Thread GitBox
shaneknapp commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472625369 test this please This is an automated message

[GitHub] [spark] SparkQA commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

2019-03-13 Thread GitBox
SparkQA commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-472625832 **[Test build #103455 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103455/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

2019-03-13 Thread GitBox
SparkQA commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472628971 **[Test build #103458 has

[GitHub] [spark] SparkQA commented on issue #23845: [SPARK-26941][YARN]Fix incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming

2019-03-13 Thread GitBox
SparkQA commented on issue #23845: [SPARK-26941][YARN]Fix incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming URL: https://github.com/apache/spark/pull/23845#issuecomment-472629004 **[Test build #103459 has

[GitHub] [spark] AmplabJenkins commented on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#issuecomment-472628438 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23845: [SPARK-26941][YARN]Fix incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #23845: [SPARK-26941][YARN]Fix incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming URL: https://github.com/apache/spark/pull/23845#issuecomment-472628453 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-472628571 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23845: [SPARK-26941][YARN]Fix incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #23845: [SPARK-26941][YARN]Fix incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming URL: https://github.com/apache/spark/pull/23845#issuecomment-472628440 Merged build finished. Test PASSed.

[GitHub] [spark] rdblue commented on a change in pull request #24029: SPARK-27108: Add parsed SQL plans for create, CTAS.

2019-03-13 Thread GitBox
rdblue commented on a change in pull request #24029: SPARK-27108: Add parsed SQL plans for create, CTAS. URL: https://github.com/apache/spark/pull/24029#discussion_r265357623 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala ## @@

[GitHub] [spark] SparkQA commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

2019-03-13 Thread GitBox
SparkQA commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472631750 Kubernetes integration test starting URL:

[GitHub] [spark] AmplabJenkins removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472634771 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472634771 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472634777 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] shaneknapp commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

2019-03-13 Thread GitBox
shaneknapp commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472636973 we're going to wait to see if the regular non-k8s PRB job passes before merging.

[GitHub] [spark] SparkQA commented on issue #24029: SPARK-27108: Add parsed SQL plans for create, CTAS.

2019-03-13 Thread GitBox
SparkQA commented on issue #24029: SPARK-27108: Add parsed SQL plans for create, CTAS. URL: https://github.com/apache/spark/pull/24029#issuecomment-472663456 **[Test build #103461 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103461/testReport)** for PR

[GitHub] [spark] AmplabJenkins commented on issue #24029: SPARK-27108: Add parsed SQL plans for create, CTAS.

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #24029: SPARK-27108: Add parsed SQL plans for create, CTAS. URL: https://github.com/apache/spark/pull/24029#issuecomment-472663563 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] SparkQA removed a comment on issue #24029: SPARK-27108: Add parsed SQL plans for create, CTAS.

2019-03-13 Thread GitBox
SparkQA removed a comment on issue #24029: SPARK-27108: Add parsed SQL plans for create, CTAS. URL: https://github.com/apache/spark/pull/24029#issuecomment-472638684 **[Test build #103461 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103461/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #24029: SPARK-27108: Add parsed SQL plans for create, CTAS.

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #24029: SPARK-27108: Add parsed SQL plans for create, CTAS. URL: https://github.com/apache/spark/pull/24029#issuecomment-472663567 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24029: SPARK-27108: Add parsed SQL plans for create, CTAS.

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #24029: SPARK-27108: Add parsed SQL plans for create, CTAS. URL: https://github.com/apache/spark/pull/24029#issuecomment-472663567 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24029: SPARK-27108: Add parsed SQL plans for create, CTAS.

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #24029: SPARK-27108: Add parsed SQL plans for create, CTAS. URL: https://github.com/apache/spark/pull/24029#issuecomment-472663563 Merged build finished. Test FAILed. This is an

[GitHub] [spark] zjf2012 commented on a change in pull request #23560: [SPARK-26632][Core] Separate Thread Configurations of Driver and Executor

2019-03-13 Thread GitBox
zjf2012 commented on a change in pull request #23560: [SPARK-26632][Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#discussion_r265388630 ## File path:

[GitHub] [spark] zjf2012 commented on a change in pull request #23560: [SPARK-26632][Core] Separate Thread Configurations of Driver and Executor

2019-03-13 Thread GitBox
zjf2012 commented on a change in pull request #23560: [SPARK-26632][Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#discussion_r265388998 ## File path: core/src/main/scala/org/apache/spark/rpc/netty/Dispatcher.scala

[GitHub] [spark] stczwd commented on issue #23827: [SPARK-26912][CORE][HISTORY] Allow setting permission for event_log

2019-03-13 Thread GitBox
stczwd commented on issue #23827: [SPARK-26912][CORE][HISTORY] Allow setting permission for event_log URL: https://github.com/apache/spark/pull/23827#issuecomment-472665014 > Oh well, that's where I leave this discussion. I'll just leave my -1 to this idea until someone bothers to

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472667297 **[Test build #103468 has

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472667501 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
SparkQA removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472667297 **[Test build #103468 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472667495 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472667490 **[Test build #103468 has

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472667495 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472667501 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472670078 **[Test build #103469 has

[GitHub] [spark] zjf2012 commented on a change in pull request #23560: [SPARK-26632][Core] Separate Thread Configurations of Driver and Executor

2019-03-13 Thread GitBox
zjf2012 commented on a change in pull request #23560: [SPARK-26632][Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#discussion_r265392921 ## File path: core/src/main/scala/org/apache/spark/rpc/netty/Dispatcher.scala

[GitHub] [spark] SparkQA removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
SparkQA removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472670078 **[Test build #103469 has

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472670258 **[Test build #103469 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472670518 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472670518 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472670525 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472670525 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472671265 Kubernetes integration test starting URL:

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472672514 Kubernetes integration test status failure URL:

[GitHub] [spark] maropu closed pull request #20433: [SPARK-23264][SQL] Make INTERVAL keyword optional in INTERVAL clauses when ANSI mode enabled

2019-03-13 Thread GitBox
maropu closed pull request #20433: [SPARK-23264][SQL] Make INTERVAL keyword optional in INTERVAL clauses when ANSI mode enabled URL: https://github.com/apache/spark/pull/20433 This is an automated message from the Apache

[GitHub] [spark] maropu commented on issue #20433: [SPARK-23264][SQL] Make INTERVAL keyword optional in INTERVAL clauses when ANSI mode enabled

2019-03-13 Thread GitBox
maropu commented on issue #20433: [SPARK-23264][SQL] Make INTERVAL keyword optional in INTERVAL clauses when ANSI mode enabled URL: https://github.com/apache/spark/pull/20433#issuecomment-472672173 Thanks! Merged to master.

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472672528 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472672528 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472672534 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-472672534 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] maropu commented on a change in pull request #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables

2019-03-13 Thread GitBox
maropu commented on a change in pull request #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/24047#discussion_r265396160 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala

[GitHub] [spark] WangGuangxin commented on a change in pull request #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntegralColumn

2019-03-13 Thread GitBox
WangGuangxin commented on a change in pull request #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntegralColumn URL: https://github.com/apache/spark/pull/23942#discussion_r265396580 ## File path:

[GitHub] [spark] maropu commented on a change in pull request #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys

2019-03-13 Thread GitBox
maropu commented on a change in pull request #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys URL: https://github.com/apache/spark/pull/24081#discussion_r265396480 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala

[GitHub] [spark] maropu commented on a change in pull request #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys

2019-03-13 Thread GitBox
maropu commented on a change in pull request #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys URL: https://github.com/apache/spark/pull/24081#discussion_r265396480 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala

[GitHub] [spark] SparkQA removed a comment on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

2019-03-13 Thread GitBox
SparkQA removed a comment on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-472626358 **[Test build #103457 has

[GitHub] [spark] SparkQA commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

2019-03-13 Thread GitBox
SparkQA commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-472675231 **[Test build #103457 has

[GitHub] [spark] AmplabJenkins commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-472675454 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys URL: https://github.com/apache/spark/pull/24081#issuecomment-472675452 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/24047#issuecomment-472675474 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys URL: https://github.com/apache/spark/pull/24081#issuecomment-472675446 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys URL: https://github.com/apache/spark/pull/24081#issuecomment-472675452 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-472675457 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-472675454 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/24047#issuecomment-472675482 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/24047#issuecomment-472675482 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys URL: https://github.com/apache/spark/pull/24081#issuecomment-472675446 Merged build finished. Test PASSed.

[GitHub] [spark] rdblue commented on a change in pull request #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

2019-03-13 Thread GitBox
rdblue commented on a change in pull request #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#discussion_r265324440 ## File path: sql/core/src/main/java/org/apache/spark/sql/sources/v2/Table.java ## @@ -45,4 +44,9 @@

[GitHub] [spark] AmplabJenkins commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-472600371 Merged build finished. Test PASSed.

[GitHub] [spark] vanzin commented on a change in pull request #24072: [SPARK-27112] : Create a resource ordering between threads to resolve the deadlocks encountered …

2019-03-13 Thread GitBox
vanzin commented on a change in pull request #24072: [SPARK-27112] : Create a resource ordering between threads to resolve the deadlocks encountered … URL: https://github.com/apache/spark/pull/24072#discussion_r265325526 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #24072: [SPARK-27112] : Create a resource ordering between threads to resolve the deadlocks encountered …

2019-03-13 Thread GitBox
vanzin commented on a change in pull request #24072: [SPARK-27112] : Create a resource ordering between threads to resolve the deadlocks encountered … URL: https://github.com/apache/spark/pull/24072#discussion_r265329112 ## File path:

[GitHub] [spark] dilipbiswal commented on a change in pull request #24073: [SPARK-27134][SQL] array_distinct function does not work correctly with columns containing array of array

2019-03-13 Thread GitBox
dilipbiswal commented on a change in pull request #24073: [SPARK-27134][SQL] array_distinct function does not work correctly with columns containing array of array URL: https://github.com/apache/spark/pull/24073#discussion_r265329064 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

2019-03-13 Thread GitBox
dongjoon-hyun commented on issue #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage URL: https://github.com/apache/spark/pull/24018#issuecomment-472603015 I'm +1 for your quick fix to append `/`, too.

[GitHub] [spark] SparkQA commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

2019-03-13 Thread GitBox
SparkQA commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-472603892 **[Test build #103454 has

[GitHub] [spark] HeartSaVioR commented on issue #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters

2019-03-13 Thread GitBox
HeartSaVioR commented on issue #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters URL: https://github.com/apache/spark/pull/24016#issuecomment-472613156 Thanks all for reviewing and merging!

[GitHub] [spark] SparkQA commented on issue #24079: [SPARK-27145][Minor]Close store in the SQLAppStatusListenerSuite after test

2019-03-13 Thread GitBox
SparkQA commented on issue #24079: [SPARK-27145][Minor]Close store in the SQLAppStatusListenerSuite after test URL: https://github.com/apache/spark/pull/24079#issuecomment-472620940 **[Test build #103440 has

[GitHub] [spark] dongjoon-hyun closed pull request #24082: [SPARK-27123][SQL][FOLLOWUP] Use isRenaming check for limit too.

2019-03-13 Thread GitBox
dongjoon-hyun closed pull request #24082: [SPARK-27123][SQL][FOLLOWUP] Use isRenaming check for limit too. URL: https://github.com/apache/spark/pull/24082 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] SparkQA commented on issue #20433: [SPARK-23264][SQL] Make INTERVAL keyword optional in INTERVAL clauses when ANSI mode enabled

2019-03-13 Thread GitBox
SparkQA commented on issue #20433: [SPARK-23264][SQL] Make INTERVAL keyword optional in INTERVAL clauses when ANSI mode enabled URL: https://github.com/apache/spark/pull/20433#issuecomment-472623750 **[Test build #103445 has

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys

2019-03-13 Thread GitBox
dongjoon-hyun commented on a change in pull request #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys URL: https://github.com/apache/spark/pull/24081#discussion_r265350815 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys

2019-03-13 Thread GitBox
dongjoon-hyun commented on a change in pull request #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys URL: https://github.com/apache/spark/pull/24081#discussion_r265350961 ## File path:

[GitHub] [spark] vanzin closed pull request #24002: [SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2

2019-03-13 Thread GitBox
vanzin closed pull request #24002: [SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2 URL: https://github.com/apache/spark/pull/24002 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

2019-03-13 Thread GitBox
SparkQA commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-472626358 **[Test build #103457 has

[GitHub] [spark] SparkQA commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

2019-03-13 Thread GitBox
SparkQA commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472626334 **[Test build #103456 has

[GitHub] [spark] AmplabJenkins commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-472628443 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-472628454 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

2019-03-13 Thread GitBox
AmplabJenkins commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-472628576 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#issuecomment-472628455 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-472627951 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-472628576 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #23845: [SPARK-26941][YARN]Fix incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #23845: [SPARK-26941][YARN]Fix incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming URL: https://github.com/apache/spark/pull/23845#issuecomment-472628453 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins removed a comment on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#issuecomment-472628438 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-472628443 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

2019-03-13 Thread GitBox
AmplabJenkins removed a comment on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-472628571 Merged build finished. Test PASSed.

<    4   5   6   7   8   9   10   >