[GitHub] [spark] squito commented on a change in pull request #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

squito commented on a change in pull request #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#discussion_r262252185 ## File path: core/src/test/scala/org/apache/spark/deploy/ExternalShuffleServiceDbSuite.scala ## @@

[GitHub] [spark] squito commented on a change in pull request #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

squito commented on a change in pull request #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#discussion_r262246651 ## File path: core/src/main/scala/org/apache/spark/deploy/worker/Worker.scala ## @@ -467,6 +467,15 @@

[GitHub] [spark] srowen commented on issue #23938: [MINOR][DOCS] Clarify that Spark apps should mark Spark as a 'provided' dependency, not package it

srowen commented on issue #23938: [MINOR][DOCS] Clarify that Spark apps should mark Spark as a 'provided' dependency, not package it URL: https://github.com/apache/spark/pull/23938#issuecomment-469434966 Ah OK on further review @steveloughran , the docs here are saying to include the depe

[GitHub] [spark] AmplabJenkins removed a comment on issue #23962: [SPARK-26016][DOCS] Clarify that text DataSource read/write, and RDD methods that read text, always use UTF-8

AmplabJenkins removed a comment on issue #23962: [SPARK-26016][DOCS] Clarify that text DataSource read/write, and RDD methods that read text, always use UTF-8 URL: https://github.com/apache/spark/pull/23962#issuecomment-469434299 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins removed a comment on issue #23962: [SPARK-26016][DOCS] Clarify that text DataSource read/write, and RDD methods that read text, always use UTF-8

AmplabJenkins removed a comment on issue #23962: [SPARK-26016][DOCS] Clarify that text DataSource read/write, and RDD methods that read text, always use UTF-8 URL: https://github.com/apache/spark/pull/23962#issuecomment-469434295 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #23962: [SPARK-26016][DOCS] Clarify that text DataSource read/write, and RDD methods that read text, always use UTF-8

AmplabJenkins commented on issue #23962: [SPARK-26016][DOCS] Clarify that text DataSource read/write, and RDD methods that read text, always use UTF-8 URL: https://github.com/apache/spark/pull/23962#issuecomment-469434299 Test PASSed. Refer to this link for build results (access rights t

[GitHub] [spark] AmplabJenkins commented on issue #23962: [SPARK-26016][DOCS] Clarify that text DataSource read/write, and RDD methods that read text, always use UTF-8

AmplabJenkins commented on issue #23962: [SPARK-26016][DOCS] Clarify that text DataSource read/write, and RDD methods that read text, always use UTF-8 URL: https://github.com/apache/spark/pull/23962#issuecomment-469434295 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #23962: [SPARK-26016][DOCS] Clarify that text DataSource read/write, and RDD methods that read text, always use UTF-8

SparkQA removed a comment on issue #23962: [SPARK-26016][DOCS] Clarify that text DataSource read/write, and RDD methods that read text, always use UTF-8 URL: https://github.com/apache/spark/pull/23962#issuecomment-469326138 **[Test build #103003 has started](https://amplab.cs.berkeley.edu/

[GitHub] [spark] SparkQA commented on issue #23962: [SPARK-26016][DOCS] Clarify that text DataSource read/write, and RDD methods that read text, always use UTF-8

SparkQA commented on issue #23962: [SPARK-26016][DOCS] Clarify that text DataSource read/write, and RDD methods that read text, always use UTF-8 URL: https://github.com/apache/spark/pull/23962#issuecomment-469433638 **[Test build #103003 has finished](https://amplab.cs.berkeley.edu/jenkins

[GitHub] [spark] SparkQA commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

SparkQA commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469431338 **[Test build #103013 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestB

[GitHub] [spark] AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469430742 Test PASSed. Refer to this link for build results (access rights to CI server n

[GitHub] [spark] AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469430739 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469430742 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469430739 Merged build finished. Test PASSed. -

[GitHub] [spark] SparkQA commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

SparkQA commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469429038 **[Test build #103012 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestB

[GitHub] [spark] AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469428494 Test PASSed. Refer to this link for build results (access rights to CI server n

[GitHub] [spark] AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469428494 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469428487 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469428487 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469426345 Test FAILed. Refer to this link for build results (access rights to CI server n

[GitHub] [spark] vanzin closed pull request #23922: [SPARK-25689][FOLLOW-UP][CORE] Get proxy user's delegation tokens

vanzin closed pull request #23922: [SPARK-25689][FOLLOW-UP][CORE] Get proxy user's delegation tokens URL: https://github.com/apache/spark/pull/23922 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

SparkQA commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469426912 **[Test build #103011 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestB

[GitHub] [spark] AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469426340 Merged build finished. Test FAILed. -

[GitHub] [spark] AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469426340 Merged build finished. Test FAILed. -

[GitHub] [spark] AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469426345 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] vanzin commented on issue #23922: [SPARK-25689][FOLLOW-UP][CORE] Get proxy user's delegation tokens

vanzin commented on issue #23922: [SPARK-25689][FOLLOW-UP][CORE] Get proxy user's delegation tokens URL: https://github.com/apache/spark/pull/23922#issuecomment-469426338 Tested locally and it seems to be working. Merging to master. -

[GitHub] [spark] squito commented on issue #23711: [SPARK-26795][SHUFFLE]Retry remote fileSegmentManagedBuffer when creating inputStream failed during shuffle read phase#SPARK-26795

squito commented on issue #23711: [SPARK-26795][SHUFFLE]Retry remote fileSegmentManagedBuffer when creating inputStream failed during shuffle read phase#SPARK-26795 URL: https://github.com/apache/spark/pull/23711#issuecomment-469424005 @mehdibn that is not enough info to help out with your

[GitHub] [spark] steveloughran commented on issue #23938: [MINOR][DOCS] Clarify that Spark apps should mark Spark as a 'provided' dependency, not package it

steveloughran commented on issue #23938: [MINOR][DOCS] Clarify that Spark apps should mark Spark as a 'provided' dependency, not package it URL: https://github.com/apache/spark/pull/23938#issuecomment-469420938 sorry, yeah, spark. Even if the spark team doesn't redist those JARs, it

[GitHub] [spark] SparkQA commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

SparkQA commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469417907 **[Test build #103010 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestB

[GitHub] [spark] AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469417261 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469417250 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins removed a comment on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469417261 Test PASSed. Refer to this link for build results (access rights to CI server n

[GitHub] [spark] AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

AmplabJenkins commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469417250 Merged build finished. Test PASSed. -

[GitHub] [spark] shahidki31 commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

shahidki31 commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469417013 Jenkins, retest this please

[GitHub] [spark] shahidki31 commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

shahidki31 commented on issue #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#issuecomment-469416709 Thank you @vanzin for the review. -

[GitHub] [spark] shahidki31 commented on a change in pull request #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

shahidki31 commented on a change in pull request #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#discussion_r262236791 ## File path: sql/core/src/test/scala/org/apache/spark/sql/executi

[GitHub] [spark] shahidki31 commented on a change in pull request #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

shahidki31 commented on a change in pull request #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#discussion_r262236739 ## File path: sql/core/src/test/scala/org/apache/spark/sql/executi

[GitHub] [spark] shahidki31 commented on a change in pull request #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

shahidki31 commented on a change in pull request #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#discussion_r262236598 ## File path: sql/core/src/main/scala/org/apache/spark/sql/executi

[GitHub] [spark] AmplabJenkins removed a comment on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString

AmplabJenkins removed a comment on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString URL: https://github.com/apache/spark/pull/23936#issuecomment-469409929 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString

AmplabJenkins removed a comment on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString URL: https://github.com/apache/spark/pull/23936#issuecomment-469409934 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins commented on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString

AmplabJenkins commented on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString URL: https://github.com/apache/spark/pull/23936#issuecomment-469409934 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] SparkQA removed a comment on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString

SparkQA removed a comment on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString URL: https://github.com/apache/spark/pull/23936#issuecomment-469307735 **[Test build #4592 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4592/test

[GitHub] [spark] AmplabJenkins commented on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString

AmplabJenkins commented on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString URL: https://github.com/apache/spark/pull/23936#issuecomment-469409929 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] SparkQA commented on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString

SparkQA commented on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString URL: https://github.com/apache/spark/pull/23936#issuecomment-469409587 **[Test build #4592 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4592/testReport)

[GitHub] [spark] SparkQA removed a comment on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString

SparkQA removed a comment on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString URL: https://github.com/apache/spark/pull/23936#issuecomment-469308688 **[Test build #103000 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103000/tes

[GitHub] [spark] SparkQA commented on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString

SparkQA commented on issue #23936: [SPARK-27031][SQL] Avoid double formatting in timestampToString URL: https://github.com/apache/spark/pull/23936#issuecomment-469409321 **[Test build #103000 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103000/testReport

[GitHub] [spark] asfgit closed pull request #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics

asfgit closed pull request #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics URL: https://github.com/apache/spark/pull/22874 This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [spark] squito commented on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics

squito commented on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics URL: https://github.com/apache/spark/pull/22874#issuecomment-469408769 merged to master, thanks @LantaoJin -- sorry for the delay from me, was out last week ---

[GitHub] [spark] AmplabJenkins commented on issue #20974: [SPARK-23862][SQL] Spark ExpressionEncoder should support java enum type in scala

AmplabJenkins commented on issue #20974: [SPARK-23862][SQL] Spark ExpressionEncoder should support java enum type in scala URL: https://github.com/apache/spark/pull/20974#issuecomment-469408164 Can one of the admins verify this patch? ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #20974: [SPARK-23862][SQL] Spark ExpressionEncoder should support java enum type in scala

AmplabJenkins removed a comment on issue #20974: [SPARK-23862][SQL] Spark ExpressionEncoder should support java enum type in scala URL: https://github.com/apache/spark/pull/20974#issuecomment-440496431 Can one of the admins verify this patch? ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #23905: [SPARK-24669][SQL] Refresh table before drop database cascade

AmplabJenkins removed a comment on issue #23905: [SPARK-24669][SQL] Refresh table before drop database cascade URL: https://github.com/apache/spark/pull/23905#issuecomment-469407092 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23905: [SPARK-24669][SQL] Refresh table before drop database cascade

AmplabJenkins removed a comment on issue #23905: [SPARK-24669][SQL] Refresh table before drop database cascade URL: https://github.com/apache/spark/pull/23905#issuecomment-469407088 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #23905: [SPARK-24669][SQL] Refresh table before drop database cascade

AmplabJenkins commented on issue #23905: [SPARK-24669][SQL] Refresh table before drop database cascade URL: https://github.com/apache/spark/pull/23905#issuecomment-469407092 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] [spark] AmplabJenkins commented on issue #23905: [SPARK-24669][SQL] Refresh table before drop database cascade

AmplabJenkins commented on issue #23905: [SPARK-24669][SQL] Refresh table before drop database cascade URL: https://github.com/apache/spark/pull/23905#issuecomment-469407088 Merged build finished. Test PASSed. This is an auto

[GitHub] [spark] SparkQA removed a comment on issue #23905: [SPARK-24669][SQL] Refresh table before drop database cascade

SparkQA removed a comment on issue #23905: [SPARK-24669][SQL] Refresh table before drop database cascade URL: https://github.com/apache/spark/pull/23905#issuecomment-469308690 **[Test build #103001 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103001/testR

[GitHub] [spark] SparkQA commented on issue #23905: [SPARK-24669][SQL] Refresh table before drop database cascade

SparkQA commented on issue #23905: [SPARK-24669][SQL] Refresh table before drop database cascade URL: https://github.com/apache/spark/pull/23905#issuecomment-469406354 **[Test build #103001 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103001/testReport)*

[GitHub] [spark] dongjoon-hyun closed pull request #23542: [WIP] [SPARK-25603][SQL] Pushing Down Nested Field projections

dongjoon-hyun closed pull request #23542: [WIP] [SPARK-25603][SQL] Pushing Down Nested Field projections URL: https://github.com/apache/spark/pull/23542 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] dongjoon-hyun commented on issue #23542: [WIP] [SPARK-25603][SQL] Pushing Down Nested Field projections

dongjoon-hyun commented on issue #23542: [WIP] [SPARK-25603][SQL] Pushing Down Nested Field projections URL: https://github.com/apache/spark/pull/23542#issuecomment-469405929 I close this WIP PR in favor of #23964 . This is a

[GitHub] [spark] asfgit closed pull request #23616: [SPARK-26688][YARN] Provide configuration of initially blacklisted YARN nodes

asfgit closed pull request #23616: [SPARK-26688][YARN] Provide configuration of initially blacklisted YARN nodes URL: https://github.com/apache/spark/pull/23616 This is an automated message from the Apache Git Service. To re

[GitHub] [spark] squito commented on issue #23616: [SPARK-26688][YARN] Provide configuration of initially blacklisted YARN nodes

squito commented on issue #23616: [SPARK-26688][YARN] Provide configuration of initially blacklisted YARN nodes URL: https://github.com/apache/spark/pull/23616#issuecomment-469405130 merged to master This is an automated mess

[GitHub] [spark] dongjoon-hyun closed pull request #23924: [SPARK-26192][MESOS] Retrieve enableFetcherCache option from submission for driver URIs

dongjoon-hyun closed pull request #23924: [SPARK-26192][MESOS] Retrieve enableFetcherCache option from submission for driver URIs URL: https://github.com/apache/spark/pull/23924 This is an automated message from the Apache G

[GitHub] [spark] AmplabJenkins removed a comment on issue #23838: [SPARK-26928][CORE] Add driver CPU Time to the metrics system

AmplabJenkins removed a comment on issue #23838: [SPARK-26928][CORE] Add driver CPU Time to the metrics system URL: https://github.com/apache/spark/pull/23838#issuecomment-469395657 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #23838: [SPARK-26928][CORE] Add driver CPU Time to the metrics system

AmplabJenkins removed a comment on issue #23838: [SPARK-26928][CORE] Add driver CPU Time to the metrics system URL: https://github.com/apache/spark/pull/23838#issuecomment-469395669 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins commented on issue #23838: [SPARK-26928][CORE] Add driver CPU Time to the metrics system

AmplabJenkins commented on issue #23838: [SPARK-26928][CORE] Add driver CPU Time to the metrics system URL: https://github.com/apache/spark/pull/23838#issuecomment-469395657 Merged build finished. Test PASSed. This is an auto

[GitHub] [spark] AmplabJenkins commented on issue #23838: [SPARK-26928][CORE] Add driver CPU Time to the metrics system

AmplabJenkins commented on issue #23838: [SPARK-26928][CORE] Add driver CPU Time to the metrics system URL: https://github.com/apache/spark/pull/23838#issuecomment-469395669 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

dongjoon-hyun commented on a change in pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#discussion_r262214266 ## File path: sql/core/benchmarks/NestedSchemaPruningBenchmark-results.txt

[GitHub] [spark] SparkQA commented on issue #23838: [SPARK-26928][CORE] Add driver CPU Time to the metrics system

SparkQA commented on issue #23838: [SPARK-26928][CORE] Add driver CPU Time to the metrics system URL: https://github.com/apache/spark/pull/23838#issuecomment-469393819 **[Test build #103009 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103009/testReport)**

[GitHub] [spark] SparkQA commented on issue #23920: [SPARK-27012] Storage tab shows rdd details even after executor ended

SparkQA commented on issue #23920: [SPARK-27012] Storage tab shows rdd details even after executor ended URL: https://github.com/apache/spark/pull/23920#issuecomment-469393764 **[Test build #103008 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103008/testR

[GitHub] [spark] AmplabJenkins removed a comment on issue #23920: [SPARK-27012] Storage tab shows rdd details even after executor ended

AmplabJenkins removed a comment on issue #23920: [SPARK-27012] Storage tab shows rdd details even after executor ended URL: https://github.com/apache/spark/pull/23920#issuecomment-469393132 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins removed a comment on issue #23920: [SPARK-27012] Storage tab shows rdd details even after executor ended

AmplabJenkins removed a comment on issue #23920: [SPARK-27012] Storage tab shows rdd details even after executor ended URL: https://github.com/apache/spark/pull/23920#issuecomment-469393127 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23920: [SPARK-27012] Storage tab shows rdd details even after executor ended

AmplabJenkins commented on issue #23920: [SPARK-27012] Storage tab shows rdd details even after executor ended URL: https://github.com/apache/spark/pull/23920#issuecomment-469393132 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins commented on issue #23920: [SPARK-27012] Storage tab shows rdd details even after executor ended

AmplabJenkins commented on issue #23920: [SPARK-27012] Storage tab shows rdd details even after executor ended URL: https://github.com/apache/spark/pull/23920#issuecomment-469393127 Merged build finished. Test PASSed. This is

[GitHub] [spark] pgandhi999 commented on a change in pull request #23778: [SPARK-24935][SQL] : Problem with Executing Hive UDF's from Spark 2.2 Onwards

pgandhi999 commented on a change in pull request #23778: [SPARK-24935][SQL] : Problem with Executing Hive UDF's from Spark 2.2 Onwards URL: https://github.com/apache/spark/pull/23778#discussion_r262212931 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expre

[GitHub] [spark] LucaCanali commented on a change in pull request #23838: [SPARK-26928][CORE] Add driver CPU Time to the metrics system

LucaCanali commented on a change in pull request #23838: [SPARK-26928][CORE] Add driver CPU Time to the metrics system URL: https://github.com/apache/spark/pull/23838#discussion_r262212864 ## File path: core/src/main/scala/org/apache/spark/metrics/source/JVMCPU.scala ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #23920: [SPARK-27012] Storage tab shows rdd details even after executor ended

AmplabJenkins removed a comment on issue #23920: [SPARK-27012] Storage tab shows rdd details even after executor ended URL: https://github.com/apache/spark/pull/23920#issuecomment-468269612 Can one of the admins verify this patch? ---

[GitHub] [spark] vanzin commented on issue #23920: [SPARK-27012] Storage tab shows rdd details even after executor ended

vanzin commented on issue #23920: [SPARK-27012] Storage tab shows rdd details even after executor ended URL: https://github.com/apache/spark/pull/23920#issuecomment-469391645 ok to test This is an automated message from the A

[GitHub] [spark] vanzin closed pull request #21213: [SPARK-24120] Show `Jobs` page when `jobId` is missing

vanzin closed pull request #21213: [SPARK-24120] Show `Jobs` page when `jobId` is missing URL: https://github.com/apache/spark/pull/21213 This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [spark] vanzin commented on issue #21213: [SPARK-24120] Show `Jobs` page when `jobId` is missing

vanzin commented on issue #21213: [SPARK-24120] Show `Jobs` page when `jobId` is missing URL: https://github.com/apache/spark/pull/21213#issuecomment-469389692 Closing due to inactivity. You can reopen the PR by updating your branch.

[GitHub] [spark] vanzin commented on issue #22578: [SPARK-25564][CORE] Add output bytes metrics for each Executor

vanzin commented on issue #22578: [SPARK-25564][CORE] Add output bytes metrics for each Executor URL: https://github.com/apache/spark/pull/22578#issuecomment-469389251 Closing due to inactivity. If you want, you can update your branch to reopen the PR.

[GitHub] [spark] vanzin closed pull request #22578: [SPARK-25564][CORE] Add output bytes metrics for each Executor

vanzin closed pull request #22578: [SPARK-25564][CORE] Add output bytes metrics for each Executor URL: https://github.com/apache/spark/pull/22578 This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [spark] vanzin commented on a change in pull request #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

vanzin commented on a change in pull request #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#discussion_r262207103 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/u

[GitHub] [spark] vanzin commented on a change in pull request #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

vanzin commented on a change in pull request #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#discussion_r262207586 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/u

[GitHub] [spark] vanzin commented on a change in pull request #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore

vanzin commented on a change in pull request #23939: [SPARK-27019] [webUI]onJobStart happens after onExecutionEnd shouldn't overwrite kvstore URL: https://github.com/apache/spark/pull/23939#discussion_r262207859 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/u

[GitHub] [spark] aokolnychyi commented on issue #23171: [SPARK-26205][SQL] Optimize InSet Expression for bytes, shorts, ints, dates

aokolnychyi commented on issue #23171: [SPARK-26205][SQL] Optimize InSet Expression for bytes, shorts, ints, dates URL: https://github.com/apache/spark/pull/23171#issuecomment-469388716 @dongjoon-hyun thanks for running the benchmarks! It's great to verify the performance benefit on one mo

[GitHub] [spark] AmplabJenkins removed a comment on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

AmplabJenkins removed a comment on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#issuecomment-469385597 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

AmplabJenkins removed a comment on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#issuecomment-469385589 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

SparkQA commented on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#issuecomment-469386254 **[Test build #103007 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103

[GitHub] [spark] AmplabJenkins commented on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

AmplabJenkins commented on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#issuecomment-469385597 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] AmplabJenkins commented on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

AmplabJenkins commented on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#issuecomment-469385589 Merged build finished. Test PASSed. ---

[GitHub] [spark] venkata91 commented on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats

venkata91 commented on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats URL: https://github.com/apache/spark/pull/23803#issuecomment-469384497 @gatorsmile @cloud-fan Can one of you please take a look at this PR? -

[GitHub] [spark] dongjoon-hyun opened a new pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

dongjoon-hyun opened a new pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## H

[GitHub] [spark] SparkQA commented on issue #23171: [SPARK-26205][SQL] Optimize InSet Expression for bytes, shorts, ints, dates

SparkQA commented on issue #23171: [SPARK-26205][SQL] Optimize InSet Expression for bytes, shorts, ints, dates URL: https://github.com/apache/spark/pull/23171#issuecomment-469383730 **[Test build #103006 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103006

[GitHub] [spark] AmplabJenkins removed a comment on issue #23171: [SPARK-26205][SQL] Optimize InSet Expression for bytes, shorts, ints, dates

AmplabJenkins removed a comment on issue #23171: [SPARK-26205][SQL] Optimize InSet Expression for bytes, shorts, ints, dates URL: https://github.com/apache/spark/pull/23171#issuecomment-469383016 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #23171: [SPARK-26205][SQL] Optimize InSet Expression for bytes, shorts, ints, dates

AmplabJenkins commented on issue #23171: [SPARK-26205][SQL] Optimize InSet Expression for bytes, shorts, ints, dates URL: https://github.com/apache/spark/pull/23171#issuecomment-469383016 Merged build finished. Test PASSed. T

[GitHub] [spark] AmplabJenkins removed a comment on issue #23924: [SPARK-26192][MESOS] Retrieve enableFetcherCache option from submission for driver URIs

AmplabJenkins removed a comment on issue #23924: [SPARK-26192][MESOS] Retrieve enableFetcherCache option from submission for driver URIs URL: https://github.com/apache/spark/pull/23924#issuecomment-469382451 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #23171: [SPARK-26205][SQL] Optimize InSet Expression for bytes, shorts, ints, dates

AmplabJenkins removed a comment on issue #23171: [SPARK-26205][SQL] Optimize InSet Expression for bytes, shorts, ints, dates URL: https://github.com/apache/spark/pull/23171#issuecomment-469383023 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23171: [SPARK-26205][SQL] Optimize InSet Expression for bytes, shorts, ints, dates

AmplabJenkins commented on issue #23171: [SPARK-26205][SQL] Optimize InSet Expression for bytes, shorts, ints, dates URL: https://github.com/apache/spark/pull/23171#issuecomment-469383023 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins removed a comment on issue #23924: [SPARK-26192][MESOS] Retrieve enableFetcherCache option from submission for driver URIs

AmplabJenkins removed a comment on issue #23924: [SPARK-26192][MESOS] Retrieve enableFetcherCache option from submission for driver URIs URL: https://github.com/apache/spark/pull/23924#issuecomment-469382460 Test PASSed. Refer to this link for build results (access rights to CI server ne

[GitHub] [spark] AmplabJenkins commented on issue #23924: [SPARK-26192][MESOS] Retrieve enableFetcherCache option from submission for driver URIs

AmplabJenkins commented on issue #23924: [SPARK-26192][MESOS] Retrieve enableFetcherCache option from submission for driver URIs URL: https://github.com/apache/spark/pull/23924#issuecomment-469382451 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #23924: [SPARK-26192][MESOS] Retrieve enableFetcherCache option from submission for driver URIs

AmplabJenkins commented on issue #23924: [SPARK-26192][MESOS] Retrieve enableFetcherCache option from submission for driver URIs URL: https://github.com/apache/spark/pull/23924#issuecomment-469382460 Test PASSed. Refer to this link for build results (access rights to CI server needed):

<    1   2   3   4   5   6   7   8   9   10   >