[GitHub] [spark] holdenk commented on pull request #30492: [SPARK-33545][CORE] Support Fallback Storage during Worker decommission

holdenk commented on pull request #30492: URL: https://github.com/apache/spark/pull/30492#issuecomment-733903026 Hi @dongjoon-hyun, I'm taking this week away from open source to take my puppy to go see snow for the first time. I'll do a review on Monday. Thanks for understanding :)

[GitHub] [spark] dongjoon-hyun commented on pull request #30504: [SPARK-33544][SQL] Optimizer should not insert filter when when explode with CreateArray/CreateMap

dongjoon-hyun commented on pull request #30504: URL: https://github.com/apache/spark/pull/30504#issuecomment-733903138 Also, cc @maropu , too. This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [spark] dongjoon-hyun commented on pull request #30492: [SPARK-33545][CORE] Support Fallback Storage during Worker decommission

dongjoon-hyun commented on pull request #30492: URL: https://github.com/apache/spark/pull/30492#issuecomment-733905003 Thank you, @holdenk . Sorry for pinging you on the holiday season. This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #30398: [SPARK-33452][SQL] Support v2 SHOW PARTITIONS

SparkQA commented on pull request #30398: URL: https://github.com/apache/spark/pull/30398#issuecomment-733905430 **[Test build #131783 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131783/testReport)** for PR 30398 at commit [`a4acf40`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

SparkQA commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733905643 **[Test build #131799 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131799/testReport)** for PR 30403 at commit [`3c4a0cf`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

AmplabJenkins commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733905856 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] dongjoon-hyun commented on pull request #30492: [SPARK-33545][CORE] Support Fallback Storage during Worker decommission

dongjoon-hyun commented on pull request #30492: URL: https://github.com/apache/spark/pull/30492#issuecomment-733906102 BTW, cc @dbtsai , too. This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [spark] AmplabJenkins commented on pull request #30398: [SPARK-33452][SQL] Support v2 SHOW PARTITIONS

AmplabJenkins commented on pull request #30398: URL: https://github.com/apache/spark/pull/30398#issuecomment-733906211 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #30398: [SPARK-33452][SQL] Support v2 SHOW PARTITIONS

SparkQA removed a comment on pull request #30398: URL: https://github.com/apache/spark/pull/30398#issuecomment-733763807 **[Test build #131783 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131783/testReport)** for PR 30398 at commit [`a4acf40`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

SparkQA removed a comment on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-733899176 **[Test build #131802 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131802/testReport)** for PR 30475 at commit [`68ee277`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #29893: [SPARK-32976][SQL]Support column list in INSERT statement

SparkQA removed a comment on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-733868465 **[Test build #131796 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131796/testReport)** for PR 29893 at commit [`86d0032`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

SparkQA removed a comment on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733873132 **[Test build #131799 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131799/testReport)** for PR 30403 at commit [`3c4a0cf`](https://gi

[GitHub] [spark] cloud-fan commented on a change in pull request #30504: [SPARK-33544][SQL] Optimizer should not insert filter when when explode with CreateArray/CreateMap

cloud-fan commented on a change in pull request #30504: URL: https://github.com/apache/spark/pull/30504#discussion_r530602009 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -873,24 +873,30 @@ object InferFiltersFromGener

[GitHub] [spark] cloud-fan commented on a change in pull request #30504: [SPARK-33544][SQL] Optimizer should not insert filter when when explode with CreateArray/CreateMap

cloud-fan commented on a change in pull request #30504: URL: https://github.com/apache/spark/pull/30504#discussion_r530603409 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -873,24 +873,30 @@ object InferFiltersFromGener

[GitHub] [spark] Victsm commented on a change in pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

Victsm commented on a change in pull request #30312: URL: https://github.com/apache/spark/pull/30312#discussion_r530605991 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1992,4 +1992,32 @@ package object config { .version("3.1.0")

[GitHub] [spark] imback82 commented on a change in pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

imback82 commented on a change in pull request #30403: URL: https://github.com/apache/spark/pull/30403#discussion_r530606256 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/CachedTableSuite.scala ## @@ -421,7 +421,7 @@ class CachedTableSuite extends QueryTest w

[GitHub] [spark] SparkQA commented on pull request #30500: [SPARK-33562][UI] Improve the style of the checkbox in executor page

SparkQA commented on pull request #30500: URL: https://github.com/apache/spark/pull/30500#issuecomment-733913452 **[Test build #131788 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131788/testReport)** for PR 30500 at commit [`8f4700e`](https://github.co

[GitHub] [spark] Victsm commented on a change in pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

Victsm commented on a change in pull request #30312: URL: https://github.com/apache/spark/pull/30312#discussion_r530605991 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1992,4 +1992,32 @@ package object config { .version("3.1.0")

[GitHub] [spark] SparkQA removed a comment on pull request #30500: [SPARK-33562][UI] Improve the style of the checkbox in executor page

SparkQA removed a comment on pull request #30500: URL: https://github.com/apache/spark/pull/30500#issuecomment-733835284 **[Test build #131788 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131788/testReport)** for PR 30500 at commit [`8f4700e`](https://gi

[GitHub] [spark] cloud-fan commented on a change in pull request #30504: [SPARK-33544][SQL] Optimizer should not insert filter when explode with CreateArray/CreateMap

cloud-fan commented on a change in pull request #30504: URL: https://github.com/apache/spark/pull/30504#discussion_r530606734 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -873,24 +873,30 @@ object InferFiltersFromGener

[GitHub] [spark] imback82 commented on a change in pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

imback82 commented on a change in pull request #30403: URL: https://github.com/apache/spark/pull/30403#discussion_r530606256 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/CachedTableSuite.scala ## @@ -421,7 +421,7 @@ class CachedTableSuite extends QueryTest w

[GitHub] [spark] imback82 commented on a change in pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

imback82 commented on a change in pull request #30403: URL: https://github.com/apache/spark/pull/30403#discussion_r530571035 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/CachedTableSuite.scala ## @@ -421,7 +421,7 @@ class CachedTableSuite extends QueryTest w

[GitHub] [spark] cloud-fan commented on a change in pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

cloud-fan commented on a change in pull request #30403: URL: https://github.com/apache/spark/pull/30403#discussion_r530608911 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/CachedTableSuite.scala ## @@ -421,7 +421,7 @@ class CachedTableSuite extends QueryTest

[GitHub] [spark] Victsm removed a comment on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

Victsm removed a comment on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733866872 The javadoc issues leading to the build failures are not related to files changed in this patch. ``` [error] /home/runner/work/spark/spark/mllib/target/java/org/apa

[GitHub] [spark] SparkQA commented on pull request #30430: [SPARK-33503][SQL] Refactor SortOrder class to allow multiple childrens

SparkQA commented on pull request #30430: URL: https://github.com/apache/spark/pull/30430#issuecomment-733916550 **[Test build #131785 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131785/testReport)** for PR 30430 at commit [`1c38e97`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30430: [SPARK-33503][SQL] Refactor SortOrder class to allow multiple childrens

SparkQA removed a comment on pull request #30430: URL: https://github.com/apache/spark/pull/30430#issuecomment-733801134 **[Test build #131785 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131785/testReport)** for PR 30430 at commit [`1c38e97`](https://gi

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

dongjoon-hyun commented on a change in pull request #30480: URL: https://github.com/apache/spark/pull/30480#discussion_r530611612 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ## @@ -1011,4 +1333,47 @@ private[spark] object MapOutputTracker extends L

[GitHub] [spark] SparkQA commented on pull request #30501: [SPARK-33563][PYTHON][R][SQL] Expose inverse hyperbolic trig functions in PySpark and SparkR

SparkQA commented on pull request #30501: URL: https://github.com/apache/spark/pull/30501#issuecomment-733917792 **[Test build #131801 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131801/testReport)** for PR 30501 at commit [`6165ba3`](https://github.co

[GitHub] [spark] dongjoon-hyun commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

dongjoon-hyun commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733918113 Retest this please This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [spark] SparkQA removed a comment on pull request #30501: [SPARK-33563][PYTHON][R][SQL] Expose inverse hyperbolic trig functions in PySpark and SparkR

SparkQA removed a comment on pull request #30501: URL: https://github.com/apache/spark/pull/30501#issuecomment-733899204 **[Test build #131801 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131801/testReport)** for PR 30501 at commit [`6165ba3`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

SparkQA commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733918563 **[Test build #131804 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131804/testReport)** for PR 30403 at commit [`7f5a0b2`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

SparkQA removed a comment on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733899162 **[Test build #131804 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131804/testReport)** for PR 30403 at commit [`7f5a0b2`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30503: [SPARK-26645][PYTHON][2.4] Support decimals with negative scale when parsing datatype

SparkQA commented on pull request #30503: URL: https://github.com/apache/spark/pull/30503#issuecomment-733919389 **[Test build #131800 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131800/testReport)** for PR 30503 at commit [`1f1592e`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30503: [SPARK-26645][PYTHON][2.4] Support decimals with negative scale when parsing datatype

SparkQA removed a comment on pull request #30503: URL: https://github.com/apache/spark/pull/30503#issuecomment-733899149 **[Test build #131800 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131800/testReport)** for PR 30503 at commit [`1f1592e`](https://gi

[GitHub] [spark] otterc commented on a change in pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

otterc commented on a change in pull request #30312: URL: https://github.com/apache/spark/pull/30312#discussion_r530614146 ## File path: core/src/main/scala/org/apache/spark/shuffle/ShuffleBlockPusher.scala ## @@ -0,0 +1,462 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [spark] tgravescs commented on a change in pull request #30504: [SPARK-33544][SQL] Optimizer should not insert filter when explode with CreateArray/CreateMap

tgravescs commented on a change in pull request #30504: URL: https://github.com/apache/spark/pull/30504#discussion_r530614422 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -873,24 +873,30 @@ object InferFiltersFromGener

[GitHub] [spark] tgravescs commented on a change in pull request #30504: [SPARK-33544][SQL] Optimizer should not insert filter when explode with CreateArray/CreateMap

tgravescs commented on a change in pull request #30504: URL: https://github.com/apache/spark/pull/30504#discussion_r530614422 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -873,24 +873,30 @@ object InferFiltersFromGener

[GitHub] [spark] dongjoon-hyun commented on pull request #30503: [SPARK-26645][PYTHON][2.4] Support decimals with negative scale when parsing datatype

dongjoon-hyun commented on pull request #30503: URL: https://github.com/apache/spark/pull/30503#issuecomment-733921583 There was a community request at SPARK-33445 and SPARK-26645 for backporting this to `branch-2.4`. Since `Apache Spark 2.4.x` is LTS, it would be great if we can have th

[GitHub] [spark] AmplabJenkins commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

AmplabJenkins commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733922313 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30430: [SPARK-33503][SQL] Refactor SortOrder class to allow multiple childrens

AmplabJenkins commented on pull request #30430: URL: https://github.com/apache/spark/pull/30430#issuecomment-733922317 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30501: [SPARK-33563][PYTHON][R][SQL] Expose inverse hyperbolic trig functions in PySpark and SparkR

AmplabJenkins commented on pull request #30501: URL: https://github.com/apache/spark/pull/30501#issuecomment-733922320 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733922315 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30503: [SPARK-26645][PYTHON][2.4] Support decimals with negative scale when parsing datatype

AmplabJenkins commented on pull request #30503: URL: https://github.com/apache/spark/pull/30503#issuecomment-733922311 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30500: [SPARK-33562][UI] Improve the style of the checkbox in executor page

AmplabJenkins commented on pull request #30500: URL: https://github.com/apache/spark/pull/30500#issuecomment-733922318 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

AmplabJenkins commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733922316 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30503: [SPARK-26645][PYTHON][2.4] Support decimals with negative scale when parsing datatype

AmplabJenkins removed a comment on pull request #30503: URL: https://github.com/apache/spark/pull/30503#issuecomment-733922311 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30430: [SPARK-33503][SQL] Refactor SortOrder class to allow multiple childrens

AmplabJenkins removed a comment on pull request #30430: URL: https://github.com/apache/spark/pull/30430#issuecomment-733922317 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

AmplabJenkins removed a comment on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733922316 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

SparkQA commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733922558 **[Test build #131807 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131807/testReport)** for PR 30480 at commit [`f18fc47`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins removed a comment on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733922315 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30500: [SPARK-33562][UI] Improve the style of the checkbox in executor page

AmplabJenkins removed a comment on pull request #30500: URL: https://github.com/apache/spark/pull/30500#issuecomment-733922318 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30501: [SPARK-33563][PYTHON][R][SQL] Expose inverse hyperbolic trig functions in PySpark and SparkR

AmplabJenkins removed a comment on pull request #30501: URL: https://github.com/apache/spark/pull/30501#issuecomment-733922320 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

AmplabJenkins removed a comment on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733874890 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

SparkQA commented on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-733922687 **[Test build #131808 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131808/testReport)** for PR 30475 at commit [`147c654`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

AmplabJenkins removed a comment on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-733901113 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

SparkQA commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-733922867 **[Test build #131809 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131809/testReport)** for PR 30312 at commit [`40fbafc`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29066: [SPARK-23889][SQL] DataSourceV2: required sorting and clustering for writes

AmplabJenkins commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-733924096 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29066: [SPARK-23889][SQL] DataSourceV2: required sorting and clustering for writes

AmplabJenkins removed a comment on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-733924096 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30494: [SPARK-33551][SQL] Do not use custom shuffle reader for repartition

SparkQA commented on pull request #30494: URL: https://github.com/apache/spark/pull/30494#issuecomment-733927636 **[Test build #131810 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131810/testReport)** for PR 30494 at commit [`97f58f5`](https://github.com

[GitHub] [spark] viirya opened a new pull request #30505: [SPARK-33523][SQL][TEST][FOLLOWUP] Fix benchmark case name in SubExprEliminationBenchmark

viirya opened a new pull request #30505: URL: https://github.com/apache/spark/pull/30505 ### What changes were proposed in this pull request? Fix the wrong benchmark case name. ### Why are the changes needed? The last commit to refactor the benchmark code

[GitHub] [spark] SparkQA commented on pull request #30505: [SPARK-33523][SQL][TEST][FOLLOWUP] Fix benchmark case name in SubExprEliminationBenchmark

SparkQA commented on pull request #30505: URL: https://github.com/apache/spark/pull/30505#issuecomment-733929360 **[Test build #131811 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131811/testReport)** for PR 30505 at commit [`99658ca`](https://github.com

[GitHub] [spark] viirya commented on a change in pull request #30504: [SPARK-33544][SQL] Optimizer should not insert filter when explode with CreateArray/CreateMap

viirya commented on a change in pull request #30504: URL: https://github.com/apache/spark/pull/30504#discussion_r530608975 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala ## @@ -30,6 +30,13 @@ import org.apache.spark

[GitHub] [spark] dongjoon-hyun commented on pull request #29843: [SPARK-33212][BUILD] Move to shaded clients for Hadoop 3.x profile

dongjoon-hyun commented on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-733932857 Hi, All. Sadly, I noticed that this breaks `master` branch like the following. This seems to be a known issue, [HADOOP-16080](https://issues.apache.org/jira/browse/

[GitHub] [spark] dongjoon-hyun closed pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

dongjoon-hyun closed pull request #30478: URL: https://github.com/apache/spark/pull/30478 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

SparkQA commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733941137 **[Test build #131786 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131786/testReport)** for PR 30412 at commit [`8789494`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

SparkQA removed a comment on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733811335 **[Test build #131786 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131786/testReport)** for PR 30412 at commit [`8789494`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

SparkQA commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-733942863 **[Test build #131795 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131795/testReport)** for PR 30312 at commit [`faa55f3`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

SparkQA removed a comment on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-733868083 **[Test build #131795 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131795/testReport)** for PR 30312 at commit [`faa55f3`](https://gi

[GitHub] [spark] sunchao commented on pull request #29843: [SPARK-33212][BUILD] Move to shaded clients for Hadoop 3.x profile

sunchao commented on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-733943432 Thanks @dongjoon-hyun for reporting. Do you know why this was not revealed in the previous CI runs? I'll take a look to see if there is any workaround from Spark side. Also wond

[GitHub] [spark] AmplabJenkins commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

AmplabJenkins commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-733945198 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #29893: [SPARK-32976][SQL]Support column list in INSERT statement

AmplabJenkins commented on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-733945204 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

AmplabJenkins commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733945203 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

AmplabJenkins removed a comment on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-733945198 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

AmplabJenkins removed a comment on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733945195 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29893: [SPARK-32976][SQL]Support column list in INSERT statement

AmplabJenkins removed a comment on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-733899415 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30502: [SPARK-31257][SPARK-33561][SQL][FOLLOWUP] Fix Scala 2.13 compilation

SparkQA commented on pull request #30502: URL: https://github.com/apache/spark/pull/30502#issuecomment-733945797 **[Test build #131790 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131790/testReport)** for PR 30502 at commit [`ecd4c93`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30502: [SPARK-31257][SPARK-33561][SQL][FOLLOWUP] Fix Scala 2.13 compilation

SparkQA removed a comment on pull request #30502: URL: https://github.com/apache/spark/pull/30502#issuecomment-733840127 **[Test build #131790 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131790/testReport)** for PR 30502 at commit [`ecd4c93`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #30502: [SPARK-31257][SPARK-33561][SQL][FOLLOWUP] Fix Scala 2.13 compilation

AmplabJenkins commented on pull request #30502: URL: https://github.com/apache/spark/pull/30502#issuecomment-733946528 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30502: [SPARK-31257][SPARK-33561][SQL][FOLLOWUP] Fix Scala 2.13 compilation

AmplabJenkins removed a comment on pull request #30502: URL: https://github.com/apache/spark/pull/30502#issuecomment-733946528 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30398: [SPARK-33452][SQL] Support v2 SHOW PARTITIONS

AmplabJenkins commented on pull request #30398: URL: https://github.com/apache/spark/pull/30398#issuecomment-733953082 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

SparkQA commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733954524 **[Test build #131803 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131803/testReport)** for PR 30412 at commit [`9850d38`](https://github.co

[GitHub] [spark] imback82 commented on a change in pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

imback82 commented on a change in pull request #30403: URL: https://github.com/apache/spark/pull/30403#discussion_r530652131 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/CachedTableSuite.scala ## @@ -421,7 +421,7 @@ class CachedTableSuite extends QueryTest w

[GitHub] [spark] SparkQA removed a comment on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

SparkQA removed a comment on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733899128 **[Test build #131803 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131803/testReport)** for PR 30412 at commit [`9850d38`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30494: [SPARK-33551][SQL] Do not use custom shuffle reader for repartition

SparkQA commented on pull request #30494: URL: https://github.com/apache/spark/pull/30494#issuecomment-733955659 **[Test build #131789 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131789/testReport)** for PR 30494 at commit [`366f703`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30494: [SPARK-33551][SQL] Do not use custom shuffle reader for repartition

SparkQA removed a comment on pull request #30494: URL: https://github.com/apache/spark/pull/30494#issuecomment-733835324 **[Test build #131789 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131789/testReport)** for PR 30494 at commit [`366f703`](https://gi

[GitHub] [spark] ron8hu commented on pull request #28036: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

ron8hu commented on pull request #28036: URL: https://github.com/apache/spark/pull/28036#issuecomment-733956792 cc @AngersZh There has been no activity on this PR since May 6th. Can you advise me what caused this PR to be put on hold? I will be happy to help. At LinkedIn, we have an

[GitHub] [spark] shaneknapp opened a new pull request #30506: [SPARK-33565][BUILD][PYTHON] remove python3.8 and fix breakage

shaneknapp opened a new pull request #30506: URL: https://github.com/apache/spark/pull/30506 ### What changes were proposed in this pull request? remove python 3.8 from python/run-tests.py and stop build breaks ### Why are the changes needed? the python tests are run

[GitHub] [spark] shaneknapp opened a new pull request #30507: [PYTHON][BUILD][3.0] Remove py38 spark3

shaneknapp opened a new pull request #30507: URL: https://github.com/apache/spark/pull/30507 ### What changes were proposed in this pull request? remove python 3.8 from python/run-tests.py and stop build breaks ### Why are the changes needed? the python tests are run

[GitHub] [spark] shaneknapp commented on pull request #30507: [SPARK-33565][PYTHON][BUILD][3.0] Remove py38 spark3

shaneknapp commented on pull request #30507: URL: https://github.com/apache/spark/pull/30507#issuecomment-733964226 oh hmm, i've apparently forgotten how to git with release branches. off to run an errand and i'll put one together for 3.0 later today.

[GitHub] [spark] shaneknapp closed pull request #30507: [SPARK-33565][PYTHON][BUILD][3.0] Remove py38 spark3

shaneknapp closed pull request #30507: URL: https://github.com/apache/spark/pull/30507 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] rdblue commented on a change in pull request #29066: [SPARK-23889][SQL] DataSourceV2: required sorting and clustering for writes

rdblue commented on a change in pull request #29066: URL: https://github.com/apache/spark/pull/29066#discussion_r530663744 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -189,6 +189,13 @@ abstract class Optimizer(catalog

[GitHub] [spark] SparkQA commented on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

SparkQA commented on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-733964777 **[Test build #131808 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131808/testReport)** for PR 30475 at commit [`147c654`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

SparkQA removed a comment on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-733922687 **[Test build #131808 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131808/testReport)** for PR 30475 at commit [`147c654`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

SparkQA commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733966480 **[Test build #131807 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131807/testReport)** for PR 30480 at commit [`f18fc47`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

AmplabJenkins commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-733966635 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

AmplabJenkins commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733966637 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30501: [SPARK-33563][PYTHON][R][SQL] Expose inverse hyperbolic trig functions in PySpark and SparkR

AmplabJenkins commented on pull request #30501: URL: https://github.com/apache/spark/pull/30501#issuecomment-733966634 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

AmplabJenkins commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733966628 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30494: [SPARK-33551][SQL] Do not use custom shuffle reader for repartition

AmplabJenkins commented on pull request #30494: URL: https://github.com/apache/spark/pull/30494#issuecomment-733966636 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30503: [SPARK-26645][PYTHON][2.4] Support decimals with negative scale when parsing datatype

AmplabJenkins commented on pull request #30503: URL: https://github.com/apache/spark/pull/30503#issuecomment-733966631 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

<    1   2   3   4   5   6   7   8   9   >