[jira] [Assigned] (SPARK-37223) Fix unit test check in JoinHintSuite

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37223: Assignee: (was: Apache Spark) > Fix unit test check in JoinHintSuite >

[jira] [Assigned] (SPARK-37223) Fix unit test check in JoinHintSuite

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37223: Assignee: Apache Spark > Fix unit test check in JoinHintSuite >

[jira] [Commented] (SPARK-37223) Fix unit test check in JoinHintSuite

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439609#comment-17439609 ] Apache Spark commented on SPARK-37223: -- User 'c21' has created a pull request for this issue:

[jira] [Commented] (SPARK-37223) Fix unit test check in JoinHintSuite

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439608#comment-17439608 ] Apache Spark commented on SPARK-37223: -- User 'c21' has created a pull request for this issue:

[jira] [Updated] (SPARK-37223) Fix unit test check in JoinHintSuite

2021-11-05 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-37223: - Issue Type: Improvement (was: Bug) > Fix unit test check in JoinHintSuite >

[jira] [Updated] (SPARK-37223) Fix unit test check in JoinHintSuite

2021-11-05 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-37223: - Issue Type: Test (was: Improvement) > Fix unit test check in JoinHintSuite >

[jira] [Created] (SPARK-37223) Fix unit test check in JoinHintSuite

2021-11-05 Thread Cheng Su (Jira)
Cheng Su created SPARK-37223: Summary: Fix unit test check in JoinHintSuite Key: SPARK-37223 URL: https://issues.apache.org/jira/browse/SPARK-37223 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-33574) Improve locality for push-based shuffle especially for join like operations

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33574: Assignee: (was: Apache Spark) > Improve locality for push-based shuffle especially

[jira] [Assigned] (SPARK-33574) Improve locality for push-based shuffle especially for join like operations

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33574: Assignee: Apache Spark > Improve locality for push-based shuffle especially for join

[jira] [Commented] (SPARK-33574) Improve locality for push-based shuffle especially for join like operations

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439603#comment-17439603 ] Apache Spark commented on SPARK-33574: -- User 'rmcyang' has created a pull request for this issue:

[jira] [Issue Comment Deleted] (SPARK-33245) Add built-in UDF - GETBIT

2021-11-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33245: --- Comment: was deleted (was: I'm working on.) > Add built-in UDF - GETBIT >

[jira] [Assigned] (SPARK-37221) The collect-like API in SparkPlan should support columnar output

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37221: Assignee: Apache Spark > The collect-like API in SparkPlan should support columnar

[jira] [Assigned] (SPARK-37221) The collect-like API in SparkPlan should support columnar output

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37221: Assignee: (was: Apache Spark) > The collect-like API in SparkPlan should support

[jira] [Commented] (SPARK-37221) The collect-like API in SparkPlan should support columnar output

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439577#comment-17439577 ] Apache Spark commented on SPARK-37221: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures

2021-11-05 Thread Shawn Smith (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439575#comment-17439575 ] Shawn Smith commented on SPARK-37222: - Plan at the start of one iteration: {noformat} Project [id#2,

[jira] [Created] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures

2021-11-05 Thread Shawn Smith (Jira)
Shawn Smith created SPARK-37222: --- Summary: Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures Key: SPARK-37222 URL: https://issues.apache.org/jira/browse/SPARK-37222

[jira] [Assigned] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37220: Assignee: Apache Spark > Do not split input file for Parquet reader with aggregate push

[jira] [Assigned] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37220: Assignee: (was: Apache Spark) > Do not split input file for Parquet reader with

[jira] [Commented] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439570#comment-17439570 ] Apache Spark commented on SPARK-37220: -- User 'c21' has created a pull request for this issue:

[jira] [Created] (SPARK-37221) The collect-like API in SparkPlan should support columnar output

2021-11-05 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-37221: --- Summary: The collect-like API in SparkPlan should support columnar output Key: SPARK-37221 URL: https://issues.apache.org/jira/browse/SPARK-37221 Project: Spark

[jira] [Created] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down

2021-11-05 Thread Cheng Su (Jira)
Cheng Su created SPARK-37220: Summary: Do not split input file for Parquet reader with aggregate push down Key: SPARK-37220 URL: https://issues.apache.org/jira/browse/SPARK-37220 Project: Spark

[jira] [Commented] (SPARK-37167) Add benchmark for aggregate push down

2021-11-05 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439569#comment-17439569 ] Cheng Su commented on SPARK-37167: -- Just FYI, I am working on it. > Add benchmark for aggregate push

[jira] [Assigned] (SPARK-36998) Handle concurrent eviction of same application in SHS

2021-11-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36998: - Assignee: Thejdeep > Handle concurrent eviction of same application in SHS >

[jira] [Resolved] (SPARK-36998) Handle concurrent eviction of same application in SHS

2021-11-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36998. --- Fix Version/s: 3.2.1 3.3.0 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-37218) Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark

2021-11-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37218: - Assignee: Dongjoon Hyun > Parameterize `spark.sql.shuffle.partitions` in

[jira] [Commented] (SPARK-37218) Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark

2021-11-05 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439554#comment-17439554 ] Chao Sun commented on SPARK-37218: -- [~dongjoon] please assign this to yourself - somehow I can't do it.

[jira] [Updated] (SPARK-37218) Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark

2021-11-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37218: -- Fix Version/s: 3.2.1 > Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark >

[jira] [Assigned] (SPARK-37219) support AS OF syntax

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37219: Assignee: (was: Apache Spark) > support AS OF syntax > > >

[jira] [Assigned] (SPARK-37219) support AS OF syntax

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37219: Assignee: Apache Spark > support AS OF syntax > > >

[jira] [Commented] (SPARK-37219) support AS OF syntax

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439528#comment-17439528 ] Apache Spark commented on SPARK-37219: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Resolved] (SPARK-37218) Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark

2021-11-05 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-37218. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34496

[jira] [Updated] (SPARK-37219) support AS OF syntax

2021-11-05 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-37219: --- Description:

[jira] [Created] (SPARK-37219) support AS OF syntax

2021-11-05 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-37219: -- Summary: support AS OF syntax Key: SPARK-37219 URL: https://issues.apache.org/jira/browse/SPARK-37219 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-33539) Standardize exception messages in Spark

2021-11-05 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33539: - Description: In the SPIP: Standardize Exception Messages in Spark, there are three major

[jira] [Commented] (SPARK-37210) An error occurred while concurrently writing to different static partitions

2021-11-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439518#comment-17439518 ] Dongjoon Hyun commented on SPARK-37210: --- Is this a correct use case? bq. When multiple tasks write

[jira] [Resolved] (SPARK-35496) Upgrade Scala 2.13 to 2.13.7

2021-11-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35496. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 32648

[jira] [Assigned] (SPARK-35496) Upgrade Scala 2.13 to 2.13.7

2021-11-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35496: - Assignee: Yang Jie > Upgrade Scala 2.13 to 2.13.7 > > >

[jira] [Assigned] (SPARK-37208) Support mapping Spark gpu/fpga resource types to custom YARN resource type

2021-11-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37208: - Assignee: Thomas Graves > Support mapping Spark gpu/fpga resource types to custom YARN

[jira] [Resolved] (SPARK-37208) Support mapping Spark gpu/fpga resource types to custom YARN resource type

2021-11-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37208. --- Fix Version/s: 3.2.1 3.3.0 Resolution: Fixed Issue resolved by

[jira] [Resolved] (SPARK-37151) Avoid executor state sync attempt fail continuously in a short timeframe

2021-11-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37151. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34428

[jira] [Updated] (SPARK-37218) Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark

2021-11-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37218: -- Summary: Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark (was:

[jira] [Assigned] (SPARK-37218) Parameterize shuffle partitions in TPCDSQueryBenchmark

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37218: Assignee: (was: Apache Spark) > Parameterize shuffle partitions in

[jira] [Commented] (SPARK-37218) Parameterize shuffle partitions in TPCDSQueryBenchmark

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439493#comment-17439493 ] Apache Spark commented on SPARK-37218: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37218) Parameterize shuffle partitions in TPCDSQueryBenchmark

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37218: Assignee: Apache Spark > Parameterize shuffle partitions in TPCDSQueryBenchmark >

[jira] [Created] (SPARK-37218) Parameterize shuffle partitions in TPCDSQueryBenchmark

2021-11-05 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-37218: - Summary: Parameterize shuffle partitions in TPCDSQueryBenchmark Key: SPARK-37218 URL: https://issues.apache.org/jira/browse/SPARK-37218 Project: Spark

[jira] [Commented] (SPARK-34230) Let AQE determine the right parallelism in DistributionAndOrderingUtils

2021-11-05 Thread Anton Okolnychyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439399#comment-17439399 ] Anton Okolnychyi commented on SPARK-34230: -- A bit more context

[jira] [Commented] (SPARK-36182) Support TimestampNTZ type in Parquet file source

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439268#comment-17439268 ] Apache Spark commented on SPARK-36182: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-36182) Support TimestampNTZ type in Parquet file source

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439266#comment-17439266 ] Apache Spark commented on SPARK-36182: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-37212) Improve the implement of aggregate pushdown.

2021-11-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37212: --- Assignee: jiaan.geng > Improve the implement of aggregate pushdown. >

[jira] [Resolved] (SPARK-37212) Improve the implement of aggregate pushdown.

2021-11-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37212. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34488

[jira] [Commented] (SPARK-37217) Dynamic partitions should fail quickly when writing to external tables to prevent data deletion

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439206#comment-17439206 ] Apache Spark commented on SPARK-37217: -- User 'cxzl25' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37217) Dynamic partitions should fail quickly when writing to external tables to prevent data deletion

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37217: Assignee: Apache Spark > Dynamic partitions should fail quickly when writing to external

[jira] [Commented] (SPARK-36924) CAST between ANSI intervals and numerics

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439205#comment-17439205 ] Apache Spark commented on SPARK-36924: -- User 'Peng-Lei' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36924) CAST between ANSI intervals and numerics

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36924: Assignee: (was: Apache Spark) > CAST between ANSI intervals and numerics >

[jira] [Assigned] (SPARK-37217) Dynamic partitions should fail quickly when writing to external tables to prevent data deletion

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37217: Assignee: (was: Apache Spark) > Dynamic partitions should fail quickly when writing

[jira] [Assigned] (SPARK-36924) CAST between ANSI intervals and numerics

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36924: Assignee: Apache Spark > CAST between ANSI intervals and numerics >

[jira] [Created] (SPARK-37217) Dynamic partitions should fail quickly when writing to external tables to prevent data deletion

2021-11-05 Thread dzcxzl (Jira)
dzcxzl created SPARK-37217: -- Summary: Dynamic partitions should fail quickly when writing to external tables to prevent data deletion Key: SPARK-37217 URL: https://issues.apache.org/jira/browse/SPARK-37217

[jira] [Assigned] (SPARK-37216) Add the Hive macro functionality to SparkSQL

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37216: Assignee: (was: Apache Spark) > Add the Hive macro functionality to SparkSQL >

[jira] [Assigned] (SPARK-37216) Add the Hive macro functionality to SparkSQL

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37216: Assignee: Apache Spark > Add the Hive macro functionality to SparkSQL >

[jira] [Commented] (SPARK-37216) Add the Hive macro functionality to SparkSQL

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439146#comment-17439146 ] Apache Spark commented on SPARK-37216: -- User 'hgs19921112' has created a pull request for this

[jira] [Created] (SPARK-37216) Add the Hive macro functionality to SparkSQL

2021-11-05 Thread hgs (Jira)
hgs created SPARK-37216: --- Summary: Add the Hive macro functionality to SparkSQL Key: SPARK-37216 URL: https://issues.apache.org/jira/browse/SPARK-37216 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-37215) Support Application Timeouts on YARN

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439131#comment-17439131 ] Apache Spark commented on SPARK-37215: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37215) Support Application Timeouts on YARN

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37215: Assignee: (was: Apache Spark) > Support Application Timeouts on YARN >

[jira] [Commented] (SPARK-37215) Support Application Timeouts on YARN

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439129#comment-17439129 ] Apache Spark commented on SPARK-37215: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37215) Support Application Timeouts on YARN

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37215: Assignee: Apache Spark > Support Application Timeouts on YARN >

[jira] [Assigned] (SPARK-37214) Fail query analysis earlier with invalid identifiers

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37214: Assignee: Apache Spark (was: Wenchen Fan) > Fail query analysis earlier with invalid

[jira] [Assigned] (SPARK-37214) Fail query analysis earlier with invalid identifiers

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37214: Assignee: Wenchen Fan (was: Apache Spark) > Fail query analysis earlier with invalid

[jira] [Commented] (SPARK-37214) Fail query analysis earlier with invalid identifiers

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439126#comment-17439126 ] Apache Spark commented on SPARK-37214: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-37215) Support Application Timeouts on YARN

2021-11-05 Thread Kent Yao (Jira)
Kent Yao created SPARK-37215: Summary: Support Application Timeouts on YARN Key: SPARK-37215 URL: https://issues.apache.org/jira/browse/SPARK-37215 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-32940) Collect, first and last should be deterministic aggregate functions

2021-11-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32940. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 29810

[jira] [Assigned] (SPARK-32940) Collect, first and last should be deterministic aggregate functions

2021-11-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32940: --- Assignee: Tanel Kiis > Collect, first and last should be deterministic aggregate functions

[jira] [Created] (SPARK-37214) Fail query analysis earlier with invalid identifiers

2021-11-05 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-37214: --- Summary: Fail query analysis earlier with invalid identifiers Key: SPARK-37214 URL: https://issues.apache.org/jira/browse/SPARK-37214 Project: Spark Issue

[jira] [Assigned] (SPARK-37210) An error occurred while concurrently writing to different static partitions

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37210: Assignee: (was: Apache Spark) > An error occurred while concurrently writing to

[jira] [Assigned] (SPARK-37210) An error occurred while concurrently writing to different static partitions

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37210: Assignee: Apache Spark > An error occurred while concurrently writing to different

[jira] [Commented] (SPARK-37210) An error occurred while concurrently writing to different static partitions

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439079#comment-17439079 ] Apache Spark commented on SPARK-37210: -- User 'wForget' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37203) Fix NotSerializableException when observe with TypedImperativeAggregate

2021-11-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37203: --- Assignee: jiaan.geng > Fix NotSerializableException when observe with

[jira] [Resolved] (SPARK-37203) Fix NotSerializableException when observe with TypedImperativeAggregate

2021-11-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37203. - Fix Version/s: 3.1.3 3.2.1 3.3.0 Resolution: Fixed

[jira] [Commented] (SPARK-37213) In the latest version release (Spark.3.2.O) in the Apache Spark documentation, the "O" at the end feels wrong, and it is written as the English letter "O"

2021-11-05 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439075#comment-17439075 ] Jungtaek Lim commented on SPARK-37213: -- Thanks for reporting! I just checked with html code and it

[jira] [Resolved] (SPARK-37213) In the latest version release (Spark.3.2.O) in the Apache Spark documentation, the "O" at the end feels wrong, and it is written as the English letter "O"

2021-11-05 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-37213. -- Resolution: Invalid > In the latest version release (Spark.3.2.O) in the Apache Spark >

[jira] [Updated] (SPARK-37213) In the latest version release (Spark.3.2.O) in the Apache Spark documentation, the "O" at the end feels wrong, and it is written as the English letter "O"

2021-11-05 Thread liu zhuang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liu zhuang updated SPARK-37213: --- Attachment: Spark3.2.0.png > In the latest version release (Spark.3.2.O) in the Apache Spark >

[jira] [Created] (SPARK-37213) In the latest version release (Spark.3.2.O) in the Apache Spark documentation, the "O" at the end feels wrong, and it is written as the English letter "O"

2021-11-05 Thread liu zhuang (Jira)
liu zhuang created SPARK-37213: -- Summary: In the latest version release (Spark.3.2.O) in the Apache Spark documentation, the "O" at the end feels wrong, and it is written as the English letter "O" Key: SPARK-37213

[jira] [Comment Edited] (SPARK-37210) An error occurred while concurrently writing to different static partitions

2021-11-05 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439061#comment-17439061 ] Zhen Wang edited comment on SPARK-37210 at 11/5/21, 7:55 AM: - In

[jira] [Commented] (SPARK-37212) Improve the implement of aggregate pushdown.

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439062#comment-17439062 ] Apache Spark commented on SPARK-37212: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37212) Improve the implement of aggregate pushdown.

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37212: Assignee: Apache Spark > Improve the implement of aggregate pushdown. >

[jira] [Assigned] (SPARK-37212) Improve the implement of aggregate pushdown.

2021-11-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37212: Assignee: (was: Apache Spark) > Improve the implement of aggregate pushdown. >

[jira] [Created] (SPARK-37212) Improve the implement of aggregate pushdown.

2021-11-05 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37212: -- Summary: Improve the implement of aggregate pushdown. Key: SPARK-37212 URL: https://issues.apache.org/jira/browse/SPARK-37212 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-37210) An error occurred while concurrently writing to different static partitions

2021-11-05 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439061#comment-17439061 ] Zhen Wang edited comment on SPARK-37210 at 11/5/21, 7:28 AM: - In

[jira] [Commented] (SPARK-37210) An error occurred while concurrently writing to different static partitions

2021-11-05 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439061#comment-17439061 ] Zhen Wang commented on SPARK-37210: --- In DataSourceAnalysis, static partition writing is converted to

[jira] [Updated] (SPARK-37210) An error occurred while concurrently writing to different static partitions

2021-11-05 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Wang updated SPARK-37210: -- Attachment: [SPARK-37210]_Write_to_static_partition_in_dynamic_write_mode.patch > An error occurred