[jira] [Updated] (SPARK-38515) Volcano test fails at deleting queue

2022-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38515: -- Description: {code} $ k delete queue queue0 Error from server: admission webhook

[jira] [Updated] (SPARK-38515) Volcano queue is not deleted

2022-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38515: -- Priority: Blocker (was: Major) > Volcano queue is not deleted >

[jira] [Updated] (SPARK-38515) Volcano queue is not deleted

2022-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38515: -- Priority: Critical (was: Blocker) > Volcano queue is not deleted >

[jira] [Resolved] (SPARK-38511) Remove priorityClassName propagation in favor of explicit settings

2022-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38511. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35807

[jira] [Assigned] (SPARK-38511) Remove priorityClassName propagation in favor of explicit settings

2022-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38511: - Assignee: Dongjoon Hyun > Remove priorityClassName propagation in favor of explicit

[jira] [Commented] (SPARK-38507) DataFrame withColumn method not adding or replacing columns when alias is used

2022-03-10 Thread qian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504703#comment-17504703 ] qian commented on SPARK-38507: -- Hi [~amavrommatis] The reason for this problem is because you alias

[jira] [Updated] (SPARK-38519) AQE throw exception should respect SparkFatalException

2022-03-10 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-38519: -- Description: BroadcastExchangeExec will wrap fatal exception in SparkFatalException and unwarp it 

[jira] [Created] (SPARK-38520) Overflow occurs when reading ANSI day time interval from CSV file

2022-03-10 Thread chong (Jira)
chong created SPARK-38520: - Summary: Overflow occurs when reading ANSI day time interval from CSV file Key: SPARK-38520 URL: https://issues.apache.org/jira/browse/SPARK-38520 Project: Spark Issue

[jira] [Created] (SPARK-38517) Fix PySpark documentation generation (missing ipython_genutils)

2022-03-10 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-38517: Summary: Fix PySpark documentation generation (missing ipython_genutils) Key: SPARK-38517 URL: https://issues.apache.org/jira/browse/SPARK-38517 Project: Spark

[jira] [Assigned] (SPARK-38516) Add log4j-core and log4j-api to classpath if active hadoop-provided

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38516: Assignee: Apache Spark > Add log4j-core and log4j-api to classpath if active

[jira] [Commented] (SPARK-38516) Add log4j-core and log4j-api to classpath if active hadoop-provided

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504683#comment-17504683 ] Apache Spark commented on SPARK-38516: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-38516) Add log4j-core and log4j-api to classpath if active hadoop-provided

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504682#comment-17504682 ] Apache Spark commented on SPARK-38516: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38516) Add log4j-core and log4j-api to classpath if active hadoop-provided

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38516: Assignee: (was: Apache Spark) > Add log4j-core and log4j-api to classpath if active

[jira] [Commented] (SPARK-38517) Fix PySpark documentation generation (missing ipython_genutils)

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504685#comment-17504685 ] Apache Spark commented on SPARK-38517: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-38522) Strengthen the contract on iterator method in StateStore

2022-03-10 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-38522: Summary: Strengthen the contract on iterator method in StateStore Key: SPARK-38522 URL: https://issues.apache.org/jira/browse/SPARK-38522 Project: Spark

[jira] [Assigned] (SPARK-38521) Throw Exception if overwriting hive partition table with dynamic and staticPartitionOverwriteMode

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38521: Assignee: Apache Spark > Throw Exception if overwriting hive partition table with

[jira] [Created] (SPARK-38521) Throw Exception if overwriting hive partition table with dynamic and staticPartitionOverwriteMode

2022-03-10 Thread Jackey Lee (Jira)
Jackey Lee created SPARK-38521: -- Summary: Throw Exception if overwriting hive partition table with dynamic and staticPartitionOverwriteMode Key: SPARK-38521 URL: https://issues.apache.org/jira/browse/SPARK-38521

[jira] [Commented] (SPARK-38521) Throw Exception if overwriting hive partition table with dynamic and staticPartitionOverwriteMode

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504771#comment-17504771 ] Apache Spark commented on SPARK-38521: -- User 'jackylee-ch' has created a pull request for this

[jira] [Assigned] (SPARK-38521) Throw Exception if overwriting hive partition table with dynamic and staticPartitionOverwriteMode

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38521: Assignee: (was: Apache Spark) > Throw Exception if overwriting hive partition table

[jira] [Commented] (SPARK-38515) Volcano test fails at deleting queue

2022-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504670#comment-17504670 ] Dongjoon Hyun commented on SPARK-38515: --- cc [~yikunkero] this is happening Intel architecture EKS.

[jira] [Created] (SPARK-38515) Volcano test fails at deleting queue

2022-03-10 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-38515: - Summary: Volcano test fails at deleting queue Key: SPARK-38515 URL: https://issues.apache.org/jira/browse/SPARK-38515 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-38515) Volcano queue is not deleted

2022-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38515: -- Summary: Volcano queue is not deleted (was: Volcano test fails at deleting queue) > Volcano

[jira] [Updated] (SPARK-38515) Volcano test fails at deleting queue

2022-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38515: -- Component/s: (was: Tests) > Volcano test fails at deleting queue >

[jira] [Created] (SPARK-38518) Implement `skipna` of `Series.all/Index.all` to exclude NA/null values

2022-03-10 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-38518: Summary: Implement `skipna` of `Series.all/Index.all` to exclude NA/null values Key: SPARK-38518 URL: https://issues.apache.org/jira/browse/SPARK-38518 Project:

[jira] [Assigned] (SPARK-38518) Implement `skipna` of `Series.all/Index.all` to exclude NA/null values

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38518: Assignee: (was: Apache Spark) > Implement `skipna` of `Series.all/Index.all` to

[jira] [Commented] (SPARK-38518) Implement `skipna` of `Series.all/Index.all` to exclude NA/null values

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504721#comment-17504721 ] Apache Spark commented on SPARK-38518: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-38518) Implement `skipna` of `Series.all/Index.all` to exclude NA/null values

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38518: Assignee: Apache Spark > Implement `skipna` of `Series.all/Index.all` to exclude NA/null

[jira] [Created] (SPARK-38519) AQE throw exception should respect SparkFatalException

2022-03-10 Thread XiDuo You (Jira)
XiDuo You created SPARK-38519: - Summary: AQE throw exception should respect SparkFatalException Key: SPARK-38519 URL: https://issues.apache.org/jira/browse/SPARK-38519 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38519) AQE throw exception should respect SparkFatalException

2022-03-10 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-38519: -- Description: BroadcastExchangeExec will wrap fatal exception in SparkFatalException and unwarp it in

[jira] [Resolved] (SPARK-38502) Distribution with hadoop-provided is missing log4j2

2022-03-10 Thread Emil Ejbyfeldt (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emil Ejbyfeldt resolved SPARK-38502. Resolution: Duplicate > Distribution with hadoop-provided is missing log4j2 >

[jira] [Commented] (SPARK-38502) Distribution with hadoop-provided is missing log4j2

2022-03-10 Thread Emil Ejbyfeldt (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504749#comment-17504749 ] Emil Ejbyfeldt commented on SPARK-38502: Duplicate of SPARK-38516 > Distribution with

[jira] [Commented] (SPARK-38517) Fix PySpark documentation generation (missing ipython_genutils)

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504684#comment-17504684 ] Apache Spark commented on SPARK-38517: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-38517) Fix PySpark documentation generation (missing ipython_genutils)

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38517: Assignee: (was: Apache Spark) > Fix PySpark documentation generation (missing

[jira] [Assigned] (SPARK-38517) Fix PySpark documentation generation (missing ipython_genutils)

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38517: Assignee: Apache Spark > Fix PySpark documentation generation (missing ipython_genutils)

[jira] [Resolved] (SPARK-38517) Fix PySpark documentation generation (missing ipython_genutils)

2022-03-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38517. -- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-38517) Fix PySpark documentation generation (missing ipython_genutils)

2022-03-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38517: Assignee: Hyukjin Kwon > Fix PySpark documentation generation (missing ipython_genutils)

[jira] [Updated] (SPARK-37273) Hidden File Metadata Support for Spark SQL

2022-03-10 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-37273: Labels: release-notes (was: ) > Hidden File Metadata Support for Spark SQL >

[jira] [Commented] (SPARK-38519) AQE throw exception should respect SparkFatalException

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504734#comment-17504734 ] Apache Spark commented on SPARK-38519: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-38519) AQE throw exception should respect SparkFatalException

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38519: Assignee: Apache Spark > AQE throw exception should respect SparkFatalException >

[jira] [Assigned] (SPARK-38519) AQE throw exception should respect SparkFatalException

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38519: Assignee: (was: Apache Spark) > AQE throw exception should respect

[jira] [Assigned] (SPARK-38509) Unregister the TIMESTAMPADD/DIFF functions and remove DATE_ADD/DIFF

2022-03-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38509: Assignee: Max Gekk > Unregister the TIMESTAMPADD/DIFF functions and remove DATE_ADD/DIFF >

[jira] [Resolved] (SPARK-38509) Unregister the TIMESTAMPADD/DIFF functions and remove DATE_ADD/DIFF

2022-03-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38509. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35805

[jira] [Created] (SPARK-38516) Add log4j-core and log4j-api to classpath if active hadoop-provided

2022-03-10 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-38516: --- Summary: Add log4j-core and log4j-api to classpath if active hadoop-provided Key: SPARK-38516 URL: https://issues.apache.org/jira/browse/SPARK-38516 Project: Spark

[jira] [Updated] (SPARK-38516) Add log4j-core, log4j-api and log4j-slf4j-impl to classpath if active hadoop-provided

2022-03-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-38516: Summary: Add log4j-core, log4j-api and log4j-slf4j-impl to classpath if active hadoop-provided

[jira] [Updated] (SPARK-38519) AQE throw exception should respect SparkFatalException

2022-03-10 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-38519: -- Description: BroadcastExchangeExec will wrap fatal exception inside SparkFatalException and unwarp

[jira] [Created] (SPARK-38502) Distribution with hadoop-provided and log4j2

2022-03-10 Thread Emil Ejbyfeldt (Jira)
Emil Ejbyfeldt created SPARK-38502: -- Summary: Distribution with hadoop-provided and log4j2 Key: SPARK-38502 URL: https://issues.apache.org/jira/browse/SPARK-38502 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38502) Distribution with hadoop-provided and log4j2

2022-03-10 Thread Emil Ejbyfeldt (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emil Ejbyfeldt updated SPARK-38502: --- Description: Currently building spark 3.3.0-SNAPSHOT using `./dev/make-distribution.sh

[jira] [Assigned] (SPARK-38489) Aggregate.groupOnly support foldable expressions

2022-03-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38489: --- Assignee: Yuming Wang > Aggregate.groupOnly support foldable expressions >

[jira] [Resolved] (SPARK-38148) Do not add dynamic partition pruning if there exists static partition pruning

2022-03-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38148. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35451

[jira] [Resolved] (SPARK-38489) Aggregate.groupOnly support foldable expressions

2022-03-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38489. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35795

[jira] [Assigned] (SPARK-38499) Upgrade Jackson to 2.13.2

2022-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38499: - Assignee: Dongjoon Hyun > Upgrade Jackson to 2.13.2 > - > >

[jira] [Resolved] (SPARK-38499) Upgrade Jackson to 2.13.2

2022-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38499. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35800

[jira] [Resolved] (SPARK-38481) Substitute Java overflow exception from TIMESTAMPADD by Spark exception

2022-03-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38481. -- Resolution: Fixed Issue resolved by pull request 35787 [https://github.com/apache/spark/pull/35787]

[jira] [Commented] (SPARK-30212) COUNT(DISTINCT) window function should be supported

2022-03-10 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504073#comment-17504073 ] luoyuxia commented on SPARK-30212: --  Hi,   Is it in the plan to support such fucntion in Spark? >

[jira] [Assigned] (SPARK-38499) Upgrade Jackson to 2.13.2

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38499: Assignee: (was: Apache Spark) > Upgrade Jackson to 2.13.2 >

[jira] [Assigned] (SPARK-38499) Upgrade Jackson to 2.13.2

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38499: Assignee: Apache Spark > Upgrade Jackson to 2.13.2 > - > >

[jira] [Commented] (SPARK-38499) Upgrade Jackson to 2.13.2

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504100#comment-17504100 ] Apache Spark commented on SPARK-38499: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-38499) Upgrade Jackson to 2.13.2

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504101#comment-17504101 ] Apache Spark commented on SPARK-38499: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-38500) Add ASF License header to all Service Provider configuration files

2022-03-10 Thread Kent Yao (Jira)
Kent Yao created SPARK-38500: Summary: Add ASF License header to all Service Provider configuration files Key: SPARK-38500 URL: https://issues.apache.org/jira/browse/SPARK-38500 Project: Spark

[jira] [Comment Edited] (SPARK-30212) COUNT(DISTINCT) window function should be supported

2022-03-10 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504073#comment-17504073 ] luoyuxia edited comment on SPARK-30212 at 3/10/22, 8:13 AM:  Hi,   Is it in

[jira] [Created] (SPARK-38501) Fix thriftserver test failures under ANSI mode

2022-03-10 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-38501: -- Summary: Fix thriftserver test failures under ANSI mode Key: SPARK-38501 URL: https://issues.apache.org/jira/browse/SPARK-38501 Project: Spark Issue

[jira] [Created] (SPARK-38499) Upgrade Jackson to 2.13.2

2022-03-10 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-38499: - Summary: Upgrade Jackson to 2.13.2 Key: SPARK-38499 URL: https://issues.apache.org/jira/browse/SPARK-38499 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-38500) Add ASF License header to all Service Provider configuration files

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38500: Assignee: Apache Spark > Add ASF License header to all Service Provider configuration

[jira] [Assigned] (SPARK-38500) Add ASF License header to all Service Provider configuration files

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38500: Assignee: (was: Apache Spark) > Add ASF License header to all Service Provider

[jira] [Commented] (SPARK-38500) Add ASF License header to all Service Provider configuration files

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504109#comment-17504109 ] Apache Spark commented on SPARK-38500: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-38501) Fix thriftserver test failures under ANSI mode

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504114#comment-17504114 ] Apache Spark commented on SPARK-38501: -- User 'gengliangwang' has created a pull request for this

[jira] [Resolved] (SPARK-38170) Fix //sql/hive-thriftserver:org.apache.spark.sql.hive.thriftserver.ThriftServerWithSparkContextInHttpSuite-hive-2.3__hadoop-2.7 in ANSI

2022-03-10 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-38170. Resolution: Duplicate It is included in https://issues.apache.org/jira/browse/SPARK-38501

[jira] [Commented] (SPARK-38501) Fix thriftserver test failures under ANSI mode

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504113#comment-17504113 ] Apache Spark commented on SPARK-38501: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-38501) Fix thriftserver test failures under ANSI mode

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38501: Assignee: Gengliang Wang (was: Apache Spark) > Fix thriftserver test failures under

[jira] [Assigned] (SPARK-38501) Fix thriftserver test failures under ANSI mode

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38501: Assignee: Apache Spark (was: Gengliang Wang) > Fix thriftserver test failures under

[jira] [Created] (SPARK-38503) Add driver `PodGroup` templates doc and cleanup executor PodGroup templates

2022-03-10 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-38503: --- Summary: Add driver `PodGroup` templates doc and cleanup executor PodGroup templates Key: SPARK-38503 URL: https://issues.apache.org/jira/browse/SPARK-38503 Project:

[jira] [Resolved] (SPARK-38490) Add Github action test job for ANSI SQL mode

2022-03-10 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-38490. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35797

[jira] [Commented] (SPARK-38379) Kubernetes: NoSuchElementException: spark.app.id when using PersistentVolumes

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504334#comment-17504334 ] Apache Spark commented on SPARK-38379: -- User 'tgravescs' has created a pull request for this issue:

[jira] [Commented] (SPARK-37735) Add appId interface to KubernetesConf

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504335#comment-17504335 ] Apache Spark commented on SPARK-37735: -- User 'tgravescs' has created a pull request for this issue:

[jira] [Commented] (SPARK-38379) Kubernetes: NoSuchElementException: spark.app.id when using PersistentVolumes

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504333#comment-17504333 ] Apache Spark commented on SPARK-38379: -- User 'tgravescs' has created a pull request for this issue:

[jira] [Commented] (SPARK-38503) Add driver `PodGroup` templates doc and cleanup executor PodGroup templates

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504246#comment-17504246 ] Apache Spark commented on SPARK-38503: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-38503) Add driver `PodGroup` templates doc and cleanup executor PodGroup templates

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504247#comment-17504247 ] Apache Spark commented on SPARK-38503: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38503) Add driver `PodGroup` templates doc and cleanup executor PodGroup templates

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38503: Assignee: (was: Apache Spark) > Add driver `PodGroup` templates doc and cleanup

[jira] [Assigned] (SPARK-38503) Add driver `PodGroup` templates doc and cleanup executor PodGroup templates

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38503: Assignee: Apache Spark > Add driver `PodGroup` templates doc and cleanup executor

[jira] [Resolved] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

2022-03-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved SPARK-31911. Fix Version/s: 3.0.1 2.4.7 Resolution: Fixed > Using S3A

[jira] [Created] (SPARK-38506) Push partial aggregation through join

2022-03-10 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-38506: --- Summary: Push partial aggregation through join Key: SPARK-38506 URL: https://issues.apache.org/jira/browse/SPARK-38506 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

2022-03-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504273#comment-17504273 ] Steve Loughran commented on SPARK-31911: I'm going to close as fixed now; the spark changes will

[jira] [Updated] (SPARK-38502) Distribution with hadoop-provided is missing log4j2

2022-03-10 Thread Emil Ejbyfeldt (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emil Ejbyfeldt updated SPARK-38502: --- Summary: Distribution with hadoop-provided is missing log4j2 (was: Distribution with

[jira] [Commented] (SPARK-38504) Can't read TimestampNTZ as TimestampLTZ

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504277#comment-17504277 ] Apache Spark commented on SPARK-38504: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-03-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504286#comment-17504286 ] Steve Loughran commented on SPARK-38330: this is a hadoop issue -create a Jira there and file as

[jira] [Commented] (SPARK-37735) Add appId interface to KubernetesConf

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504336#comment-17504336 ] Apache Spark commented on SPARK-37735: -- User 'tgravescs' has created a pull request for this issue:

[jira] [Commented] (SPARK-37735) Add appId interface to KubernetesConf

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504337#comment-17504337 ] Apache Spark commented on SPARK-37735: -- User 'tgravescs' has created a pull request for this issue:

[jira] [Created] (SPARK-38505) Make partial aggregation adaptive

2022-03-10 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-38505: --- Summary: Make partial aggregation adaptive Key: SPARK-38505 URL: https://issues.apache.org/jira/browse/SPARK-38505 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-38500) Add ASF License header to all Service Provider configuration files

2022-03-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38500. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35801

[jira] [Assigned] (SPARK-38500) Add ASF License header to all Service Provider configuration files

2022-03-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38500: Assignee: Kent Yao > Add ASF License header to all Service Provider configuration files

[jira] [Updated] (SPARK-38504) Can't read TimestampNTZ as TimestampLTZ

2022-03-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38504: --- Summary: Can't read TimestampNTZ as TimestampLTZ (was: can't read TimestampNTZ as TimestampLTZ) >

[jira] [Resolved] (SPARK-38360) Introduce a `exists` function for `TreeNode` to eliminate duplicate code pattern

2022-03-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38360. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35694

[jira] [Assigned] (SPARK-38360) Introduce a `exists` function for `TreeNode` to eliminate duplicate code pattern

2022-03-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38360: --- Assignee: Yang Jie > Introduce a `exists` function for `TreeNode` to eliminate duplicate

[jira] [Created] (SPARK-38504) can't read TimestampNTZ as TimestampLTZ

2022-03-10 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38504: -- Summary: can't read TimestampNTZ as TimestampLTZ Key: SPARK-38504 URL: https://issues.apache.org/jira/browse/SPARK-38504 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-38504) Can't read TimestampNTZ as TimestampLTZ

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38504: Assignee: Apache Spark > Can't read TimestampNTZ as TimestampLTZ >

[jira] [Commented] (SPARK-38504) Can't read TimestampNTZ as TimestampLTZ

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504274#comment-17504274 ] Apache Spark commented on SPARK-38504: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38504) Can't read TimestampNTZ as TimestampLTZ

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38504: Assignee: (was: Apache Spark) > Can't read TimestampNTZ as TimestampLTZ >

[jira] [Commented] (SPARK-38505) Make partial aggregation adaptive

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504349#comment-17504349 ] Apache Spark commented on SPARK-38505: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38505) Make partial aggregation adaptive

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38505: Assignee: Apache Spark > Make partial aggregation adaptive >

[jira] [Assigned] (SPARK-38505) Make partial aggregation adaptive

2022-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38505: Assignee: (was: Apache Spark) > Make partial aggregation adaptive >

  1   2   >