[jira] [Updated] (SPARK-44886) Introduce CLUSTER BY SQL clause to CREATE/REPLACE TABLE

2023-11-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44886: --- Labels: pull-request-available (was: ) > Introduce CLUSTER BY SQL clause to CREATE/REPLACE

[jira] [Resolved] (SPARK-45738) client will wait forever if session in spark connect server is evicted

2023-11-05 Thread xie shuiahu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xie shuiahu resolved SPARK-45738. - Resolution: Implemented > client will wait forever if session in spark connect server is

[jira] [Updated] (SPARK-45801) Introduce two helper methods for `QueryTest` that accept the `Array` type `expectedAnswer`

2023-11-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45801: - Parent: SPARK-45314 Issue Type: Sub-task (was: Improvement) > Introduce two helper methods for

[jira] [Updated] (SPARK-45801) Introduce two helper methods for `QueryTest` that accept the `Array` type `expectedAnswer`

2023-11-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45801: --- Labels: pull-request-available (was: ) > Introduce two helper methods for `QueryTest` that

[jira] [Created] (SPARK-45801) Introduce two helper methods for `QueryTest` that accept the `Array` type `expectedAnswer`

2023-11-05 Thread Yang Jie (Jira)
Yang Jie created SPARK-45801: Summary: Introduce two helper methods for `QueryTest` that accept the `Array` type `expectedAnswer` Key: SPARK-45801 URL: https://issues.apache.org/jira/browse/SPARK-45801

[jira] [Updated] (SPARK-43242) diagnoseCorruption should not throw Unexpected type of BlockId for ShuffleBlockBatchId

2023-11-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43242: --- Labels: pull-request-available (was: ) > diagnoseCorruption should not throw Unexpected

[jira] [Updated] (SPARK-45800) FileOutputCommiter race condition

2023-11-05 Thread Sayed Mohammad Hossein Torabi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sayed Mohammad Hossein Torabi updated SPARK-45800: -- Attachment: spark.log > FileOutputCommiter race condition >

[jira] [Updated] (SPARK-45800) FileOutputCommiter race condition

2023-11-05 Thread Sayed Mohammad Hossein Torabi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sayed Mohammad Hossein Torabi updated SPARK-45800: -- Description: Race condition happens when multiple spark jobs

[jira] [Created] (SPARK-45800) FileOutputCommiter race condition

2023-11-05 Thread Sayed Mohammad Hossein Torabi (Jira)
Sayed Mohammad Hossein Torabi created SPARK-45800: - Summary: FileOutputCommiter race condition Key: SPARK-45800 URL: https://issues.apache.org/jira/browse/SPARK-45800 Project: Spark

[jira] [Updated] (SPARK-45800) FileOutputCommiter race condition

2023-11-05 Thread Sayed Mohammad Hossein Torabi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sayed Mohammad Hossein Torabi updated SPARK-45800: -- Attachment: main.py > FileOutputCommiter race condition >

[jira] [Updated] (SPARK-45686) Fix `method copyArrayToImmutableIndexedSeq in class LowPriorityImplicits2 is deprecated`

2023-11-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45686: --- Labels: pull-request-available (was: ) > Fix `method copyArrayToImmutableIndexedSeq in

[jira] [Resolved] (SPARK-45710) Assign name to _LEGACY_ERROR_TEMP_21[59,60,61,62]

2023-11-05 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45710. -- Resolution: Fixed Issue resolved by pull request 43567 [https://github.com/apache/spark/pull/43567]

[jira] [Assigned] (SPARK-45799) Remove some unused method in QueryExecutionErrors & QueryCompilationErrors

2023-11-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45799: - Assignee: BingKun Pan > Remove some unused method in QueryExecutionErrors &

[jira] [Resolved] (SPARK-45799) Remove some unused method in QueryExecutionErrors & QueryCompilationErrors

2023-11-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45799. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43665

[jira] [Commented] (SPARK-45797) Discrepancies in PySpark DataFrame Results When Using Window Functions and Filters

2023-11-05 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17783015#comment-17783015 ] Bruce Robbins commented on SPARK-45797: --- I wonder if this is the same as SPARK-45543, which had

[jira] [Updated] (SPARK-45793) Improve the built-in compression codecs

2023-11-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45793: --- Labels: pull-request-available (was: ) > Improve the built-in compression codecs >

[jira] [Updated] (SPARK-45799) Remove some unused method in QueryExecutionErrors & QueryCompilationErrors

2023-11-05 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-45799: Summary: Remove some unused method in QueryExecutionErrors & QueryCompilationErrors (was: Remove

[jira] [Updated] (SPARK-45799) Remove some unused method in QueryExecutionErrors

2023-11-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45799: --- Labels: pull-request-available (was: ) > Remove some unused method in QueryExecutionErrors

[jira] [Created] (SPARK-45799) Remove some unused method in QueryExecutionErrors

2023-11-05 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-45799: --- Summary: Remove some unused method in QueryExecutionErrors Key: SPARK-45799 URL: https://issues.apache.org/jira/browse/SPARK-45799 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45798) Assert server-side session ID in Spark Connect

2023-11-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45798: --- Labels: pull-request-available (was: ) > Assert server-side session ID in Spark Connect >

[jira] [Created] (SPARK-45798) Assert server-side session ID in Spark Connect

2023-11-05 Thread Martin Grund (Jira)
Martin Grund created SPARK-45798: Summary: Assert server-side session ID in Spark Connect Key: SPARK-45798 URL: https://issues.apache.org/jira/browse/SPARK-45798 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45796) Support MODE() WITHIN GROUP (ORDER BY col)

2023-11-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45796: --- Labels: pull-request-available (was: ) > Support MODE() WITHIN GROUP (ORDER BY col) >

[jira] [Updated] (SPARK-45797) Discrepancies in PySpark DataFrame Results When Using Window Functions and Filters

2023-11-05 Thread Daniel Diego Horcajuelo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Diego Horcajuelo updated SPARK-45797: Description: When doing certain types of transformations on a dataframe

[jira] [Created] (SPARK-45797) Discrepancies in PySpark DataFrame Results When Using Window Functions and Filters

2023-11-05 Thread Daniel Diego Horcajuelo (Jira)
Daniel Diego Horcajuelo created SPARK-45797: --- Summary: Discrepancies in PySpark DataFrame Results When Using Window Functions and Filters Key: SPARK-45797 URL:

[jira] [Updated] (SPARK-45796) Support MODE() WITHIN GROUP (ORDER BY col)

2023-11-05 Thread Jiaan Geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-45796: --- Description: Many mainstream databases supports the syntax show below. { MODE() WITHIN GROUP (ORDER

[jira] [Created] (SPARK-45796) Support MODE() WITHIN GROUP (ORDER BY col)

2023-11-05 Thread Jiaan Geng (Jira)
Jiaan Geng created SPARK-45796: -- Summary: Support MODE() WITHIN GROUP (ORDER BY col) Key: SPARK-45796 URL: https://issues.apache.org/jira/browse/SPARK-45796 Project: Spark Issue Type: New

[jira] [Created] (SPARK-45795) DS V2 supports push down Mode

2023-11-05 Thread Jiaan Geng (Jira)
Jiaan Geng created SPARK-45795: -- Summary: DS V2 supports push down Mode Key: SPARK-45795 URL: https://issues.apache.org/jira/browse/SPARK-45795 Project: Spark Issue Type: Sub-task