[jira] [Updated] (SPARK-46772) Benchmarking Avro with ZSTD

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46772: --- Labels: pull-request-available (was: ) > Benchmarking Avro with ZSTD >

[jira] [Resolved] (SPARK-46808) Refine error classes in Python with automatic sorting function

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46808. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44848

[jira] [Assigned] (SPARK-46808) Refine error classes in Python with automatic sorting function

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46808: Assignee: Hyukjin Kwon > Refine error classes in Python with automatic sorting function

[jira] [Assigned] (SPARK-46807) Include automation notice in SQL error class documents

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46807: Assignee: Nicholas Chammas > Include automation notice in SQL error class documents >

[jira] [Resolved] (SPARK-46807) Include automation notice in SQL error class documents

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46807. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44847

[jira] [Updated] (SPARK-45869) Revisit and Improve Spark Standalone Cluster

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45869: -- Priority: Critical (was: Major) > Revisit and Improve Spark Standalone Cluster >

[jira] [Updated] (SPARK-46800) Support `spark.deploy.spreadOutDrivers`

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46800: -- Priority: Major (was: Critical) > Support `spark.deploy.spreadOutDrivers` >

[jira] [Updated] (SPARK-46800) Support `spark.deploy.spreadOutDrivers`

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46800: -- Priority: Critical (was: Major) > Support `spark.deploy.spreadOutDrivers` >

[jira] [Resolved] (SPARK-46718) Upgrade Arrow to 15.0.0

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46718. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44797

[jira] [Assigned] (SPARK-46718) Upgrade Arrow to 15.0.0

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46718: - Assignee: Yang Jie > Upgrade Arrow to 15.0.0 > --- > >

[jira] [Resolved] (SPARK-46805) Upgrade `scalafmt` to 3.7.17

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46805. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44845

[jira] [Updated] (SPARK-46808) Refine error classes in Python with automatic sorting function

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46808: - Parent: SPARK-45673 Issue Type: Sub-task (was: Test) > Refine error classes in Python

[jira] [Updated] (SPARK-46809) Check error message parameter properly

2024-01-22 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46809: Description: If error message parameter from template is missing in actual usage or the name is

[jira] [Updated] (SPARK-46809) Check error message parameter properly

2024-01-22 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46809: Summary: Check error message parameter properly (was: Check missing error message parameter

[jira] [Created] (SPARK-46809) Check missing error message parameter properly

2024-01-22 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46809: --- Summary: Check missing error message parameter properly Key: SPARK-46809 URL: https://issues.apache.org/jira/browse/SPARK-46809 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46806) Improve error message for spark.table when argument type is wrong

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46806. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44846

[jira] [Assigned] (SPARK-46806) Improve error message for spark.table when argument type is wrong

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46806: Assignee: Hyukjin Kwon > Improve error message for spark.table when argument type is

[jira] [Updated] (SPARK-46808) Refine error classes in Python with automatic sorting function

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46808: --- Labels: pull-request-available (was: ) > Refine error classes in Python with automatic

[jira] [Updated] (SPARK-46807) Include automation notice in SQL error class documents

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46807: --- Labels: pull-request-available (was: ) > Include automation notice in SQL error class

[jira] [Created] (SPARK-46808) Refine error classes in Python with automatic sorting function

2024-01-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46808: Summary: Refine error classes in Python with automatic sorting function Key: SPARK-46808 URL: https://issues.apache.org/jira/browse/SPARK-46808 Project: Spark

[jira] [Created] (SPARK-46807) Include automation notice in SQL error class documents

2024-01-22 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46807: Summary: Include automation notice in SQL error class documents Key: SPARK-46807 URL: https://issues.apache.org/jira/browse/SPARK-46807 Project: Spark

[jira] [Resolved] (SPARK-46800) Support `spark.deploy.spreadOutDrivers`

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46800. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44840

[jira] [Updated] (SPARK-46806) Improve error message for spark.table when argument type is wrong

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46806: --- Labels: pull-request-available (was: ) > Improve error message for spark.table when

[jira] [Updated] (SPARK-46806) Improve error message for spark.table when argument type is wrong

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46806: - Description: {code} >>> spark.table(None) Traceback (most recent call last): File "", line 1,

[jira] [Created] (SPARK-46806) Improve error message for spark.table when argument type is wrong

2024-01-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46806: Summary: Improve error message for spark.table when argument type is wrong Key: SPARK-46806 URL: https://issues.apache.org/jira/browse/SPARK-46806 Project: Spark

[jira] [Resolved] (SPARK-46803) Remove scala-2.13 profile

2024-01-22 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan resolved SPARK-46803. - Resolution: Not A Problem > Remove scala-2.13 profile > - > >

[jira] [Assigned] (SPARK-46804) Recover the generated documents

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46804: - Assignee: Dongjoon Hyun > Recover the generated documents >

[jira] [Resolved] (SPARK-46804) Recover the generated documents

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46804. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44843

[jira] [Resolved] (SPARK-46802) Cleanup codecov script

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46802. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44842

[jira] [Assigned] (SPARK-46802) Cleanup codecov script

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46802: Assignee: Hyukjin Kwon > Cleanup codecov script > -- > >

[jira] [Updated] (SPARK-46803) Remove scala-2.13 profile

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46803: --- Labels: pull-request-available (was: ) > Remove scala-2.13 profile >

[jira] [Updated] (SPARK-46804) Recover the generated documents

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46804: --- Labels: pull-request-available (was: ) > Recover the generated documents >

[jira] [Created] (SPARK-46804) Recover the generated documents

2024-01-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-46804: - Summary: Recover the generated documents Key: SPARK-46804 URL: https://issues.apache.org/jira/browse/SPARK-46804 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-46803) Remove scala-2.13 profile

2024-01-22 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46803: --- Summary: Remove scala-2.13 profile Key: SPARK-46803 URL: https://issues.apache.org/jira/browse/SPARK-46803 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46802) Cleanup codecov script

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46802: --- Labels: pull-request-available (was: ) > Cleanup codecov script > -- >

[jira] [Resolved] (SPARK-46801) Do not treat exit 5 as a test failure in Python testing script

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46801. --- Fix Version/s: 3.4.3 3.5.1 4.0.0 Resolution:

[jira] [Assigned] (SPARK-46801) Do not treat exit 5 as a test failure in Python testing script

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46801: - Assignee: Hyukjin Kwon > Do not treat exit 5 as a test failure in Python testing

[jira] [Created] (SPARK-46802) Cleanup codecov script

2024-01-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46802: Summary: Cleanup codecov script Key: SPARK-46802 URL: https://issues.apache.org/jira/browse/SPARK-46802 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-46800) Support `spark.deploy.spreadOutDrivers`

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46800: - Assignee: Dongjoon Hyun > Support `spark.deploy.spreadOutDrivers` >

[jira] [Updated] (SPARK-46801) Do not treat exit 5 as a test failure in Python testing script

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46801: --- Labels: pull-request-available (was: ) > Do not treat exit 5 as a test failure in Python

[jira] [Updated] (SPARK-46800) Support `spark.deploy.spreadOutDrivers`

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46800: --- Labels: pull-request-available (was: ) > Support `spark.deploy.spreadOutDrivers` >

[jira] [Created] (SPARK-46801) Do not treat exit 5 as a test failure in Python testing script

2024-01-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46801: Summary: Do not treat exit 5 as a test failure in Python testing script Key: SPARK-46801 URL: https://issues.apache.org/jira/browse/SPARK-46801 Project: Spark

[jira] [Created] (SPARK-46800) Support `spark.deploy.spreadOutDrivers`

2024-01-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-46800: - Summary: Support `spark.deploy.spreadOutDrivers` Key: SPARK-46800 URL: https://issues.apache.org/jira/browse/SPARK-46800 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46799) Improve `MasterSuite` to use nanoTime-based appIDs and workerIDs

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46799: --- Labels: pull-request-available (was: ) > Improve `MasterSuite` to use nanoTime-based

[jira] [Resolved] (SPARK-46797) Rename spark.deploy.spreadOut to spark.deploy.spreadOutApps

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46797. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44838

[jira] [Resolved] (SPARK-46781) Test custom data source and input partition (pyspark.sql.datasource)

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46781. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44808

[jira] [Created] (SPARK-46798) Kafka custom partition location assignment in Spark Structured Streaming (rack awareness)

2024-01-22 Thread Randall Schwager (Jira)
Randall Schwager created SPARK-46798: Summary: Kafka custom partition location assignment in Spark Structured Streaming (rack awareness) Key: SPARK-46798 URL: https://issues.apache.org/jira/browse/SPARK-46798

[jira] [Updated] (SPARK-46797) Rename spark.deploy.spreadOut to spark.deploy.spreadOutApps

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46797: -- Parent: SPARK-45869 Issue Type: Sub-task (was: Improvement) > Rename

[jira] [Assigned] (SPARK-46797) Rename spark.deploy.spreadOut to spark.deploy.spreadOutApps

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46797: - Assignee: Dongjoon Hyun > Rename spark.deploy.spreadOut to spark.deploy.spreadOutApps

[jira] [Updated] (SPARK-46797) Rename spark.deploy.spreadOut to spark.deploy.spreadOutApps

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46797: --- Labels: pull-request-available (was: ) > Rename spark.deploy.spreadOut to

[jira] [Created] (SPARK-46797) Rename spark.deploy.spreadOut to spark.deploy.spreadOutApps

2024-01-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-46797: - Summary: Rename spark.deploy.spreadOut to spark.deploy.spreadOutApps Key: SPARK-46797 URL: https://issues.apache.org/jira/browse/SPARK-46797 Project: Spark

[jira] [Commented] (SPARK-46796) RocksDB versionID Mismatch in SST files

2024-01-22 Thread Bhuwan Sahni (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809657#comment-17809657 ] Bhuwan Sahni commented on SPARK-46796: -- PR created - [https://github.com/apache/spark/pull/44837]

[jira] [Updated] (SPARK-46796) RocksDB versionID Mismatch in SST files

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46796: --- Labels: pull-request-available (was: ) > RocksDB versionID Mismatch in SST files >

[jira] [Updated] (SPARK-46687) Implement memory-profiler

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46687: --- Labels: pull-request-available (was: ) > Implement memory-profiler >

[jira] [Commented] (SPARK-46796) RocksDB versionID Mismatch in SST files

2024-01-22 Thread Bhuwan Sahni (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809634#comment-17809634 ] Bhuwan Sahni commented on SPARK-46796: -- Working on a PR for the fix. > RocksDB versionID Mismatch

[jira] [Created] (SPARK-46796) RocksDB versionID Mismatch in SST files

2024-01-22 Thread Bhuwan Sahni (Jira)
Bhuwan Sahni created SPARK-46796: Summary: RocksDB versionID Mismatch in SST files Key: SPARK-46796 URL: https://issues.apache.org/jira/browse/SPARK-46796 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-46779) Grouping by subquery with a cached relation can fail

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46779: - Assignee: Bruce Robbins > Grouping by subquery with a cached relation can fail >

[jira] [Resolved] (SPARK-46779) Grouping by subquery with a cached relation can fail

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46779. --- Fix Version/s: 3.4.3 3.5.1 4.0.0 Resolution:

[jira] [Created] (SPARK-46795) Replace UnsupportedOperationException by SparkUnsupportedOperationException in sql/core

2024-01-22 Thread Max Gekk (Jira)
Max Gekk created SPARK-46795: Summary: Replace UnsupportedOperationException by SparkUnsupportedOperationException in sql/core Key: SPARK-46795 URL: https://issues.apache.org/jira/browse/SPARK-46795

[jira] [Updated] (SPARK-46795) Replace UnsupportedOperationException by SparkUnsupportedOperationException in sql/core

2024-01-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-46795: - Description: Replace all UnsupportedOperationException by SparkUnsupportedOperationException in

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

2024-01-22 Thread nirav patel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Summary: Spark Connect 3.5 Classloading issue with external jar (was: Spark Connect 3.5

[jira] [Updated] (SPARK-46763) ReplaceDeduplicateWithAggregate fails when non-grouping keys have duplicate attributes

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46763: --- Labels: pull-request-available (was: ) > ReplaceDeduplicateWithAggregate fails when

[jira] [Commented] (SPARK-45404) Support AWS_ENDPOINT_URL env variable

2024-01-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809536#comment-17809536 ] Steve Loughran commented on SPARK-45404: Just saw this while working on SPARK-35878. If you

[jira] [Created] (SPARK-46794) Incorrect results due to inferred predicate from checkpoint with subquery

2024-01-22 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-46794: -- Summary: Incorrect results due to inferred predicate from checkpoint with subquery Key: SPARK-46794 URL: https://issues.apache.org/jira/browse/SPARK-46794

[jira] [Updated] (SPARK-46792) Refactor ChannelBuilder system

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46792: --- Labels: pull-request-available (was: ) > Refactor ChannelBuilder system >

[jira] [Updated] (SPARK-46793) Revert S3A endpoint fixup logic of SPARK-35878

2024-01-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-46793: --- Summary: Revert S3A endpoint fixup logic of SPARK-35878 (was: Revert region fixup logic of

[jira] [Created] (SPARK-46793) Revert region fixup logic of SPARK-35878

2024-01-22 Thread Steve Loughran (Jira)
Steve Loughran created SPARK-46793: -- Summary: Revert region fixup logic of SPARK-35878 Key: SPARK-46793 URL: https://issues.apache.org/jira/browse/SPARK-46793 Project: Spark Issue Type:

[jira] [Created] (SPARK-46792) Refactor ChannelBuilder system

2024-01-22 Thread Alice Sayutina (Jira)
Alice Sayutina created SPARK-46792: -- Summary: Refactor ChannelBuilder system Key: SPARK-46792 URL: https://issues.apache.org/jira/browse/SPARK-46792 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-46791) Support Java `Set` in JavaTypeInference

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46791. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44828

[jira] [Resolved] (SPARK-46777) Refactor `StreamingDataSourceRelation` into `StreamingDataSourceRelation` and `StreamingDataSourceScanRelation` for parity with batch scan

2024-01-22 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-46777. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44818

[jira] [Assigned] (SPARK-46777) Refactor `StreamingDataSourceRelation` into `StreamingDataSourceRelation` and `StreamingDataSourceScanRelation` for parity with batch scan

2024-01-22 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-46777: Assignee: Jackie Zhang > Refactor `StreamingDataSourceRelation` into

[jira] [Updated] (SPARK-46789) Add `VolumeSuite` to K8s IT

2024-01-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46789: -- Fix Version/s: 3.5.1 > Add `VolumeSuite` to K8s IT > --- > >

[jira] [Updated] (SPARK-46738) `Cast` displayed different results between Regular Spark and Spark Connect

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46738: --- Labels: pull-request-available (was: ) > `Cast` displayed different results between

[jira] [Updated] (SPARK-46738) `Cast` displayed different results between Regular Spark and Spark Connect

2024-01-22 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46738: Summary: `Cast` displayed different results between Regular Spark and Spark Connect (was: `Cast`

[jira] [Assigned] (SPARK-46718) Upgrade Arrow to 15.0.0

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46718: -- Assignee: (was: Apache Spark) > Upgrade Arrow to 15.0.0 >

[jira] [Assigned] (SPARK-46718) Upgrade Arrow to 15.0.0

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46718: -- Assignee: Apache Spark > Upgrade Arrow to 15.0.0 > --- > >

[jira] [Assigned] (SPARK-46789) Add `VolumeSuite` to K8s IT

2024-01-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46789: Assignee: Dongjoon Hyun > Add `VolumeSuite` to K8s IT > --- > >

[jira] [Resolved] (SPARK-46789) Add `VolumeSuite` to K8s IT

2024-01-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46789. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44827

[jira] [Assigned] (SPARK-46673) Refine docstring `aes_encrypt/aes_decrypt/try_aes_decrypt`

2024-01-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46673: Assignee: BingKun Pan > Refine docstring `aes_encrypt/aes_decrypt/try_aes_decrypt` >

[jira] [Resolved] (SPARK-46673) Refine docstring `aes_encrypt/aes_decrypt/try_aes_decrypt`

2024-01-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46673. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44750

[jira] [Updated] (SPARK-46791) Support Java `Set` in JavaTypeInference

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46791: --- Labels: pull-request-available (was: ) > Support Java `Set` in JavaTypeInference >

[jira] [Created] (SPARK-46791) Support Java `Set` in JavaTypeInference

2024-01-22 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-46791: --- Summary: Support Java `Set` in JavaTypeInference Key: SPARK-46791 URL: https://issues.apache.org/jira/browse/SPARK-46791 Project: Spark Issue Type: