[jira] [Updated] (SPARK-46784) Create and use a K8s test tag for `PersistentVolume`

[ https://issues.apache.org/jira/browse/SPARK-46784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46784: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Create and use a K8s test tag

[jira] [Assigned] (SPARK-46784) Create and use a K8s test tag for `PersistentVolume`

[ https://issues.apache.org/jira/browse/SPARK-46784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46784: - Assignee: Dongjoon Hyun > Create and use a K8s test tag for `PersistentVolume` >

[jira] [Updated] (SPARK-46784) Create and use a K8s test tag for `PersistentVolume`

[ https://issues.apache.org/jira/browse/SPARK-46784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46784: --- Labels: pull-request-available (was: ) > Create and use a K8s test tag for

[jira] [Updated] (SPARK-46784) Create and use a K8s test tag for `PersistentVolume`

[ https://issues.apache.org/jira/browse/SPARK-46784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46784: -- Summary: Create and use a K8s test tag for `PersistentVolume` (was: Create a K8s test tag

[jira] [Updated] (SPARK-46784) Create a K8s test tag for `PersistentVolume` and use it

[ https://issues.apache.org/jira/browse/SPARK-46784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46784: -- Summary: Create a K8s test tag for `PersistentVolume` and use it (was: Create K8s test tag

[jira] [Created] (SPARK-46784) Create K8s test tag for `PersistentVolume` and use it

Dongjoon Hyun created SPARK-46784: - Summary: Create K8s test tag for `PersistentVolume` and use it Key: SPARK-46784 URL: https://issues.apache.org/jira/browse/SPARK-46784 Project: Spark

[jira] [Updated] (SPARK-46783) Use `built-in` storage classes in PVTestsSuite

[ https://issues.apache.org/jira/browse/SPARK-46783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46783: --- Labels: pull-request-available (was: ) > Use `built-in` storage classes in PVTestsSuite >

[jira] [Created] (SPARK-46783) Use `built-in` storage classes in PVTestsSuite

Dongjoon Hyun created SPARK-46783: - Summary: Use `built-in` storage classes in PVTestsSuite Key: SPARK-46783 URL: https://issues.apache.org/jira/browse/SPARK-46783 Project: Spark Issue Type:

[jira] [Updated] (SPARK-44495) Resume to use the latest minikube for k8s-it on GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-44495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44495: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Resume to use the latest

[jira] [Created] (SPARK-46782) Bad SQLSTATE "ID001" for INVALID_INVERSE_DISTRIBUTION_FUNCTION

Serge Rielau created SPARK-46782: Summary: Bad SQLSTATE "ID001" for INVALID_INVERSE_DISTRIBUTION_FUNCTION Key: SPARK-46782 URL: https://issues.apache.org/jira/browse/SPARK-46782 Project: Spark

[jira] [Resolved] (SPARK-46467) Improve and test exceptions of TimedeltaIndex

[ https://issues.apache.org/jira/browse/SPARK-46467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-46467. -- Assignee: Xinrong Meng Resolution: Not A Problem We don't have a plan to migrate Pandas

[jira] [Updated] (SPARK-46781) Test custom data source and input partition (pyspark.sql.datasource)

[ https://issues.apache.org/jira/browse/SPARK-46781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46781: --- Labels: pull-request-available (was: ) > Test custom data source and input partition

[jira] [Created] (SPARK-46781) Test data source (pyspark.sql.datasource)

Xinrong Meng created SPARK-46781: Summary: Test data source (pyspark.sql.datasource) Key: SPARK-46781 URL: https://issues.apache.org/jira/browse/SPARK-46781 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46781) Test custom data source and input partition (pyspark.sql.datasource)

[ https://issues.apache.org/jira/browse/SPARK-46781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-46781: - Summary: Test custom data source and input partition (pyspark.sql.datasource) (was: Test data

[jira] [Resolved] (SPARK-46780) Improve SBT K8s IT to skip R image build step if not needed

[ https://issues.apache.org/jira/browse/SPARK-46780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46780. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44807

[jira] [Assigned] (SPARK-46780) Improve SBT K8s IT to skip R image build step if not needed

[ https://issues.apache.org/jira/browse/SPARK-46780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46780: - Assignee: Dongjoon Hyun > Improve SBT K8s IT to skip R image build step if not needed

[jira] [Updated] (SPARK-46780) Improve SBT K8s IT to skip R image build step if not needed

[ https://issues.apache.org/jira/browse/SPARK-46780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46780: -- Summary: Improve SBT K8s IT to skip R image build step if not needed (was: Support skipping

[jira] [Updated] (SPARK-46779) Grouping by subquery with a cached relation can fail

[ https://issues.apache.org/jira/browse/SPARK-46779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-46779: -- Description: Example: {noformat} create or replace temp view data(c1, c2) as values (1, 2),

[jira] [Updated] (SPARK-46779) Grouping by subquery with a cached relation can fail

[ https://issues.apache.org/jira/browse/SPARK-46779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-46779: -- Affects Version/s: 3.5.0 3.4.2 > Grouping by subquery with a cached

[jira] [Updated] (SPARK-46779) Grouping by subquery with a cached relation can fail

[ https://issues.apache.org/jira/browse/SPARK-46779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46779: --- Labels: pull-request-available (was: ) > Grouping by subquery with a cached relation can

[jira] [Updated] (SPARK-46780) Support skipping R image build step

[ https://issues.apache.org/jira/browse/SPARK-46780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46780: --- Labels: pull-request-available (was: ) > Support skipping R image build step >

[jira] [Created] (SPARK-46780) Support skipping R image build step

Dongjoon Hyun created SPARK-46780: - Summary: Support skipping R image build step Key: SPARK-46780 URL: https://issues.apache.org/jira/browse/SPARK-46780 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-46779) Grouping by subquery with a cached relation can fail

Bruce Robbins created SPARK-46779: - Summary: Grouping by subquery with a cached relation can fail Key: SPARK-46779 URL: https://issues.apache.org/jira/browse/SPARK-46779 Project: Spark Issue

[jira] [Created] (SPARK-46778) get_json_object flattens wildcard queries that match a single value

Robert Joseph Evans created SPARK-46778: --- Summary: get_json_object flattens wildcard queries that match a single value Key: SPARK-46778 URL: https://issues.apache.org/jira/browse/SPARK-46778

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: We are having following `java.lang.ClassCastException` error in spark Executors

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: We are having following `java.lang.ClassCastException` error in spark Executors

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: We are having following `java.lang.ClassCastException` error in spark Executors

[jira] [Assigned] (SPARK-46773) Change to use whitelist to generate assemblyExcludedJars for the connect server module

[ https://issues.apache.org/jira/browse/SPARK-46773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46773: - Assignee: Yang Jie > Change to use whitelist to generate assemblyExcludedJars for the

[jira] [Resolved] (SPARK-46773) Change to use whitelist to generate assemblyExcludedJars for the connect server module

[ https://issues.apache.org/jira/browse/SPARK-46773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46773. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44798

[jira] [Resolved] (SPARK-46774) Do not use deprecated mapred.output.compress in Avro files

[ https://issues.apache.org/jira/browse/SPARK-46774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46774. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44799

[jira] [Assigned] (SPARK-46774) Do not use deprecated mapred.output.compress in Avro files

[ https://issues.apache.org/jira/browse/SPARK-46774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46774: - Assignee: Kent Yao > Do not use deprecated mapred.output.compress in Avro files >

[jira] [Created] (SPARK-46777) Refactor `StreamingDataSourceRelation` into `StreamingDataSourceRelation` and `StreamingDataSourceScanRelation` for parity with batch scan

Jackie Zhang created SPARK-46777: Summary: Refactor `StreamingDataSourceRelation` into `StreamingDataSourceRelation` and `StreamingDataSourceScanRelation` for parity with batch scan Key: SPARK-46777 URL:

[jira] [Created] (SPARK-46776) Pandas UDF Serialization Error: Expected Array, got

Kyle Osborne created SPARK-46776: Summary: Pandas UDF Serialization Error: Expected Array, got Key: SPARK-46776 URL: https://issues.apache.org/jira/browse/SPARK-46776 Project: Spark Issue

[jira] [Updated] (SPARK-46775) Fix formatting of Kinesis docs

[ https://issues.apache.org/jira/browse/SPARK-46775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46775: --- Labels: pull-request-available (was: ) > Fix formatting of Kinesis docs >

[jira] [Created] (SPARK-46775) Fix formatting of Kinesis docs

Nicholas Chammas created SPARK-46775: Summary: Fix formatting of Kinesis docs Key: SPARK-46775 URL: https://issues.apache.org/jira/browse/SPARK-46775 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46771) InMemoryTableScanExec#outputPartitioning does not update the KeyGroupedPartitioning#expressions

[ https://issues.apache.org/jira/browse/SPARK-46771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Никита Соколов updated SPARK-46771: --- Description: Only expression-based partitionings get updated, so the KeyGroupedPartitioning

[jira] [Updated] (SPARK-46774) Do not use deprecated mapred.output.compress in Avro files

[ https://issues.apache.org/jira/browse/SPARK-46774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46774: --- Labels: pull-request-available (was: ) > Do not use deprecated mapred.output.compress in

[jira] [Created] (SPARK-46774) Do not use deprecated mapred.output.compress in Avro files

Kent Yao created SPARK-46774: Summary: Do not use deprecated mapred.output.compress in Avro files Key: SPARK-46774 URL: https://issues.apache.org/jira/browse/SPARK-46774 Project: Spark Issue

[jira] [Updated] (SPARK-46773) Change to use whitelist to generate assemblyExcludedJars for the connect server module

[ https://issues.apache.org/jira/browse/SPARK-46773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46773: --- Labels: pull-request-available (was: ) > Change to use whitelist to generate

[jira] [Created] (SPARK-46773) Change to use whitelist to generate assemblyExcludedJars for the connect server module

Yang Jie created SPARK-46773: Summary: Change to use whitelist to generate assemblyExcludedJars for the connect server module Key: SPARK-46773 URL: https://issues.apache.org/jira/browse/SPARK-46773

[jira] [Created] (SPARK-46772) Benchmarking Avro with ZSTD

Kent Yao created SPARK-46772: Summary: Benchmarking Avro with ZSTD Key: SPARK-46772 URL: https://issues.apache.org/jira/browse/SPARK-46772 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-46768) Upgrade the Guava version used by the connect module to 33.0-jre

[ https://issues.apache.org/jira/browse/SPARK-46768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46768. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44795

[jira] [Assigned] (SPARK-46768) Upgrade the Guava version used by the connect module to 33.0-jre

[ https://issues.apache.org/jira/browse/SPARK-46768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46768: Assignee: Yang Jie > Upgrade the Guava version used by the connect module to 33.0-jre >

[jira] [Resolved] (SPARK-46770) Remove legacy `docker-for-desktop` logic

[ https://issues.apache.org/jira/browse/SPARK-46770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46770. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44796

[jira] [Updated] (SPARK-46718) Upgrade Arrow to 15.0.0

[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46718: --- Labels: pull-request-available (was: ) > Upgrade Arrow to 15.0.0 > ---

[jira] [Created] (SPARK-46771) InMemoryTableScanExec#outputPartitioning does not update the KeyGroupedPartitioning#expressions

Никита Соколов created SPARK-46771: -- Summary: InMemoryTableScanExec#outputPartitioning does not update the KeyGroupedPartitioning#expressions Key: SPARK-46771 URL: