[jira] [Assigned] (SPARK-47506) Support all file source formats for collated data types

[ https://issues.apache.org/jira/browse/SPARK-47506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-47506: Assignee: Stefan Kandic > Support all file source formats for collated data types >

[jira] [Resolved] (SPARK-47506) Support all file source formats for collated data types

[ https://issues.apache.org/jira/browse/SPARK-47506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47506. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45641

[jira] [Updated] (SPARK-47538) Remove `commons-logging` dependency

[ https://issues.apache.org/jira/browse/SPARK-47538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47538: --- Labels: pull-request-available (was: ) > Remove `commons-logging` dependency >

[jira] [Updated] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47537: --- Labels: pull-request-available (was: ) > Use MySQL Connector/J for MySQL DB instead of

[jira] [Created] (SPARK-47538) Remove `commons-logging` dependency

Dongjoon Hyun created SPARK-47538: - Summary: Remove `commons-logging` dependency Key: SPARK-47538 URL: https://issues.apache.org/jira/browse/SPARK-47538 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

Kent Yao created SPARK-47537: Summary: Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J Key: SPARK-47537 URL: https://issues.apache.org/jira/browse/SPARK-47537 Project: Spark

[jira] [Updated] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47537: - Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Use MySQL Connector/J for MySQL DB

[jira] [Assigned] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1

[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47536: - Assignee: Yang Jie > Upgrade jmock-junit5 to 2.13.1 > -- >

[jira] [Updated] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1

[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47536: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade jmock-junit5

[jira] [Resolved] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1

[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47536. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45669

[jira] [Updated] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1

[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47536: --- Labels: pull-request-available (was: ) > Upgrade jmock-junit5 to 2.13.1 >

[jira] [Resolved] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day

[ https://issues.apache.org/jira/browse/SPARK-47535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47535. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45686

[jira] [Created] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1

Yang Jie created SPARK-47536: Summary: Upgrade jmock-junit5 to 2.13.1 Key: SPARK-47536 URL: https://issues.apache.org/jira/browse/SPARK-47536 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day

[ https://issues.apache.org/jira/browse/SPARK-47535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47535: - Assignee: Dongjoon Hyun > Update `publish_snapshot.yml` to publish twice per day >

[jira] [Resolved] (SPARK-47527) Cache miss for queries using With expressions

[ https://issues.apache.org/jira/browse/SPARK-47527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-47527. --- Resolution: Duplicate > Cache miss for queries using With expressions >

[jira] [Updated] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day

[ https://issues.apache.org/jira/browse/SPARK-47535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47535: --- Labels: pull-request-available (was: ) > Update `publish_snapshot.yml` to publish twice

[jira] [Created] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day

Dongjoon Hyun created SPARK-47535: - Summary: Update `publish_snapshot.yml` to publish twice per day Key: SPARK-47535 URL: https://issues.apache.org/jira/browse/SPARK-47535 Project: Spark

[jira] [Resolved] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`

[ https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47534. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45685

[jira] [Updated] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`

[ https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47534: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Move `o.a.s.variant` to

[jira] [Assigned] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`

[ https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47534: - Assignee: Dongjoon Hyun > Move `o.a.s.variant` to `o.a.s.types.variant` >

[jira] [Updated] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`

[ https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47534: --- Labels: pull-request-available (was: ) > Move `o.a.s.variant` to `o.a.s.types.variant` >

[jira] [Updated] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`

[ https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47534: -- Description: {code} -package org.apache.spark.variant; +package

[jira] [Assigned] (SPARK-47516) Move `remove unused installation package logic` from `each test job` to `create the docker image`

[ https://issues.apache.org/jira/browse/SPARK-47516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47516: Assignee: BingKun Pan > Move `remove unused installation package logic` from `each test

[jira] [Resolved] (SPARK-47516) Move `remove unused installation package logic` from `each test job` to `create the docker image`

[ https://issues.apache.org/jira/browse/SPARK-47516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47516. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45659

[jira] [Resolved] (SPARK-47533) Migrate scalafmt dialect to scala213

[ https://issues.apache.org/jira/browse/SPARK-47533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47533. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45683

[jira] [Assigned] (SPARK-44708) Migrate test_reset_index assert_eq to use assertDataFrameEqual

[ https://issues.apache.org/jira/browse/SPARK-44708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44708: Assignee: Amanda Liu > Migrate test_reset_index assert_eq to use assertDataFrameEqual >

[jira] [Resolved] (SPARK-44708) Migrate test_reset_index assert_eq to use assertDataFrameEqual

[ https://issues.apache.org/jira/browse/SPARK-44708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44708. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45629

[jira] [Updated] (SPARK-47533) Migrate scalafmt dialect to scala213

[ https://issues.apache.org/jira/browse/SPARK-47533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47533: --- Labels: pull-request-available (was: ) > Migrate scalafmt dialect to scala213 >

[jira] [Created] (SPARK-47533) Migrate scalafmt dialect to scala213

BingKun Pan created SPARK-47533: --- Summary: Migrate scalafmt dialect to scala213 Key: SPARK-47533 URL: https://issues.apache.org/jira/browse/SPARK-47533 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47503: -- Fix Version/s: 3.5.2 > Spark history sever fails to display query for cached JDBC relation

[jira] [Commented] (SPARK-47489) Action performed on Dataset is triggering an error as "The Spark SQL phase planning failed with an internal error."

[ https://issues.apache.org/jira/browse/SPARK-47489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830286#comment-17830286 ] Jagadeesh Marada commented on SPARK-47489: -- Hi Team,  Can anyone check on this issue with

[jira] [Resolved] (SPARK-47528) Add UserDefinedType support to DataTypeUtils.canWrite

[ https://issues.apache.org/jira/browse/SPARK-47528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47528. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45678

[jira] [Assigned] (SPARK-47526) Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final

[ https://issues.apache.org/jira/browse/SPARK-47526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47526: - Assignee: BingKun Pan > Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to

[jira] [Resolved] (SPARK-47526) Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final

[ https://issues.apache.org/jira/browse/SPARK-47526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47526. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45676

[jira] [Resolved] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47503. --- Fix Version/s: 4.0.0 Assignee: alexey Resolution: Fixed This is resolved

[jira] [Resolved] (SPARK-47497) Make `to_csv` support the output of `array/struct/map` as pretty strings

[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47497. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45657

[jira] [Assigned] (SPARK-47497) Make `to_csv` support the output of `array/struct/map` as pretty strings

[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47497: - Assignee: BingKun Pan > Make `to_csv` support the output of `array/struct/map` as

[jira] [Resolved] (SPARK-47531) Upgrade Arrow to 15.0.2

[ https://issues.apache.org/jira/browse/SPARK-47531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47531. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45682