[jira] [Created] (SPARK-48200) Split `build_python.yml` into per-version cron jobs

Dongjoon Hyun created SPARK-48200: - Summary: Split `build_python.yml` into per-version cron jobs Key: SPARK-48200 URL: https://issues.apache.org/jira/browse/SPARK-48200 Project: Spark Issue

[jira] [Resolved] (SPARK-48202) Spin off `pyspark` tests from `build_branch35.yml` Daily CI

[ https://issues.apache.org/jira/browse/SPARK-48202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48202. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46479

[jira] [Updated] (SPARK-48116) Run `pyspark-pandas*` only in PR builder and Daily Python CIs

[ https://issues.apache.org/jira/browse/SPARK-48116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48116: -- Fix Version/s: 3.5.2 > Run `pyspark-pandas*` only in PR builder and Daily Python CIs >

[jira] [Updated] (SPARK-48109) Enable `k8s-integration-tests` only for `kubernetes` module change

[ https://issues.apache.org/jira/browse/SPARK-48109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48109: -- Fix Version/s: 3.5.2 > Enable `k8s-integration-tests` only for `kubernetes` module change >

[jira] [Created] (SPARK-48205) Remove the private[sql] modifier for Python data sources

Allison Wang created SPARK-48205: Summary: Remove the private[sql] modifier for Python data sources Key: SPARK-48205 URL: https://issues.apache.org/jira/browse/SPARK-48205 Project: Spark

[jira] [Updated] (SPARK-47421) URL expressions (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47421: --- Labels: pull-request-available (was: ) > URL expressions (all collations) >

[jira] [Assigned] (SPARK-48200) Split `build_python.yml` into per-version cron jobs

[ https://issues.apache.org/jira/browse/SPARK-48200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48200: - Assignee: Dongjoon Hyun > Split `build_python.yml` into per-version cron jobs >

[jira] [Assigned] (SPARK-48149) Serialize `build_python.yml` to run a single Python version per cron schedule

[ https://issues.apache.org/jira/browse/SPARK-48149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48149: - Assignee: (was: Dongjoon Hyun) > Serialize `build_python.yml` to run a single

[jira] [Resolved] (SPARK-48200) Split `build_python.yml` into per-version cron jobs

[ https://issues.apache.org/jira/browse/SPARK-48200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48200. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46477

[jira] [Commented] (SPARK-48149) Serialize `build_python.yml` to run a single Python version per cron schedule

[ https://issues.apache.org/jira/browse/SPARK-48149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844713#comment-17844713 ] Dongjoon Hyun commented on SPARK-48149: --- This is technically reverted via SPARK-48200 > Serialize

[jira] [Reopened] (SPARK-48149) Serialize `build_python.yml` to run a single Python version per cron schedule

[ https://issues.apache.org/jira/browse/SPARK-48149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-48149: --- > Serialize `build_python.yml` to run a single Python version per cron schedule >

[jira] [Resolved] (SPARK-48149) Serialize `build_python.yml` to run a single Python version per cron schedule

[ https://issues.apache.org/jira/browse/SPARK-48149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48149. --- Fix Version/s: (was: 4.0.0) Resolution: Abandoned > Serialize `build_python.yml`

[jira] [Closed] (SPARK-48149) Serialize `build_python.yml` to run a single Python version per cron schedule

[ https://issues.apache.org/jira/browse/SPARK-48149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-48149. - > Serialize `build_python.yml` to run a single Python version per cron schedule >

[jira] [Commented] (SPARK-47134) Unexpected nulls when casting decimal values in specific cases

[ https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844720#comment-17844720 ] Dylan Walker commented on SPARK-47134: -- This ticket can be withdrawn. I can confirm that it is not

[jira] [Updated] (SPARK-48201) Docstrings of the pyspark DataStream Reader methods are inaccurate

[ https://issues.apache.org/jira/browse/SPARK-48201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48201: --- Labels: pull-request-available (was: ) > Docstrings of the pyspark DataStream Reader

[jira] [Resolved] (SPARK-48198) Upgrade jackson to 2.17.1

[ https://issues.apache.org/jira/browse/SPARK-48198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48198. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46476

[jira] [Updated] (SPARK-48198) Upgrade jackson to 2.17.1

[ https://issues.apache.org/jira/browse/SPARK-48198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48198: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade jackson to

[jira] [Commented] (SPARK-48201) Docstrings of the pyspark DataStream Reader methods are inaccurate

[ https://issues.apache.org/jira/browse/SPARK-48201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844719#comment-17844719 ] Chloe He commented on SPARK-48201: -- PR: https://github.com/apache/spark/pull/46416 > Docstrings of the

[jira] [Resolved] (SPARK-47545) [Connect] DF observe support for the scala client

[ https://issues.apache.org/jira/browse/SPARK-47545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-47545. --- Fix Version/s: 4.0.0 Assignee: Pengfei Xu Resolution: Fixed >

[jira] [Created] (SPARK-48206) Fix window rewrite in RewriteWithExpression

Kelvin Jiang created SPARK-48206: Summary: Fix window rewrite in RewriteWithExpression Key: SPARK-48206 URL: https://issues.apache.org/jira/browse/SPARK-48206 Project: Spark Issue Type:

[jira] [Created] (SPARK-48204) fix release script for Spark 4.0+

Wenchen Fan created SPARK-48204: --- Summary: fix release script for Spark 4.0+ Key: SPARK-48204 URL: https://issues.apache.org/jira/browse/SPARK-48204 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-48204) fix release script for Spark 4.0+

[ https://issues.apache.org/jira/browse/SPARK-48204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48204: --- Labels: pull-request-available (was: ) > fix release script for Spark 4.0+ >

[jira] [Updated] (SPARK-48162) Miscellaneous expressions (all collations)

[ https://issues.apache.org/jira/browse/SPARK-48162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48162: --- Labels: pull-request-available (was: ) > Miscellaneous expressions (all collations) >

[jira] [Updated] (SPARK-48186) Add support for AbstractMapType

[ https://issues.apache.org/jira/browse/SPARK-48186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48186: --- Labels: pull-request-available (was: ) > Add support for AbstractMapType >

[jira] [Updated] (SPARK-48200) Split `build_python.yml` into per-version cron jobs

[ https://issues.apache.org/jira/browse/SPARK-48200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48200: --- Labels: pull-request-available (was: ) > Split `build_python.yml` into per-version cron

[jira] [Updated] (SPARK-48116) Run `pyspark-pandas*` only in PR builder and Daily Python CIs

[ https://issues.apache.org/jira/browse/SPARK-48116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48116: -- Fix Version/s: 3.4.4 > Run `pyspark-pandas*` only in PR builder and Daily Python CIs >

[jira] [Created] (SPARK-48201) Docstrings of the pyspark DataStream Reader methods are inaccurate

Chloe He created SPARK-48201: Summary: Docstrings of the pyspark DataStream Reader methods are inaccurate Key: SPARK-48201 URL: https://issues.apache.org/jira/browse/SPARK-48201 Project: Spark

[jira] [Resolved] (SPARK-48203) Spin off `pyspark` tests from `build_branch34.yml` Daily CI

[ https://issues.apache.org/jira/browse/SPARK-48203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48203. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46480

[jira] [Updated] (SPARK-48205) Remove the private[sql] modifier for Python data sources

[ https://issues.apache.org/jira/browse/SPARK-48205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48205: --- Labels: pull-request-available (was: ) > Remove the private[sql] modifier for Python data

[jira] [Updated] (SPARK-48192) Enable TPC-DS tests in forked repository

[ https://issues.apache.org/jira/browse/SPARK-48192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48192: -- Fix Version/s: 3.5.2 > Enable TPC-DS tests in forked repository >

[jira] [Updated] (SPARK-48132) Run `k8s-integration-tests` only in PR builder and Daily CIs

[ https://issues.apache.org/jira/browse/SPARK-48132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48132: -- Fix Version/s: 3.4.4 > Run `k8s-integration-tests` only in PR builder and Daily CIs >

[jira] [Resolved] (SPARK-48205) Remove the private[sql] modifier for Python data sources

[ https://issues.apache.org/jira/browse/SPARK-48205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48205. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46487

[jira] [Assigned] (SPARK-48205) Remove the private[sql] modifier for Python data sources

[ https://issues.apache.org/jira/browse/SPARK-48205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48205: Assignee: Allison Wang > Remove the private[sql] modifier for Python data sources >

[jira] [Resolved] (SPARK-48197) avoid assert error for invalid lambda function

[ https://issues.apache.org/jira/browse/SPARK-48197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48197. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-48207) Run `build/scala-213/java-11-17` jobs of `branch-3.4` only if needed

[ https://issues.apache.org/jira/browse/SPARK-48207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48207. --- Fix Version/s: 3.4.4 Resolution: Fixed Issue resolved by pull request 46489

[jira] [Resolved] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48094. --- Assignee: Dongjoon Hyun Resolution: Fixed > Reduce GitHub Action usage according to

[jira] [Reopened] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-48094: --- Assignee: (was: Dongjoon Hyun) > Reduce GitHub Action usage according to ASF project

[jira] [Updated] (SPARK-48192) Enable TPC-DS and docker tests in forked repository

[ https://issues.apache.org/jira/browse/SPARK-48192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48192: -- Summary: Enable TPC-DS and docker tests in forked repository (was: Enable TPC-DS tests in

[jira] [Updated] (SPARK-48207) Run `build/scala-213/java-11-17` jobs of `branch-3.4` only if needed

[ https://issues.apache.org/jira/browse/SPARK-48207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48207: -- Summary: Run `build/scala-213/java-11-17` jobs of `branch-3.4` only if needed (was: Run

[jira] [Assigned] (SPARK-48207) Run `build/scala-213/java-11-17` jobs of `branch-3.4` only if needed

[ https://issues.apache.org/jira/browse/SPARK-48207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48207: - Assignee: Dongjoon Hyun > Run `build/scala-213/java-11-17` jobs of `branch-3.4` only

[jira] [Resolved] (SPARK-47134) Unexpected nulls when casting decimal values in specific cases

[ https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-47134. --- Resolution: Invalid > Unexpected nulls when casting decimal values in specific cases >

[jira] [Updated] (SPARK-48206) Add tests for window expression rewrites in RewriteWithExpression

[ https://issues.apache.org/jira/browse/SPARK-48206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48206: --- Labels: pull-request-available (was: ) > Add tests for window expression rewrites in

[jira] [Updated] (SPARK-47354) Variant expressions (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47354: --- Labels: pull-request-available (was: ) > Variant expressions (all collations) >

[jira] [Updated] (SPARK-48133) Run `sparkr` only in PR builders and Daily CIs

[ https://issues.apache.org/jira/browse/SPARK-48133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48133: -- Fix Version/s: 3.5.2 > Run `sparkr` only in PR builders and Daily CIs >

[jira] [Updated] (SPARK-48192) Enable TPC-DS and docker tests in forked repository

[ https://issues.apache.org/jira/browse/SPARK-48192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48192: -- Fix Version/s: 3.4.4 > Enable TPC-DS and docker tests in forked repository >

[jira] [Updated] (SPARK-47465) Remove experimental tag from toArrow() PySpark DataFrame method

[ https://issues.apache.org/jira/browse/SPARK-47465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Cook updated SPARK-47465: - Summary: Remove experimental tag from toArrow() PySpark DataFrame method (was: Remove experimental tag

[jira] [Updated] (SPARK-47465) Remove experimental tag from toArrow() PySpark DataFrame method

[ https://issues.apache.org/jira/browse/SPARK-47465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Cook updated SPARK-47465: - Description: As a follow-up to SPARK-47365: What is needed to consider making the *toArrow()* PySpark

[jira] [Updated] (SPARK-47365) Add toArrowTable() DataFrame method to PySpark

[ https://issues.apache.org/jira/browse/SPARK-47365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Cook updated SPARK-47365: - Description: Over in the Apache Arrow community, we hear from a lot of users who want to return the

[jira] [Updated] (SPARK-47365) Add toArrow() DataFrame method to PySpark

[ https://issues.apache.org/jira/browse/SPARK-47365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Cook updated SPARK-47365: - Summary: Add toArrow() DataFrame method to PySpark (was: Add toArrowTable() DataFrame method to

[jira] [Updated] (SPARK-47466) Add PySpark DataFrame method to return iterator of PyArrow RecordBatches

[ https://issues.apache.org/jira/browse/SPARK-47466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Cook updated SPARK-47466: - Description: As a follow-up to SPARK-47365: *toArrow()* is useful when the data is relatively small.

[jira] [Updated] (SPARK-47579) Spark core: Migrate logInfo with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47579: --- Labels: pull-request-available (was: ) > Spark core: Migrate logInfo with variables to

[jira] [Created] (SPARK-48210) Modify the description of whether dynamic partitioning is enabled in the “ Stage Level Scheduling Overview”

guihuawen created SPARK-48210: - Summary: Modify the description of whether dynamic partitioning is enabled in the “ Stage Level Scheduling Overview” Key: SPARK-48210 URL:

[jira] [Updated] (SPARK-48210) Modify the description of whether dynamic partitioning is enabled in the “ Stage Level Scheduling Overview”

[ https://issues.apache.org/jira/browse/SPARK-48210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48210: --- Labels: pull-request-available (was: ) > Modify the description of whether dynamic

[jira] [Created] (SPARK-48211) DB2: Read SMALLINT as ShortType

Kent Yao created SPARK-48211: Summary: DB2: Read SMALLINT as ShortType Key: SPARK-48211 URL: https://issues.apache.org/jira/browse/SPARK-48211 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-48208) Skip reporting memory usage metrics if bounded memory usage is enabled

Anish Shrigondekar created SPARK-48208: -- Summary: Skip reporting memory usage metrics if bounded memory usage is enabled Key: SPARK-48208 URL: https://issues.apache.org/jira/browse/SPARK-48208

[jira] [Created] (SPARK-48207) Run build/scala-213/java-11-17 jobs of `branch-3.4` only if needed

Dongjoon Hyun created SPARK-48207: - Summary: Run build/scala-213/java-11-17 jobs of `branch-3.4` only if needed Key: SPARK-48207 URL: https://issues.apache.org/jira/browse/SPARK-48207 Project: Spark

[jira] [Updated] (SPARK-48207) Run build/scala-213/java-11-17 jobs of `branch-3.4` only if needed

[ https://issues.apache.org/jira/browse/SPARK-48207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48207: --- Labels: pull-request-available (was: ) > Run build/scala-213/java-11-17 jobs of

[jira] [Updated] (SPARK-48208) Skip reporting memory usage metrics if bounded memory usage is enabled

[ https://issues.apache.org/jira/browse/SPARK-48208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48208: --- Labels: pull-request-available (was: ) > Skip reporting memory usage metrics if bounded

[jira] [Updated] (SPARK-48206) Add tests for window expression rewrites in RewriteWithExpression

[ https://issues.apache.org/jira/browse/SPARK-48206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kelvin Jiang updated SPARK-48206: - Description: Window expressions can be potentially problematic if we pull out a window

[jira] [Updated] (SPARK-48206) Add tests for window expression rewrites in RewriteWithExpression

[ https://issues.apache.org/jira/browse/SPARK-48206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kelvin Jiang updated SPARK-48206: - Summary: Add tests for window expression rewrites in RewriteWithExpression (was: Fix window

[jira] [Created] (SPARK-48209) Common (java side): Migrate `error/warn/info` with variables to structured logging framework

BingKun Pan created SPARK-48209: --- Summary: Common (java side): Migrate `error/warn/info` with variables to structured logging framework Key: SPARK-48209 URL: https://issues.apache.org/jira/browse/SPARK-48209

[jira] [Updated] (SPARK-48209) Common (java side): Migrate `error/warn/info` with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-48209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48209: --- Labels: pull-request-available (was: ) > Common (java side): Migrate `error/warn/info`

[jira] [Assigned] (SPARK-48182) SQL (java side): Migrate `error/warn/info` with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-48182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48182: -- Assignee: BingKun Pan > SQL (java side): Migrate `error/warn/info` with variables to

[jira] [Resolved] (SPARK-48182) SQL (java side): Migrate `error/warn/info` with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-48182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48182. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46450

[jira] [Commented] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844808#comment-17844808 ] Hyukjin Kwon commented on SPARK-48094: -- Woohoo! > Reduce GitHub Action usage according to ASF

[jira] [Resolved] (SPARK-48204) fix release script for Spark 4.0+

[ https://issues.apache.org/jira/browse/SPARK-48204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48204. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46484

[jira] [Assigned] (SPARK-48204) fix release script for Spark 4.0+

[ https://issues.apache.org/jira/browse/SPARK-48204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48204: - Assignee: Wenchen Fan > fix release script for Spark 4.0+ >

[jira] [Updated] (SPARK-48211) DB2: Read SMALLINT as ShortType

[ https://issues.apache.org/jira/browse/SPARK-48211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48211: --- Labels: pull-request-available (was: ) > DB2: Read SMALLINT as ShortType >

[jira] [Commented] (SPARK-47599) MLLib: Migrate logWarn with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844869#comment-17844869 ] Gengliang Wang commented on SPARK-47599: I checked with [~itholic] and he is not available for

[jira] [Created] (SPARK-48188) Consistently use normalized plan for cache

Wenchen Fan created SPARK-48188: --- Summary: Consistently use normalized plan for cache Key: SPARK-48188 URL: https://issues.apache.org/jira/browse/SPARK-48188 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-48172) Fix escaping issues in JDBCDialects

[ https://issues.apache.org/jira/browse/SPARK-48172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-48172: -- Summary: Fix escaping issues in JDBCDialects (was: Fix escaping issue in

[jira] [Updated] (SPARK-48172) Fix escaping issue in JDBCDialects

[ https://issues.apache.org/jira/browse/SPARK-48172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-48172: -- Summary: Fix escaping issue in JDBCDialects (was: Fix escaping issue for mysql) >

[jira] [Updated] (SPARK-48187) Run `docs` only in PR builders and `build_non_ansi` Daily CI

[ https://issues.apache.org/jira/browse/SPARK-48187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48187: -- Summary: Run `docs` only in PR builders and `build_non_ansi` Daily CI (was: Run `docs` only

[jira] [Created] (SPARK-48187) Run `docs` only in PR builders and Java 21 Daily CI

Dongjoon Hyun created SPARK-48187: - Summary: Run `docs` only in PR builders and Java 21 Daily CI Key: SPARK-48187 URL: https://issues.apache.org/jira/browse/SPARK-48187 Project: Spark Issue

[jira] [Created] (SPARK-48189) Fix EXCEPT ALL behaviour for UTF8_BINARY_LCASE

Uroš Bojanić created SPARK-48189: Summary: Fix EXCEPT ALL behaviour for UTF8_BINARY_LCASE Key: SPARK-48189 URL: https://issues.apache.org/jira/browse/SPARK-48189 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-48187) Run `docs` only in PR builders and Java 21 Daily CI

[ https://issues.apache.org/jira/browse/SPARK-48187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48187. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46463

[jira] [Updated] (SPARK-48188) Consistently use normalized plan for cache

[ https://issues.apache.org/jira/browse/SPARK-48188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48188: --- Labels: pull-request-available (was: ) > Consistently use normalized plan for cache >

[jira] [Updated] (SPARK-48192) Enable TPC-DS tests in forked repository

[ https://issues.apache.org/jira/browse/SPARK-48192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48192: --- Labels: pull-request-available (was: ) > Enable TPC-DS tests in forked repository >

[jira] [Created] (SPARK-48193) Make `maven-deploy-plugin` retry 3 times

BingKun Pan created SPARK-48193: --- Summary: Make `maven-deploy-plugin` retry 3 times Key: SPARK-48193 URL: https://issues.apache.org/jira/browse/SPARK-48193 Project: Spark Issue Type:

[jira] [Updated] (SPARK-48175) Store collation information in metadata and not in type for SER/DE

[ https://issues.apache.org/jira/browse/SPARK-48175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48175: --- Labels: pull-request-available (was: ) > Store collation information in metadata and not

[jira] [Created] (SPARK-48194) OOM exception / infinite loop when having multiple alias column projections

Laurens Versluis created SPARK-48194: Summary: OOM exception / infinite loop when having multiple alias column projections Key: SPARK-48194 URL: https://issues.apache.org/jira/browse/SPARK-48194

[jira] [Created] (SPARK-48192) Enable TPC-DS tests in forked repository

Hyukjin Kwon created SPARK-48192: Summary: Enable TPC-DS tests in forked repository Key: SPARK-48192 URL: https://issues.apache.org/jira/browse/SPARK-48192 Project: Spark Issue Type:

[jira] [Updated] (SPARK-48193) Make `maven-deploy-plugin` retry 3 times

[ https://issues.apache.org/jira/browse/SPARK-48193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48193: --- Labels: pull-request-available (was: ) > Make `maven-deploy-plugin` retry 3 times >

[jira] [Resolved] (SPARK-48185) Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo'

[ https://issues.apache.org/jira/browse/SPARK-48185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48185. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46457

[jira] [Assigned] (SPARK-48193) Make `maven-deploy-plugin` retry 3 times

[ https://issues.apache.org/jira/browse/SPARK-48193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48193: Assignee: BingKun Pan > Make `maven-deploy-plugin` retry 3 times >

[jira] [Updated] (SPARK-48191) Support UTF-32 for string encode and decode

[ https://issues.apache.org/jira/browse/SPARK-48191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48191: --- Labels: pull-request-available (was: ) > Support UTF-32 for string encode and decode >

[jira] [Updated] (SPARK-48161) JSON expressions (all collations)

[ https://issues.apache.org/jira/browse/SPARK-48161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48161: --- Labels: pull-request-available (was: ) > JSON expressions (all collations) >

[jira] [Assigned] (SPARK-48185) Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo'

[ https://issues.apache.org/jira/browse/SPARK-48185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48185: Assignee: Kent Yao > Fix 'symbolic reference class is not accessible: class >

[jira] [Created] (SPARK-48191) Support UTF-32 for string encode and decode

Vladimir Golubev created SPARK-48191: Summary: Support UTF-32 for string encode and decode Key: SPARK-48191 URL: https://issues.apache.org/jira/browse/SPARK-48191 Project: Spark Issue

[jira] [Updated] (SPARK-48184) Always set the seed of dataframe.sample in Client side

[ https://issues.apache.org/jira/browse/SPARK-48184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-48184: -- Description: In Spark Classic: In [1]: df = spark.range(1).sample(0.1) In [2]:

[jira] [Assigned] (SPARK-48192) Enable TPC-DS tests in forked repository

[ https://issues.apache.org/jira/browse/SPARK-48192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48192: Assignee: Hyukjin Kwon > Enable TPC-DS tests in forked repository >

[jira] [Resolved] (SPARK-48192) Enable TPC-DS tests in forked repository

[ https://issues.apache.org/jira/browse/SPARK-48192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48192. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46470

[jira] [Resolved] (SPARK-48193) Make `maven-deploy-plugin` retry 3 times

[ https://issues.apache.org/jira/browse/SPARK-48193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48193. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46471

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48094: - Fix Version/s: 4.0.0 > Reduce GitHub Action usage according to ASF project allowance >

[jira] [Resolved] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48094. -- Assignee: Dongjoon Hyun Resolution: Done Seems like we're done :-)? I will resolve this

[jira] [Created] (SPARK-48195) Keep and RDD created by SparkPlan doExecute

Juliusz Sompolski created SPARK-48195: - Summary: Keep and RDD created by SparkPlan doExecute Key: SPARK-48195 URL: https://issues.apache.org/jira/browse/SPARK-48195 Project: Spark Issue

[jira] [Created] (SPARK-48196) Make lazy val plans in QueryExecution Trys to not re-execute on error

Juliusz Sompolski created SPARK-48196: - Summary: Make lazy val plans in QueryExecution Trys to not re-execute on error Key: SPARK-48196 URL: https://issues.apache.org/jira/browse/SPARK-48196

[jira] [Resolved] (SPARK-48191) Support UTF-32 for string encode and decode

[ https://issues.apache.org/jira/browse/SPARK-48191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48191. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46469

[jira] [Updated] (SPARK-48087) Python UDTF incompatibility in 3.5 client <> 4.0 server

[ https://issues.apache.org/jira/browse/SPARK-48087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48087: --- Labels: pull-request-available (was: ) > Python UDTF incompatibility in 3.5 client <> 4.0

[jira] [Resolved] (SPARK-48087) Python UDTF incompatibility in 3.5 client <> 4.0 server

[ https://issues.apache.org/jira/browse/SPARK-48087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48087. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46473

  1   2   >