[jira] [Updated] (SPARK-48197) avoid assert error for invalid lambda function

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48197: --- Labels: pull-request-available (was: ) > avoid assert error for invalid lambda funct

[jira] [Resolved] (SPARK-48161) JSON expressions (all collations)

2024-05-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48161. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46462 [https

[jira] [Updated] (SPARK-47972) Restrict CAST expression for collations

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47972: --- Labels: pull-request-available (was: ) > Restrict CAST expression for collati

[jira] [Assigned] (SPARK-48188) Consistently use normalized plan for cache

2024-05-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48188: Assignee: Wenchen Fan > Consistently use normalized plan for ca

[jira] [Resolved] (SPARK-48188) Consistently use normalized plan for cache

2024-05-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48188. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46465 [https

[jira] [Resolved] (SPARK-48191) Support UTF-32 for string encode and decode

2024-05-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48191. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46469 [https

[jira] [Created] (SPARK-48196) Make lazy val plans in QueryExecution Trys to not re-execute on error

2024-05-08 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-48196: - Summary: Make lazy val plans in QueryExecution Trys to not re-execute on error Key: SPARK-48196 URL: https://issues.apache.org/jira/browse/SPARK-48196

[jira] [Created] (SPARK-48195) Keep and RDD created by SparkPlan doExecute

2024-05-08 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-48195: - Summary: Keep and RDD created by SparkPlan doExecute Key: SPARK-48195 URL: https://issues.apache.org/jira/browse/SPARK-48195 Project: Spark Issue

[jira] [Assigned] (SPARK-48087) Python UDTF incompatibility in 3.5 client <> 4.0 server

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48087: Assignee: Hyukjin Kwon > Python UDTF incompatibility in 3.5 client <> 4

[jira] [Resolved] (SPARK-48087) Python UDTF incompatibility in 3.5 client <> 4.0 server

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48087. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46473 [https

[jira] [Resolved] (SPARK-48190) Introduce a helper function to drop metadata

2024-05-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-48190. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46466 [https

[jira] [Resolved] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48094. -- Assignee: Dongjoon Hyun Resolution: Done Seems like we're done :-)? I will resolve

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48094: - Fix Version/s: 4.0.0 > Reduce GitHub Action usage according to ASF project allowa

[jira] [Updated] (SPARK-48163) Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48163: - Fix Version/s: (was: 4.0.0) > Disable `SparkConnectServiceSuite.SPARK-43923: commands s

[jira] [Reopened] (SPARK-48163) Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-48163: -- Assignee: (was: Dongjoon Hyun) > Disable `SparkConnectServiceSuite.SPARK-43

[jira] [Commented] (SPARK-48163) Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844618#comment-17844618 ] Hyukjin Kwon commented on SPARK-48163: -- reverted in https://github.com/apache/spark/commit

[jira] [Resolved] (SPARK-48164) Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48164. -- Resolution: Invalid > Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send eve

[jira] [Updated] (SPARK-48164) Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48164: - Target Version/s: (was: 4.0.0) > Re-enable `SparkConnectServiceSuite.SPARK-43923: comma

[jira] [Updated] (SPARK-48087) Python UDTF incompatibility in 3.5 client <> 4.0 server

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48087: --- Labels: pull-request-available (was: ) > Python UDTF incompatibility in 3.5 client <

[jira] [Resolved] (SPARK-48193) Make `maven-deploy-plugin` retry 3 times

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48193. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46471 [https

[jira] [Assigned] (SPARK-48193) Make `maven-deploy-plugin` retry 3 times

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48193: Assignee: BingKun Pan > Make `maven-deploy-plugin` retry 3 ti

[jira] [Assigned] (SPARK-48185) Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo'

2024-05-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48185: Assignee: Kent Yao > Fix 'symbolic reference class is not accessible: cl

[jira] [Resolved] (SPARK-48185) Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo'

2024-05-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48185. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46457 [https

[jira] [Updated] (SPARK-48161) JSON expressions (all collations)

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48161: --- Labels: pull-request-available (was: ) > JSON expressions (all collati

[jira] [Created] (SPARK-48194) OOM exception / infinite loop when having multiple alias column projections

2024-05-08 Thread Laurens Versluis (Jira)
Laurens Versluis created SPARK-48194: Summary: OOM exception / infinite loop when having multiple alias column projections Key: SPARK-48194 URL: https://issues.apache.org/jira/browse/SPARK-48194

[jira] [Updated] (SPARK-48175) Store collation information in metadata and not in type for SER/DE

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48175: --- Labels: pull-request-available (was: ) > Store collation information in metad

[jira] [Updated] (SPARK-48193) Make `maven-deploy-plugin` retry 3 times

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48193: --- Labels: pull-request-available (was: ) > Make `maven-deploy-plugin` retry 3 ti

[jira] [Resolved] (SPARK-48192) Enable TPC-DS tests in forked repository

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48192. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46470 [https

[jira] [Assigned] (SPARK-48192) Enable TPC-DS tests in forked repository

2024-05-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48192: Assignee: Hyukjin Kwon > Enable TPC-DS tests in forked reposit

[jira] [Updated] (SPARK-48192) Enable TPC-DS tests in forked repository

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48192: --- Labels: pull-request-available (was: ) > Enable TPC-DS tests in forked reposit

[jira] [Created] (SPARK-48193) Make `maven-deploy-plugin` retry 3 times

2024-05-08 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48193: --- Summary: Make `maven-deploy-plugin` retry 3 times Key: SPARK-48193 URL: https://issues.apache.org/jira/browse/SPARK-48193 Project: Spark Issue Type

[jira] [Created] (SPARK-48192) Enable TPC-DS tests in forked repository

2024-05-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48192: Summary: Enable TPC-DS tests in forked repository Key: SPARK-48192 URL: https://issues.apache.org/jira/browse/SPARK-48192 Project: Spark Issue Type: Sub

[jira] [Updated] (SPARK-48184) Always set the seed of dataframe.sample in Client side

2024-05-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-48184: -- Description: In Spark Classic: In [1]: df = spark.range(1).sample(0.1) In [2]: [df.count

[jira] [Updated] (SPARK-48191) Support UTF-32 for string encode and decode

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48191: --- Labels: pull-request-available (was: ) > Support UTF-32 for string encode and dec

[jira] [Created] (SPARK-48191) Support UTF-32 for string encode and decode

2024-05-08 Thread Vladimir Golubev (Jira)
Vladimir Golubev created SPARK-48191: Summary: Support UTF-32 for string encode and decode Key: SPARK-48191 URL: https://issues.apache.org/jira/browse/SPARK-48191 Project: Spark Issue

[jira] [Updated] (SPARK-48187) Run `docs` only in PR builders and `build_non_ansi` Daily CI

2024-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48187: -- Summary: Run `docs` only in PR builders and `build_non_ansi` Daily CI (was: Run `docs` only

[jira] [Resolved] (SPARK-48187) Run `docs` only in PR builders and Java 21 Daily CI

2024-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48187. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46463 [https

[jira] [Created] (SPARK-48189) Fix EXCEPT ALL behaviour for UTF8_BINARY_LCASE

2024-05-08 Thread Jira
Uroš Bojanić created SPARK-48189: Summary: Fix EXCEPT ALL behaviour for UTF8_BINARY_LCASE Key: SPARK-48189 URL: https://issues.apache.org/jira/browse/SPARK-48189 Project: Spark Issue Type

[jira] [Updated] (SPARK-48172) Fix escaping issues in JDBCDialects

2024-05-08 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-48172: -- Summary: Fix escaping issues in JDBCDialects (was: Fix escaping issue

[jira] [Updated] (SPARK-48172) Fix escaping issue in JDBCDialects

2024-05-08 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-48172: -- Summary: Fix escaping issue in JDBCDialects (was: Fix escaping issue for mysql

[jira] [Updated] (SPARK-48188) Consistently use normalized plan for cache

2024-05-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48188: --- Labels: pull-request-available (was: ) > Consistently use normalized plan for ca

[jira] [Created] (SPARK-48188) Consistently use normalized plan for cache

2024-05-08 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-48188: --- Summary: Consistently use normalized plan for cache Key: SPARK-48188 URL: https://issues.apache.org/jira/browse/SPARK-48188 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-48187) Run `docs` only in PR builders and Java 21 Daily CI

2024-05-08 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-48187: - Summary: Run `docs` only in PR builders and Java 21 Daily CI Key: SPARK-48187 URL: https://issues.apache.org/jira/browse/SPARK-48187 Project: Spark Issue

[jira] [Updated] (SPARK-48187) Run `docs` only in PR builders and Java 21 Daily CI

2024-05-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48187: --- Labels: pull-request-available (was: ) > Run `docs` only in PR builders and Java 21 Da

[jira] [Updated] (SPARK-48138) Disable a flaky `SparkSessionE2ESuite.interrupt tag` test

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48138: -- Fix Version/s: 3.5.2 > Disable a flaky `SparkSessionE2ESuite.interrupt tag` t

[jira] [Updated] (SPARK-48139) Re-enable `SparkSessionE2ESuite.interrupt tag`

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48139: -- Affects Version/s: 3.5.2 > Re-enable `SparkSessionE2ESuite.interrupt

[jira] [Updated] (SPARK-48037) SortShuffleWriter lacks shuffle write related metrics resulting in potentially inaccurate data

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48037: -- Fix Version/s: 3.5.2 > SortShuffleWriter lacks shuffle write related metrics result

[jira] [Updated] (SPARK-48160) XPath expressions (all collations)

2024-05-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-48160: - Component/s: SQL (was: Spark Core) > XPath expressions (all collati

[jira] [Updated] (SPARK-48158) XML expressions (all collations)

2024-05-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-48158: - Component/s: SQL (was: Spark Core) > XML expressions (all collati

[jira] [Updated] (SPARK-48159) Datetime expressions (all collations)

2024-05-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-48159: - Component/s: SQL (was: Spark Core) > Datetime expressions (all collati

[jira] [Updated] (SPARK-48157) CSV expressions (all collations)

2024-05-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-48157: - Component/s: SQL (was: Spark Core) > CSV expressions (all collati

[jira] [Updated] (SPARK-48161) JSON expressions (all collations)

2024-05-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-48161: - Component/s: SQL (was: Spark Core) > JSON expressions (all collati

[jira] [Updated] (SPARK-48162) Miscellaneous expressions (all collations)

2024-05-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-48162: - Component/s: SQL (was: Spark Core) > Miscellaneous expressions (

[jira] [Created] (SPARK-48186) Add support for AbstractMapType

2024-05-07 Thread Jira
Uroš Bojanić created SPARK-48186: Summary: Add support for AbstractMapType Key: SPARK-48186 URL: https://issues.apache.org/jira/browse/SPARK-48186 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-48183) Update error contribution guide to respect new error class file

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48183. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46455 [https

[jira] [Assigned] (SPARK-48183) Update error contribution guide to respect new error class file

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48183: - Assignee: Haejoon Lee > Update error contribution guide to respect new error cl

[jira] [Resolved] (SPARK-47914) Do not display the splits parameter in Rang

2024-05-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47914. -- Resolution: Fixed Issue resolved by pull request 46136 [https://github.com/apache/spark/pull/46136

[jira] [Assigned] (SPARK-47914) Do not display the splits parameter in Rang

2024-05-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47914: Assignee: guihuawen > Do not display the splits parameter in R

[jira] [Updated] (SPARK-48185) Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo'

2024-05-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48185: --- Labels: pull-request-available (was: ) > Fix 'symbolic reference class is not accessi

[jira] [Created] (SPARK-48185) Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo'

2024-05-07 Thread Kent Yao (Jira)
Kent Yao created SPARK-48185: Summary: Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo' Key: SPARK-48185 URL: https://issues.apache.org/jira/browse/SPARK-48185 Project

[jira] [Updated] (SPARK-48183) Update error contribution guide to respect new error class file

2024-05-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48183: --- Labels: pull-request-available (was: ) > Update error contribution guide to respect

[jira] [Created] (SPARK-48183) Update error contribution guide to respect new error class file

2024-05-07 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-48183: --- Summary: Update error contribution guide to respect new error class file Key: SPARK-48183 URL: https://issues.apache.org/jira/browse/SPARK-48183 Project: Spark

[jira] [Updated] (SPARK-47365) Add toArrowTable() DataFrame method to PySpark

2024-05-07 Thread Ian Cook (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Cook updated SPARK-47365: - Description: Over in the Apache Arrow community, we hear from a lot of users who want to return

[jira] [Resolved] (SPARK-48126) Make spark.log.structuredLogging.enabled effective

2024-05-07 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48126. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46452 [https

[jira] [Updated] (SPARK-47365) Add toArrowTable() DataFrame method to PySpark

2024-05-07 Thread Ian Cook (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Cook updated SPARK-47365: - Summary: Add toArrowTable() DataFrame method to PySpark (was: Add _toArrowTable() DataFrame method

[jira] [Assigned] (SPARK-48045) Pandas API groupby with multi-agg-relabel ignores as_index=False

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48045: Assignee: Saidatt Sinai Amonkar > Pandas API groupby with multi-agg-relabel igno

[jira] [Resolved] (SPARK-48045) Pandas API groupby with multi-agg-relabel ignores as_index=False

2024-05-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48045. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46391 [https

[jira] [Resolved] (SPARK-48152) Make spark-profiler as a part of release and publish to maven central repo

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48152. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46402 [https

[jira] [Assigned] (SPARK-48152) Make spark-profiler as a part of release and publish to maven central repo

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48152: - Assignee: BingKun Pan > Make spark-profiler as a part of release and publish to ma

[jira] [Assigned] (SPARK-47960) Support Chaining Stateful Operators in TransformWithState

2024-05-07 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-47960: Assignee: Bhuwan Sahni > Support Chaining Stateful Operators in TransformWithSt

[jira] [Resolved] (SPARK-47960) Support Chaining Stateful Operators in TransformWithState

2024-05-07 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47960. -- Resolution: Fixed Issue resolved by pull request 45376 [https://github.com/apache/spark/pull

[jira] [Updated] (SPARK-48126) Make spark.log.structuredLogging.enabled effective

2024-05-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48126: --- Labels: pull-request-available (was: ) > Make spark.log.structuredLogging.enab

[jira] [Commented] (SPARK-48180) Analyzer bug with multiple ORDER BY items for input table argument

2024-05-07 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844471#comment-17844471 ] Daniel commented on SPARK-48180: Fix here: [https://github.com/apache/spark/pull/46451] > Analyzer

[jira] [Updated] (SPARK-48126) Make spark.log.structuredLogging.enabled effective

2024-05-07 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48126: --- Summary: Make spark.log.structuredLogging.enabled effective (was: Make

[jira] [Updated] (SPARK-48180) Analyzer bug with multiple ORDER BY items for input table argument

2024-05-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48180: --- Labels: pull-request-available (was: ) > Analyzer bug with multiple ORDER BY it

[jira] [Updated] (SPARK-48182) SQL (java side): Migrate `error/warn/info` with variables to structured logging framework

2024-05-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48182: --- Labels: pull-request-available (was: ) > SQL (java side): Migrate `error/warn/i

[jira] [Created] (SPARK-48182) SQL (java side): Migrate `error/warn/info` with variables to structured logging framework

2024-05-07 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48182: --- Summary: SQL (java side): Migrate `error/warn/info` with variables to structured logging framework Key: SPARK-48182 URL: https://issues.apache.org/jira/browse/SPARK-48182

[jira] [Updated] (SPARK-48152) Make spark-profiler as a part of release and publish to maven central repo

2024-05-07 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48152: Summary: Make spark-profiler as a part of release and publish to maven central repo

[jira] [Resolved] (SPARK-48178) Run `build/scala-213/java-11-17` jobs of branch-3.5 only if needed

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48178. --- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46449 [https

[jira] [Commented] (SPARK-48180) Analyzer bug with multiple ORDER BY items for input table argument

2024-05-07 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844467#comment-17844467 ] Daniel commented on SPARK-48180: The bug is that parentheses are required around the two arguments

[jira] [Assigned] (SPARK-48178) Run `build/scala-213/java-11-17` jobs of branch-3.5 only if needed

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48178: - Assignee: Dongjoon Hyun > Run `build/scala-213/java-11-17` jobs of branch-3.5 o

[jira] [Created] (SPARK-48181) Unify StreamingPythonRunner and PythonPlannerRunner

2024-05-07 Thread Wei Liu (Jira)
Wei Liu created SPARK-48181: --- Summary: Unify StreamingPythonRunner and PythonPlannerRunner Key: SPARK-48181 URL: https://issues.apache.org/jira/browse/SPARK-48181 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-48178) Run `build/scala-213/java-11-17` jobs of branch-3.5 only if needed

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48178: -- Summary: Run `build/scala-213/java-11-17` jobs of branch-3.5 only if needed (was: Run `build

[jira] [Resolved] (SPARK-48179) Pin `nbsphinx` to `0.9.3`

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48179. --- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46448 [https

[jira] [Assigned] (SPARK-48179) Pin `nbsphinx` to `0.9.3`

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48179: - Assignee: Dongjoon Hyun > Pin `nbsphinx` to `0.

[jira] [Updated] (SPARK-48179) Pin `nbsphinx` to `0.9.3`

2024-05-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48179: --- Labels: pull-request-available (was: ) > Pin `nbsphinx` to `0.

[jira] [Created] (SPARK-48180) Analyzer bug with multiple ORDER BY items for input table argument

2024-05-07 Thread Daniel (Jira)
Daniel created SPARK-48180: -- Summary: Analyzer bug with multiple ORDER BY items for input table argument Key: SPARK-48180 URL: https://issues.apache.org/jira/browse/SPARK-48180 Project: Spark

[jira] [Created] (SPARK-48179) Pin `nbsphinx` to `0.9.3`

2024-05-07 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-48179: - Summary: Pin `nbsphinx` to `0.9.3` Key: SPARK-48179 URL: https://issues.apache.org/jira/browse/SPARK-48179 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-48178) Run `build/scala-211/java-11-17` jobs of branch-3.5 only if needed

2024-05-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48178: --- Labels: pull-request-available (was: ) > Run `build/scala-211/java-11-17` jobs of bra

[jira] [Created] (SPARK-48178) Run `build/scala-211/java-11-17` jobs of branch-3.5 only if needed

2024-05-07 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-48178: - Summary: Run `build/scala-211/java-11-17` jobs of branch-3.5 only if needed Key: SPARK-48178 URL: https://issues.apache.org/jira/browse/SPARK-48178 Project: Spark

[jira] [Updated] (SPARK-48177) Upgrade `Parquet` to 1.14.0

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48177: -- Summary: Upgrade `Parquet` to 1.14.0 (was: Bump Parquet to 1.14.0) > Upgrade `Parq

[jira] [Updated] (SPARK-48177) Bump Parquet to 1.14.0

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48177: -- Affects Version/s: 4.0.0 (was: 3.5.2) > Bump Parquet to 1.1

[jira] [Assigned] (SPARK-48177) Bump Parquet to 1.14.0

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48177: - Assignee: Fokko Driesprong > Bump Parquet to 1.1

[jira] [Updated] (SPARK-48177) Bump Parquet to 1.14.0

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48177: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Bump Parquet to 1.1

[jira] [Updated] (SPARK-48177) Bump Parquet to 1.14.0

2024-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48177: -- Fix Version/s: (was: 4.0.0) > Bump Parquet to 1.1

[jira] [Updated] (SPARK-48177) Bump Parquet to 1.14.0

2024-05-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48177: --- Labels: pull-request-available (was: ) > Bump Parquet to 1.1

[jira] [Created] (SPARK-48177) Bump Parquet to 1.14.0

2024-05-07 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-48177: Summary: Bump Parquet to 1.14.0 Key: SPARK-48177 URL: https://issues.apache.org/jira/browse/SPARK-48177 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-48134) Spark core (java side): Migrate `error/warn/info` with variables to structured logging framework

2024-05-07 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48134. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46390 [https

[jira] [Assigned] (SPARK-48134) Spark core (java side): Migrate `error/warn/info` with variables to structured logging framework

2024-05-07 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48134: -- Assignee: BingKun Pan > Spark core (java side): Migrate `error/warn/i

[jira] [Created] (SPARK-48176) Fix name of FIELD_ALREADY_EXISTS error condition

2024-05-07 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-48176: Summary: Fix name of FIELD_ALREADY_EXISTS error condition Key: SPARK-48176 URL: https://issues.apache.org/jira/browse/SPARK-48176 Project: Spark

  1   2   3   4   5   6   7   8   9   10   >