[jira] [Resolved] (SPARK-53563) PS: SQLProcessor.execute() builds a string inefficiently by concatenation

2025-09-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-53563. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 52322 [https://gi

[jira] [Resolved] (SPARK-43579) Cache the converter between Arrow and pandas for reuse

2025-09-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43579. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 52332 [https://gi

[jira] [Created] (SPARK-53574) nested query execution should also wipe out AnalysisContext

2025-09-14 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-53574: --- Summary: nested query execution should also wipe out AnalysisContext Key: SPARK-53574 URL: https://issues.apache.org/jira/browse/SPARK-53574 Project: Spark Is

[jira] [Resolved] (SPARK-53524) Fix temporal value conversion in LiteralValueProtoConverter

2025-09-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-53524. - Fix Version/s: 4.1.0 4.0.2 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-53524) Fix temporal value conversion in LiteralValueProtoConverter

2025-09-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-53524: --- Assignee: Yihong He > Fix temporal value conversion in LiteralValueProtoConverter > ---

[jira] [Resolved] (SPARK-53568) Fix several small bugs in Spark Connect Python client error handling logic

2025-09-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-53568. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 52325 [https://gi

[jira] [Updated] (SPARK-52186) An Optimization for EXISTS Subquery

2025-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52186: --- Labels: pull-request-available (was: ) > An Optimization for EXISTS Subquery >

[jira] [Assigned] (SPARK-53568) Fix several small bugs in Spark Connect Python client error handling logic

2025-09-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-53568: Assignee: Alex Khakhlyuk > Fix several small bugs in Spark Connect Python client error ha

[jira] [Resolved] (SPARK-53544) Support complex data type in python observed metrics

2025-09-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-53544. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 52321 [https://gi

[jira] [Assigned] (SPARK-53182) Broken and missing links in PySpark DataFrames user guide

2025-09-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-53182: Assignee: Jonny Comes > Broken and missing links in PySpark DataFrames user guide > -

[jira] [Resolved] (SPARK-53182) Broken and missing links in PySpark DataFrames user guide

2025-09-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-53182. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51851 [https://gi

[jira] [Assigned] (SPARK-53544) Support complex data type in python observed metrics

2025-09-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-53544: Assignee: Yihong He > Support complex data type in python observed metrics >

[jira] [Assigned] (SPARK-53563) PS: SQLProcessor.execute() builds a string inefficiently by concatenation

2025-09-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-53563: Assignee: Peter Nguyen > PS: SQLProcessor.execute() builds a string inefficiently by conc

[jira] [Created] (SPARK-53529) Spark Connect Client throw exception if remote is ipv6 arress

2025-09-14 Thread EdisonWang (Jira)
EdisonWang created SPARK-53529: -- Summary: Spark Connect Client throw exception if remote is ipv6 arress Key: SPARK-53529 URL: https://issues.apache.org/jira/browse/SPARK-53529 Project: Spark Is

[jira] [Commented] (SPARK-52381) JsonProtocol: tidy up deserialization

2025-09-14 Thread PJ Fanning (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18020201#comment-18020201 ] PJ Fanning commented on SPARK-52381: https://github.com/apache/spark/pull/51312 appe

[jira] [Updated] (SPARK-52381) JsonProtocol: tidy up deserialization

2025-09-14 Thread PJ Fanning (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PJ Fanning updated SPARK-52381: --- Fix Version/s: 4.0.1 > JsonProtocol: tidy up deserialization > -

[jira] [Created] (SPARK-53531) Better error message for HadoopRDD.getInputFormat

2025-09-14 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-53531: - Summary: Better error message for HadoopRDD.getInputFormat Key: SPARK-53531 URL: https://issues.apache.org/jira/browse/SPARK-53531 Project: Spark Issue Type: Impro

[jira] [Resolved] (SPARK-53569) Use `Iceberg` 1.10 for Iceberg integration test

2025-09-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-53569. --- Fix Version/s: connect-swift-0.4.0 Resolution: Fixed Issue resolved by pull request 2

[jira] [Updated] (SPARK-53559) Refactor HLL sketch update to use collation key bytes instead of string

2025-09-14 Thread Christopher Boumalhab (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Boumalhab updated SPARK-53559: -- Description: Update the {{sketch.update}} logic to use CollationKey bytes inst

[jira] [Updated] (SPARK-53559) Refactor HLL sketch update to use collation key bytes instead of string

2025-09-14 Thread Christopher Boumalhab (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Boumalhab updated SPARK-53559: -- Description: Update the {{sketch.update}} logic to use CollationKey bytes inst