[jira] [Created] (SPARK-48341) Allow Spark Connect plugins to use PlanTest in their tests

2024-05-20 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-48341: -- Summary: Allow Spark Connect plugins to use PlanTest in their tests Key: SPARK-48341 URL: https://issues.apache.org/jira/browse/SPARK-48341 Project: Spark

[jira] [Created] (SPARK-48112) Expose session in SparkConnectPlanner to plugin developers

2024-05-03 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-48112: -- Summary: Expose session in SparkConnectPlanner to plugin developers Key: SPARK-48112 URL: https://issues.apache.org/jira/browse/SPARK-48112 Project: Spark

[jira] [Created] (SPARK-47868) Recursion Limit Error in SparkSession and SparkConnectPlanner

2024-04-16 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-47868: -- Summary: Recursion Limit Error in SparkSession and SparkConnectPlanner Key: SPARK-47868 URL: https://issues.apache.org/jira/browse/SPARK-47868 Project: Spark

[jira] [Created] (SPARK-46794) Incorrect results due to inferred predicate from checkpoint with subquery

2024-01-22 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-46794: -- Summary: Incorrect results due to inferred predicate from checkpoint with subquery Key: SPARK-46794 URL: https://issues.apache.org/jira/browse/SPARK-46794

[jira] [Created] (SPARK-42735) Allow passing additional confs to server in RemoteSparkSession

2023-03-09 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-42735: -- Summary: Allow passing additional confs to server in RemoteSparkSession Key: SPARK-42735 URL: https://issues.apache.org/jira/browse/SPARK-42735 Project: Spark

[jira] [Updated] (SPARK-42735) Allow passing additional confs to server in RemoteSparkSession

2023-03-09 Thread Tom van Bussel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom van Bussel updated SPARK-42735: --- Issue Type: Improvement (was: New Feature) > Allow passing additional confs to server in

[jira] [Created] (SPARK-42631) Support custom extensions in Spark Connect Scala client

2023-03-01 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-42631: -- Summary: Support custom extensions in Spark Connect Scala client Key: SPARK-42631 URL: https://issues.apache.org/jira/browse/SPARK-42631 Project: Spark

[jira] [Created] (SPARK-41453) Implement DataFrame.subtract

2022-12-08 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-41453: -- Summary: Implement DataFrame.subtract Key: SPARK-41453 URL: https://issues.apache.org/jira/browse/SPARK-41453 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-37388) WidthBucket throws NullPointerException in WholeStageCodegenExec

2021-11-19 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-37388: -- Summary: WidthBucket throws NullPointerException in WholeStageCodegenExec Key: SPARK-37388 URL: https://issues.apache.org/jira/browse/SPARK-37388 Project: Spark

[jira] [Created] (SPARK-35898) Converting arrays with RowToColumnConverter triggers assertion

2021-06-25 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-35898: -- Summary: Converting arrays with RowToColumnConverter triggers assertion Key: SPARK-35898 URL: https://issues.apache.org/jira/browse/SPARK-35898 Project: Spark

[jira] [Commented] (SPARK-35898) Converting arrays with RowToColumnConverter triggers assertion

2021-06-25 Thread Tom van Bussel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17369553#comment-17369553 ] Tom van Bussel commented on SPARK-35898: I will open a PR with the fix. > Converting arrays

[jira] [Created] (SPARK-32911) UnsafeExternalSorter.SpillableIterator cannot spill after reading all records

2020-09-17 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-32911: -- Summary: UnsafeExternalSorter.SpillableIterator cannot spill after reading all records Key: SPARK-32911 URL: https://issues.apache.org/jira/browse/SPARK-32911

[jira] [Created] (SPARK-32901) UnsafeExternalSorter may cause a SparkOutOfMemoryError to be thrown while spilling

2020-09-16 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-32901: -- Summary: UnsafeExternalSorter may cause a SparkOutOfMemoryError to be thrown while spilling Key: SPARK-32901 URL: https://issues.apache.org/jira/browse/SPARK-32901

[jira] [Updated] (SPARK-32900) UnsafeExternalSorter.SpillableIterator cannot spill when there are NULLs in the input and radix sorting is used.

2020-09-16 Thread Tom van Bussel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom van Bussel updated SPARK-32900: --- Description: In order to determine whether {{UnsafeExternalSorter.SpillableIterator}} has

[jira] [Created] (SPARK-32900) UnsafeExternalSorter.SpillableIterator cannot spill when there are NULLs in the input and radix sorting is used.

2020-09-16 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-32900: -- Summary: UnsafeExternalSorter.SpillableIterator cannot spill when there are NULLs in the input and radix sorting is used. Key: SPARK-32900 URL:

[jira] [Created] (SPARK-27071) Expose additional metrics in status.api.v1.StageData

2019-03-06 Thread Tom van Bussel (JIRA)
Tom van Bussel created SPARK-27071: -- Summary: Expose additional metrics in status.api.v1.StageData Key: SPARK-27071 URL: https://issues.apache.org/jira/browse/SPARK-27071 Project: Spark

[jira] [Created] (SPARK-26690) Checkpoints of Dataframes are not visible in the SQL UI

2019-01-22 Thread Tom van Bussel (JIRA)
Tom van Bussel created SPARK-26690: -- Summary: Checkpoints of Dataframes are not visible in the SQL UI Key: SPARK-26690 URL: https://issues.apache.org/jira/browse/SPARK-26690 Project: Spark