[jira] [Created] (SPARK-41300) Unset Read.schema is incorrectly read when unset

2022-11-28 Thread Martin Grund (Jira)
Martin Grund created SPARK-41300: Summary: Unset Read.schema is incorrectly read when unset Key: SPARK-41300 URL: https://issues.apache.org/jira/browse/SPARK-41300 Project: Spark Issue Type:

[jira] [Updated] (SPARK-41297) Support string sql expressions in DF.where()

2022-11-28 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund updated SPARK-41297: - Priority: Blocker (was: Major) > Support string sql expressions in DF.where() >

[jira] [Created] (SPARK-41297) Support string sql expressions in DF.where()

2022-11-28 Thread Martin Grund (Jira)
Martin Grund created SPARK-41297: Summary: Support string sql expressions in DF.where() Key: SPARK-41297 URL: https://issues.apache.org/jira/browse/SPARK-41297 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41279) Feature parity: DataFrame API in Spark Connect

2022-11-27 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17639844#comment-17639844 ] Martin Grund commented on SPARK-41279: -- Not all open items in this Jira have the same priority,

[jira] [Created] (SPARK-41292) Window-function support

2022-11-27 Thread Martin Grund (Jira)
Martin Grund created SPARK-41292: Summary: Window-function support Key: SPARK-41292 URL: https://issues.apache.org/jira/browse/SPARK-41292 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-40546) Homogenize built-in function names for binary operators like + - /

2022-11-27 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund resolved SPARK-40546. -- Resolution: Fixed This was implemented already. > Homogenize built-in function names for

[jira] [Resolved] (SPARK-40993) Migrate markdown style README to python/docs/development/testing.rst

2022-11-27 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund resolved SPARK-40993. -- Resolution: Fixed > Migrate markdown style README to python/docs/development/testing.rst >

[jira] [Resolved] (SPARK-41033) RemoteSparkSession should only accept one `user_id`

2022-11-27 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund resolved SPARK-41033. -- Resolution: Fixed > RemoteSparkSession should only accept one `user_id` >

[jira] [Updated] (SPARK-41264) Make Literal support more datatypes

2022-11-27 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund updated SPARK-41264: - Priority: Blocker (was: Major) > Make Literal support more datatypes >

[jira] [Updated] (SPARK-41268) Refactor "Column" for API Compatibility

2022-11-27 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund updated SPARK-41268: - Priority: Blocker (was: Major) > Refactor "Column" for API Compatibility >

[jira] [Updated] (SPARK-41256) Implement DataFrame.withColumn(s)

2022-11-27 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund updated SPARK-41256: - Priority: Blocker (was: Major) > Implement DataFrame.withColumn(s) >

[jira] [Created] (SPARK-41255) RemoteSparkSession should be called SparkSession

2022-11-24 Thread Martin Grund (Jira)
Martin Grund created SPARK-41255: Summary: RemoteSparkSession should be called SparkSession Key: SPARK-41255 URL: https://issues.apache.org/jira/browse/SPARK-41255 Project: Spark Issue Type:

[jira] [Created] (SPARK-41225) Disable unsupported functions

2022-11-22 Thread Martin Grund (Jira)
Martin Grund created SPARK-41225: Summary: Disable unsupported functions Key: SPARK-41225 URL: https://issues.apache.org/jira/browse/SPARK-41225 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41204) Migrate custom exceptions to SparkException

2022-11-19 Thread Martin Grund (Jira)
Martin Grund created SPARK-41204: Summary: Migrate custom exceptions to SparkException Key: SPARK-41204 URL: https://issues.apache.org/jira/browse/SPARK-41204 Project: Spark Issue Type:

[jira] [Created] (SPARK-41203) Dataframe.transform in Python client support

2022-11-19 Thread Martin Grund (Jira)
Martin Grund created SPARK-41203: Summary: Dataframe.transform in Python client support Key: SPARK-41203 URL: https://issues.apache.org/jira/browse/SPARK-41203 Project: Spark Issue Type:

[jira] [Created] (SPARK-41196) Homogenize the protobuf version across server and client

2022-11-18 Thread Martin Grund (Jira)
Martin Grund created SPARK-41196: Summary: Homogenize the protobuf version across server and client Key: SPARK-41196 URL: https://issues.apache.org/jira/browse/SPARK-41196 Project: Spark

[jira] [Created] (SPARK-41001) Connection string support for Python client

2022-11-02 Thread Martin Grund (Jira)
Martin Grund created SPARK-41001: Summary: Connection string support for Python client Key: SPARK-41001 URL: https://issues.apache.org/jira/browse/SPARK-41001 Project: Spark Issue Type:

[jira] [Created] (SPARK-40995) Developer Documentation for Spark Connect

2022-11-02 Thread Martin Grund (Jira)
Martin Grund created SPARK-40995: Summary: Developer Documentation for Spark Connect Key: SPARK-40995 URL: https://issues.apache.org/jira/browse/SPARK-40995 Project: Spark Issue Type:

[jira] [Created] (SPARK-40899) UserContext should be extensible

2022-10-24 Thread Martin Grund (Jira)
Martin Grund created SPARK-40899: Summary: UserContext should be extensible Key: SPARK-40899 URL: https://issues.apache.org/jira/browse/SPARK-40899 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40857) Allow configurable GPRC interceptors for Spark Connect

2022-10-20 Thread Martin Grund (Jira)
Martin Grund created SPARK-40857: Summary: Allow configurable GPRC interceptors for Spark Connect Key: SPARK-40857 URL: https://issues.apache.org/jira/browse/SPARK-40857 Project: Spark Issue

[jira] [Created] (SPARK-40854) Change default serialization from 'broken' CSV to Spark DF JSON

2022-10-20 Thread Martin Grund (Jira)
Martin Grund created SPARK-40854: Summary: Change default serialization from 'broken' CSV to Spark DF JSON Key: SPARK-40854 URL: https://issues.apache.org/jira/browse/SPARK-40854 Project: Spark

[jira] [Created] (SPARK-40799) Enforce Scalafmt for Spark Connect Module

2022-10-14 Thread Martin Grund (Jira)
Martin Grund created SPARK-40799: Summary: Enforce Scalafmt for Spark Connect Module Key: SPARK-40799 URL: https://issues.apache.org/jira/browse/SPARK-40799 Project: Spark Issue Type:

[jira] [Created] (SPARK-40797) Force grouped import onto single line with Scalafmt

2022-10-14 Thread Martin Grund (Jira)
Martin Grund created SPARK-40797: Summary: Force grouped import onto single line with Scalafmt Key: SPARK-40797 URL: https://issues.apache.org/jira/browse/SPARK-40797 Project: Spark Issue

[jira] [Created] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Martin Grund (Jira)
Martin Grund created SPARK-40737: Summary: Add basic support for DataFrameWriter Key: SPARK-40737 URL: https://issues.apache.org/jira/browse/SPARK-40737 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40718) Replace shaded netty with grpc netty to avoid double shaded dependency.

2022-10-09 Thread Martin Grund (Jira)
Martin Grund created SPARK-40718: Summary: Replace shaded netty with grpc netty to avoid double shaded dependency. Key: SPARK-40718 URL: https://issues.apache.org/jira/browse/SPARK-40718 Project:

[jira] [Created] (SPARK-40557) Re-generate Spark Connect Python protos

2022-09-26 Thread Martin Grund (Jira)
Martin Grund created SPARK-40557: Summary: Re-generate Spark Connect Python protos Key: SPARK-40557 URL: https://issues.apache.org/jira/browse/SPARK-40557 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40532) Python version for UDF should follow the servers version

2022-09-23 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund updated SPARK-40532: - Description: Currently, we artificially pin the Python version to 3.9 in the UDF generation

[jira] [Created] (SPARK-40539) PySpark readwriter API parity for Spark Connect

2022-09-22 Thread Martin Grund (Jira)
Martin Grund created SPARK-40539: Summary: PySpark readwriter API parity for Spark Connect Key: SPARK-40539 URL: https://issues.apache.org/jira/browse/SPARK-40539 Project: Spark Issue Type:

[jira] [Created] (SPARK-40538) Add missing PySpark functions to Spark Connect

2022-09-22 Thread Martin Grund (Jira)
Martin Grund created SPARK-40538: Summary: Add missing PySpark functions to Spark Connect Key: SPARK-40538 URL: https://issues.apache.org/jira/browse/SPARK-40538 Project: Spark Issue Type:

[jira] [Created] (SPARK-40537) Re-enable mypi supoprt

2022-09-22 Thread Martin Grund (Jira)
Martin Grund created SPARK-40537: Summary: Re-enable mypi supoprt Key: SPARK-40537 URL: https://issues.apache.org/jira/browse/SPARK-40537 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40536) Make Spark Connect port configurable.

2022-09-22 Thread Martin Grund (Jira)
Martin Grund created SPARK-40536: Summary: Make Spark Connect port configurable. Key: SPARK-40536 URL: https://issues.apache.org/jira/browse/SPARK-40536 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40534) Extend support for Join Relation

2022-09-22 Thread Martin Grund (Jira)
Martin Grund created SPARK-40534: Summary: Extend support for Join Relation Key: SPARK-40534 URL: https://issues.apache.org/jira/browse/SPARK-40534 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40533) Extend type support for Spark Connect literals

2022-09-22 Thread Martin Grund (Jira)
Martin Grund created SPARK-40533: Summary: Extend type support for Spark Connect literals Key: SPARK-40533 URL: https://issues.apache.org/jira/browse/SPARK-40533 Project: Spark Issue Type:

[jira] [Created] (SPARK-40532) Python version for UDF should follow the servers version

2022-09-22 Thread Martin Grund (Jira)
Martin Grund created SPARK-40532: Summary: Python version for UDF should follow the servers version Key: SPARK-40532 URL: https://issues.apache.org/jira/browse/SPARK-40532 Project: Spark

[jira] [Updated] (SPARK-39673) High-Level Design Doc for Spark Connect

2022-09-15 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund updated SPARK-39673: - Description: Please find the HLD for Spark Connect here: https://s.apache.org/hld-spark-connect

[jira] [Created] (SPARK-40454) [SparkConnect] Initial DSL framework for protobuf testing

2022-09-15 Thread Martin Grund (Jira)
Martin Grund created SPARK-40454: Summary: [SparkConnect] Initial DSL framework for protobuf testing Key: SPARK-40454 URL: https://issues.apache.org/jira/browse/SPARK-40454 Project: Spark

[jira] [Created] (SPARK-40453) [SparkConnect] Improve Error handling for GRPC server

2022-09-15 Thread Martin Grund (Jira)
Martin Grund created SPARK-40453: Summary: [SparkConnect] Improve Error handling for GRPC server Key: SPARK-40453 URL: https://issues.apache.org/jira/browse/SPARK-40453 Project: Spark Issue

[jira] [Created] (SPARK-40451) [Spark Connect] Type annotations for Spark Connect Python client

2022-09-15 Thread Martin Grund (Jira)
Martin Grund created SPARK-40451: Summary: [Spark Connect] Type annotations for Spark Connect Python client Key: SPARK-40451 URL: https://issues.apache.org/jira/browse/SPARK-40451 Project: Spark

[jira] [Created] (SPARK-40452) [Spark Connect] Developer Documentation

2022-09-15 Thread Martin Grund (Jira)
Martin Grund created SPARK-40452: Summary: [Spark Connect] Developer Documentation Key: SPARK-40452 URL: https://issues.apache.org/jira/browse/SPARK-40452 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40450) [SparkConnect] Extend test coverage for Spark Connect Python client

2022-09-15 Thread Martin Grund (Jira)
Martin Grund created SPARK-40450: Summary: [SparkConnect] Extend test coverage for Spark Connect Python client Key: SPARK-40450 URL: https://issues.apache.org/jira/browse/SPARK-40450 Project: Spark

[jira] [Updated] (SPARK-40448) [SparkConnect] Prototype Implementation

2022-09-15 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund updated SPARK-40448: - Summary: [SparkConnect] Prototype Implementation (was: [Spark Connect]Prototype

[jira] [Updated] (SPARK-40448) [Spark Connect]Prototype Implementation

2022-09-15 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund updated SPARK-40448: - Summary: [Spark Connect]Prototype Implementation (was: Prototype Implementation) > [Spark

[jira] [Created] (SPARK-40449) [SparkConnect] Extend Test Coverage of Planner

2022-09-15 Thread Martin Grund (Jira)
Martin Grund created SPARK-40449: Summary: [SparkConnect] Extend Test Coverage of Planner Key: SPARK-40449 URL: https://issues.apache.org/jira/browse/SPARK-40449 Project: Spark Issue Type:

[jira] [Updated] (SPARK-40448) Prototype Implementation

2022-09-15 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund updated SPARK-40448: - Description: In [https://github.com/apache/spark/pull/37710] we created a prototype that shows

[jira] [Created] (SPARK-40448) Prototype Implementation

2022-09-15 Thread Martin Grund (Jira)
Martin Grund created SPARK-40448: Summary: Prototype Implementation Key: SPARK-40448 URL: https://issues.apache.org/jira/browse/SPARK-40448 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-39881) Python Lint does not actually check for `black` formatter

2022-07-26 Thread Martin Grund (Jira)
Martin Grund created SPARK-39881: Summary: Python Lint does not actually check for `black` formatter Key: SPARK-39881 URL: https://issues.apache.org/jira/browse/SPARK-39881 Project: Spark

[jira] [Created] (SPARK-39870) Add flag to run-tests.py to retain the test output.

2022-07-26 Thread Martin Grund (Jira)
Martin Grund created SPARK-39870: Summary: Add flag to run-tests.py to retain the test output. Key: SPARK-39870 URL: https://issues.apache.org/jira/browse/SPARK-39870 Project: Spark Issue

[jira] [Created] (SPARK-39674) Initial Protobuf Definition for Spark Connect API

2022-07-04 Thread Martin Grund (Jira)
Martin Grund created SPARK-39674: Summary: Initial Protobuf Definition for Spark Connect API Key: SPARK-39674 URL: https://issues.apache.org/jira/browse/SPARK-39674 Project: Spark Issue

[jira] [Created] (SPARK-39673) High-Level Design Doc for Spark Connect

2022-07-04 Thread Martin Grund (Jira)
Martin Grund created SPARK-39673: Summary: High-Level Design Doc for Spark Connect Key: SPARK-39673 URL: https://issues.apache.org/jira/browse/SPARK-39673 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark.

2022-06-03 Thread Martin Grund (Jira)
Martin Grund created SPARK-39375: Summary: SPIP: Spark Connect - A client and server interface for Apache Spark. Key: SPARK-39375 URL: https://issues.apache.org/jira/browse/SPARK-39375 Project: Spark

<    1   2