[jira] [Commented] (SPARK-41666) Support parameterized SQL in PySpark

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650898#comment-17650898 ] Apache Spark commented on SPARK-41666: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-41666) Support parameterized SQL in PySpark

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41666: Assignee: Max Gekk (was: Apache Spark) > Support parameterized SQL in PySpark >

[jira] [Commented] (SPARK-41666) Support parameterized SQL in PySpark

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650897#comment-17650897 ] Apache Spark commented on SPARK-41666: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-41666) Support parameterized SQL in PySpark

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41666: Assignee: Apache Spark (was: Max Gekk) > Support parameterized SQL in PySpark >

[jira] [Commented] (SPARK-41354) Implement `DataFrame.repartitionByRange`

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650894#comment-17650894 ] Apache Spark commented on SPARK-41354: -- User 'dengziming' has created a pull reques

[jira] [Assigned] (SPARK-41354) Implement `DataFrame.repartitionByRange`

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41354: Assignee: Apache Spark > Implement `DataFrame.repartitionByRange` > -

[jira] [Commented] (SPARK-41651) Test parity: pyspark.sql.tests.test_dataframe

2022-12-21 Thread Deng Ziming (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650893#comment-17650893 ] Deng Ziming commented on SPARK-41651: - Thank you [~gurwls223] for this information!

[jira] [Assigned] (SPARK-41354) Implement `DataFrame.repartitionByRange`

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41354: Assignee: (was: Apache Spark) > Implement `DataFrame.repartitionByRange` > --

[jira] [Commented] (SPARK-41354) Implement `DataFrame.repartitionByRange`

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650892#comment-17650892 ] Apache Spark commented on SPARK-41354: -- User 'dengziming' has created a pull reques

[jira] [Updated] (SPARK-41665) Spark streaming query scheduling synchronisation with Trigger Interval

2022-12-21 Thread Thomas Prelle (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Prelle updated SPARK-41665: -- Description: Hi, We detect a strange behavior on spark streaming when we set a trigger interva

[jira] [Updated] (SPARK-41666) Support parameterized SQL in PySpark

2022-12-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-41666: - Description: Enhance the PySpark SQL API with support for parameterized SQL statements to improve secur

[jira] [Created] (SPARK-41666) Support parameterized SQL in PySpark

2022-12-21 Thread Max Gekk (Jira)
Max Gekk created SPARK-41666: Summary: Support parameterized SQL in PySpark Key: SPARK-41666 URL: https://issues.apache.org/jira/browse/SPARK-41666 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-41565) Add the error class UNRESOLVED_ROUTINE

2022-12-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41565. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39095 [https://github.com

[jira] [Resolved] (SPARK-41509) Delay execution hash until after aggregation for semi-join runtime filter.

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41509. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39049 [https://gith

[jira] [Assigned] (SPARK-41509) Delay execution hash until after aggregation for semi-join runtime filter.

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41509: --- Assignee: jiaan.geng > Delay execution hash until after aggregation for semi-join runtime f

[jira] [Assigned] (SPARK-41660) only propagate metadata columns if they are used

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41660: --- Assignee: Wenchen Fan > only propagate metadata columns if they are used >

[jira] [Resolved] (SPARK-41660) only propagate metadata columns if they are used

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41660. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39152 [https://gith

[jira] [Created] (SPARK-41665) Spark streaming query scheduling synchronisation with Trigger Interval

2022-12-21 Thread Thomas Prelle (Jira)
Thomas Prelle created SPARK-41665: - Summary: Spark streaming query scheduling synchronisation with Trigger Interval Key: SPARK-41665 URL: https://issues.apache.org/jira/browse/SPARK-41665 Project: Sp

[jira] [Updated] (SPARK-41665) Spark streaming query scheduling synchronisation with Trigger Interval

2022-12-21 Thread Thomas Prelle (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Prelle updated SPARK-41665: -- Description: Hi, We detect a strange behavior on spark streaming when we set a trigger interva

[jira] [Updated] (SPARK-41665) Spark streaming query scheduling synchronisation with Trigger Interval

2022-12-21 Thread Thomas Prelle (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Prelle updated SPARK-41665: -- Attachment: image-2022-12-21-07-57-18-679.png > Spark streaming query scheduling synchronisati

[jira] [Updated] (SPARK-41665) Spark streaming query scheduling synchronisation with Trigger Interval

2022-12-21 Thread Thomas Prelle (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Prelle updated SPARK-41665: -- Attachment: image-2022-12-21-07-57-32-654.png > Spark streaming query scheduling synchronisati

[jira] [Updated] (SPARK-41665) Spark streaming query scheduling synchronisation with Trigger Interval

2022-12-21 Thread Thomas Prelle (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Prelle updated SPARK-41665: -- Description: Hi, We detect a strange behavior on spark streaming when we set a trigger interva

[jira] [Resolved] (SPARK-41364) implement `broadcast` function

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41364. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39156 [https://gi

[jira] [Assigned] (SPARK-41364) implement `broadcast` function

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41364: Assignee: Ruifeng Zheng > implement `broadcast` function > --

[jira] [Commented] (SPARK-41646) Deduplicate docstrings in pyspark.sql.connect.session

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650827#comment-17650827 ] Apache Spark commented on SPARK-41646: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-41646) Deduplicate docstrings in pyspark.sql.connect.session

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41646: Assignee: (was: Apache Spark) > Deduplicate docstrings in pyspark.sql.connect.session

[jira] [Commented] (SPARK-41646) Deduplicate docstrings in pyspark.sql.connect.session

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650828#comment-17650828 ] Apache Spark commented on SPARK-41646: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-41646) Deduplicate docstrings in pyspark.sql.connect.session

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41646: Assignee: Apache Spark > Deduplicate docstrings in pyspark.sql.connect.session >

[jira] [Created] (SPARK-41664) Support streaming client data to create large DataFrames

2022-12-21 Thread Martin Grund (Jira)
Martin Grund created SPARK-41664: Summary: Support streaming client data to create large DataFrames Key: SPARK-41664 URL: https://issues.apache.org/jira/browse/SPARK-41664 Project: Spark Issu

[jira] [Assigned] (SPARK-41364) implement `broadcast` function

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41364: Assignee: (was: Apache Spark) > implement `broadcast` function >

[jira] [Commented] (SPARK-41364) implement `broadcast` function

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650806#comment-17650806 ] Apache Spark commented on SPARK-41364: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41364) implement `broadcast` function

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41364: Assignee: Apache Spark > implement `broadcast` function > --

[jira] [Assigned] (SPARK-41663) Implement the rest of Lambda functions

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41663: Assignee: (was: Apache Spark) > Implement the rest of Lambda functions >

[jira] [Assigned] (SPARK-41663) Implement the rest of Lambda functions

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41663: Assignee: Apache Spark > Implement the rest of Lambda functions > ---

[jira] [Commented] (SPARK-41663) Implement the rest of Lambda functions

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650721#comment-17650721 ] Apache Spark commented on SPARK-41663: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-41663) Implement the rest of Lambda functions

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650719#comment-17650719 ] Apache Spark commented on SPARK-41663: -- User 'zhengruifeng' has created a pull requ

[jira] [Created] (SPARK-41663) Implement the rest of Lambda functions

2022-12-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41663: - Summary: Implement the rest of Lambda functions Key: SPARK-41663 URL: https://issues.apache.org/jira/browse/SPARK-41663 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41643) Deduplicate docstrings in pyspark.sql.connect.column

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41643: Assignee: Hyukjin Kwon > Deduplicate docstrings in pyspark.sql.connect.column > -

[jira] [Resolved] (SPARK-41643) Deduplicate docstrings in pyspark.sql.connect.column

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41643. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39150 [https://gi

[jira] [Created] (SPARK-41662) Minimal support for pickled Python UDFs

2022-12-21 Thread Martin Grund (Jira)
Martin Grund created SPARK-41662: Summary: Minimal support for pickled Python UDFs Key: SPARK-41662 URL: https://issues.apache.org/jira/browse/SPARK-41662 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41661) Support for Python UDFs

2022-12-21 Thread Martin Grund (Jira)
Martin Grund created SPARK-41661: Summary: Support for Python UDFs Key: SPARK-41661 URL: https://issues.apache.org/jira/browse/SPARK-41661 Project: Spark Issue Type: Umbrella Compon

[jira] [Resolved] (SPARK-41464) Implement DataFrame.to

2022-12-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41464. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39084 [https://

[jira] [Assigned] (SPARK-41464) Implement DataFrame.to

2022-12-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41464: - Assignee: jiaan.geng > Implement DataFrame.to > -- > >

<    1   2