[jira] [Updated] (SPARK-42247) Standardize `returnType` property of UserDefinedFunction

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42247: - Affects Version/s: 3.4.0 (was: 3.5.0) > Standardize `returnType`

[jira] [Updated] (SPARK-42247) Standardize `returnType` property of UserDefinedFunction

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42247: - Parent: SPARK-42393 Issue Type: Sub-task (was: Improvement) > Standardize `returnType`

[jira] [Updated] (SPARK-42393) Support for Pandas Functions API

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42393: - Affects Version/s: 3.4.0 > Support for Pandas Functions API >

[jira] [Updated] (SPARK-42247) Standardize `returnType` property of UserDefinedFunction

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42247: - Affects Version/s: 3.5.0 (was: 3.4.0) > Standardize `returnType`

[jira] [Updated] (SPARK-42340) Implement GroupedData.applyInPandas

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42340: - Epic Link: (was: SPARK-39375) > Implement GroupedData.applyInPandas >

[jira] [Updated] (SPARK-42340) Implement GroupedData.applyInPandas

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42340: - Parent: SPARK-42393 Issue Type: Sub-task (was: New Feature) > Implement

[jira] [Created] (SPARK-42393) Support for Pandas Functions API

2023-02-09 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-42393: Summary: Support for Pandas Functions API Key: SPARK-42393 URL: https://issues.apache.org/jira/browse/SPARK-42393 Project: Spark Issue Type: Umbrella

[jira] [Resolved] (SPARK-42264) Test Parity: pyspark.sql.tests.test_udf and pyspark.sql.tests.pandas.test_pandas_udf

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-42264. -- Resolution: Fixed > Test Parity: pyspark.sql.tests.test_udf and >

[jira] [Assigned] (SPARK-42264) Test Parity: pyspark.sql.tests.test_udf and pyspark.sql.tests.pandas.test_pandas_udf

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-42264: Assignee: Xinrong Meng > Test Parity: pyspark.sql.tests.test_udf and >

[jira] [Resolved] (SPARK-42246) Reach Full Parity with Vanilla PySpark's UDF

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-42246. -- Resolution: Resolved > Reach Full Parity with Vanilla PySpark's UDF >

[jira] [Updated] (SPARK-42263) Implement `spark.catalog.registerFunction`

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42263: - Parent: (was: SPARK-42246) Issue Type: Improvement (was: Sub-task) > Implement

[jira] [Updated] (SPARK-42247) Standardize `returnType` property of UserDefinedFunction

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42247: - Parent: (was: SPARK-42246) Issue Type: Improvement (was: Sub-task) > Standardize

[jira] [Updated] (SPARK-42269) Support complex return types in DDL strings

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42269: - Parent: SPARK-41661 Issue Type: Sub-task (was: Improvement) > Support complex return

[jira] [Updated] (SPARK-42269) Support complex return types in DDL strings

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42269: - Parent: (was: SPARK-42246) Issue Type: Improvement (was: Sub-task) > Support

[jira] [Updated] (SPARK-42247) Standardize `returnType` property of UserDefinedFunction

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42247: - Description: There are checks (was: The inconsistency can be reproduced as shown below:

[jira] [Comment Edited] (SPARK-42034) QueryExecutionListener and Observation API, df.observe do not work with `foreach` action.

2023-02-09 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686914#comment-17686914 ] Nick Hryhoriev edited comment on SPARK-42034 at 2/10/23 7:36 AM: - I can

[jira] [Commented] (SPARK-42034) QueryExecutionListener and Observation API, df.observe do not work with `foreach` action.

2023-02-09 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686914#comment-17686914 ] Nick Hryhoriev commented on SPARK-42034: I can do PR, but I need someone to target me to some

[jira] [Updated] (SPARK-42246) Reach Full Parity with Vanilla PySpark's UDF

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42246: - Summary: Reach Full Parity with Vanilla PySpark's UDF (was: Reach Full Parity with Vanilla

[jira] [Commented] (SPARK-42325) Assign name to _LEGACY_ERROR_TEMP_0035

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686890#comment-17686890 ] Apache Spark commented on SPARK-42325: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42325) Assign name to _LEGACY_ERROR_TEMP_0035

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42325: Assignee: (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_0035 >

[jira] [Assigned] (SPARK-42325) Assign name to _LEGACY_ERROR_TEMP_0035

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42325: Assignee: Apache Spark > Assign name to _LEGACY_ERROR_TEMP_0035 >

[jira] [Commented] (SPARK-42325) Assign name to _LEGACY_ERROR_TEMP_0035

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686889#comment-17686889 ] Apache Spark commented on SPARK-42325: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42269) Support complex return types in DDL strings

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42269: Assignee: (was: Apache Spark) > Support complex return types in DDL strings >

[jira] [Commented] (SPARK-42269) Support complex return types in DDL strings

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686888#comment-17686888 ] Apache Spark commented on SPARK-42269: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-42269) Support complex return types in DDL strings

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42269: Assignee: Apache Spark > Support complex return types in DDL strings >

[jira] [Updated] (SPARK-42269) Support complex return types in DDL strings

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42269: - Summary: Support complex return types in DDL strings (was: Support user-specified return type

[jira] [Commented] (SPARK-42324) Assign name to _LEGACY_ERROR_TEMP_1001

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686881#comment-17686881 ] Apache Spark commented on SPARK-42324: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42324) Assign name to _LEGACY_ERROR_TEMP_1001

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42324: Assignee: Apache Spark > Assign name to _LEGACY_ERROR_TEMP_1001 >

[jira] [Assigned] (SPARK-42324) Assign name to _LEGACY_ERROR_TEMP_1001

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42324: Assignee: (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_1001 >

[jira] [Commented] (SPARK-42324) Assign name to _LEGACY_ERROR_TEMP_1001

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686880#comment-17686880 ] Apache Spark commented on SPARK-42324: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-42324) Assign name to _LEGACY_ERROR_TEMP_1001

2023-02-09 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686877#comment-17686877 ] Haejoon Lee commented on SPARK-42324: - I'm working on it > Assign name to _LEGACY_ERROR_TEMP_1001 >

[jira] (SPARK-42311) Assign name to _LEGACY_ERROR_TEMP_2432

2023-02-09 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42311 ] Haejoon Lee deleted comment on SPARK-42311: - was (Author: itholic): I'm working on it > Assign name to _LEGACY_ERROR_TEMP_2432 > -- > >

[jira] [Commented] (SPARK-42392) Add a new case of TriggeredByExecutorDecommissionInfo to remove unnecessary param

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686868#comment-17686868 ] Apache Spark commented on SPARK-42392: -- User 'smallzhongfeng' has created a pull request for this

[jira] [Commented] (SPARK-42392) Add a new case of TriggeredByExecutorDecommissionInfo to remove unnecessary param

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686867#comment-17686867 ] Apache Spark commented on SPARK-42392: -- User 'smallzhongfeng' has created a pull request for this

[jira] [Assigned] (SPARK-42392) Add a new case of TriggeredByExecutorDecommissionInfo to remove unnecessary param

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42392: Assignee: (was: Apache Spark) > Add a new case of

[jira] [Assigned] (SPARK-42392) Add a new case of TriggeredByExecutorDecommissionInfo to remove unnecessary param

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42392: Assignee: Apache Spark > Add a new case of TriggeredByExecutorDecommissionInfo to remove

[jira] [Created] (SPARK-42392) Add a new case of TriggeredByExecutorDecommissionInfo to remove unnecessary param

2023-02-09 Thread jingxiong zhong (Jira)
jingxiong zhong created SPARK-42392: --- Summary: Add a new case of TriggeredByExecutorDecommissionInfo to remove unnecessary param Key: SPARK-42392 URL: https://issues.apache.org/jira/browse/SPARK-42392

[jira] [Updated] (SPARK-42247) Standardize `returnType` property of UserDefinedFunction

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42247: - Summary: Standardize `returnType` property of UserDefinedFunction (was: `returnType` attribute

[jira] [Assigned] (SPARK-42391) Close Live AppStore in the finally block for test cases

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42391: Assignee: (was: Apache Spark) > Close Live AppStore in the finally block for test

[jira] [Commented] (SPARK-42391) Close Live AppStore in the finally block for test cases

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686852#comment-17686852 ] Apache Spark commented on SPARK-42391: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42391) Close Live AppStore in the finally block for test cases

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42391: Assignee: Apache Spark > Close Live AppStore in the finally block for test cases >

[jira] [Resolved] (SPARK-42276) Add ServicesResourceTransformer to connect server module shade configuration

2023-02-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42276. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39848

[jira] [Assigned] (SPARK-42276) Add ServicesResourceTransformer to connect server module shade configuration

2023-02-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42276: Assignee: Yang Jie > Add ServicesResourceTransformer to connect server module shade

[jira] [Created] (SPARK-42391) Close Live AppStore in the finally block for test cases

2023-02-09 Thread Yang Jie (Jira)
Yang Jie created SPARK-42391: Summary: Close Live AppStore in the finally block for test cases Key: SPARK-42391 URL: https://issues.apache.org/jira/browse/SPARK-42391 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41963) Different exception message in DataFrame.unpivot

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41963: Assignee: Apache Spark > Different exception message in DataFrame.unpivot >

[jira] [Assigned] (SPARK-41963) Different exception message in DataFrame.unpivot

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41963: Assignee: (was: Apache Spark) > Different exception message in DataFrame.unpivot >

[jira] [Commented] (SPARK-41963) Different exception message in DataFrame.unpivot

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686831#comment-17686831 ] Apache Spark commented on SPARK-41963: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41715) Catch specific exceptions for both Spark Connect and PySpark

2023-02-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41715: Assignee: Hyukjin Kwon > Catch specific exceptions for both Spark Connect and PySpark >

[jira] [Assigned] (SPARK-40453) Improve error handling for GRPC server

2023-02-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40453: Assignee: Hyukjin Kwon > Improve error handling for GRPC server >

[jira] [Resolved] (SPARK-40453) Improve error handling for GRPC server

2023-02-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40453. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39947

[jira] [Resolved] (SPARK-41715) Catch specific exceptions for both Spark Connect and PySpark

2023-02-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41715. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39947

[jira] [Resolved] (SPARK-42211) Python UDFs with inconsistent client and server versions

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-42211. -- Resolution: Duplicate > Python UDFs with inconsistent client and server versions >

[jira] [Commented] (SPARK-42390) Upgrade buf from 1.13.1 to 1.14.0

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686822#comment-17686822 ] Apache Spark commented on SPARK-42390: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-42390) Upgrade buf from 1.13.1 to 1.14.0

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42390: Assignee: Apache Spark > Upgrade buf from 1.13.1 to 1.14.0 >

[jira] [Assigned] (SPARK-42390) Upgrade buf from 1.13.1 to 1.14.0

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42390: Assignee: (was: Apache Spark) > Upgrade buf from 1.13.1 to 1.14.0 >

[jira] [Created] (SPARK-42390) Upgrade buf from 1.13.1 to 1.14.0

2023-02-09 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-42390: --- Summary: Upgrade buf from 1.13.1 to 1.14.0 Key: SPARK-42390 URL: https://issues.apache.org/jira/browse/SPARK-42390 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-42034) QueryExecutionListener and Observation API, df.observe do not work with `foreach` action.

2023-02-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686807#comment-17686807 ] Hyukjin Kwon commented on SPARK-42034: -- please go ahead > QueryExecutionListener and Observation

[jira] [Assigned] (SPARK-42338) Different exception in DataFrame.sample

2023-02-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42338: Assignee: Takuya Ueshin > Different exception in DataFrame.sample >

[jira] [Resolved] (SPARK-42338) Different exception in DataFrame.sample

2023-02-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42338. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39957

[jira] [Resolved] (SPARK-42353) Cleanup orphan sst and log files in RocksDB checkpoint directory

2023-02-09 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-42353. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39897

[jira] [Assigned] (SPARK-42353) Cleanup orphan sst and log files in RocksDB checkpoint directory

2023-02-09 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-42353: Assignee: Chaoqin Li > Cleanup orphan sst and log files in RocksDB checkpoint directory

[jira] [Assigned] (SPARK-42338) Different exception in DataFrame.sample

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42338: Assignee: Apache Spark > Different exception in DataFrame.sample >

[jira] [Commented] (SPARK-42338) Different exception in DataFrame.sample

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686796#comment-17686796 ] Apache Spark commented on SPARK-42338: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42338) Different exception in DataFrame.sample

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42338: Assignee: (was: Apache Spark) > Different exception in DataFrame.sample >

[jira] [Commented] (SPARK-42338) Different exception in DataFrame.sample

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686795#comment-17686795 ] Apache Spark commented on SPARK-42338: -- User 'ueshin' has created a pull request for this issue:

[jira] [Updated] (SPARK-42017) df["bad_key"] does not raise AnalysisException

2023-02-09 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-42017: -- Parent Issue: SPARK-41282 (was: SPARK-42006) > df["bad_key"] does not raise

[jira] [Reopened] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

2023-02-09 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov reopened SPARK-41793: --- > Incorrect result for window frames defined by a range clause on large > decimals >

[jira] [Comment Edited] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

2023-02-09 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685384#comment-17685384 ] Gera Shegalov edited comment on SPARK-41793 at 2/9/23 6:26 PM: --- Another

[jira] [Commented] (SPARK-42389) Ensure Live UI dir be cleaned up after test when `LIVE_UI_LOCAL_STORE_DIR` is configured

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686653#comment-17686653 ] Apache Spark commented on SPARK-42389: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-42389) Ensure Live UI dir be cleaned up after test when `LIVE_UI_LOCAL_STORE_DIR` is configured

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686652#comment-17686652 ] Apache Spark commented on SPARK-42389: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-42389) Ensure Live UI dir be cleaned up after test when `LIVE_UI_LOCAL_STORE_DIR` is configured

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686651#comment-17686651 ] Apache Spark commented on SPARK-42389: -- User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-42389) Ensure Live UI dir be cleaned up after test when `LIVE_UI_LOCAL_STORE_DIR` is configured

2023-02-09 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42389: - Summary: Ensure Live UI dir be cleaned up after test when `LIVE_UI_LOCAL_STORE_DIR` is configured

[jira] [Updated] (SPARK-42389) Ensure Live UI dir be cleaned up after testing when `LIVE_UI_LOCAL_STORE_DIR` is configured

2023-02-09 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42389: - Summary: Ensure Live UI dir be cleaned up after testing when `LIVE_UI_LOCAL_STORE_DIR` is configured

[jira] [Resolved] (SPARK-42366) Log shuffle data corruption diagnose cause

2023-02-09 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-42366. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-42366) Log shuffle data corruption diagnose cause

2023-02-09 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-42366: --- Assignee: dzcxzl > Log shuffle data corruption diagnose cause >

[jira] [Commented] (SPARK-42034) QueryExecutionListener and Observation API, df.observe do not work with `foreach` action.

2023-02-09 Thread zzzzming95 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686612#comment-17686612 ] ming95 commented on SPARK-42034: I am interested in this pr, if no one else is in development I

[jira] [Assigned] (SPARK-42389) Clean up the remaining ui path after test when `LIVE_UI_LOCAL_STORE_DIR` is configured

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42389: Assignee: Apache Spark > Clean up the remaining ui path after test when

[jira] [Assigned] (SPARK-42389) Clean up the remaining ui path after test when `LIVE_UI_LOCAL_STORE_DIR` is configured

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42389: Assignee: (was: Apache Spark) > Clean up the remaining ui path after test when

[jira] [Commented] (SPARK-42389) Clean up the remaining ui path after test when `LIVE_UI_LOCAL_STORE_DIR` is configured

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686591#comment-17686591 ] Apache Spark commented on SPARK-42389: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-42389) Clean up the remaining ui path after test when `LIVE_UI_LOCAL_STORE_DIR` is configured

2023-02-09 Thread Yang Jie (Jira)
Yang Jie created SPARK-42389: Summary: Clean up the remaining ui path after test when `LIVE_UI_LOCAL_STORE_DIR` is configured Key: SPARK-42389 URL: https://issues.apache.org/jira/browse/SPARK-42389

[jira] [Commented] (SPARK-42289) DS V2 pushdown could let JDBC dialect decide to push down offset and limit

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686502#comment-17686502 ] Apache Spark commented on SPARK-42289: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42289) DS V2 pushdown could let JDBC dialect decide to push down offset and limit

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42289: Assignee: (was: Apache Spark) > DS V2 pushdown could let JDBC dialect decide to push

[jira] [Commented] (SPARK-42289) DS V2 pushdown could let JDBC dialect decide to push down offset and limit

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686497#comment-17686497 ] Apache Spark commented on SPARK-42289: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42289) DS V2 pushdown could let JDBC dialect decide to push down offset and limit

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42289: Assignee: Apache Spark > DS V2 pushdown could let JDBC dialect decide to push down

[jira] [Commented] (SPARK-39348) Create table in overwrite mode fails when interrupted

2023-02-09 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686390#comment-17686390 ] Wei Guo commented on SPARK-39348: - After PR [https://github.com/apache/spark/pull/26559,] it has been

[jira] [Commented] (SPARK-42313) Assign name to _LEGACY_ERROR_TEMP_1152

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686374#comment-17686374 ] Apache Spark commented on SPARK-42313: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42313) Assign name to _LEGACY_ERROR_TEMP_1152

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42313: Assignee: Apache Spark > Assign name to _LEGACY_ERROR_TEMP_1152 >

[jira] [Assigned] (SPARK-42313) Assign name to _LEGACY_ERROR_TEMP_1152

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42313: Assignee: (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_1152 >

[jira] [Updated] (SPARK-40770) Improved error messages for applyInPandas for schema mismatch

2023-02-09 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-40770: -- Description: Error messages raised by `applyInPandas` and `mapInPadnas` are very generic or

[jira] [Commented] (SPARK-40770) Improved error messages for applyInPandas for schema mismatch

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686372#comment-17686372 ] Apache Spark commented on SPARK-40770: -- User 'EnricoMi' has created a pull request for this issue:

[jira] [Commented] (SPARK-40770) Improved error messages for applyInPandas for schema mismatch

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686371#comment-17686371 ] Apache Spark commented on SPARK-40770: -- User 'EnricoMi' has created a pull request for this issue:

[jira] [Commented] (SPARK-42312) Assign name to _LEGACY_ERROR_TEMP_0042

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686368#comment-17686368 ] Apache Spark commented on SPARK-42312: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42312) Assign name to _LEGACY_ERROR_TEMP_0042

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42312: Assignee: (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_0042 >

[jira] [Assigned] (SPARK-42312) Assign name to _LEGACY_ERROR_TEMP_0042

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42312: Assignee: Apache Spark > Assign name to _LEGACY_ERROR_TEMP_0042 >

[jira] [Commented] (SPARK-42312) Assign name to _LEGACY_ERROR_TEMP_0042

2023-02-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686369#comment-17686369 ] Apache Spark commented on SPARK-42312: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42281) Update Debugging PySpark documents to show error message properly

2023-02-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42281: Assignee: Haejoon Lee > Update Debugging PySpark documents to show error message

[jira] [Resolved] (SPARK-42281) Update Debugging PySpark documents to show error message properly

2023-02-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42281. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/39852 > Update Debugging

[jira] [Resolved] (SPARK-41597) Improve PySpark errors

2023-02-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41597. -- Fix Version/s: 3.4.0 Assignee: Haejoon Lee Resolution: Done > Improve PySpark

[jira] [Updated] (SPARK-42281) Update Debugging PySpark documents to show error message properly

2023-02-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42281: - Fix Version/s: 3.4.0 > Update Debugging PySpark documents to show error message properly >

[jira] [Resolved] (SPARK-42210) Standardize registered pickled Python UDFs

2023-02-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-42210. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39860

  1   2   >