[jira] [Resolved] (SPARK-42162) Memory usage on executors increased drastically for a complex query with large number of addition operations

2023-02-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42162. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39722

[jira] [Assigned] (SPARK-42162) Memory usage on executors increased drastically for a complex query with large number of addition operations

2023-02-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42162: --- Assignee: Supun Nakandala > Memory usage on executors increased drastically for a complex

[jira] [Created] (SPARK-42398) refine default column value framework

2023-02-10 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-42398: --- Summary: refine default column value framework Key: SPARK-42398 URL: https://issues.apache.org/jira/browse/SPARK-42398 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-42131) Extract the function that construct the select statement for JDBC dialect.

2023-02-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42131. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39667

[jira] [Assigned] (SPARK-42131) Extract the function that construct the select statement for JDBC dialect.

2023-02-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42131: --- Assignee: jiaan.geng > Extract the function that construct the select statement for JDBC

[jira] [Assigned] (SPARK-42136) Refactor BroadcastHashJoinExec output partitioning generation

2023-02-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42136: --- Assignee: Peter Toth > Refactor BroadcastHashJoinExec output partitioning generation >

[jira] [Resolved] (SPARK-42136) Refactor BroadcastHashJoinExec output partitioning generation

2023-02-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42136. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 38038

[jira] [Assigned] (SPARK-42348) Add SQLSTATE

2023-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42348: --- Assignee: Haejoon Lee > Add SQLSTATE > > > Key: SPARK-42348 >

[jira] [Resolved] (SPARK-42348) Add SQLSTATE

2023-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42348. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39886

[jira] [Resolved] (SPARK-42093) Move JavaTypeInference to AgnosticEncoders

2023-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42093. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39615

[jira] [Assigned] (SPARK-42115) Push down limit through Python UDFs

2023-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42115: --- Assignee: Hyukjin Kwon > Push down limit through Python UDFs >

[jira] [Resolved] (SPARK-42115) Push down limit through Python UDFs

2023-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42115. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39842

[jira] [Assigned] (SPARK-41985) Centralize more column resolution rules

2023-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41985: --- Assignee: Wenchen Fan > Centralize more column resolution rules >

[jira] [Resolved] (SPARK-41985) Centralize more column resolution rules

2023-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41985. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39508

[jira] [Assigned] (SPARK-42278) DS V2 pushdown supports supports JDBC dialects compile `SortOrder` by themselves

2023-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42278: --- Assignee: jiaan.geng > DS V2 pushdown supports supports JDBC dialects compile `SortOrder`

[jira] [Resolved] (SPARK-42278) DS V2 pushdown supports supports JDBC dialects compile `SortOrder` by themselves

2023-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42278. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39846

[jira] [Assigned] (SPARK-42259) ResolveGroupingAnalytics should take care of Python UDAF

2023-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42259: --- Assignee: Wenchen Fan > ResolveGroupingAnalytics should take care of Python UDAF >

[jira] [Resolved] (SPARK-42259) ResolveGroupingAnalytics should take care of Python UDAF

2023-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42259. - Fix Version/s: 3.2.4 3.3.2 3.4.0 Resolution: Fixed

[jira] [Assigned] (SPARK-42191) Support udf luhn_check

2023-01-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42191: --- Assignee: Vinod KC > Support udf luhn_check > --- > >

[jira] [Resolved] (SPARK-42191) Support udf luhn_check

2023-01-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42191. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39747

[jira] [Created] (SPARK-42259) ResolveGroupingAnalytics should take care of Python UDAF

2023-01-31 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-42259: --- Summary: ResolveGroupingAnalytics should take care of Python UDAF Key: SPARK-42259 URL: https://issues.apache.org/jira/browse/SPARK-42259 Project: Spark Issue

[jira] [Assigned] (SPARK-42049) Improve AliasAwareOutputExpression

2023-01-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42049: --- Assignee: Peter Toth > Improve AliasAwareOutputExpression >

[jira] [Resolved] (SPARK-42049) Improve AliasAwareOutputExpression

2023-01-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42049. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37525

[jira] [Assigned] (SPARK-40086) Improve AliasAwareOutputPartitioning to take all aliases into account

2023-01-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40086: --- Assignee: Peter Toth > Improve AliasAwareOutputPartitioning to take all aliases into

[jira] [Resolved] (SPARK-40086) Improve AliasAwareOutputPartitioning to take all aliases into account

2023-01-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40086. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37525

[jira] [Resolved] (SPARK-41219) Regression in IntegralDivide returning null instead of 0

2023-01-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41219. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38760

[jira] [Assigned] (SPARK-41219) Regression in IntegralDivide returning null instead of 0

2023-01-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41219: --- Assignee: XiDuo You > Regression in IntegralDivide returning null instead of 0 >

[jira] [Resolved] (SPARK-42231) Rename error class: MISSING_STATIC_PARTITION_COLUMN

2023-01-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42231. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39797

[jira] [Assigned] (SPARK-42231) Rename error class: MISSING_STATIC_PARTITION_COLUMN

2023-01-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42231: --- Assignee: Haejoon Lee > Rename error class: MISSING_STATIC_PARTITION_COLUMN >

[jira] [Resolved] (SPARK-42163) Schema pruning fails on non-foldable array index or map key

2023-01-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42163. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39718

[jira] [Assigned] (SPARK-42163) Schema pruning fails on non-foldable array index or map key

2023-01-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42163: --- Assignee: David Cashman > Schema pruning fails on non-foldable array index or map key >

[jira] [Resolved] (SPARK-42066) The DATATYPE_MISMATCH error class contains inappropriate and duplicating subclasses

2023-01-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42066. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39625

[jira] [Assigned] (SPARK-42066) The DATATYPE_MISMATCH error class contains inappropriate and duplicating subclasses

2023-01-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42066: --- Assignee: Haejoon Lee > The DATATYPE_MISMATCH error class contains inappropriate and

[jira] [Assigned] (SPARK-41735) Any SparkThrowable (with an error class) not in error-classes.json is masked in SQLExecution.withNewExecutionId and end-user will see "org.apache.spark.SparkException:

2023-01-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41735: --- Assignee: XiDuo You > Any SparkThrowable (with an error class) not in error-classes.json

[jira] [Resolved] (SPARK-41735) Any SparkThrowable (with an error class) not in error-classes.json is masked in SQLExecution.withNewExecutionId and end-user will see "org.apache.spark.SparkException:

2023-01-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41735. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39794

[jira] [Resolved] (SPARK-42081) improve the plan change validation

2023-01-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42081. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39592

[jira] [Assigned] (SPARK-42081) improve the plan change validation

2023-01-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42081: --- Assignee: Wenchen Fan > improve the plan change validation >

[jira] [Assigned] (SPARK-41976) Improve error message for `INDEX_NOT_FOUND`

2023-01-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41976: --- Assignee: Haejoon Lee > Improve error message for `INDEX_NOT_FOUND` >

[jira] [Resolved] (SPARK-41976) Improve error message for `INDEX_NOT_FOUND`

2023-01-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41976. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39498

[jira] [Resolved] (SPARK-38591) Add sortWithinGroups to KeyValueGroupedDataset

2023-01-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38591. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39640

[jira] [Assigned] (SPARK-42108) Make Analyzer transform Count(*) into Count(1)

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42108: --- Assignee: Ruifeng Zheng > Make Analyzer transform Count(*) into Count(1) >

[jira] [Resolved] (SPARK-42108) Make Analyzer transform Count(*) into Count(1)

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42108. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39636

[jira] [Resolved] (SPARK-41970) SparkPath

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41970. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39488

[jira] [Assigned] (SPARK-41970) SparkPath

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41970: --- Assignee: David Lewis > SparkPath > - > > Key: SPARK-41970 >

[jira] [Updated] (SPARK-42084) Avoid leaking the qualified-access-only restriction

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-42084: Fix Version/s: 3.3.2 > Avoid leaking the qualified-access-only restriction >

[jira] [Assigned] (SPARK-42084) Avoid leaking the qualified-access-only restriction

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42084: --- Assignee: Wenchen Fan > Avoid leaking the qualified-access-only restriction >

[jira] [Resolved] (SPARK-42084) Avoid leaking the qualified-access-only restriction

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42084. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39596

[jira] [Assigned] (SPARK-41983) Rename error class: NULL_COMPARISON_RESULT

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41983: --- Assignee: Haejoon Lee > Rename error class: NULL_COMPARISON_RESULT >

[jira] [Resolved] (SPARK-41983) Rename error class: NULL_COMPARISON_RESULT

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41983. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39506

[jira] [Assigned] (SPARK-41960) Assign name to _LEGACY_ERROR_TEMP_1056

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41960: --- Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_1056 >

[jira] [Resolved] (SPARK-41960) Assign name to _LEGACY_ERROR_TEMP_1056

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41960. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39480

[jira] [Assigned] (SPARK-41572) Assign name to _LEGACY_ERROR_TEMP_2149

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41572: --- Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_2149 >

[jira] [Resolved] (SPARK-41572) Assign name to _LEGACY_ERROR_TEMP_2149

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41572. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39258

[jira] [Resolved] (SPARK-41574) Assign name to _LEGACY_ERROR_TEMP_2009

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41574. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39389

[jira] [Assigned] (SPARK-41574) Assign name to _LEGACY_ERROR_TEMP_2009

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41574: --- Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_2009 >

[jira] [Resolved] (SPARK-41579) Assign name to _LEGACY_ERROR_TEMP_1249

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41579. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39260

[jira] [Assigned] (SPARK-41579) Assign name to _LEGACY_ERROR_TEMP_1249

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41579: --- Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_1249 >

[jira] [Assigned] (SPARK-41984) Rename & improve error message for RESET_PERMISSION_TO_ORIGINAL

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41984: --- Assignee: Haejoon Lee > Rename & improve error message for RESET_PERMISSION_TO_ORIGINAL >

[jira] [Resolved] (SPARK-41984) Rename & improve error message for RESET_PERMISSION_TO_ORIGINAL

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41984. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39507

[jira] [Assigned] (SPARK-41975) Improve error message for `INDEX_ALREADY_EXISTS`

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41975: --- Assignee: Haejoon Lee > Improve error message for `INDEX_ALREADY_EXISTS` >

[jira] [Resolved] (SPARK-41975) Improve error message for `INDEX_ALREADY_EXISTS`

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41975. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39497

[jira] [Resolved] (SPARK-41974) Turn `INCORRECT_END_OFFSET` into `INTERNAL_ERROR`

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41974. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39496

[jira] [Assigned] (SPARK-41974) Turn `INCORRECT_END_OFFSET` into `INTERNAL_ERROR`

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41974: --- Assignee: Haejoon Lee > Turn `INCORRECT_END_OFFSET` into `INTERNAL_ERROR` >

[jira] [Assigned] (SPARK-41973) Assign name to _LEGACY_ERROR_TEMP_1311

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41973: --- Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_1311 >

[jira] [Resolved] (SPARK-41973) Assign name to _LEGACY_ERROR_TEMP_1311

2023-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41973. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39495

[jira] [Resolved] (SPARK-42061) Mark Expressions that have state has stateful

2023-01-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42061. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39630

[jira] [Assigned] (SPARK-42061) Mark Expressions that have state has stateful

2023-01-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42061: --- Assignee: (was: Wenchen Fan) > Mark Expressions that have state has stateful >

[jira] [Assigned] (SPARK-42061) Mark Expressions that have state has stateful

2023-01-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42061: --- Assignee: Wenchen Fan > Mark Expressions that have state has stateful >

[jira] [Resolved] (SPARK-40599) Add multiTransform methods to TreeNode to generate alternatives

2023-01-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40599. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38034

[jira] [Assigned] (SPARK-40599) Add multiTransform methods to TreeNode to generate alternatives

2023-01-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40599: --- Assignee: Peter Toth > Add multiTransform methods to TreeNode to generate alternatives >

[jira] [Created] (SPARK-42098) ResolveInlineTables should handle RuntimeReplaceable

2023-01-16 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-42098: --- Summary: ResolveInlineTables should handle RuntimeReplaceable Key: SPARK-42098 URL: https://issues.apache.org/jira/browse/SPARK-42098 Project: Spark Issue

[jira] [Resolved] (SPARK-41982) When the inserted partition type is of string type, similar `dt=01` will be converted to `dt=1`

2023-01-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41982. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39558

[jira] [Assigned] (SPARK-41982) When the inserted partition type is of string type, similar `dt=01` will be converted to `dt=1`

2023-01-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41982: --- Assignee: jingxiong zhong > When the inserted partition type is of string type, similar

[jira] [Resolved] (SPARK-42058) Harden SQLSTATE usage for error classes (2)

2023-01-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42058. - Fix Version/s: 3.4.0 Resolution: Fixed > Harden SQLSTATE usage for error classes (2) >

[jira] [Assigned] (SPARK-42058) Harden SQLSTATE usage for error classes (2)

2023-01-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42058: --- Assignee: Serge Rielau > Harden SQLSTATE usage for error classes (2) >

[jira] [Assigned] (SPARK-41994) Harden SQLSTATE usage for error classes

2023-01-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41994: --- Assignee: Serge Rielau > Harden SQLSTATE usage for error classes >

[jira] [Resolved] (SPARK-41994) Harden SQLSTATE usage for error classes

2023-01-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41994. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39537

[jira] [Resolved] (SPARK-41993) Move RowEncoder to AgnosticEncoders

2023-01-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41993. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39517

[jira] [Created] (SPARK-42084) Avoid leaking the qualified-access-only restriction

2023-01-15 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-42084: --- Summary: Avoid leaking the qualified-access-only restriction Key: SPARK-42084 URL: https://issues.apache.org/jira/browse/SPARK-42084 Project: Spark Issue

[jira] [Created] (SPARK-42081) improve the plan change validation

2023-01-15 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-42081: --- Summary: improve the plan change validation Key: SPARK-42081 URL: https://issues.apache.org/jira/browse/SPARK-42081 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-41896) Filtering by row_index always returns empty results

2023-01-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41896: --- Assignee: Jan-Ole Sasse > Filtering by row_index always returns empty results >

[jira] [Resolved] (SPARK-41896) Filtering by row_index always returns empty results

2023-01-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41896. - Resolution: Fixed Issue resolved by pull request 39408

[jira] [Assigned] (SPARK-41961) Support table-valued functions with LATERAL

2023-01-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41961: --- Assignee: Allison Wang > Support table-valued functions with LATERAL >

[jira] [Resolved] (SPARK-41961) Support table-valued functions with LATERAL

2023-01-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41961. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39479

[jira] [Created] (SPARK-42061) Mark Expressions that have state has stateful

2023-01-13 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-42061: --- Summary: Mark Expressions that have state has stateful Key: SPARK-42061 URL: https://issues.apache.org/jira/browse/SPARK-42061 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-42003) Reduce duplicate code in ResolveGroupByAll

2023-01-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42003. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39523

[jira] [Created] (SPARK-41985) Centralize more column resolution rules

2023-01-11 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41985: --- Summary: Centralize more column resolution rules Key: SPARK-41985 URL: https://issues.apache.org/jira/browse/SPARK-41985 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-41752) UI improvement for nested SQL executions

2023-01-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41752: --- Assignee: Linhong Liu > UI improvement for nested SQL executions >

[jira] [Resolved] (SPARK-41752) UI improvement for nested SQL executions

2023-01-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41752. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39268

[jira] [Resolved] (SPARK-41595) Support generator function explode/explode_outer in the FROM clause

2023-01-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41595. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39133

[jira] [Assigned] (SPARK-41595) Support generator function explode/explode_outer in the FROM clause

2023-01-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41595: --- Assignee: Allison Wang > Support generator function explode/explode_outer in the FROM

[jira] [Resolved] (SPARK-41914) Sorting issue with partitioned-writing and planned write optimization disabled

2023-01-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41914. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39431

[jira] [Assigned] (SPARK-41914) Sorting issue with partitioned-writing and planned write optimization disabled

2023-01-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41914: --- Assignee: Enrico Minack > Sorting issue with partitioned-writing and planned write

[jira] [Resolved] (SPARK-41943) Use java api to create files and grant permissions is DiskBlockManager

2023-01-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41943. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39448

[jira] [Resolved] (SPARK-41805) Reuse expressions in WindowSpecDefinition

2023-01-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41805. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39333

[jira] [Assigned] (SPARK-41805) Reuse expressions in WindowSpecDefinition

2023-01-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41805: --- Assignee: Wan Kun > Reuse expressions in WindowSpecDefinition >

[jira] [Assigned] (SPARK-40711) Add spill size metrics for window

2023-01-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40711: --- Assignee: XiDuo You > Add spill size metrics for window >

[jira] [Resolved] (SPARK-40711) Add spill size metrics for window

2023-01-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40711. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38163

[jira] [Assigned] (SPARK-41708) Pull v1write information to WriteFiles

2023-01-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41708: --- Assignee: XiDuo You > Pull v1write information to WriteFiles >

[jira] [Resolved] (SPARK-41708) Pull v1write information to WriteFiles

2023-01-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41708. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39277

<    4   5   6   7   8   9   10   11   12   13   >