[jira] [Assigned] (SPARK-42058) Harden SQLSTATE usage for error classes (2)

[ https://issues.apache.org/jira/browse/SPARK-42058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42058: --- Assignee: Serge Rielau > Harden SQLSTATE usage for error classes (2) >

[jira] [Assigned] (SPARK-41994) Harden SQLSTATE usage for error classes

[ https://issues.apache.org/jira/browse/SPARK-41994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41994: --- Assignee: Serge Rielau > Harden SQLSTATE usage for error classes >

[jira] [Resolved] (SPARK-41994) Harden SQLSTATE usage for error classes

[ https://issues.apache.org/jira/browse/SPARK-41994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41994. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39537

[jira] [Resolved] (SPARK-41993) Move RowEncoder to AgnosticEncoders

[ https://issues.apache.org/jira/browse/SPARK-41993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41993. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39517

[jira] [Created] (SPARK-42084) Avoid leaking the qualified-access-only restriction

Wenchen Fan created SPARK-42084: --- Summary: Avoid leaking the qualified-access-only restriction Key: SPARK-42084 URL: https://issues.apache.org/jira/browse/SPARK-42084 Project: Spark Issue

[jira] [Created] (SPARK-42081) improve the plan change validation

Wenchen Fan created SPARK-42081: --- Summary: improve the plan change validation Key: SPARK-42081 URL: https://issues.apache.org/jira/browse/SPARK-42081 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-41896) Filtering by row_index always returns empty results

[ https://issues.apache.org/jira/browse/SPARK-41896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41896: --- Assignee: Jan-Ole Sasse > Filtering by row_index always returns empty results >

[jira] [Resolved] (SPARK-41896) Filtering by row_index always returns empty results

[ https://issues.apache.org/jira/browse/SPARK-41896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41896. - Resolution: Fixed Issue resolved by pull request 39408

[jira] [Assigned] (SPARK-41961) Support table-valued functions with LATERAL

[ https://issues.apache.org/jira/browse/SPARK-41961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41961: --- Assignee: Allison Wang > Support table-valued functions with LATERAL >

[jira] [Resolved] (SPARK-41961) Support table-valued functions with LATERAL

[ https://issues.apache.org/jira/browse/SPARK-41961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41961. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39479

[jira] [Created] (SPARK-42061) Mark Expressions that have state has stateful

Wenchen Fan created SPARK-42061: --- Summary: Mark Expressions that have state has stateful Key: SPARK-42061 URL: https://issues.apache.org/jira/browse/SPARK-42061 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-42003) Reduce duplicate code in ResolveGroupByAll

[ https://issues.apache.org/jira/browse/SPARK-42003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42003. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39523

[jira] [Created] (SPARK-41985) Centralize more column resolution rules

Wenchen Fan created SPARK-41985: --- Summary: Centralize more column resolution rules Key: SPARK-41985 URL: https://issues.apache.org/jira/browse/SPARK-41985 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-41752) UI improvement for nested SQL executions

[ https://issues.apache.org/jira/browse/SPARK-41752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41752: --- Assignee: Linhong Liu > UI improvement for nested SQL executions >

[jira] [Resolved] (SPARK-41752) UI improvement for nested SQL executions

[ https://issues.apache.org/jira/browse/SPARK-41752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41752. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39268

[jira] [Resolved] (SPARK-41595) Support generator function explode/explode_outer in the FROM clause

[ https://issues.apache.org/jira/browse/SPARK-41595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41595. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39133

[jira] [Assigned] (SPARK-41595) Support generator function explode/explode_outer in the FROM clause

[ https://issues.apache.org/jira/browse/SPARK-41595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41595: --- Assignee: Allison Wang > Support generator function explode/explode_outer in the FROM

[jira] [Resolved] (SPARK-41914) Sorting issue with partitioned-writing and planned write optimization disabled

[ https://issues.apache.org/jira/browse/SPARK-41914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41914. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39431

[jira] [Assigned] (SPARK-41914) Sorting issue with partitioned-writing and planned write optimization disabled

[ https://issues.apache.org/jira/browse/SPARK-41914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41914: --- Assignee: Enrico Minack > Sorting issue with partitioned-writing and planned write

[jira] [Resolved] (SPARK-41943) Use java api to create files and grant permissions is DiskBlockManager

[ https://issues.apache.org/jira/browse/SPARK-41943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41943. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39448

[jira] [Resolved] (SPARK-41805) Reuse expressions in WindowSpecDefinition

[ https://issues.apache.org/jira/browse/SPARK-41805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41805. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39333

[jira] [Assigned] (SPARK-41805) Reuse expressions in WindowSpecDefinition

[ https://issues.apache.org/jira/browse/SPARK-41805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41805: --- Assignee: Wan Kun > Reuse expressions in WindowSpecDefinition >

[jira] [Assigned] (SPARK-40711) Add spill size metrics for window

[ https://issues.apache.org/jira/browse/SPARK-40711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40711: --- Assignee: XiDuo You > Add spill size metrics for window >

[jira] [Resolved] (SPARK-40711) Add spill size metrics for window

[ https://issues.apache.org/jira/browse/SPARK-40711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40711. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38163

[jira] [Assigned] (SPARK-41708) Pull v1write information to WriteFiles

[ https://issues.apache.org/jira/browse/SPARK-41708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41708: --- Assignee: XiDuo You > Pull v1write information to WriteFiles >

[jira] [Resolved] (SPARK-41708) Pull v1write information to WriteFiles

[ https://issues.apache.org/jira/browse/SPARK-41708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41708. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39277

[jira] [Resolved] (SPARK-41162) Anti-join must not be pushed below aggregation with ambiguous predicates

[ https://issues.apache.org/jira/browse/SPARK-41162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41162. - Fix Version/s: 3.2.4 3.3.2 3.4.0 Resolution: Fixed

[jira] [Assigned] (SPARK-41162) Anti-join must not be pushed below aggregation with ambiguous predicates

[ https://issues.apache.org/jira/browse/SPARK-41162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41162: --- Assignee: Enrico Minack > Anti-join must not be pushed below aggregation with ambiguous

[jira] [Resolved] (SPARK-41912) Subquery should not validate CTE

[ https://issues.apache.org/jira/browse/SPARK-41912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41912. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39414

[jira] [Resolved] (SPARK-41861) Make v2 ScanBuilders' build() return typed scan

[ https://issues.apache.org/jira/browse/SPARK-41861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41861. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39367

[jira] [Assigned] (SPARK-41861) Make v2 ScanBuilders' build() return typed scan

[ https://issues.apache.org/jira/browse/SPARK-41861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41861: --- Assignee: Lorenzo Martini > Make v2 ScanBuilders' build() return typed scan >

[jira] [Assigned] (SPARK-41806) Use AppendData.byName for SQL INSERT INTO by name for DSV2 and block ambiguous queries with static partitions columns

[ https://issues.apache.org/jira/browse/SPARK-41806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41806: --- Assignee: Allison Portis > Use AppendData.byName for SQL INSERT INTO by name for DSV2 and

[jira] [Resolved] (SPARK-41806) Use AppendData.byName for SQL INSERT INTO by name for DSV2 and block ambiguous queries with static partitions columns

[ https://issues.apache.org/jira/browse/SPARK-41806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41806. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39334

[jira] [Assigned] (SPARK-41791) Create distinct metadata attributes for metadata that is constant or file and metadata that is generated during the scan

[ https://issues.apache.org/jira/browse/SPARK-41791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41791: --- Assignee: Jan-Ole Sasse > Create distinct metadata attributes for metadata that is

[jira] [Resolved] (SPARK-41791) Create distinct metadata attributes for metadata that is constant or file and metadata that is generated during the scan

[ https://issues.apache.org/jira/browse/SPARK-41791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41791. - Resolution: Fixed Issue resolved by pull request 39314

[jira] [Assigned] (SPARK-39318) Remove tpch-plan-stability WithStats golden files

[ https://issues.apache.org/jira/browse/SPARK-39318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39318: --- Assignee: XiDuo You > Remove tpch-plan-stability WithStats golden files >

[jira] [Resolved] (SPARK-39318) Remove tpch-plan-stability WithStats golden files

[ https://issues.apache.org/jira/browse/SPARK-39318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39318. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36700

[jira] [Assigned] (SPARK-41859) CreateHiveTableAsSelectCommand should set the overwrite flag correctly

[ https://issues.apache.org/jira/browse/SPARK-41859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41859: --- Assignee: Wenchen Fan > CreateHiveTableAsSelectCommand should set the overwrite flag

[jira] [Resolved] (SPARK-41859) CreateHiveTableAsSelectCommand should set the overwrite flag correctly

[ https://issues.apache.org/jira/browse/SPARK-41859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41859. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39365

[jira] [Created] (SPARK-41859) CreateHiveTableAsSelectCommand should set the overwrite flag correctly

Wenchen Fan created SPARK-41859: --- Summary: CreateHiveTableAsSelectCommand should set the overwrite flag correctly Key: SPARK-41859 URL: https://issues.apache.org/jira/browse/SPARK-41859 Project: Spark

[jira] [Assigned] (SPARK-41405) centralize the column resolution logic

[ https://issues.apache.org/jira/browse/SPARK-41405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41405: --- Assignee: Wenchen Fan > centralize the column resolution logic >

[jira] [Resolved] (SPARK-41405) centralize the column resolution logic

[ https://issues.apache.org/jira/browse/SPARK-41405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41405. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 3

[jira] [Assigned] (SPARK-41049) Nondeterministic expressions have unstable values if they are children of CodegenFallback expressions

[ https://issues.apache.org/jira/browse/SPARK-41049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41049: --- Assignee: Wenchen Fan > Nondeterministic expressions have unstable values if they are

[jira] [Resolved] (SPARK-41049) Nondeterministic expressions have unstable values if they are children of CodegenFallback expressions

[ https://issues.apache.org/jira/browse/SPARK-41049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41049. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39248

[jira] [Resolved] (SPARK-41760) Enforce scalafmt for Spark Connect Client module

[ https://issues.apache.org/jira/browse/SPARK-41760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41760. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39274

[jira] [Assigned] (SPARK-41760) Enforce scalafmt for Spark Connect Client module

[ https://issues.apache.org/jira/browse/SPARK-41760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41760: --- Assignee: Deng Ziming > Enforce scalafmt for Spark Connect Client module >

[jira] [Assigned] (SPARK-41753) Add tests for ArrayZip to check the result size and nullability.

[ https://issues.apache.org/jira/browse/SPARK-41753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41753: --- Assignee: Takuya Ueshin > Add tests for ArrayZip to check the result size and nullability.

[jira] [Resolved] (SPARK-41753) Add tests for ArrayZip to check the result size and nullability.

[ https://issues.apache.org/jira/browse/SPARK-41753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41753. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39266

[jira] [Resolved] (SPARK-41713) Make CTAS hold a nested execution for data writing

[ https://issues.apache.org/jira/browse/SPARK-41713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41713. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39220

[jira] [Assigned] (SPARK-41713) Make CTAS hold a nested execution for data writing

[ https://issues.apache.org/jira/browse/SPARK-41713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41713: --- Assignee: XiDuo You > Make CTAS hold a nested execution for data writing >

[jira] [Assigned] (SPARK-41235) High-order function: array_compact

[ https://issues.apache.org/jira/browse/SPARK-41235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41235: --- Assignee: Sandeep Katta > High-order function: array_compact >

[jira] [Resolved] (SPARK-41235) High-order function: array_compact

[ https://issues.apache.org/jira/browse/SPARK-41235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41235. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38874

[jira] [Resolved] (SPARK-41690) Introduce AgnosticEncoders

[ https://issues.apache.org/jira/browse/SPARK-41690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41690. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39186

[jira] [Created] (SPARK-41720) Rename UnresolvedFunc to UnresolvedFunctionName

Wenchen Fan created SPARK-41720: --- Summary: Rename UnresolvedFunc to UnresolvedFunctionName Key: SPARK-41720 URL: https://issues.apache.org/jira/browse/SPARK-41720 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41498) Union does not propagate Metadata output

[ https://issues.apache.org/jira/browse/SPARK-41498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41498: --- Assignee: Fredrik Klauß > Union does not propagate Metadata output >

[jira] [Resolved] (SPARK-41498) Union does not propagate Metadata output

[ https://issues.apache.org/jira/browse/SPARK-41498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41498. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38941

[jira] [Assigned] (SPARK-41407) Pull out v1 write to WriteFiles

[ https://issues.apache.org/jira/browse/SPARK-41407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41407: --- Assignee: XiDuo You > Pull out v1 write to WriteFiles > --- >

[jira] [Resolved] (SPARK-41407) Pull out v1 write to WriteFiles

[ https://issues.apache.org/jira/browse/SPARK-41407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41407. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38939

[jira] [Resolved] (SPARK-41637) ORDER BY ALL

[ https://issues.apache.org/jira/browse/SPARK-41637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41637. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39144

[jira] [Resolved] (SPARK-41513) Implement a Accumulator to collect per mapper row count metrics

[ https://issues.apache.org/jira/browse/SPARK-41513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41513. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39057

[jira] [Resolved] (SPARK-41635) GROUP BY ALL

[ https://issues.apache.org/jira/browse/SPARK-41635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41635. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39134

[jira] [Assigned] (SPARK-41639) Remove ScalaReflectionLock

[ https://issues.apache.org/jira/browse/SPARK-41639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41639: --- Assignee: Sandish Kumar HN > Remove ScalaReflectionLock > --- > >

[jira] [Resolved] (SPARK-41639) Remove ScalaReflectionLock

[ https://issues.apache.org/jira/browse/SPARK-41639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41639. - Resolution: Fixed Issue resolved by pull request 39147

[jira] [Resolved] (SPARK-41669) Speed up CollapseProject for wide tables

[ https://issues.apache.org/jira/browse/SPARK-41669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41669. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39161

[jira] [Assigned] (SPARK-41669) Speed up CollapseProject for wide tables

[ https://issues.apache.org/jira/browse/SPARK-41669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41669: --- Assignee: Allison Wang > Speed up CollapseProject for wide tables >

[jira] [Resolved] (SPARK-41509) Delay execution hash until after aggregation for semi-join runtime filter.

[ https://issues.apache.org/jira/browse/SPARK-41509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41509. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39049

[jira] [Assigned] (SPARK-41509) Delay execution hash until after aggregation for semi-join runtime filter.

[ https://issues.apache.org/jira/browse/SPARK-41509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41509: --- Assignee: jiaan.geng > Delay execution hash until after aggregation for semi-join runtime

[jira] [Assigned] (SPARK-41660) only propagate metadata columns if they are used

[ https://issues.apache.org/jira/browse/SPARK-41660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41660: --- Assignee: Wenchen Fan > only propagate metadata columns if they are used >

[jira] [Resolved] (SPARK-41660) only propagate metadata columns if they are used

[ https://issues.apache.org/jira/browse/SPARK-41660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41660. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39152

[jira] [Created] (SPARK-41660) only propagate metadata columns if they are used

Wenchen Fan created SPARK-41660: --- Summary: only propagate metadata columns if they are used Key: SPARK-41660 URL: https://issues.apache.org/jira/browse/SPARK-41660 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-41631) Support lateral column alias in Aggregate code path

[ https://issues.apache.org/jira/browse/SPARK-41631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41631. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39040

[jira] [Assigned] (SPARK-41631) Support lateral column alias in Aggregate code path

[ https://issues.apache.org/jira/browse/SPARK-41631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41631: --- Assignee: Xinyi Yu > Support lateral column alias in Aggregate code path >

[jira] [Assigned] (SPARK-41396) Oneof field support and recursive fields

[ https://issues.apache.org/jira/browse/SPARK-41396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41396: --- Assignee: Sandish Kumar HN > Oneof field support and recursive fields >

[jira] [Resolved] (SPARK-41396) Oneof field support and recursive fields

[ https://issues.apache.org/jira/browse/SPARK-41396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41396. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38922

[jira] [Resolved] (SPARK-41441) Allow Generate with no required child output to host outer references

[ https://issues.apache.org/jira/browse/SPARK-41441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41441. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38968

[jira] [Assigned] (SPARK-41441) Allow Generate with no required child output to host outer references

[ https://issues.apache.org/jira/browse/SPARK-41441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41441: --- Assignee: Allison Wang > Allow Generate with no required child output to host outer

[jira] [Resolved] (SPARK-41511) LongToUnsafeRowMap support ignoresDuplicatedKey

[ https://issues.apache.org/jira/browse/SPARK-41511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41511. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39051

[jira] [Created] (SPARK-41530) extend MedianHeap to support percentile

Wenchen Fan created SPARK-41530: --- Summary: extend MedianHeap to support percentile Key: SPARK-41530 URL: https://issues.apache.org/jira/browse/SPARK-41530 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-27561) Support "lateral column alias references" to allow column aliases to be used within SELECT clauses

[ https://issues.apache.org/jira/browse/SPARK-27561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27561: --- Assignee: Xinyi Yu > Support "lateral column alias references" to allow column aliases to

[jira] [Resolved] (SPARK-27561) Support "lateral column alias references" to allow column aliases to be used within SELECT clauses

[ https://issues.apache.org/jira/browse/SPARK-27561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27561. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38776

[jira] [Assigned] (SPARK-41448) Make consistent MR job IDs in FileBatchWriter and FileFormatWriter

[ https://issues.apache.org/jira/browse/SPARK-41448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41448: --- Assignee: Hui An > Make consistent MR job IDs in FileBatchWriter and FileFormatWriter >

[jira] [Resolved] (SPARK-41448) Make consistent MR job IDs in FileBatchWriter and FileFormatWriter

[ https://issues.apache.org/jira/browse/SPARK-41448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41448. - Fix Version/s: 3.3.2 3.2.3 3.4.0 Resolution: Fixed

[jira] [Assigned] (SPARK-40775) V2 file scans have duplicative descriptions

[ https://issues.apache.org/jira/browse/SPARK-40775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40775: --- Assignee: Adam Binford > V2 file scans have duplicative descriptions >

[jira] [Resolved] (SPARK-40775) V2 file scans have duplicative descriptions

[ https://issues.apache.org/jira/browse/SPARK-40775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40775. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38229

[jira] [Resolved] (SPARK-41468) Fix PlanExpression handling in EquivalentExpressions

[ https://issues.apache.org/jira/browse/SPARK-41468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41468. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-41468) Fix PlanExpression handling in EquivalentExpressions

[ https://issues.apache.org/jira/browse/SPARK-41468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41468: --- Assignee: Peter Toth > Fix PlanExpression handling in EquivalentExpressions >

[jira] [Resolved] (SPARK-41437) Do not optimize the input query twice for v1 write fallback

[ https://issues.apache.org/jira/browse/SPARK-41437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41437. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38942

[jira] [Assigned] (SPARK-41437) Do not optimize the input query twice for v1 write fallback

[ https://issues.apache.org/jira/browse/SPARK-41437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41437: --- Assignee: Wenchen Fan > Do not optimize the input query twice for v1 write fallback >

[jira] [Resolved] (SPARK-41349) Implement `DataFrame.hint`

[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41349. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38899

[jira] [Assigned] (SPARK-41349) Implement `DataFrame.hint`

[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41349: --- Assignee: Deng Ziming > Implement `DataFrame.hint` > -- > >

[jira] [Created] (SPARK-41437) Do not optimize the input query twice for v1 write fallback

Wenchen Fan created SPARK-41437: --- Summary: Do not optimize the input query twice for v1 write fallback Key: SPARK-41437 URL: https://issues.apache.org/jira/browse/SPARK-41437 Project: Spark

[jira] [Created] (SPARK-41405) centralize the column resolution logic

Wenchen Fan created SPARK-41405: --- Summary: centralize the column resolution logic Key: SPARK-41405 URL: https://issues.apache.org/jira/browse/SPARK-41405 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-41355) Workaround hive table name validation issue

[ https://issues.apache.org/jira/browse/SPARK-41355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41355: --- Assignee: Wan Kun > Workaround hive table name validation issue >

[jira] [Resolved] (SPARK-41355) Workaround hive table name validation issue

[ https://issues.apache.org/jira/browse/SPARK-41355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41355. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38765

[jira] [Resolved] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils

[ https://issues.apache.org/jira/browse/SPARK-41358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41358. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38873

[jira] [Assigned] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils

[ https://issues.apache.org/jira/browse/SPARK-41358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41358: --- Assignee: Yang Jie > Use `PhysicalDataType` instead of DataType in ColumnVectorUtils >

[jira] [Created] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias

Wenchen Fan created SPARK-41350: --- Summary: allow simple name access of using join hidden columns after subquery alias Key: SPARK-41350 URL: https://issues.apache.org/jira/browse/SPARK-41350 Project:

[jira] [Resolved] (SPARK-41347) Add Cast to Expression proto

[ https://issues.apache.org/jira/browse/SPARK-41347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41347. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38859

[jira] [Assigned] (SPARK-41338) resolve outer references and normal columns in the same analyzer batch

[ https://issues.apache.org/jira/browse/SPARK-41338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41338: --- Assignee: Wenchen Fan > resolve outer references and normal columns in the same analyzer

[jira] [Resolved] (SPARK-41338) resolve outer references and normal columns in the same analyzer batch

[ https://issues.apache.org/jira/browse/SPARK-41338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41338. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38851

<    5   6   7   8   9   10   11   12   13   14   >