[jira] [Resolved] (SPARK-41441) Allow Generate with no required child output to host outer references

[ https://issues.apache.org/jira/browse/SPARK-41441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41441. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38968

[jira] [Assigned] (SPARK-41441) Allow Generate with no required child output to host outer references

[ https://issues.apache.org/jira/browse/SPARK-41441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41441: --- Assignee: Allison Wang > Allow Generate with no required child output to host outer

[jira] [Resolved] (SPARK-41511) LongToUnsafeRowMap support ignoresDuplicatedKey

[ https://issues.apache.org/jira/browse/SPARK-41511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41511. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39051

[jira] [Created] (SPARK-41530) extend MedianHeap to support percentile

Wenchen Fan created SPARK-41530: --- Summary: extend MedianHeap to support percentile Key: SPARK-41530 URL: https://issues.apache.org/jira/browse/SPARK-41530 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-27561) Support "lateral column alias references" to allow column aliases to be used within SELECT clauses

[ https://issues.apache.org/jira/browse/SPARK-27561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27561: --- Assignee: Xinyi Yu > Support "lateral column alias references" to allow column aliases to

[jira] [Resolved] (SPARK-27561) Support "lateral column alias references" to allow column aliases to be used within SELECT clauses

[ https://issues.apache.org/jira/browse/SPARK-27561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27561. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38776

[jira] [Assigned] (SPARK-41448) Make consistent MR job IDs in FileBatchWriter and FileFormatWriter

[ https://issues.apache.org/jira/browse/SPARK-41448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41448: --- Assignee: Hui An > Make consistent MR job IDs in FileBatchWriter and FileFormatWriter >

[jira] [Resolved] (SPARK-41448) Make consistent MR job IDs in FileBatchWriter and FileFormatWriter

[ https://issues.apache.org/jira/browse/SPARK-41448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41448. - Fix Version/s: 3.3.2 3.2.3 3.4.0 Resolution: Fixed

[jira] [Assigned] (SPARK-40775) V2 file scans have duplicative descriptions

[ https://issues.apache.org/jira/browse/SPARK-40775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40775: --- Assignee: Adam Binford > V2 file scans have duplicative descriptions >

[jira] [Resolved] (SPARK-40775) V2 file scans have duplicative descriptions

[ https://issues.apache.org/jira/browse/SPARK-40775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40775. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38229

[jira] [Resolved] (SPARK-41468) Fix PlanExpression handling in EquivalentExpressions

[ https://issues.apache.org/jira/browse/SPARK-41468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41468. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-41468) Fix PlanExpression handling in EquivalentExpressions

[ https://issues.apache.org/jira/browse/SPARK-41468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41468: --- Assignee: Peter Toth > Fix PlanExpression handling in EquivalentExpressions >

[jira] [Resolved] (SPARK-41437) Do not optimize the input query twice for v1 write fallback

[ https://issues.apache.org/jira/browse/SPARK-41437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41437. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38942

[jira] [Assigned] (SPARK-41437) Do not optimize the input query twice for v1 write fallback

[ https://issues.apache.org/jira/browse/SPARK-41437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41437: --- Assignee: Wenchen Fan > Do not optimize the input query twice for v1 write fallback >

[jira] [Resolved] (SPARK-41349) Implement `DataFrame.hint`

[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41349. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38899

[jira] [Assigned] (SPARK-41349) Implement `DataFrame.hint`

[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41349: --- Assignee: Deng Ziming > Implement `DataFrame.hint` > -- > >

[jira] [Created] (SPARK-41437) Do not optimize the input query twice for v1 write fallback

Wenchen Fan created SPARK-41437: --- Summary: Do not optimize the input query twice for v1 write fallback Key: SPARK-41437 URL: https://issues.apache.org/jira/browse/SPARK-41437 Project: Spark

[jira] [Created] (SPARK-41405) centralize the column resolution logic

Wenchen Fan created SPARK-41405: --- Summary: centralize the column resolution logic Key: SPARK-41405 URL: https://issues.apache.org/jira/browse/SPARK-41405 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-41355) Workaround hive table name validation issue

[ https://issues.apache.org/jira/browse/SPARK-41355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41355: --- Assignee: Wan Kun > Workaround hive table name validation issue >

[jira] [Resolved] (SPARK-41355) Workaround hive table name validation issue

[ https://issues.apache.org/jira/browse/SPARK-41355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41355. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38765

[jira] [Resolved] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils

[ https://issues.apache.org/jira/browse/SPARK-41358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41358. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38873

[jira] [Assigned] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils

[ https://issues.apache.org/jira/browse/SPARK-41358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41358: --- Assignee: Yang Jie > Use `PhysicalDataType` instead of DataType in ColumnVectorUtils >

[jira] [Created] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias

Wenchen Fan created SPARK-41350: --- Summary: allow simple name access of using join hidden columns after subquery alias Key: SPARK-41350 URL: https://issues.apache.org/jira/browse/SPARK-41350 Project:

[jira] [Resolved] (SPARK-41347) Add Cast to Expression proto

[ https://issues.apache.org/jira/browse/SPARK-41347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41347. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38859

[jira] [Assigned] (SPARK-41338) resolve outer references and normal columns in the same analyzer batch

[ https://issues.apache.org/jira/browse/SPARK-41338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41338: --- Assignee: Wenchen Fan > resolve outer references and normal columns in the same analyzer

[jira] [Resolved] (SPARK-41338) resolve outer references and normal columns in the same analyzer batch

[ https://issues.apache.org/jira/browse/SPARK-41338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41338. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38851

[jira] [Resolved] (SPARK-41343) Move FunctionName parsing to server side

[ https://issues.apache.org/jira/browse/SPARK-41343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41343. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38854

[jira] [Resolved] (SPARK-41226) Refactor Spark types by introducing physical types

[ https://issues.apache.org/jira/browse/SPARK-41226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41226. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38750

[jira] [Assigned] (SPARK-41226) Refactor Spark types by introducing physical types

[ https://issues.apache.org/jira/browse/SPARK-41226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41226: --- Assignee: Gengliang Wang > Refactor Spark types by introducing physical types >

[jira] [Created] (SPARK-41338) resolve outer references and normal columns in the same analyzer batch

Wenchen Fan created SPARK-41338: --- Summary: resolve outer references and normal columns in the same analyzer batch Key: SPARK-41338 URL: https://issues.apache.org/jira/browse/SPARK-41338 Project: Spark

[jira] [Resolved] (SPARK-41323) Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE()

[ https://issues.apache.org/jira/browse/SPARK-41323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41323. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38840

[jira] [Assigned] (SPARK-41323) Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE()

[ https://issues.apache.org/jira/browse/SPARK-41323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41323: --- Assignee: Serge Rielau > Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE() >

[jira] [Resolved] (SPARK-41256) Implement DataFrame.withColumn(s)

[ https://issues.apache.org/jira/browse/SPARK-41256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41256. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38793

[jira] [Resolved] (SPARK-41306) Improve Connect Expression proto documentation

[ https://issues.apache.org/jira/browse/SPARK-41306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41306. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38825

[jira] [Resolved] (SPARK-41003) BHJ LeftAnti does not update numOutputRows when codegen is disabled

[ https://issues.apache.org/jira/browse/SPARK-41003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41003. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38489

[jira] [Assigned] (SPARK-41003) BHJ LeftAnti does not update numOutputRows when codegen is disabled

[ https://issues.apache.org/jira/browse/SPARK-41003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41003: --- Assignee: dzcxzl > BHJ LeftAnti does not update numOutputRows when codegen is disabled >

[jira] [Assigned] (SPARK-41154) Incorrect relation caching for queries with time travel spec

[ https://issues.apache.org/jira/browse/SPARK-41154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41154: --- Assignee: XiDuo You > Incorrect relation caching for queries with time travel spec >

[jira] [Resolved] (SPARK-41154) Incorrect relation caching for queries with time travel spec

[ https://issues.apache.org/jira/browse/SPARK-41154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41154. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-41183) Add an extension API to do plan normalization for caching

[ https://issues.apache.org/jira/browse/SPARK-41183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41183: --- Assignee: Wenchen Fan > Add an extension API to do plan normalization for caching >

[jira] [Resolved] (SPARK-41183) Add an extension API to do plan normalization for caching

[ https://issues.apache.org/jira/browse/SPARK-41183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41183. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38692

[jira] [Created] (SPARK-41195) Support PIVOT/UNPIVOT with join children

Wenchen Fan created SPARK-41195: --- Summary: Support PIVOT/UNPIVOT with join children Key: SPARK-41195 URL: https://issues.apache.org/jira/browse/SPARK-41195 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-40999) Hints on subqueries are not properly propagated

[ https://issues.apache.org/jira/browse/SPARK-40999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40999: --- Assignee: Fredrik Klauß > Hints on subqueries are not properly propagated >

[jira] [Resolved] (SPARK-40999) Hints on subqueries are not properly propagated

[ https://issues.apache.org/jira/browse/SPARK-40999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40999. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38497

[jira] [Resolved] (SPARK-41178) fix parser rule precedence between JOIN and comma

[ https://issues.apache.org/jira/browse/SPARK-41178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41178. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38691

[jira] [Assigned] (SPARK-41178) fix parser rule precedence between JOIN and comma

[ https://issues.apache.org/jira/browse/SPARK-41178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41178: --- Assignee: Wenchen Fan > fix parser rule precedence between JOIN and comma >

[jira] [Created] (SPARK-41183) Add an extension API to do plan normalization for caching

Wenchen Fan created SPARK-41183: --- Summary: Add an extension API to do plan normalization for caching Key: SPARK-41183 URL: https://issues.apache.org/jira/browse/SPARK-41183 Project: Spark

[jira] [Created] (SPARK-41178) fix parser rule precedence between JOIN and comma

Wenchen Fan created SPARK-41178: --- Summary: fix parser rule precedence between JOIN and comma Key: SPARK-41178 URL: https://issues.apache.org/jira/browse/SPARK-41178 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41048) Improve output partitioning and ordering with AQE cache

[ https://issues.apache.org/jira/browse/SPARK-41048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41048: --- Assignee: XiDuo You > Improve output partitioning and ordering with AQE cache >

[jira] [Resolved] (SPARK-41048) Improve output partitioning and ordering with AQE cache

[ https://issues.apache.org/jira/browse/SPARK-41048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41048. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38558

[jira] [Resolved] (SPARK-41090) Enhance Dataset.createTempView testing coverage for db_name.view_name

[ https://issues.apache.org/jira/browse/SPARK-41090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41090. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38595

[jira] [Assigned] (SPARK-41090) Enhance Dataset.createTempView testing coverage for db_name.view_name

[ https://issues.apache.org/jira/browse/SPARK-41090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41090: --- Assignee: Rui Wang > Enhance Dataset.createTempView testing coverage for db_name.view_name

[jira] [Resolved] (SPARK-41103) Document how to add a new proto field of messages

[ https://issues.apache.org/jira/browse/SPARK-41103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41103. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38605

[jira] [Assigned] (SPARK-41103) Document how to add a new proto field of messages

[ https://issues.apache.org/jira/browse/SPARK-41103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41103: --- Assignee: Rui Wang > Document how to add a new proto field of messages >

[jira] [Assigned] (SPARK-40956) SQL Equivalent for Dataframe overwrite command

[ https://issues.apache.org/jira/browse/SPARK-40956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40956: --- Assignee: chengyan fu > SQL Equivalent for Dataframe overwrite command >

[jira] [Resolved] (SPARK-40956) SQL Equivalent for Dataframe overwrite command

[ https://issues.apache.org/jira/browse/SPARK-40956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40956. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38404

[jira] [Assigned] (SPARK-41144) UnresolvedHint should not cause query failure

[ https://issues.apache.org/jira/browse/SPARK-41144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41144: --- Assignee: XiDuo You > UnresolvedHint should not cause query failure >

[jira] [Resolved] (SPARK-41144) UnresolvedHint should not cause query failure

[ https://issues.apache.org/jira/browse/SPARK-41144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41144. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-41112) RuntimeFilter should apply ColumnPruning eagerly with in-subquery filter

[ https://issues.apache.org/jira/browse/SPARK-41112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41112. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38619

[jira] [Assigned] (SPARK-41112) RuntimeFilter should apply ColumnPruning eagerly with in-subquery filter

[ https://issues.apache.org/jira/browse/SPARK-41112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41112: --- Assignee: XiDuo You > RuntimeFilter should apply ColumnPruning eagerly with in-subquery

[jira] [Assigned] (SPARK-41134) improve error message of internal errors

[ https://issues.apache.org/jira/browse/SPARK-41134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41134: --- Assignee: Wenchen Fan > improve error message of internal errors >

[jira] [Resolved] (SPARK-41134) improve error message of internal errors

[ https://issues.apache.org/jira/browse/SPARK-41134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41134. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38648

[jira] [Created] (SPARK-41134) improve error message of internal errors

Wenchen Fan created SPARK-41134: --- Summary: improve error message of internal errors Key: SPARK-41134 URL: https://issues.apache.org/jira/browse/SPARK-41134 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-41111) Implement `DataFrame.show`

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-4. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38621

[jira] [Resolved] (SPARK-41116) Input relation can be optional for Project in Connect proto

[ https://issues.apache.org/jira/browse/SPARK-41116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41116. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38632

[jira] [Assigned] (SPARK-41116) Input relation can be optional for Project in Connect proto

[ https://issues.apache.org/jira/browse/SPARK-41116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41116: --- Assignee: Rui Wang > Input relation can be optional for Project in Connect proto >

[jira] [Assigned] (SPARK-41102) Merge SparkConnectPlanner and SparkConnectCommandPlanner

[ https://issues.apache.org/jira/browse/SPARK-41102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41102: --- Assignee: Rui Wang > Merge SparkConnectPlanner and SparkConnectCommandPlanner >

[jira] [Resolved] (SPARK-41102) Merge SparkConnectPlanner and SparkConnectCommandPlanner

[ https://issues.apache.org/jira/browse/SPARK-41102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41102. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38604

[jira] [Created] (SPARK-41092) Do not use identifier to match interval units

Wenchen Fan created SPARK-41092: --- Summary: Do not use identifier to match interval units Key: SPARK-41092 URL: https://issues.apache.org/jira/browse/SPARK-41092 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41078) DataFrame `withColumnsRenamed` can be implemented through `RenameColumns` proto

[ https://issues.apache.org/jira/browse/SPARK-41078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41078: --- Assignee: Rui Wang > DataFrame `withColumnsRenamed` can be implemented through

[jira] [Resolved] (SPARK-41078) DataFrame `withColumnsRenamed` can be implemented through `RenameColumns` proto

[ https://issues.apache.org/jira/browse/SPARK-41078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41078. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38587

[jira] [Resolved] (SPARK-41046) Support CreateView in Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-41046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41046. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38566

[jira] [Assigned] (SPARK-41046) Support CreateView in Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-41046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41046: --- Assignee: Rui Wang > Support CreateView in Connect DSL > -

[jira] [Resolved] (SPARK-41061) Support SelectExpr which apply Projection by expressions in Strings in Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-41061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41061. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38573

[jira] [Assigned] (SPARK-41061) Support SelectExpr which apply Projection by expressions in Strings in Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-41061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41061: --- Assignee: Rui Wang > Support SelectExpr which apply Projection by expressions in Strings

[jira] [Assigned] (SPARK-40588) Sorting issue with partitioned-writing and AQE turned on

[ https://issues.apache.org/jira/browse/SPARK-40588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40588: --- Assignee: Enrico Minack > Sorting issue with partitioned-writing and AQE turned on >

[jira] [Resolved] (SPARK-40588) Sorting issue with partitioned-writing and AQE turned on

[ https://issues.apache.org/jira/browse/SPARK-40588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40588. - Fix Version/s: 3.3.2 3.2.3 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-40992) Support toDF(columnNames) in Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-40992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40992. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38475

[jira] [Assigned] (SPARK-40992) Support toDF(columnNames) in Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-40992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40992: --- Assignee: Rui Wang > Support toDF(columnNames) in Connect DSL >

[jira] [Assigned] (SPARK-41058) Removing unused code in connect

[ https://issues.apache.org/jira/browse/SPARK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41058: --- Assignee: Deng Ziming > Removing unused code in connect > ---

[jira] [Resolved] (SPARK-41058) Removing unused code in connect

[ https://issues.apache.org/jira/browse/SPARK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41058. - Resolution: Fixed Issue resolved by pull request 38491

[jira] [Resolved] (SPARK-40852) Implement `DataFrame.summary`

[ https://issues.apache.org/jira/browse/SPARK-40852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40852. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38318

[jira] [Updated] (SPARK-41017) Support column pruning with multiple nondeterministic Filters

[ https://issues.apache.org/jira/browse/SPARK-41017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-41017: Summary: Support column pruning with multiple nondeterministic Filters (was: Do not push Filter

[jira] [Resolved] (SPARK-41026) Support Repartition in Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-41026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41026. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38529

[jira] [Assigned] (SPARK-41026) Support Repartition in Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-41026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41026: --- Assignee: Rui Wang > Support Repartition in Connect DSL >

[jira] [Assigned] (SPARK-40875) Add .agg() to Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-40875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40875: --- Assignee: Rui Wang > Add .agg() to Connect DSL > - > >

[jira] [Resolved] (SPARK-40875) Add .agg() to Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-40875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40875. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38527

[jira] [Created] (SPARK-41017) Do not push Filter through reference-only Project

Wenchen Fan created SPARK-41017: --- Summary: Do not push Filter through reference-only Project Key: SPARK-41017 URL: https://issues.apache.org/jira/browse/SPARK-41017 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40834) Use SparkListenerSQLExecutionEnd to track final SQL status in UI

[ https://issues.apache.org/jira/browse/SPARK-40834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40834: --- Assignee: XiDuo You > Use SparkListenerSQLExecutionEnd to track final SQL status in UI >

[jira] [Resolved] (SPARK-40834) Use SparkListenerSQLExecutionEnd to track final SQL status in UI

[ https://issues.apache.org/jira/browse/SPARK-40834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40834. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38302

[jira] [Assigned] (SPARK-40921) Add WHEN NOT MATCHED BY SOURCE clause to MERGE INTO command

[ https://issues.apache.org/jira/browse/SPARK-40921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40921: --- Assignee: Johan Lasperas > Add WHEN NOT MATCHED BY SOURCE clause to MERGE INTO command >

[jira] [Resolved] (SPARK-40921) Add WHEN NOT MATCHED BY SOURCE clause to MERGE INTO command

[ https://issues.apache.org/jira/browse/SPARK-40921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40921. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38400

[jira] [Resolved] (SPARK-38270) SQL CLI AM should keep same exitcode with client

[ https://issues.apache.org/jira/browse/SPARK-38270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38270. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35594

[jira] [Assigned] (SPARK-38270) SQL CLI AM should keep same exitcode with client

[ https://issues.apache.org/jira/browse/SPARK-38270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38270: --- Assignee: angerszhu > SQL CLI AM should keep same exitcode with client >

[jira] [Resolved] (SPARK-40938) Support Alias for every Relation

[ https://issues.apache.org/jira/browse/SPARK-40938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40938. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38415

[jira] [Assigned] (SPARK-40938) Support Alias for every Relation

[ https://issues.apache.org/jira/browse/SPARK-40938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40938: --- Assignee: Rui Wang > Support Alias for every Relation > >

[jira] [Resolved] (SPARK-40883) Support Range in Connect proto

[ https://issues.apache.org/jira/browse/SPARK-40883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40883. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38347

[jira] [Assigned] (SPARK-40883) Support Range in Connect proto

[ https://issues.apache.org/jira/browse/SPARK-40883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40883: --- Assignee: Rui Wang > Support Range in Connect proto > -- > >

[jira] [Assigned] (SPARK-40971) Imports more from connect proto package to avoid calling `proto.` for Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-40971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40971: --- Assignee: Rui Wang > Imports more from connect proto package to avoid calling `proto.` for

[jira] [Resolved] (SPARK-40971) Imports more from connect proto package to avoid calling `proto.` for Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-40971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40971. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38445

[jira] [Resolved] (SPARK-40713) Improve SET operation support in the proto and the server

[ https://issues.apache.org/jira/browse/SPARK-40713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40713. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38166

<    6   7   8   9   10   11   12   13   14   15   >