[jira] [Assigned] (SPARK-42855) Migrate nullability write checks to runtime for V2 tables

[ https://issues.apache.org/jira/browse/SPARK-42855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42855: --- Assignee: Anton Okolnychyi > Migrate nullability write checks to runtime for V2 tables >

[jira] [Resolved] (SPARK-42855) Migrate nullability write checks to runtime for V2 tables

[ https://issues.apache.org/jira/browse/SPARK-42855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42855. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40655

[jira] [Created] (SPARK-43030) deduplicate relations with metadata columns

Wenchen Fan created SPARK-43030: --- Summary: deduplicate relations with metadata columns Key: SPARK-43030 URL: https://issues.apache.org/jira/browse/SPARK-43030 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-42655) Incorrect ambiguous column reference error

[ https://issues.apache.org/jira/browse/SPARK-42655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42655: --- Assignee: Shrikant Prasad > Incorrect ambiguous column reference error >

[jira] [Resolved] (SPARK-42655) Incorrect ambiguous column reference error

[ https://issues.apache.org/jira/browse/SPARK-42655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42655. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40258

[jira] [Assigned] (SPARK-43026) Apply AQE with non-exchange table cache

[ https://issues.apache.org/jira/browse/SPARK-43026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43026: --- Assignee: XiDuo You > Apply AQE with non-exchange table cache >

[jira] [Resolved] (SPARK-43026) Apply AQE with non-exchange table cache

[ https://issues.apache.org/jira/browse/SPARK-43026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43026. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40659

[jira] [Assigned] (SPARK-42918) Generalize handling of metadata attributes in FileSourceStrategy

[ https://issues.apache.org/jira/browse/SPARK-42918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42918: --- Assignee: Johan Lasperas > Generalize handling of metadata attributes in

[jira] [Resolved] (SPARK-42918) Generalize handling of metadata attributes in FileSourceStrategy

[ https://issues.apache.org/jira/browse/SPARK-42918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42918. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40545

[jira] [Assigned] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect

[ https://issues.apache.org/jira/browse/SPARK-41391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41391: --- Assignee: Ritika Maheshwari > The output column name of `groupBy.agg(count_distinct)` is

[jira] [Resolved] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect

[ https://issues.apache.org/jira/browse/SPARK-41391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41391. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40116

[jira] [Reopened] (SPARK-41765) Pull out v1 write metrics to WriteFiles

[ https://issues.apache.org/jira/browse/SPARK-41765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-41765: - Assignee: (was: XiDuo You) > Pull out v1 write metrics to WriteFiles >

[jira] [Resolved] (SPARK-41765) Pull out v1 write metrics to WriteFiles

[ https://issues.apache.org/jira/browse/SPARK-41765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41765. - Fix Version/s: (was: 3.4.0) Resolution: Won't Do > Pull out v1 write metrics to

[jira] [Assigned] (SPARK-42683) Automatically rename metadata columns that conflict with data schema columns

[ https://issues.apache.org/jira/browse/SPARK-42683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42683: --- Assignee: Ryan Johnson > Automatically rename metadata columns that conflict with data

[jira] [Resolved] (SPARK-42683) Automatically rename metadata columns that conflict with data schema columns

[ https://issues.apache.org/jira/browse/SPARK-42683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42683. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40300

[jira] [Assigned] (SPARK-41359) Use `PhysicalDataType` instead of DataType in UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-41359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41359: --- Assignee: Yang Jie > Use `PhysicalDataType` instead of DataType in UnsafeRow >

[jira] [Resolved] (SPARK-41359) Use `PhysicalDataType` instead of DataType in UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-41359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41359. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40400

[jira] [Resolved] (SPARK-42949) Simplify code for NAAJ

[ https://issues.apache.org/jira/browse/SPARK-42949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42949. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40578

[jira] [Assigned] (SPARK-42949) Simplify code for NAAJ

[ https://issues.apache.org/jira/browse/SPARK-42949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42949: --- Assignee: Cheng Pan > Simplify code for NAAJ > -- > >

[jira] [Assigned] (SPARK-42928) Make resolvePersistentFunction synchronized

[ https://issues.apache.org/jira/browse/SPARK-42928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42928: --- Assignee: Allison Wang > Make resolvePersistentFunction synchronized >

[jira] [Resolved] (SPARK-42928) Make resolvePersistentFunction synchronized

[ https://issues.apache.org/jira/browse/SPARK-42928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42928. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40557

[jira] [Resolved] (SPARK-42936) Unresolved having at the end of analysis when using with LCA with the having clause that can be resolved directly by its child Aggregate

[ https://issues.apache.org/jira/browse/SPARK-42936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42936. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40558

[jira] [Assigned] (SPARK-42936) Unresolved having at the end of analysis when using with LCA with the having clause that can be resolved directly by its child Aggregate

[ https://issues.apache.org/jira/browse/SPARK-42936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42936: --- Assignee: Xinyi Yu > Unresolved having at the end of analysis when using with LCA with the

[jira] [Resolved] (SPARK-41630) Support lateral column alias in Project code path

[ https://issues.apache.org/jira/browse/SPARK-41630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41630. - Fix Version/s: 3.4.0 Assignee: Xinyi Yu Resolution: Fixed > Support lateral

[jira] [Assigned] (SPARK-42815) Subexpression elimination support shortcut expression

[ https://issues.apache.org/jira/browse/SPARK-42815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42815: --- Assignee: XiDuo You > Subexpression elimination support shortcut expression >

[jira] [Resolved] (SPARK-42815) Subexpression elimination support shortcut expression

[ https://issues.apache.org/jira/browse/SPARK-42815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42815. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40446

[jira] [Assigned] (SPARK-42052) Codegen Support for HiveSimpleUDF

[ https://issues.apache.org/jira/browse/SPARK-42052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42052: --- Assignee: BingKun Pan > Codegen Support for HiveSimpleUDF >

[jira] [Resolved] (SPARK-42052) Codegen Support for HiveSimpleUDF

[ https://issues.apache.org/jira/browse/SPARK-42052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42052. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40397

[jira] [Resolved] (SPARK-42851) EquivalentExpressions methods need to be consistently guarded by supportedExpression

[ https://issues.apache.org/jira/browse/SPARK-42851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42851. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40473

[jira] [Assigned] (SPARK-42851) EquivalentExpressions methods need to be consistently guarded by supportedExpression

[ https://issues.apache.org/jira/browse/SPARK-42851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42851: --- Assignee: Kris Mok > EquivalentExpressions methods need to be consistently guarded by >

[jira] [Resolved] (SPARK-42876) DataType's physicalDataType should be private[sql]

[ https://issues.apache.org/jira/browse/SPARK-42876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42876. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40499

[jira] [Assigned] (SPARK-42791) Create golden file test framework for analysis

[ https://issues.apache.org/jira/browse/SPARK-42791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42791: --- Assignee: Daniel > Create golden file test framework for analysis >

[jira] [Resolved] (SPARK-42791) Create golden file test framework for analysis

[ https://issues.apache.org/jira/browse/SPARK-42791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42791. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40449

[jira] [Resolved] (SPARK-42772) Change the default value of JDBC options about push down to true

[ https://issues.apache.org/jira/browse/SPARK-42772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42772. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40396

[jira] [Assigned] (SPARK-42772) Change the default value of JDBC options about push down to true

[ https://issues.apache.org/jira/browse/SPARK-42772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42772: --- Assignee: jiaan.geng > Change the default value of JDBC options about push down to true >

[jira] [Assigned] (SPARK-42783) Infer window group limit should run as late as possible

[ https://issues.apache.org/jira/browse/SPARK-42783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42783: --- Assignee: jiaan.geng > Infer window group limit should run as late as possible >

[jira] [Resolved] (SPARK-42783) Infer window group limit should run as late as possible

[ https://issues.apache.org/jira/browse/SPARK-42783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42783. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40410

[jira] [Resolved] (SPARK-42771) Refactor HiveGenericUDF

[ https://issues.apache.org/jira/browse/SPARK-42771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42771. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40394

[jira] [Assigned] (SPARK-42771) Refactor HiveGenericUDF

[ https://issues.apache.org/jira/browse/SPARK-42771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42771: --- Assignee: BingKun Pan > Refactor HiveGenericUDF > --- > >

[jira] [Resolved] (SPARK-42778) QueryStageExec should respect supportsRowBased

[ https://issues.apache.org/jira/browse/SPARK-42778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42778. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40407

[jira] [Resolved] (SPARK-42702) Support parameterized CTE

[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42702. - Assignee: Wenchen Fan (was: Max Gekk) Resolution: Fixed > Support parameterized CTE >

[jira] [Resolved] (SPARK-39235) Make Catalog API be compatible with 3-layer-namespace

[ https://issues.apache.org/jira/browse/SPARK-39235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39235. - Fix Version/s: 3.4.0 Resolution: Fixed > Make Catalog API be compatible with

[jira] [Assigned] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42101: --- Assignee: XiDuo You > Wrap InMemoryTableScanExec with QueryStage >

[jira] [Resolved] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42101. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39624

[jira] [Assigned] (SPARK-42745) Improved AliasAwareOutputExpression works with DSv2

[ https://issues.apache.org/jira/browse/SPARK-42745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42745: --- Assignee: Peter Toth > Improved AliasAwareOutputExpression works with DSv2 >

[jira] [Resolved] (SPARK-42745) Improved AliasAwareOutputExpression works with DSv2

[ https://issues.apache.org/jira/browse/SPARK-42745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42745. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40364

[jira] [Resolved] (SPARK-42623) parameter markers not blocked in DDL

[ https://issues.apache.org/jira/browse/SPARK-42623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42623. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40333

[jira] [Assigned] (SPARK-42623) parameter markers not blocked in DDL

[ https://issues.apache.org/jira/browse/SPARK-42623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42623: --- Assignee: Wenchen Fan > parameter markers not blocked in DDL >

[jira] [Resolved] (SPARK-42702) Support parameterized CTE

[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42702. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40333

[jira] [Assigned] (SPARK-42684) v2 catalog should not allow column default value by default

[ https://issues.apache.org/jira/browse/SPARK-42684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42684: --- Assignee: Wenchen Fan > v2 catalog should not allow column default value by default >

[jira] [Resolved] (SPARK-42684) v2 catalog should not allow column default value by default

[ https://issues.apache.org/jira/browse/SPARK-42684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42684. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40299

[jira] [Updated] (SPARK-42623) parameter markers not blocked in DDL

[ https://issues.apache.org/jira/browse/SPARK-42623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-42623: Fix Version/s: (was: 3.4.0) > parameter markers not blocked in DDL >

[jira] [Commented] (SPARK-42623) parameter markers not blocked in DDL

[ https://issues.apache.org/jira/browse/SPARK-42623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697721#comment-17697721 ] Wenchen Fan commented on SPARK-42623: - I think the problem occurs when we store the original SQL

[jira] [Created] (SPARK-42684) v2 catalog should not allow column default value by default

Wenchen Fan created SPARK-42684: --- Summary: v2 catalog should not allow column default value by default Key: SPARK-42684 URL: https://issues.apache.org/jira/browse/SPARK-42684 Project: Spark

[jira] [Resolved] (SPARK-42611) Insert char/varchar length checks for inner fields during resolution

[ https://issues.apache.org/jira/browse/SPARK-42611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42611. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40206

[jira] [Assigned] (SPARK-42611) Insert char/varchar length checks for inner fields during resolution

[ https://issues.apache.org/jira/browse/SPARK-42611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42611: --- Assignee: Anton Okolnychyi > Insert char/varchar length checks for inner fields during

[jira] [Assigned] (SPARK-42548) Add ReferenceAllColumns to skip rewriting attributes

[ https://issues.apache.org/jira/browse/SPARK-42548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42548: --- Assignee: XiDuo You > Add ReferenceAllColumns to skip rewriting attributes >

[jira] [Resolved] (SPARK-42548) Add ReferenceAllColumns to skip rewriting attributes

[ https://issues.apache.org/jira/browse/SPARK-42548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42548. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40154

[jira] [Resolved] (SPARK-41171) Push down filter through window when partitionSpec is empty

[ https://issues.apache.org/jira/browse/SPARK-41171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41171. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40142

[jira] [Assigned] (SPARK-41171) Push down filter through window when partitionSpec is empty

[ https://issues.apache.org/jira/browse/SPARK-41171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41171: --- Assignee: jiaan.geng > Push down filter through window when partitionSpec is empty >

[jira] [Assigned] (SPARK-42600) currentDatabase Shall use NamespaceHelper instead of MultipartIdentifierHelper

[ https://issues.apache.org/jira/browse/SPARK-42600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42600: --- Assignee: Kent Yao > currentDatabase Shall use NamespaceHelper instead of >

[jira] [Resolved] (SPARK-42600) currentDatabase Shall use NamespaceHelper instead of MultipartIdentifierHelper

[ https://issues.apache.org/jira/browse/SPARK-42600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42600. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40192

[jira] [Resolved] (SPARK-42121) Add built-in table-valued functions posexplode and posexplode_outer

[ https://issues.apache.org/jira/browse/SPARK-42121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42121. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40151

[jira] [Assigned] (SPARK-42121) Add built-in table-valued functions posexplode and posexplode_outer

[ https://issues.apache.org/jira/browse/SPARK-42121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42121: --- Assignee: Allison Wang > Add built-in table-valued functions posexplode and

[jira] [Assigned] (SPARK-42478) Make a serializable jobTrackerId instead of a non-serializable JobID in FileWriterFactory

[ https://issues.apache.org/jira/browse/SPARK-42478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42478: --- Assignee: Yi kaifei > Make a serializable jobTrackerId instead of a non-serializable JobID

[jira] [Resolved] (SPARK-42478) Make a serializable jobTrackerId instead of a non-serializable JobID in FileWriterFactory

[ https://issues.apache.org/jira/browse/SPARK-42478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42478. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40064

[jira] [Assigned] (SPARK-41290) Support GENERATED ALWAYS AS syntax in create/replace table to create a generated column

[ https://issues.apache.org/jira/browse/SPARK-41290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41290: --- Assignee: Allison Portis > Support GENERATED ALWAYS AS syntax in create/replace table to

[jira] [Resolved] (SPARK-41290) Support GENERATED ALWAYS AS syntax in create/replace table to create a generated column

[ https://issues.apache.org/jira/browse/SPARK-41290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41290. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38823

[jira] [Resolved] (SPARK-42528) Optimize PercentileHeap

[ https://issues.apache.org/jira/browse/SPARK-42528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42528. - Fix Version/s: 3.5.0 (was: 3.4.0) Resolution: Fixed Issue

[jira] [Assigned] (SPARK-41516) Allow jdbc dialects to override the query used to create a table

[ https://issues.apache.org/jira/browse/SPARK-41516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41516: --- Assignee: xiaoping.huang > Allow jdbc dialects to override the query used to create a

[jira] [Resolved] (SPARK-41516) Allow jdbc dialects to override the query used to create a table

[ https://issues.apache.org/jira/browse/SPARK-41516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41516. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39062

[jira] [Assigned] (SPARK-42534) Fix DB2 Limit clause

[ https://issues.apache.org/jira/browse/SPARK-42534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42534: --- Assignee: Ivan Sadikov > Fix DB2 Limit clause > > >

[jira] [Resolved] (SPARK-42534) Fix DB2 Limit clause

[ https://issues.apache.org/jira/browse/SPARK-42534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42534. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40155

[jira] [Assigned] (SPARK-42289) DS V2 pushdown could let JDBC dialect decide to push down offset and limit

[ https://issues.apache.org/jira/browse/SPARK-42289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42289: --- Assignee: jiaan.geng > DS V2 pushdown could let JDBC dialect decide to push down offset

[jira] [Resolved] (SPARK-42289) DS V2 pushdown could let JDBC dialect decide to push down offset and limit

[ https://issues.apache.org/jira/browse/SPARK-42289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42289. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39954

[jira] [Commented] (SPARK-42546) SPARK-42045 is incomplete in supporting ANSI_MODE fro round() and bround()

[ https://issues.apache.org/jira/browse/SPARK-42546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692985#comment-17692985 ] Wenchen Fan commented on SPARK-42546: - [~beliefer] do you have time to take a look? > SPARK-42045

[jira] [Resolved] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41793. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40138

[jira] [Assigned] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41793: --- Assignee: XiDuo You > Incorrect result for window frames defined by a range clause on

[jira] [Resolved] (SPARK-42484) Better logging for UnsafeRowUtils

[ https://issues.apache.org/jira/browse/SPARK-42484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42484. - Fix Version/s: 3.5.0 Resolution: Fixed > Better logging for UnsafeRowUtils >

[jira] [Assigned] (SPARK-42484) Better logging for UnsafeRowUtils

[ https://issues.apache.org/jira/browse/SPARK-42484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42484: --- Assignee: Wei Liu > Better logging for UnsafeRowUtils > -

[jira] [Commented] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692451#comment-17692451 ] Wenchen Fan commented on SPARK-41793: - When we are doing window operator computing per partition,

[jira] [Assigned] (SPARK-42528) Optimize PercentileHeap

[ https://issues.apache.org/jira/browse/SPARK-42528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42528: --- Assignee: Alkis Evlogimenos (was: Wenchen Fan) > Optimize PercentileHeap >

[jira] [Resolved] (SPARK-42520) Spark Connect Scala Client: Window

[ https://issues.apache.org/jira/browse/SPARK-42520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42520. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40107

[jira] [Assigned] (SPARK-41765) Pull out v1 write metrics to WriteFiles

[ https://issues.apache.org/jira/browse/SPARK-41765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41765: --- Assignee: XiDuo You > Pull out v1 write metrics to WriteFiles >

[jira] [Resolved] (SPARK-41765) Pull out v1 write metrics to WriteFiles

[ https://issues.apache.org/jira/browse/SPARK-41765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41765. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39428

[jira] [Assigned] (SPARK-37099) Introduce a rank-based filter to optimize top-k computation

[ https://issues.apache.org/jira/browse/SPARK-37099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37099: --- Assignee: jiaan.geng > Introduce a rank-based filter to optimize top-k computation >

[jira] [Resolved] (SPARK-37099) Introduce a rank-based filter to optimize top-k computation

[ https://issues.apache.org/jira/browse/SPARK-37099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37099. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 38799

[jira] [Assigned] (SPARK-42423) Add metadata column file block start and length

[ https://issues.apache.org/jira/browse/SPARK-42423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42423: --- Assignee: XiDuo You > Add metadata column file block start and length >

[jira] [Resolved] (SPARK-42423) Add metadata column file block start and length

[ https://issues.apache.org/jira/browse/SPARK-42423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42423. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39996

[jira] [Resolved] (SPARK-41959) Improve v1 writes with empty2null

[ https://issues.apache.org/jira/browse/SPARK-41959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41959. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39475

[jira] [Resolved] (SPARK-42398) refine default column value framework

[ https://issues.apache.org/jira/browse/SPARK-42398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42398. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40049

[jira] [Assigned] (SPARK-42398) refine default column value framework

[ https://issues.apache.org/jira/browse/SPARK-42398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42398: --- Assignee: Wenchen Fan > refine default column value framework >

[jira] [Resolved] (SPARK-42453) Implement function max in Scala client

[ https://issues.apache.org/jira/browse/SPARK-42453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42453. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40041

[jira] [Assigned] (SPARK-42453) Implement function max in Scala client

[ https://issues.apache.org/jira/browse/SPARK-42453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42453: --- Assignee: Rui Wang > Implement function max in Scala client >

[jira] [Resolved] (SPARK-42405) Better documentation of array_insert function

[ https://issues.apache.org/jira/browse/SPARK-42405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42405. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39975

[jira] [Assigned] (SPARK-42436) Improve multiTransform to generate alternatives dynamically

[ https://issues.apache.org/jira/browse/SPARK-42436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42436: --- Assignee: Peter Toth > Improve multiTransform to generate alternatives dynamically >

[jira] [Resolved] (SPARK-42436) Improve multiTransform to generate alternatives dynamically

[ https://issues.apache.org/jira/browse/SPARK-42436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42436. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40016

[jira] [Resolved] (SPARK-42331) Fix metadata col can not been resolved

[ https://issues.apache.org/jira/browse/SPARK-42331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42331. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39870

[jira] [Assigned] (SPARK-42331) Fix metadata col can not been resolved

[ https://issues.apache.org/jira/browse/SPARK-42331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42331: --- Assignee: XiDuo You (was: Apache Spark) > Fix metadata col can not been resolved >

[jira] [Assigned] (SPARK-42331) Fix metadata col can not been resolved

[ https://issues.apache.org/jira/browse/SPARK-42331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42331: --- Assignee: Apache Spark > Fix metadata col can not been resolved >

<    3   4   5   6   7   8   9   10   11   12   >