[jira] [Assigned] (SPARK-43098) Should not handle the COUNT bug when the GROUP BY clause of a correlated scalar subquery is non-empty

2023-04-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43098: --- Assignee: Jack Chen > Should not handle the COUNT bug when the GROUP BY clause of a correla

[jira] [Resolved] (SPARK-43098) Should not handle the COUNT bug when the GROUP BY clause of a correlated scalar subquery is non-empty

2023-04-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43098. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull re

[jira] [Resolved] (SPARK-42151) Align UPDATE assignments with table attributes

2023-04-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42151. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40308 [https://gith

[jira] [Assigned] (SPARK-42151) Align UPDATE assignments with table attributes

2023-04-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42151: --- Assignee: Anton Okolnychyi > Align UPDATE assignments with table attributes > -

[jira] [Resolved] (SPARK-43130) Move InternalType to PhysicalDataType

2023-04-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43130. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40784 [https://gith

[jira] [Assigned] (SPARK-43099) `Class.getCanonicalName` return null for anonymous class on JDK15+, impacting function registry

2023-04-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43099: --- Assignee: Alex Jing > `Class.getCanonicalName` return null for anonymous class on JDK15+, i

[jira] [Resolved] (SPARK-43099) `Class.getCanonicalName` return null for anonymous class on JDK15+, impacting function registry

2023-04-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43099. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40747 [https://gith

[jira] [Resolved] (SPARK-43123) special internal field metadata should not be leaked to catalogs

2023-04-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43123. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40776 [https://gith

[jira] [Assigned] (SPARK-43123) special internal field metadata should not be leaked to catalogs

2023-04-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43123: --- Assignee: Wenchen Fan > special internal field metadata should not be leaked to catalogs >

[jira] [Resolved] (SPARK-43021) Shuffle happens when Coalesce Buckets should occur

2023-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43021. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40688 [https://gith

[jira] [Assigned] (SPARK-43021) Shuffle happens when Coalesce Buckets should occur

2023-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43021: --- Assignee: ming95 > Shuffle happens when Coalesce Buckets should occur > ---

[jira] [Resolved] (SPARK-41674) Runtime filter should supports multi level shuffle join side as filter creation side

2023-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41674. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39170 [https://gith

[jira] [Assigned] (SPARK-41674) Runtime filter should supports multi level shuffle join side as filter creation side

2023-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41674: --- Assignee: jiaan.geng > Runtime filter should supports multi level shuffle join side as filt

[jira] [Created] (SPARK-43126) mark two Hive UDF expressions as stateful

2023-04-13 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-43126: --- Summary: mark two Hive UDF expressions as stateful Key: SPARK-43126 URL: https://issues.apache.org/jira/browse/SPARK-43126 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-43123) special internal field metadata should not be leaked to catalogs

2023-04-13 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-43123: --- Summary: special internal field metadata should not be leaked to catalogs Key: SPARK-43123 URL: https://issues.apache.org/jira/browse/SPARK-43123 Project: Spark

[jira] [Resolved] (SPARK-43088) Respect RequiresDistributionAndOrdering in CTAS/RTAS

2023-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43088. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40734 [https://gith

[jira] [Assigned] (SPARK-43088) Respect RequiresDistributionAndOrdering in CTAS/RTAS

2023-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43088: --- Assignee: Anton Okolnychyi > Respect RequiresDistributionAndOrdering in CTAS/RTAS > ---

[jira] [Assigned] (SPARK-43063) `df.show` handle null should print NULL instead of null

2023-04-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43063: --- Assignee: yikaifei > `df.show` handle null should print NULL instead of null >

[jira] [Resolved] (SPARK-43063) `df.show` handle null should print NULL instead of null

2023-04-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43063. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40699 [https://gith

[jira] [Resolved] (SPARK-43110) Move asIntegral to PhysicalDataType

2023-04-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43110. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40758 [https://gith

[jira] [Resolved] (SPARK-43103) Move Integral to PhysicalDataType

2023-04-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43103. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40752 [https://gith

[jira] [Resolved] (SPARK-43039) Support custom fields in the file source _metadata column

2023-04-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43039. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40677 [https://gith

[jira] [Assigned] (SPARK-43039) Support custom fields in the file source _metadata column

2023-04-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43039: --- Assignee: Ryan Johnson > Support custom fields in the file source _metadata column > --

[jira] [Updated] (SPARK-39625) add Dataset.to(StructType)

2023-04-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-39625: Summary: add Dataset.to(StructType) (was: add Dataset.as(StructType)) > add Dataset.to(StructType

[jira] [Resolved] (SPARK-43058) Move Numeric to PhysicalDataType

2023-04-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43058. - Fix Version/s: 3.5.0 Resolution: Fixed > Move Numeric to PhysicalDataType > -

[jira] [Updated] (SPARK-43061) Introduce PartitionEvaluator for SQL operator execution

2023-04-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-43061: Summary: Introduce PartitionEvaluator for SQL operator execution (was: Introduce TaskEvaluator fo

[jira] [Resolved] (SPARK-43061) Introduce TaskEvaluator for SQL operator execution

2023-04-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43061. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40697 [https://gith

[jira] [Assigned] (SPARK-43061) Introduce TaskEvaluator for SQL operator execution

2023-04-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43061: --- Assignee: Wenchen Fan > Introduce TaskEvaluator for SQL operator execution > --

[jira] [Created] (SPARK-43061) Introduce TaskEvaluator for SQL operator execution

2023-04-06 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-43061: --- Summary: Introduce TaskEvaluator for SQL operator execution Key: SPARK-43061 URL: https://issues.apache.org/jira/browse/SPARK-43061 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-43030) deduplicate relations with metadata columns

2023-04-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43030. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40662 [https://gith

[jira] [Assigned] (SPARK-43030) deduplicate relations with metadata columns

2023-04-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43030: --- Assignee: Wenchen Fan > deduplicate relations with metadata columns > -

[jira] [Assigned] (SPARK-42855) Migrate nullability write checks to runtime for V2 tables

2023-04-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42855: --- Assignee: Anton Okolnychyi > Migrate nullability write checks to runtime for V2 tables > --

[jira] [Resolved] (SPARK-42855) Migrate nullability write checks to runtime for V2 tables

2023-04-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42855. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40655 [https://gith

[jira] [Created] (SPARK-43030) deduplicate relations with metadata columns

2023-04-04 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-43030: --- Summary: deduplicate relations with metadata columns Key: SPARK-43030 URL: https://issues.apache.org/jira/browse/SPARK-43030 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-42655) Incorrect ambiguous column reference error

2023-04-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42655: --- Assignee: Shrikant Prasad > Incorrect ambiguous column reference error > --

[jira] [Resolved] (SPARK-42655) Incorrect ambiguous column reference error

2023-04-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42655. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40258 [https://gith

[jira] [Assigned] (SPARK-43026) Apply AQE with non-exchange table cache

2023-04-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43026: --- Assignee: XiDuo You > Apply AQE with non-exchange table cache > ---

[jira] [Resolved] (SPARK-43026) Apply AQE with non-exchange table cache

2023-04-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43026. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40659 [https://gith

[jira] [Assigned] (SPARK-42918) Generalize handling of metadata attributes in FileSourceStrategy

2023-03-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42918: --- Assignee: Johan Lasperas > Generalize handling of metadata attributes in FileSourceStrategy

[jira] [Resolved] (SPARK-42918) Generalize handling of metadata attributes in FileSourceStrategy

2023-03-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42918. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40545 [https://gith

[jira] [Assigned] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect

2023-03-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41391: --- Assignee: Ritika Maheshwari > The output column name of `groupBy.agg(count_distinct)` is in

[jira] [Resolved] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect

2023-03-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41391. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40116 [https://gith

[jira] [Reopened] (SPARK-41765) Pull out v1 write metrics to WriteFiles

2023-03-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-41765: - Assignee: (was: XiDuo You) > Pull out v1 write metrics to WriteFiles > ---

[jira] [Resolved] (SPARK-41765) Pull out v1 write metrics to WriteFiles

2023-03-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41765. - Fix Version/s: (was: 3.4.0) Resolution: Won't Do > Pull out v1 write metrics to Write

[jira] [Assigned] (SPARK-42683) Automatically rename metadata columns that conflict with data schema columns

2023-03-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42683: --- Assignee: Ryan Johnson > Automatically rename metadata columns that conflict with data sche

[jira] [Resolved] (SPARK-42683) Automatically rename metadata columns that conflict with data schema columns

2023-03-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42683. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40300 [https://gith

[jira] [Assigned] (SPARK-41359) Use `PhysicalDataType` instead of DataType in UnsafeRow

2023-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41359: --- Assignee: Yang Jie > Use `PhysicalDataType` instead of DataType in UnsafeRow >

[jira] [Resolved] (SPARK-41359) Use `PhysicalDataType` instead of DataType in UnsafeRow

2023-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41359. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40400 [https://gith

[jira] [Resolved] (SPARK-42949) Simplify code for NAAJ

2023-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42949. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40578 [https://gith

[jira] [Assigned] (SPARK-42949) Simplify code for NAAJ

2023-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42949: --- Assignee: Cheng Pan > Simplify code for NAAJ > -- > > K

[jira] [Assigned] (SPARK-42928) Make resolvePersistentFunction synchronized

2023-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42928: --- Assignee: Allison Wang > Make resolvePersistentFunction synchronized >

[jira] [Resolved] (SPARK-42928) Make resolvePersistentFunction synchronized

2023-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42928. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40557 [https://gith

[jira] [Resolved] (SPARK-42936) Unresolved having at the end of analysis when using with LCA with the having clause that can be resolved directly by its child Aggregate

2023-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42936. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40558 [https://gith

[jira] [Assigned] (SPARK-42936) Unresolved having at the end of analysis when using with LCA with the having clause that can be resolved directly by its child Aggregate

2023-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42936: --- Assignee: Xinyi Yu > Unresolved having at the end of analysis when using with LCA with the

[jira] [Resolved] (SPARK-41630) Support lateral column alias in Project code path

2023-03-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41630. - Fix Version/s: 3.4.0 Assignee: Xinyi Yu Resolution: Fixed > Support lateral colu

[jira] [Assigned] (SPARK-42815) Subexpression elimination support shortcut expression

2023-03-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42815: --- Assignee: XiDuo You > Subexpression elimination support shortcut expression > -

[jira] [Resolved] (SPARK-42815) Subexpression elimination support shortcut expression

2023-03-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42815. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40446 [https://gith

[jira] [Assigned] (SPARK-42052) Codegen Support for HiveSimpleUDF

2023-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42052: --- Assignee: BingKun Pan > Codegen Support for HiveSimpleUDF > ---

[jira] [Resolved] (SPARK-42052) Codegen Support for HiveSimpleUDF

2023-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42052. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40397 [https://gith

[jira] [Resolved] (SPARK-42851) EquivalentExpressions methods need to be consistently guarded by supportedExpression

2023-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42851. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40473 [https://gith

[jira] [Assigned] (SPARK-42851) EquivalentExpressions methods need to be consistently guarded by supportedExpression

2023-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42851: --- Assignee: Kris Mok > EquivalentExpressions methods need to be consistently guarded by > su

[jira] [Resolved] (SPARK-42876) DataType's physicalDataType should be private[sql]

2023-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42876. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40499 [https://gith

[jira] [Assigned] (SPARK-42791) Create golden file test framework for analysis

2023-03-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42791: --- Assignee: Daniel > Create golden file test framework for analysis > ---

[jira] [Resolved] (SPARK-42791) Create golden file test framework for analysis

2023-03-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42791. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40449 [https://gith

[jira] [Resolved] (SPARK-42772) Change the default value of JDBC options about push down to true

2023-03-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42772. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40396 [https://gith

[jira] [Assigned] (SPARK-42772) Change the default value of JDBC options about push down to true

2023-03-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42772: --- Assignee: jiaan.geng > Change the default value of JDBC options about push down to true > -

[jira] [Assigned] (SPARK-42783) Infer window group limit should run as late as possible

2023-03-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42783: --- Assignee: jiaan.geng > Infer window group limit should run as late as possible > --

[jira] [Resolved] (SPARK-42783) Infer window group limit should run as late as possible

2023-03-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42783. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40410 [https://gith

[jira] [Resolved] (SPARK-42771) Refactor HiveGenericUDF

2023-03-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42771. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40394 [https://gith

[jira] [Assigned] (SPARK-42771) Refactor HiveGenericUDF

2023-03-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42771: --- Assignee: BingKun Pan > Refactor HiveGenericUDF > --- > >

[jira] [Resolved] (SPARK-42778) QueryStageExec should respect supportsRowBased

2023-03-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42778. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40407 [https://gith

[jira] [Resolved] (SPARK-42702) Support parameterized CTE

2023-03-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42702. - Assignee: Wenchen Fan (was: Max Gekk) Resolution: Fixed > Support parameterized CTE > ---

[jira] [Resolved] (SPARK-39235) Make Catalog API be compatible with 3-layer-namespace

2023-03-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39235. - Fix Version/s: 3.4.0 Resolution: Fixed > Make Catalog API be compatible with 3-layer-name

[jira] [Assigned] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

2023-03-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42101: --- Assignee: XiDuo You > Wrap InMemoryTableScanExec with QueryStage >

[jira] [Resolved] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

2023-03-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42101. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39624 [https://gith

[jira] [Assigned] (SPARK-42745) Improved AliasAwareOutputExpression works with DSv2

2023-03-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42745: --- Assignee: Peter Toth > Improved AliasAwareOutputExpression works with DSv2 > --

[jira] [Resolved] (SPARK-42745) Improved AliasAwareOutputExpression works with DSv2

2023-03-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42745. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40364 [https://gith

[jira] [Resolved] (SPARK-42623) parameter markers not blocked in DDL

2023-03-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42623. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40333 [https://gith

[jira] [Assigned] (SPARK-42623) parameter markers not blocked in DDL

2023-03-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42623: --- Assignee: Wenchen Fan > parameter markers not blocked in DDL >

[jira] [Resolved] (SPARK-42702) Support parameterized CTE

2023-03-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42702. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40333 [https://gith

[jira] [Assigned] (SPARK-42684) v2 catalog should not allow column default value by default

2023-03-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42684: --- Assignee: Wenchen Fan > v2 catalog should not allow column default value by default > -

[jira] [Resolved] (SPARK-42684) v2 catalog should not allow column default value by default

2023-03-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42684. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40299 [https://gith

[jira] [Updated] (SPARK-42623) parameter markers not blocked in DDL

2023-03-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-42623: Fix Version/s: (was: 3.4.0) > parameter markers not blocked in DDL > -

[jira] [Commented] (SPARK-42623) parameter markers not blocked in DDL

2023-03-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17697721#comment-17697721 ] Wenchen Fan commented on SPARK-42623: - I think the problem occurs when we store the

[jira] [Created] (SPARK-42684) v2 catalog should not allow column default value by default

2023-03-06 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-42684: --- Summary: v2 catalog should not allow column default value by default Key: SPARK-42684 URL: https://issues.apache.org/jira/browse/SPARK-42684 Project: Spark Is

[jira] [Resolved] (SPARK-42611) Insert char/varchar length checks for inner fields during resolution

2023-02-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42611. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40206 [https://gith

[jira] [Assigned] (SPARK-42611) Insert char/varchar length checks for inner fields during resolution

2023-02-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42611: --- Assignee: Anton Okolnychyi > Insert char/varchar length checks for inner fields during reso

[jira] [Assigned] (SPARK-42548) Add ReferenceAllColumns to skip rewriting attributes

2023-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42548: --- Assignee: XiDuo You > Add ReferenceAllColumns to skip rewriting attributes > --

[jira] [Resolved] (SPARK-42548) Add ReferenceAllColumns to skip rewriting attributes

2023-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42548. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40154 [https://gith

[jira] [Resolved] (SPARK-41171) Push down filter through window when partitionSpec is empty

2023-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41171. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40142 [https://gith

[jira] [Assigned] (SPARK-41171) Push down filter through window when partitionSpec is empty

2023-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41171: --- Assignee: jiaan.geng > Push down filter through window when partitionSpec is empty > --

[jira] [Assigned] (SPARK-42600) currentDatabase Shall use NamespaceHelper instead of MultipartIdentifierHelper

2023-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42600: --- Assignee: Kent Yao > currentDatabase Shall use NamespaceHelper instead of > MultipartIden

[jira] [Resolved] (SPARK-42600) currentDatabase Shall use NamespaceHelper instead of MultipartIdentifierHelper

2023-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42600. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40192 [https://gith

[jira] [Resolved] (SPARK-42121) Add built-in table-valued functions posexplode and posexplode_outer

2023-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42121. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40151 [https://gith

[jira] [Assigned] (SPARK-42121) Add built-in table-valued functions posexplode and posexplode_outer

2023-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42121: --- Assignee: Allison Wang > Add built-in table-valued functions posexplode and posexplode_oute

[jira] [Assigned] (SPARK-42478) Make a serializable jobTrackerId instead of a non-serializable JobID in FileWriterFactory

2023-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42478: --- Assignee: Yi kaifei > Make a serializable jobTrackerId instead of a non-serializable JobID

[jira] [Resolved] (SPARK-42478) Make a serializable jobTrackerId instead of a non-serializable JobID in FileWriterFactory

2023-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42478. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40064 [https://gith

[jira] [Assigned] (SPARK-41290) Support GENERATED ALWAYS AS syntax in create/replace table to create a generated column

2023-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41290: --- Assignee: Allison Portis > Support GENERATED ALWAYS AS syntax in create/replace table to cr

[jira] [Resolved] (SPARK-41290) Support GENERATED ALWAYS AS syntax in create/replace table to create a generated column

2023-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41290. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38823 [https://gith

[jira] [Resolved] (SPARK-42528) Optimize PercentileHeap

2023-02-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42528. - Fix Version/s: 3.5.0 (was: 3.4.0) Resolution: Fixed Issue resolved

<    5   6   7   8   9   10   11   12   13   14   >