[jira] [Resolved] (SPARK-44505) DataSource v2 Scans should not require planning the input partitions on explain

2023-07-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44505. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42099

[jira] [Assigned] (SPARK-44355) Move commands to CTEDef code path and deprecate CTE inline path

2023-07-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44355: --- Assignee: Wenchen Fan > Move commands to CTEDef code path and deprecate CTE inline path >

[jira] [Resolved] (SPARK-44355) Move commands to CTEDef code path and deprecate CTE inline path

2023-07-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44355. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42036

[jira] [Resolved] (SPARK-39634) Allow file splitting in combination with row index generation

2023-07-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39634. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40728

[jira] [Assigned] (SPARK-39634) Allow file splitting in combination with row index generation

2023-07-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39634: --- Assignee: Ala Luszczak > Allow file splitting in combination with row index generation >

[jira] [Assigned] (SPARK-43966) Support non-deterministic Python UDTFs

2023-07-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43966: --- Assignee: Allison Wang > Support non-deterministic Python UDTFs >

[jira] [Resolved] (SPARK-43966) Support non-deterministic Python UDTFs

2023-07-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43966. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42075

[jira] [Resolved] (SPARK-44475) Relocate DataType and Parser to sql/api

2023-07-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44475. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41928

[jira] [Assigned] (SPARK-44431) Wrong semantics for null IN (empty list)

2023-07-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44431: --- Assignee: Jack Chen > Wrong semantics for null IN (empty list) >

[jira] [Resolved] (SPARK-44431) Wrong semantics for null IN (empty list)

2023-07-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44431. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42007

[jira] [Resolved] (SPARK-43838) Subquery on single table with having clause can't be optimized

2023-07-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43838. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 41347

[jira] [Assigned] (SPARK-43838) Subquery on single table with having clause can't be optimized

2023-07-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43838: --- Assignee: Jia Fan > Subquery on single table with having clause can't be optimized >

[jira] [Assigned] (SPARK-44361) Use PartitionEvaluator API in MapInBatchExec

2023-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44361: --- Assignee: Vinod KC > Use PartitionEvaluator API in MapInBatchExec >

[jira] [Resolved] (SPARK-44361) Use PartitionEvaluator API in MapInBatchExec

2023-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44361. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42024

[jira] [Resolved] (SPARK-44411) Use PartitionEvaluator API in ArrowEvalPythonExec, BatchEvalPythonExec

2023-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44411. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 41998

[jira] [Assigned] (SPARK-44411) Use PartitionEvaluator API in ArrowEvalPythonExec, BatchEvalPythonExec

2023-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44411: --- Assignee: Vinod KC > Use PartitionEvaluator API in ArrowEvalPythonExec,

[jira] [Assigned] (SPARK-44375) Use PartitionEvaluator API in DebugExec

2023-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44375: --- Assignee: Jia Fan > Use PartitionEvaluator API in DebugExec >

[jira] [Resolved] (SPARK-44375) Use PartitionEvaluator API in DebugExec

2023-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44375. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 41949

[jira] [Updated] (SPARK-44448) Wrong results for dense_rank() <= k from InferWindowGroupLimit and DenseRankLimitIterator

2023-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-8: Fix Version/s: (was: 4.0.0) > Wrong results for dense_rank() <= k from InferWindowGroupLimit

[jira] [Resolved] (SPARK-44448) Wrong results for dense_rank() <= k from InferWindowGroupLimit and DenseRankLimitIterator

2023-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-8. - Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-44448) Wrong results for dense_rank() <= k from InferWindowGroupLimit and DenseRankLimitIterator

2023-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-8: --- Assignee: Jack Chen > Wrong results for dense_rank() <= k from InferWindowGroupLimit and

[jira] [Resolved] (SPARK-44324) Move CaseInsensitiveMap to sql/api

2023-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44324. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41882

[jira] [Updated] (SPARK-44341) Define the computing logic through PartitionEvaluator API and use it in WindowExec and WindowInPandasExec

2023-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-44341: Fix Version/s: 4.0.0 (was: 3.5.0) > Define the computing logic through

[jira] [Assigned] (SPARK-44341) Define the computing logic through PartitionEvaluator API and use it in WindowExec and WindowInPandasExec

2023-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44341: --- Assignee: jiaan.geng > Define the computing logic through PartitionEvaluator API and use

[jira] [Resolved] (SPARK-44341) Define the computing logic through PartitionEvaluator API and use it in WindowExec and WindowInPandasExec

2023-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44341. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41939

[jira] [Resolved] (SPARK-44059) Add named argument support for SQL functions

2023-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44059. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42020

[jira] [Assigned] (SPARK-44059) Add named argument support for SQL functions

2023-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44059: --- Assignee: Richard Yu > Add named argument support for SQL functions >

[jira] [Assigned] (SPARK-44180) DistributionAndOrderingUtils should apply ResolveTimeZone

2023-07-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44180: --- Assignee: Cheng Pan > DistributionAndOrderingUtils should apply ResolveTimeZone >

[jira] [Resolved] (SPARK-44180) DistributionAndOrderingUtils should apply ResolveTimeZone

2023-07-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44180. - Fix Version/s: 3.5.0 3.4.2 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-44340) Define the computing logic through PartitionEvaluator API and use it in WindowGroupLimitExec

2023-07-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44340. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41899

[jira] [Assigned] (SPARK-44340) Define the computing logic through PartitionEvaluator API and use it in WindowGroupLimitExec

2023-07-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44340: --- Assignee: jiaan.geng > Define the computing logic through PartitionEvaluator API and use

[jira] [Created] (SPARK-44338) fix view schema mismatch error message

2023-07-07 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-44338: --- Summary: fix view schema mismatch error message Key: SPARK-44338 URL: https://issues.apache.org/jira/browse/SPARK-44338 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-44287) Define the computing logic through PartitionEvaluator API and use it in RowToColumnarExec & ColumnarToRowExec SQL operators.

2023-07-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44287: --- Assignee: Vinod KC > Define the computing logic through PartitionEvaluator API and

[jira] [Resolved] (SPARK-44287) Define the computing logic through PartitionEvaluator API and use it in RowToColumnarExec & ColumnarToRowExec SQL operators.

2023-07-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44287. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41839

[jira] [Created] (SPARK-44335) SQL parser should have a SQLConf parameter instead of relying on the active conf

2023-07-07 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-44335: --- Summary: SQL parser should have a SQLConf parameter instead of relying on the active conf Key: SPARK-44335 URL: https://issues.apache.org/jira/browse/SPARK-44335

[jira] [Resolved] (SPARK-44315) Move DefinedByConstructorParams to sql/api

2023-07-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44315. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41873

[jira] [Resolved] (SPARK-44154) Bitmap functions

2023-07-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44154. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41623

[jira] [Resolved] (SPARK-44274) Move out util functions used by ArtifactManager to common/utils

2023-07-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44274. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41825

[jira] [Resolved] (SPARK-44266) Move Util.truncatedString to sql/api

2023-07-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44266. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41811

[jira] [Assigned] (SPARK-44199) CacheManager refreshes the fileIndex unnecessarily

2023-07-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44199: --- Assignee: Vihang Karajgaonkar > CacheManager refreshes the fileIndex unnecessarily >

[jira] [Resolved] (SPARK-44199) CacheManager refreshes the fileIndex unnecessarily

2023-07-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44199. - Fix Version/s: 3.5.0 Resolution: Fixed > CacheManager refreshes the fileIndex

[jira] [Resolved] (SPARK-30424) Change ExpressionEncoder toRow method to return UnsafeRow

2023-07-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30424. - Resolution: Won't Fix > Change ExpressionEncoder toRow method to return UnsafeRow >

[jira] [Created] (SPARK-44232) add a config for auto refresh query result cache

2023-06-28 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-44232: --- Summary: add a config for auto refresh query result cache Key: SPARK-44232 URL: https://issues.apache.org/jira/browse/SPARK-44232 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-44205) Extract catalyst code from DecimalType

2023-06-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44205. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41757

[jira] [Resolved] (SPARK-44026) Update helper methods to create SQLMetric with initial value

2023-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44026. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41555

[jira] [Assigned] (SPARK-44026) Update helper methods to create SQLMetric with initial value

2023-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44026: --- Assignee: Johan Lasperas > Update helper methods to create SQLMetric with initial value >

[jira] [Resolved] (SPARK-43203) Fix DROP table behavior in session catalog

2023-06-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43203. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41348

[jira] [Assigned] (SPARK-43203) Fix DROP table behavior in session catalog

2023-06-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43203: --- Assignee: Jia Fan > Fix DROP table behavior in session catalog >

[jira] [Resolved] (SPARK-44018) Improve the hashCode for Some DS V2 Expression

2023-06-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44018. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-44018) Improve the hashCode for Some DS V2 Expression

2023-06-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44018: --- Assignee: jiaan.geng > Improve the hashCode for Some DS V2 Expression >

[jira] [Resolved] (SPARK-43961) Add optional pattern for Catalog.listTables

2023-06-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43961. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41461

[jira] [Resolved] (SPARK-43979) CollectedMetrics should be treated as the same one for self-join

2023-06-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43979. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41475

[jira] [Resolved] (SPARK-42750) Support INSERT INTO by name

2023-06-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42750. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40908

[jira] [Updated] (SPARK-43760) Incorrect attribute nullability after RewriteCorrelatedScalarSubquery leads to incorrect query results

2023-06-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-43760: Fix Version/s: 3.4.1 > Incorrect attribute nullability after RewriteCorrelatedScalarSubquery

[jira] [Resolved] (SPARK-43792) Add optional pattern for Catalog.listCatalogs

2023-05-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43792. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41311

[jira] [Assigned] (SPARK-43760) Incorrect attribute nullability after RewriteCorrelatedScalarSubquery leads to incorrect query results

2023-05-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43760: --- Assignee: Andrey Gubichev > Incorrect attribute nullability after

[jira] [Resolved] (SPARK-43760) Incorrect attribute nullability after RewriteCorrelatedScalarSubquery leads to incorrect query results

2023-05-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43760. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41287

[jira] [Resolved] (SPARK-43475) Expression lineage not handling Window and AggregatePart operators

2023-05-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43475. - Resolution: Invalid > Expression lineage not handling Window and AggregatePart operators >

[jira] [Resolved] (SPARK-43779) ParseToDate should load the EvalMode in main thread

2023-05-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43779. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41298

[jira] [Resolved] (SPARK-43596) Subquery decorrelation rewriteDomainJoins failure from ConstantFolding to isnull

2023-05-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43596. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41265

[jira] [Created] (SPARK-43752) default column value should support v2 write commands

2023-05-23 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-43752: --- Summary: default column value should support v2 write commands Key: SPARK-43752 URL: https://issues.apache.org/jira/browse/SPARK-43752 Project: Spark Issue

[jira] [Created] (SPARK-43742) refactor default column value resolution

2023-05-23 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-43742: --- Summary: refactor default column value resolution Key: SPARK-43742 URL: https://issues.apache.org/jira/browse/SPARK-43742 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-43522) Creating struct column occurs error 'org.apache.spark.sql.AnalysisException [DATATYPE_MISMATCH.CREATE_NAMED_STRUCT_WITHOUT_FOLDABLE_STRING]'

2023-05-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43522: --- Assignee: Jia Fan > Creating struct column occurs error

[jira] [Resolved] (SPARK-43522) Creating struct column occurs error 'org.apache.spark.sql.AnalysisException [DATATYPE_MISMATCH.CREATE_NAMED_STRUCT_WITHOUT_FOLDABLE_STRING]'

2023-05-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43522. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-43157) TreeNode tags can become corrupted and hang driver when the dataset is cached

2023-05-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43157: --- Assignee: Rob Reeves > TreeNode tags can become corrupted and hang driver when the dataset

[jira] [Resolved] (SPARK-43157) TreeNode tags can become corrupted and hang driver when the dataset is cached

2023-05-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43157. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-43281) Fix concurrent writer does not update file metrics

2023-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43281. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-43281) Fix concurrent writer does not update file metrics

2023-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43281: --- Assignee: XiDuo You > Fix concurrent writer does not update file metrics >

[jira] [Assigned] (SPARK-43413) IN subquery ListQuery has wrong nullability

2023-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43413: --- Assignee: Jack Chen > IN subquery ListQuery has wrong nullability >

[jira] [Resolved] (SPARK-43413) IN subquery ListQuery has wrong nullability

2023-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43413. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41094

[jira] [Assigned] (SPARK-43316) Add more CTE SQL tests

2023-05-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43316: --- Assignee: Runyao.Chen > Add more CTE SQL tests > -- > >

[jira] [Resolved] (SPARK-43316) Add more CTE SQL tests

2023-05-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43316. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40989

[jira] [Assigned] (SPARK-43357) Spark AWS Glue date partition push down broken

2023-05-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43357: --- Assignee: Stijn De Haes > Spark AWS Glue date partition push down broken >

[jira] [Resolved] (SPARK-43357) Spark AWS Glue date partition push down broken

2023-05-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43357. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41035

[jira] [Assigned] (SPARK-43390) DSv2 allows CTAS/RTAS to reserve schema nullability

2023-05-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43390: --- Assignee: Cheng Pan > DSv2 allows CTAS/RTAS to reserve schema nullability >

[jira] [Resolved] (SPARK-43390) DSv2 allows CTAS/RTAS to reserve schema nullability

2023-05-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43390. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41070

[jira] [Resolved] (SPARK-43376) Improve reuse subquery with table cache

2023-05-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43376. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41046

[jira] [Assigned] (SPARK-43376) Improve reuse subquery with table cache

2023-05-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43376: --- Assignee: XiDuo You > Improve reuse subquery with table cache >

[jira] [Assigned] (SPARK-43284) _metadata.file_path regression

2023-05-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43284: --- Assignee: David Lewis > _metadata.file_path regression > -- >

[jira] [Resolved] (SPARK-43284) _metadata.file_path regression

2023-05-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43284. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-43040) Improve TimestampNTZ support in JDBC data source

2023-05-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43040: --- Assignee: Tianhan Hu > Improve TimestampNTZ support in JDBC data source >

[jira] [Resolved] (SPARK-43040) Improve TimestampNTZ support in JDBC data source

2023-05-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43040. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40678

[jira] [Commented] (SPARK-43373) Revert [SPARK-39203][SQL] Rewrite table location to absolute URI based on database URI

2023-05-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719130#comment-17719130 ] Wenchen Fan commented on SPARK-43373: - https://github.com/apache/spark/pull/40871 > Revert

[jira] [Resolved] (SPARK-43373) Revert [SPARK-39203][SQL] Rewrite table location to absolute URI based on database URI

2023-05-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43373. - Fix Version/s: 3.4.1 Assignee: Wenchen Fan Resolution: Fixed > Revert

[jira] [Created] (SPARK-43373) Revert [SPARK-39203][SQL] Rewrite table location to absolute URI based on database URI

2023-05-03 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-43373: --- Summary: Revert [SPARK-39203][SQL] Rewrite table location to absolute URI based on database URI Key: SPARK-43373 URL: https://issues.apache.org/jira/browse/SPARK-43373

[jira] [Assigned] (SPARK-43302) Make Python UDAF an AggregateFunction

2023-04-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43302: --- Assignee: Wenchen Fan > Make Python UDAF an AggregateFunction >

[jira] [Resolved] (SPARK-38461) Use error classes in org.apache.spark.broadcast

2023-04-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38461. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40978

[jira] [Resolved] (SPARK-43302) Make Python UDAF an AggregateFunction

2023-04-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43302. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40739

[jira] [Resolved] (SPARK-43309) Extend INTERNAL_ERROR with category

2023-04-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43309. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40978

[jira] [Assigned] (SPARK-43309) Extend INTERNAL_ERROR with category

2023-04-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43309: --- Assignee: Bo Zhang > Extend INTERNAL_ERROR with category >

[jira] [Assigned] (SPARK-38461) Use error classes in org.apache.spark.broadcast

2023-04-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38461: --- Assignee: Bo Zhang > Use error classes in org.apache.spark.broadcast >

[jira] [Resolved] (SPARK-43219) Website can't find INSERT INTO REPLACE Statement

2023-04-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43219. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40890

[jira] [Assigned] (SPARK-43219) Website can't find INSERT INTO REPLACE Statement

2023-04-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43219: --- Assignee: Jia Fan > Website can't find INSERT INTO REPLACE Statement >

[jira] [Created] (SPARK-43302) Make Python UDAF an AggregateFunction

2023-04-26 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-43302: --- Summary: Make Python UDAF an AggregateFunction Key: SPARK-43302 URL: https://issues.apache.org/jira/browse/SPARK-43302 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-43293) __qualified_access_only should be ignored in normal columns

2023-04-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43293: --- Assignee: Wenchen Fan > __qualified_access_only should be ignored in normal columns >

[jira] [Resolved] (SPARK-43293) __qualified_access_only should be ignored in normal columns

2023-04-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43293. - Fix Version/s: 3.3.3 3.5.0 3.4.1 Resolution: Fixed

[jira] [Created] (SPARK-43293) __qualified_access_only should be ignored in normal columns

2023-04-26 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-43293: --- Summary: __qualified_access_only should be ignored in normal columns Key: SPARK-43293 URL: https://issues.apache.org/jira/browse/SPARK-43293 Project: Spark

[jira] [Resolved] (SPARK-43240) df.describe() method may- return wrong result if the last RDD is RDD[UnsafeRow]

2023-04-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43240. - Fix Version/s: 3.3.3 Resolution: Fixed Issue resolved by pull request 40914

[jira] [Assigned] (SPARK-43240) df.describe() method may- return wrong result if the last RDD is RDD[UnsafeRow]

2023-04-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43240: --- Assignee: Ke Jia > df.describe() method may- return wrong result if the last RDD is >

[jira] [Assigned] (SPARK-43199) Make InlineCTE idempotent

2023-04-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43199: --- Assignee: Peter Toth > Make InlineCTE idempotent > - > >

<    1   2   3   4   5   6   7   8   9   10   >