[jira] [Assigned] (SPARK-52142) Display table constraints in SHOW CREATE TABLE COMMAND

2025-07-18 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-52142: -- Assignee: Gengliang Wang > Display table constraints in SHOW CREATE TABLE COMMAND > -

[jira] [Resolved] (SPARK-52142) Display table constraints in SHOW CREATE TABLE COMMAND

2025-07-18 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-52142. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51541 [https:

[jira] [Closed] (SPARK-51955) Adding release() to ReadStateStore interface and reusing ReadStore for Streaming Aggregations

2025-07-18 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar closed SPARK-51955. -- > Adding release() to ReadStateStore interface and reusing ReadStore for > Streaming Aggr

[jira] [Resolved] (SPARK-51955) Adding release() to ReadStateStore interface and reusing ReadStore for Streaming Aggregations

2025-07-18 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar resolved SPARK-51955. Fix Version/s: 4.1.0 Resolution: Fixed > Adding release() to ReadStateStore

[jira] [Assigned] (SPARK-51955) Adding release() to ReadStateStore interface and reusing ReadStore for Streaming Aggregations

2025-07-18 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar reassigned SPARK-51955: -- Assignee: Eric Marnadi > Adding release() to ReadStateStore interface and reu

[jira] [Commented] (SPARK-51955) Adding release() to ReadStateStore interface and reusing ReadStore for Streaming Aggregations

2025-07-18 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008190#comment-18008190 ] Anish Shrigondekar commented on SPARK-51955: PR merged here -> [GitHub Pull

[jira] [Created] (SPARK-52877) Improve Python UDF Arrow Serializer Performance

2025-07-18 Thread Amanda Liu (Jira)
Amanda Liu created SPARK-52877: -- Summary: Improve Python UDF Arrow Serializer Performance Key: SPARK-52877 URL: https://issues.apache.org/jira/browse/SPARK-52877 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-51713) Python Data Sources Column Pruning API

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51713: --- Labels: pull-request-available (was: ) > Python Data Sources Column Pruning API > -

[jira] [Assigned] (SPARK-52817) Spark SQL LIKE expressions show poor performance when using multiple '%'

2025-07-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-52817: --- Assignee: zhixingheyi-tian > Spark SQL LIKE expressions show poor performance when using mu

[jira] [Resolved] (SPARK-52817) Spark SQL LIKE expressions show poor performance when using multiple '%'

2025-07-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-52817. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51510 [https://gith

[jira] [Updated] (SPARK-52876) Fix a typo `buffer` to `body` in `ChunkFetchSuccess.toString`

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52876: -- Affects Version/s: 4.0.0 3.0.0 2.0.0

[jira] [Updated] (SPARK-52876) Fix a typo `buffer` to `body` in `ChunkFetchSuccess.toString`

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52876: --- Labels: pull-request-available (was: ) > Fix a typo `buffer` to `body` in `ChunkFetchSucces

[jira] [Updated] (SPARK-52876) Fix a typo `buffer` to `body` in `ChunkFetchSuccess.toString`

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52876: -- Summary: Fix a typo `buffer` to `body` in `ChunkFetchSuccess.toString` (was: Fix `buffer` to

[jira] [Created] (SPARK-52876) Fix `buffer` to `body` in `ChunkFetchSuccess.toString`

2025-07-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52876: - Summary: Fix `buffer` to `body` in `ChunkFetchSuccess.toString` Key: SPARK-52876 URL: https://issues.apache.org/jira/browse/SPARK-52876 Project: Spark Issu

[jira] [Resolved] (SPARK-52874) Support `o.a.s.util.Pair` Java Record

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52874. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51568 [https://

[jira] [Closed] (SPARK-51596) Fix concurrent StateStoreProvider maintenance and closing

2025-07-18 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar closed SPARK-51596. -- > Fix concurrent StateStoreProvider maintenance and closing >

[jira] [Commented] (SPARK-51596) Fix concurrent StateStoreProvider maintenance and closing

2025-07-18 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008169#comment-18008169 ] Anish Shrigondekar commented on SPARK-51596: PR merged here -> [GitHub Pull

[jira] [Assigned] (SPARK-51596) Fix concurrent StateStoreProvider maintenance and closing

2025-07-18 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar reassigned SPARK-51596: -- Assignee: Eric Marnadi > Fix concurrent StateStoreProvider maintenance and cl

[jira] [Resolved] (SPARK-51596) Fix concurrent StateStoreProvider maintenance and closing

2025-07-18 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar resolved SPARK-51596. Fix Version/s: 4.1.0 Resolution: Fixed > Fix concurrent StateStoreProvider

[jira] [Updated] (SPARK-52875) Simplify V2 expression translation if the input is context-independent-foldable

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52875: --- Labels: pull-request-available (was: ) > Simplify V2 expression translation if the input is

[jira] [Created] (SPARK-52875) Simplify V2 expression translation if the input is context-independent-foldable

2025-07-18 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-52875: -- Summary: Simplify V2 expression translation if the input is context-independent-foldable Key: SPARK-52875 URL: https://issues.apache.org/jira/browse/SPARK-52875

[jira] [Resolved] (SPARK-52861) Skip Row object creation in Arrow-optimized UDTF execution

2025-07-18 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-52861. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51546 [https://

[jira] [Assigned] (SPARK-52861) Skip Row object creation in Arrow-optimized UDTF execution

2025-07-18 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-52861: - Assignee: Takuya Ueshin > Skip Row object creation in Arrow-optimized UDTF execution >

[jira] [Assigned] (SPARK-52874) Support `o.a.s.util.Pair` Java Record

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52874: - Assignee: Dongjoon Hyun > Support `o.a.s.util.Pair` Java Record > -

[jira] [Updated] (SPARK-52874) Support `o.a.s.util.Pair` Java Record

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52874: -- Summary: Support `o.a.s.util.Pair` Java Record (was: Add `o.a.s.util.Pair` Java Record) > Su

[jira] [Updated] (SPARK-52874) Add `o.a.s.util.Pair` Java Record

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52874: --- Labels: pull-request-available (was: ) > Add `o.a.s.util.Pair` Java Record > --

[jira] [Created] (SPARK-52874) Add `o.a.s.util.Pair` Java Record

2025-07-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52874: - Summary: Add `o.a.s.util.Pair` Java Record Key: SPARK-52874 URL: https://issues.apache.org/jira/browse/SPARK-52874 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-52873) Hint causes semi join results to vary

2025-07-18 Thread Peter Connolly (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008136#comment-18008136 ] Peter Connolly commented on SPARK-52873: Worth noting that this problem also see

[jira] [Resolved] (SPARK-51562) Add the time() function

2025-07-18 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-51562. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51551 [https://github.com

[jira] [Created] (SPARK-52873) Hint causes semi join results to vary

2025-07-18 Thread Peter Connolly (Jira)
Peter Connolly created SPARK-52873: -- Summary: Hint causes semi join results to vary Key: SPARK-52873 URL: https://issues.apache.org/jira/browse/SPARK-52873 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-51562) Add the time() function

2025-07-18 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-51562: Assignee: Uroš Bojanić > Add the time() function > --- > > Ke

[jira] [Closed] (SPARK-52787) Reorganize streaming checkpoint & runtime dirs

2025-07-18 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar closed SPARK-52787. -- > Reorganize streaming checkpoint & runtime dirs > ---

[jira] [Resolved] (SPARK-52787) Reorganize streaming checkpoint & runtime dirs

2025-07-18 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar resolved SPARK-52787. Fix Version/s: 4.1.0 Assignee: Anish Shrigondekar Resolution: Fixed

[jira] [Commented] (SPARK-52787) Reorganize streaming checkpoint & runtime dirs

2025-07-18 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008127#comment-18008127 ] Anish Shrigondekar commented on SPARK-52787: PR merged here -> [GitHub Pull

[jira] [Updated] (SPARK-52851) Remove public APIs for append once flows

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52851: --- Labels: pull-request-available (was: ) > Remove public APIs for append once flows > ---

[jira] [Assigned] (SPARK-52871) Merge `o.a.s.sql.catalyst.util.SparkStringUtils` to `o.a.s.util.SparkStringUtils`

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52871: - Assignee: Dongjoon Hyun > Merge `o.a.s.sql.catalyst.util.SparkStringUtils` to > `o.a.s

[jira] [Resolved] (SPARK-52871) Merge `o.a.s.sql.catalyst.util.SparkStringUtils` to `o.a.s.util.SparkStringUtils`

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52871. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51562 [https://

[jira] [Updated] (SPARK-52872) Improve test coverage for `HigherOrderFunctions`

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52872: --- Labels: pull-request-available (was: ) > Improve test coverage for `HigherOrderFunctions` >

[jira] [Commented] (SPARK-46057) Support SQL user-defined functions

2025-07-18 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008120#comment-18008120 ] Allison Wang commented on SPARK-46057: -- [~ajantha] The documentation for SQL UDFs h

[jira] [Created] (SPARK-52872) Improve test coverage for `HigherOrderFunctions`

2025-07-18 Thread Mihailo Timotic (Jira)
Mihailo Timotic created SPARK-52872: --- Summary: Improve test coverage for `HigherOrderFunctions` Key: SPARK-52872 URL: https://issues.apache.org/jira/browse/SPARK-52872 Project: Spark Issue

[jira] [Updated] (SPARK-52846) Log fetch time for from JDBC remote source

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52846: --- Labels: pull-request-available (was: ) > Log fetch time for from JDBC remote source > -

[jira] [Updated] (SPARK-52432) [SDP] DataflowGraphRegistry should be scoped to a session

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52432: --- Labels: pull-request-available (was: ) > [SDP] DataflowGraphRegistry should be scoped to a

[jira] [Updated] (SPARK-52871) Merge `o.a.s.sql.catalyst.util.SparkStringUtils` to `o.a.s.util.SparkStringUtils`

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52871: --- Labels: pull-request-available (was: ) > Merge `o.a.s.sql.catalyst.util.SparkStringUtils` t

[jira] [Created] (SPARK-52871) Merge `o.a.s.sql.catalyst.util.SparkStringUtils` to `o.a.s.util.SparkStringUtils`

2025-07-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52871: - Summary: Merge `o.a.s.sql.catalyst.util.SparkStringUtils` to `o.a.s.util.SparkStringUtils` Key: SPARK-52871 URL: https://issues.apache.org/jira/browse/SPARK-52871 P

[jira] [Updated] (SPARK-52841) Fix PlanStability id normalization

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52841: -- Parent: SPARK-51166 Issue Type: Sub-task (was: Bug) > Fix PlanStability id normalizat

[jira] [Resolved] (SPARK-52516) Memory Leak with coalesce foreachpartitions and v2 datasources

2025-07-18 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-52516. - Resolution: Fixed > Memory Leak with coalesce foreachpartitions and v2 datasources > ---

[jira] [Reopened] (SPARK-52516) Memory Leak with coalesce foreachpartitions and v2 datasources

2025-07-18 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reopened SPARK-52516: - > Memory Leak with coalesce foreachpartitions and v2 datasources > -

[jira] [Assigned] (SPARK-52516) Memory Leak with coalesce foreachpartitions and v2 datasources

2025-07-18 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-52516: --- Assignee: L. C. Hsieh > Memory Leak with coalesce foreachpartitions and v2 datasources > --

[jira] [Updated] (SPARK-52516) Memory Leak with coalesce foreachpartitions and v2 datasources

2025-07-18 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-52516: Fix Version/s: 4.1.0 4.0.1 3.5.7 > Memory Leak with coalesce

[jira] [Assigned] (SPARK-52841) Fix PlanStability id normalization

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52841: - Assignee: Peter Toth > Fix PlanStability id normalization > ---

[jira] [Resolved] (SPARK-52841) Fix PlanStability id normalization

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52841. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51534 [https://

[jira] [Resolved] (SPARK-52859) Add `SparkSystemUtils` trait

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52859. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51545 [https://

[jira] [Resolved] (SPARK-52832) Fix oracle dialect identifier quoting

2025-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52832. - Fix Version/s: 4.1.0 4.0.1 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-52832) Fix oracle dialect identifier quoting

2025-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52832: --- Assignee: Uros Stankovic > Fix oracle dialect identifier quoting >

[jira] [Resolved] (SPARK-52850) Skip calling conversions if identity function.

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52850. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51542 [https://

[jira] [Assigned] (SPARK-52850) Skip calling conversions if identity function.

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52850: - Assignee: Takuya Ueshin > Skip calling conversions if identity function. >

[jira] [Assigned] (SPARK-52863) Clean up code paths for old pandas versions

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52863: - Assignee: Ruifeng Zheng > Clean up code paths for old pandas versions > ---

[jira] [Resolved] (SPARK-52863) Clean up code paths for old pandas versions

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52863. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51550 [https://

[jira] [Assigned] (SPARK-52859) Add `SparkSystemUtils` trait

2025-07-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52859: - Assignee: Dongjoon Hyun > Add `SparkSystemUtils` trait > >

[jira] [Updated] (SPARK-52448) Add simplified Struct Expression.Literal

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52448: --- Labels: pull-request-available (was: ) > Add simplified Struct Expression.Literal > ---

[jira] [Resolved] (SPARK-52848) Simplify casting TIME to DECIMAL

2025-07-18 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-52848. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51539 [https://github.com

[jira] [Updated] (SPARK-52696) Strip `__is_duplicate` metadata after analysis

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52696: --- Labels: pull-request-available (was: ) > Strip `__is_duplicate` metadata after analysis > -

[jira] [Updated] (SPARK-52870) FOR statement errors when referenced columns have whitespace, or are int literals

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52870: --- Labels: pull-request-available (was: ) > FOR statement errors when referenced columns have

[jira] [Updated] (SPARK-52870) FOR statement errors when referenced columns have whitespace, or are int literals

2025-07-18 Thread Dusan Tisma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dusan Tisma updated SPARK-52870: Description: *Example 1:* {{BEGIN}} {{  FOR SELECT 1 DO}} {{    SELECT 1;}} {{  END FOR;}} {{END}

[jira] [Created] (SPARK-52870) FOR statement errors when referenced columns have whitespace, or are int literals

2025-07-18 Thread Dusan Tisma (Jira)
Dusan Tisma created SPARK-52870: --- Summary: FOR statement errors when referenced columns have whitespace, or are int literals Key: SPARK-52870 URL: https://issues.apache.org/jira/browse/SPARK-52870 Proje

[jira] [Updated] (SPARK-52869) Add FrameLessOffsetWindowFunction validation to validateResolvedWindowExpression for reuse in single-pass analyzer

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52869: --- Labels: pull-request-available (was: ) > Add FrameLessOffsetWindowFunction validation to >

[jira] [Updated] (SPARK-52869) Add FrameLessOffsetWindowFunction validation to validateResolvedWindowExpression for reuse in single-pass analyzer

2025-07-18 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-52869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Jovićević updated SPARK-52869: - Summary: Add FrameLessOffsetWindowFunction validation to validateResolvedWindowExpressio

[jira] [Created] (SPARK-52869) Add window function and frame mismatch validation to WindowResolver for reuse in single-pass analyzer

2025-07-18 Thread Jira
Nikola Jovićević created SPARK-52869: Summary: Add window function and frame mismatch validation to WindowResolver for reuse in single-pass analyzer Key: SPARK-52869 URL: https://issues.apache.org/jira/browse/

[jira] [Updated] (SPARK-52868) CBO: OOM-risky iceberg table stats underestimation for some filters

2025-07-18 Thread Artem Kupchinskiy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artem Kupchinskiy updated SPARK-52868: -- Description: Some data sources like Iceberg provide only partial column statistics. S

[jira] [Updated] (SPARK-52868) CBO: OOM-risky iceberg table stats underestimation for some filters

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52868: --- Labels: pull-request-available (was: ) > CBO: OOM-risky iceberg table stats underestimation

[jira] [Created] (SPARK-52868) CBO: OOM-risky iceberg table stats underestimation for some filters

2025-07-18 Thread Artem Kupchinskiy (Jira)
Artem Kupchinskiy created SPARK-52868: - Summary: CBO: OOM-risky iceberg table stats underestimation for some filters Key: SPARK-52868 URL: https://issues.apache.org/jira/browse/SPARK-52868 Project

[jira] [Updated] (SPARK-52867) Remove redundant GetTimestamp

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52867: --- Labels: pull-request-available (was: ) > Remove redundant GetTimestamp > --

[jira] [Updated] (SPARK-52866) Add support for `try_to_date`

2025-07-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52866: --- Labels: pull-request-available (was: ) > Add support for `try_to_date` > --

[jira] [Created] (SPARK-52867) Remove redundant GetTimestamp

2025-07-18 Thread Mingliang Zhu (Jira)
Mingliang Zhu created SPARK-52867: - Summary: Remove redundant GetTimestamp Key: SPARK-52867 URL: https://issues.apache.org/jira/browse/SPARK-52867 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-48091) Using `explode` together with `transform` in the same select statement causes aliases in the transformed column to be ignored

2025-07-18 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007808#comment-18007808 ] André Souprayane edited comment on SPARK-48091 at 7/18/25 7:14 AM: ---