[jira] [Updated] (SPARK-52227) the packaging results from Maven and sbt should be consistent for `spark-protobuf` module

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52227: --- Labels: pull-request-available (was: ) > the packaging results from Maven and sbt should be

[jira] [Created] (SPARK-52227) the packaging results from Maven and sbt should be consistent for `spark-protobuf` module,

2025-05-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-52227: Summary: the packaging results from Maven and sbt should be consistent for `spark-protobuf` module, Key: SPARK-52227 URL: https://issues.apache.org/jira/browse/SPARK-52227

[jira] [Updated] (SPARK-52227) the packaging results from Maven and sbt should be consistent for `spark-protobuf` module

2025-05-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-52227: - Summary: the packaging results from Maven and sbt should be consistent for `spark-protobuf` module (wa

[jira] [Updated] (SPARK-52153) Fix from_json and to_json with variant

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52153: --- Labels: pull-request-available (was: ) > Fix from_json and to_json with variant > -

[jira] [Created] (SPARK-52226) Strengthen data source v2 operators' equality checks

2025-05-19 Thread Boxuan Li (Jira)
Boxuan Li created SPARK-52226: - Summary: Strengthen data source v2 operators' equality checks Key: SPARK-52226 URL: https://issues.apache.org/jira/browse/SPARK-52226 Project: Spark Issue Type: Im

[jira] [Updated] (SPARK-52226) Strengthen data source v2 operators' equality checks

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52226: --- Labels: pull-request-available (was: ) > Strengthen data source v2 operators' equality chec

[jira] [Resolved] (SPARK-52217) Skip outer reference validation under Filter in single-pass resolver

2025-05-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52217. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50935 [https://gith

[jira] [Assigned] (SPARK-52217) Skip outer reference validation under Filter in single-pass resolver

2025-05-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52217: --- Assignee: Mihailo Aleksic > Skip outer reference validation under Filter in single-pass res

[jira] [Assigned] (SPARK-52221) Refactor SQL Scripting local variable manager into context manager

2025-05-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52221: --- Assignee: David Milicevic > Refactor SQL Scripting local variable manager into context mana

[jira] [Resolved] (SPARK-52221) Refactor SQL Scripting local variable manager into context manager

2025-05-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52221. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50938 [https://gith

[jira] [Updated] (SPARK-52178) Make release scripts to respect SKIP_TAG and ANSWER when already set

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52178: --- Labels: pull-request-available (was: ) > Make release scripts to respect SKIP_TAG and ANSWE

[jira] [Resolved] (SPARK-52225) Avoid using interactive TTY mode in release scripts for branch-3.5 and 4.0.

2025-05-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52225. -- Fix Version/s: 4.0.0 3.5.6 Assignee: Hyukjin Kwon Resolution

[jira] [Updated] (SPARK-52225) Avoid using interactive TTY mode in release scripts for branch-3.5 and 4.0.

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52225: --- Labels: pull-request-available (was: ) > Avoid using interactive TTY mode in release script

[jira] [Updated] (SPARK-52225) Avoid using interactive TTY mode in release scripts for branch-3.5 and 4.0.

2025-05-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-52225: - Affects Version/s: 3.5.5 > Avoid using interactive TTY mode in release scripts for branch-3.5 an

[jira] [Created] (SPARK-52225) Avoid using interactive TTY mode in release scripts for branch-3.5 and 4.0.

2025-05-19 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52225: Summary: Avoid using interactive TTY mode in release scripts for branch-3.5 and 4.0. Key: SPARK-52225 URL: https://issues.apache.org/jira/browse/SPARK-52225 Project:

[jira] [Updated] (SPARK-51927) Upgrade jackson to 2.19.0

2025-05-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-51927: - Fix Version/s: (was: 4.1.0) > Upgrade jackson to 2.19.0 > - > >

[jira] [Reopened] (SPARK-51927) Upgrade jackson to 2.19.0

2025-05-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-51927: -- Assignee: (was: Yang Jie) Reverted in https://github.com/apache/spark/commit/14fca6551e

[jira] [Updated] (SPARK-52213) Upgrade kubernetes-client to 7.3.0

2025-05-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-52213: - Fix Version/s: (was: 4.1.0) > Upgrade kubernetes-client to 7.3.0 >

[jira] [Assigned] (SPARK-52166) [SDP] Add support for PipelineEvents

2025-05-19 Thread Sandy Ryza (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned SPARK-52166: -- Assignee: Jon Mio > [SDP] Add support for PipelineEvents > --

[jira] [Assigned] (SPARK-52223) [SDP] Create spark connect API for SDP

2025-05-19 Thread Sandy Ryza (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned SPARK-52223: -- Assignee: Aakash Japi > [SDP] Create spark connect API for SDP >

[jira] [Updated] (SPARK-52224) Add pyyaml as an optional dependency

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52224: --- Labels: pull-request-available (was: ) > Add pyyaml as an optional dependency > ---

[jira] [Updated] (SPARK-42931) dropDuplicates within watermark

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42931: --- Labels: pull-request-available (was: ) > dropDuplicates within watermark >

[jira] [Updated] (SPARK-52224) Add pyyaml as an optional dependency

2025-05-19 Thread Sandy Ryza (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-52224: --- Description: The pipeline spec file described in the [Declarative Pipelines SPIP|https://docs.googl

[jira] [Created] (SPARK-52224) Add pyyaml as an optional dependency

2025-05-19 Thread Sandy Ryza (Jira)
Sandy Ryza created SPARK-52224: -- Summary: Add pyyaml as an optional dependency Key: SPARK-52224 URL: https://issues.apache.org/jira/browse/SPARK-52224 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-52223) [SDP] Create spark connect API for SDP

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52223: --- Labels: pull-request-available (was: ) > [SDP] Create spark connect API for SDP > -

[jira] [Updated] (SPARK-51727) SPIP: Declarative Pipelines

2025-05-19 Thread Sandy Ryza (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-51727: --- Issue Type: Umbrella (was: Improvement) > SPIP: Declarative Pipelines > ---

[jira] [Commented] (SPARK-51727) SPIP: Declarative Pipelines

2025-05-19 Thread Sandy Ryza (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17952728#comment-17952728 ] Sandy Ryza commented on SPARK-51727: Good point [~LuciferYang] – just changed > SPI

[jira] [Updated] (SPARK-52223) [SDP] Create spark connect API for SDP

2025-05-19 Thread Aakash Japi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aakash Japi updated SPARK-52223: Description: SDP is a Spark Connect-only feature. We need to add the following APIs to cover the

[jira] [Updated] (SPARK-52223) [SDP] Create spark connect API for SDP

2025-05-19 Thread Aakash Japi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aakash Japi updated SPARK-52223: Summary: [SDP] Create spark connect API for SDP (was: Create spark connect API for SDP) > [SDP]

[jira] [Created] (SPARK-52223) Create spark connect API for SDP

2025-05-19 Thread Aakash Japi (Jira)
Aakash Japi created SPARK-52223: --- Summary: Create spark connect API for SDP Key: SPARK-52223 URL: https://issues.apache.org/jira/browse/SPARK-52223 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-51984) Support Check Constraint enforcement in UpdateTable and MergeIntoTable

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51984: --- Labels: pull-request-available (was: ) > Support Check Constraint enforcement in UpdateTabl

[jira] [Updated] (SPARK-51984) Support Check Constraint enforcement in UpdateTable and MergeIntoTable

2025-05-19 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-51984: --- Summary: Support Check Constraint enforcement in UpdateTable and MergeIntoTable (was: Suppo

[jira] [Updated] (SPARK-51984) Support Check Constraint enforcement in UpdateTable and MergeIntoTable

2025-05-19 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-51984: --- Priority: Major (was: Minor) > Support Check Constraint enforcement in UpdateTable and Merg

[jira] [Updated] (SPARK-52187) Introduce Join Pushdown to Datasource V2

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52187: --- Labels: pull-request-available (was: ) > Introduce Join Pushdown to Datasource V2 > ---

[jira] [Commented] (SPARK-47547) observed false positive rate in bloom filter is greater than expected for large n

2025-05-19 Thread Ish Nagy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17952695#comment-17952695 ] Ish Nagy commented on SPARK-47547: -- Hi all, I'm working on [PR#50933|https://github.co

[jira] [Updated] (SPARK-52166) [SDP] Add support for PipelineEvents

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52166: --- Labels: pull-request-available (was: ) > [SDP] Add support for PipelineEvents > ---

[jira] [Updated] (SPARK-52214) Python Arrow UDF

2025-05-19 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-52214: -- Description: Pandas UDFs (and Pandas Functions like MapInPandas) have a pandas <> arrow conve

[jira] [Updated] (SPARK-52215) Implement Scalar Arrow UDF

2025-05-19 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-52215: -- Summary: Implement Scalar Arrow UDF (was: Introduce Scalar Arrow UDF) > Implement Scalar Arro

[jira] [Resolved] (SPARK-52222) Upgrade `kubernetes-client` to 7.3.0

2025-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-5. --- Fix Version/s: kubernetes-operator-0.3.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-52220) Update `README.md` and integration test with Apache Spark 4.0.0 RC7

2025-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52220. --- Fix Version/s: connect-swift-0.3.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Created] (SPARK-52222) Upgrade `kubernetes-client` to 7.3.0

2025-05-19 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-5: - Summary: Upgrade `kubernetes-client` to 7.3.0 Key: SPARK-5 URL: https://issues.apache.org/jira/browse/SPARK-5 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-51927) Upgrade jackson to 2.19.0

2025-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51927: -- Parent: SPARK-51166 Issue Type: Sub-task (was: Improvement) > Upgrade jackson to 2.19

[jira] [Assigned] (SPARK-52213) Upgrade kubernetes-client to 7.3.0

2025-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52213: - Assignee: Yang Jie > Upgrade kubernetes-client to 7.3.0 >

[jira] [Resolved] (SPARK-52213) Upgrade kubernetes-client to 7.3.0

2025-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52213. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50730 [https://

[jira] [Resolved] (SPARK-51927) Upgrade jackson to 2.19.0

2025-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51927. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50730 [https://

[jira] [Assigned] (SPARK-51927) Upgrade jackson to 2.19.0

2025-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51927: - Assignee: Yang Jie > Upgrade jackson to 2.19.0 > - > >

[jira] [Created] (SPARK-52221) Refactor SQL Scripting local variable manager into context manager

2025-05-19 Thread David Milicevic (Jira)
David Milicevic created SPARK-52221: --- Summary: Refactor SQL Scripting local variable manager into context manager Key: SPARK-52221 URL: https://issues.apache.org/jira/browse/SPARK-52221 Project: Spa

[jira] [Updated] (SPARK-52220) Update `README.md` and integration test with Apache Spark 4.0.0 RC7

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52220: --- Labels: pull-request-available (was: ) > Update `README.md` and integration test with Apach

[jira] [Updated] (SPARK-52220) Update `README.md` and integration test with Apache Spark 4.0.0 RC7

2025-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52220: -- Parent: SPARK-52204 Issue Type: Sub-task (was: Test) > Update `README.md` and integra

[jira] [Updated] (SPARK-52221) Refactor SQL Scripting local variable manager into context manager

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52221: --- Labels: pull-request-available (was: ) > Refactor SQL Scripting local variable manager into

[jira] [Created] (SPARK-52220) Update `README.md` and integration test with Apache Spark 4.0.0 RC7

2025-05-19 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52220: - Summary: Update `README.md` and integration test with Apache Spark 4.0.0 RC7 Key: SPARK-52220 URL: https://issues.apache.org/jira/browse/SPARK-52220 Project: Spark

[jira] [Updated] (SPARK-51531) Proper StructType for Schema

2025-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51531: -- Affects Version/s: connect-swift-0.3.0 (was: 4.0.0) > Proper Struct

[jira] [Updated] (SPARK-51530) Client should support re-attachable execution

2025-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51530: -- Affects Version/s: connect-swift-0.3.0 (was: connect-swift-0.2.0) >

[jira] [Updated] (SPARK-52219) Schema level collation support for tables

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52219: --- Labels: pull-request-available (was: ) > Schema level collation support for tables > --

[jira] [Updated] (SPARK-52218) Make current datetime functions evaluable again

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52218: --- Labels: pull-request-available (was: ) > Make current datetime functions evaluable again >

[jira] [Created] (SPARK-52219) Schema level collation support for tables

2025-05-19 Thread Marko Ilic (Jira)
Marko Ilic created SPARK-52219: -- Summary: Schema level collation support for tables Key: SPARK-52219 URL: https://issues.apache.org/jira/browse/SPARK-52219 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-52218) Make current datetime functions evaluable again

2025-05-19 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-52218: --- Summary: Make current datetime functions evaluable again Key: SPARK-52218 URL: https://issues.apache.org/jira/browse/SPARK-52218 Project: Spark Issue Type: Imp

[jira] [Assigned] (SPARK-52203) Implement additional single-pass Analyzer functionality

2025-05-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52203: --- Assignee: Vladimir Golubev > Implement additional single-pass Analyzer functionality >

[jira] [Updated] (SPARK-44422) Fine grained interrupt in Spark Connect

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44422: --- Labels: pull-request-available (was: ) > Fine grained interrupt in Spark Connect >

[jira] [Updated] (SPARK-52217) Skip outer reference validation under Filter in single-pass resolver

2025-05-19 Thread Mihailo Aleksic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-52217: Description: Validation for outer references in subquery expressions is done in the bottom

[jira] [Updated] (SPARK-52217) Skip outer reference validation under Filter in single-pass resolver

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52217: --- Labels: pull-request-available (was: ) > Skip outer reference validation under Filter in si

[jira] [Resolved] (SPARK-52203) Implement additional single-pass Analyzer functionality

2025-05-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52203. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50929 [https://gith

[jira] [Assigned] (SPARK-52101) Disable Inline Forcing for all rCTEs

2025-05-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52101: --- Assignee: Pavle Martinović > Disable Inline Forcing for all rCTEs > ---

[jira] [Resolved] (SPARK-52101) Disable Inline Forcing for all rCTEs

2025-05-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52101. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50904 [https://gith

[jira] [Created] (SPARK-52217) Skip outer reference validation under Filter in single-pass resolver

2025-05-19 Thread Mihailo Aleksic (Jira)
Mihailo Aleksic created SPARK-52217: --- Summary: Skip outer reference validation under Filter in single-pass resolver Key: SPARK-52217 URL: https://issues.apache.org/jira/browse/SPARK-52217 Project: S

[jira] [Assigned] (SPARK-52159) [JDBC] Improve error handling in table exists check

2025-05-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-52159: Assignee: Milan Stefanovic > [JDBC] Improve error handling in table exists check > --

[jira] [Updated] (SPARK-52216) Make InvalidCommandInput a user-facing error

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52216: --- Labels: pull-request-available (was: ) > Make InvalidCommandInput a user-facing error > ---

[jira] [Updated] (SPARK-52159) [JDBC] Improve error handling in table exists check

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52159: --- Labels: pull-request-available (was: ) > [JDBC] Improve error handling in table exists chec

[jira] [Created] (SPARK-52216) Make InvalidCommandInput a user-facing error

2025-05-19 Thread Yihong He (Jira)
Yihong He created SPARK-52216: - Summary: Make InvalidCommandInput a user-facing error Key: SPARK-52216 URL: https://issues.apache.org/jira/browse/SPARK-52216 Project: Spark Issue Type: Improvemen

[jira] [Resolved] (SPARK-52159) [JDBC] Improve error handling in table exists check

2025-05-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-52159. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50835 [https://github.com

[jira] [Updated] (SPARK-52215) Implement Scalar Arrow UDF

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52215: --- Labels: pull-request-available (was: ) > Implement Scalar Arrow UDF > -

[jira] [Resolved] (SPARK-52109) Introduce listTableSummaries API in TableCatalog

2025-05-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52109. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50886 [https://gith

[jira] [Created] (SPARK-52215) Introduce Scalar Arrow UDF

2025-05-19 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-52215: - Summary: Introduce Scalar Arrow UDF Key: SPARK-52215 URL: https://issues.apache.org/jira/browse/SPARK-52215 Project: Spark Issue Type: Sub-task C

[jira] [Created] (SPARK-52214) Python Arrow UDF

2025-05-19 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-52214: - Summary: Python Arrow UDF Key: SPARK-52214 URL: https://issues.apache.org/jira/browse/SPARK-52214 Project: Spark Issue Type: Umbrella Components:

[jira] [Updated] (SPARK-52032) ORC filter pushdown causes incorrect results with eqNullSafe (<=>) in DataFrame filter (Parquet works as expected)

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52032: --- Labels: pull-request-available (was: ) > ORC filter pushdown causes incorrect results with

[jira] [Resolved] (SPARK-52189) Add new golden file tests for NATURAL JOIN with GROUP BY, HAVING, ORDER BY and LCAs

2025-05-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-52189. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50920 [https://github.com

[jira] [Updated] (SPARK-52189) Add new golden file tests for NATURAL JOIN with GROUP BY, HAVING, ORDER BY and LCAs

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52189: --- Labels: pull-request-available (was: ) > Add new golden file tests for NATURAL JOIN with GR

[jira] [Assigned] (SPARK-52189) Add new golden file tests for NATURAL JOIN with GROUP BY, HAVING, ORDER BY and LCAs

2025-05-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-52189: Assignee: Vladimir Golubev > Add new golden file tests for NATURAL JOIN with GROUP BY, HAVING, OR

[jira] [Resolved] (SPARK-51892) Reading JSON file with schema array[array[struct]] fails with ClassCastException in Spark 3.5.1

2025-05-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51892. -- Resolution: Duplicate The issue can no longer be reproduced after Spark 3.5.2. It seems that SPARK-48

[jira] [Updated] (SPARK-52060) Create dedicated OneRowRelationExec node

2025-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52060: --- Labels: pull-request-available (was: ) > Create dedicated OneRowRelationExec node > ---