[jira] [Resolved] (SPARK-44044) Improve Error message for SQL Window functions

[ https://issues.apache.org/jira/browse/SPARK-44044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-44044. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41578

[jira] [Assigned] (SPARK-44044) Improve Error message for SQL Window functions

[ https://issues.apache.org/jira/browse/SPARK-44044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44044: Assignee: Siying Dong > Improve Error message for SQL Window functions >

[jira] [Resolved] (SPARK-43851) Support LCA in grouping expressions

[ https://issues.apache.org/jira/browse/SPARK-43851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-43851. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41804

[jira] [Assigned] (SPARK-43851) Support LCA in grouping expressions

[ https://issues.apache.org/jira/browse/SPARK-43851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-43851: Assignee: Jia Fan > Support LCA in grouping expressions > --- >

[jira] [Assigned] (SPARK-44060) Code-gen for build side outer shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-44060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-44060: -- Assignee: Szehon Ho > Code-gen for build side outer shuffled hash join >

[jira] [Resolved] (SPARK-44060) Code-gen for build side outer shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-44060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-44060. Fix Version/s: 3.5.0 Resolution: Fixed > Code-gen for build side outer shuffled hash join

[jira] [Commented] (SPARK-44261) Move QueryCompilationErrors to sql/api

[ https://issues.apache.org/jira/browse/SPARK-44261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739269#comment-17739269 ] BingKun Pan commented on SPARK-44261: - Okay，go ahead. > Move QueryCompilationErrors to sql/api >

[jira] [Resolved] (SPARK-42784) Fix the problem of incomplete creation of subdirectories in push merged localDir

[ https://issues.apache.org/jira/browse/SPARK-42784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-42784. - Resolution: Fixed > Fix the problem of incomplete creation of subdirectories in

[jira] [Updated] (SPARK-42784) Fix the problem of incomplete creation of subdirectories in push merged localDir

[ https://issues.apache.org/jira/browse/SPARK-42784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-42784: Fix Version/s: 3.3.3 3.5.0 3.4.2 > Fix the

[jira] [Assigned] (SPARK-42784) Fix the problem of incomplete creation of subdirectories in push merged localDir

[ https://issues.apache.org/jira/browse/SPARK-42784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-42784: --- Assignee: Fencheng Mei > Fix the problem of incomplete creation of

[jira] [Created] (SPARK-44267) Upgrade `pandas` to 2.0.3

BingKun Pan created SPARK-44267: --- Summary: Upgrade `pandas` to 2.0.3 Key: SPARK-44267 URL: https://issues.apache.org/jira/browse/SPARK-44267 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-44116) Utilize Hadoop vectorized APIs

[ https://issues.apache.org/jira/browse/SPARK-44116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44116: -- Description: Apache Hadoop 3.3.5+ supports vectorized APIs. > Utilize Hadoop vectorized APIs

[jira] [Assigned] (SPARK-44259) Make `connect-jvm-client` module pass except arrow-related ones in Java 21

[ https://issues.apache.org/jira/browse/SPARK-44259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44259: - Assignee: Yang Jie > Make `connect-jvm-client` module pass except arrow-related ones

[jira] [Resolved] (SPARK-44259) Make `connect-jvm-client` module pass except arrow-related ones in Java 21

[ https://issues.apache.org/jira/browse/SPARK-44259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44259. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41805

[jira] [Updated] (SPARK-43974) Upgrade buf to v1.23.1

[ https://issues.apache.org/jira/browse/SPARK-43974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-43974: Summary: Upgrade buf to v1.23.1 (was: Upgrade buf to v1.23.0) > Upgrade buf to v1.23.1 >

[jira] [Commented] (SPARK-42887) Simple DataType interface

[ https://issues.apache.org/jira/browse/SPARK-42887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739249#comment-17739249 ] BingKun Pan commented on SPARK-42887: - Okay, I'm very happy to do it.  > Simple DataType interface

[jira] [Commented] (SPARK-44261) Move QueryCompilationErrors to sql/api

[ https://issues.apache.org/jira/browse/SPARK-44261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739248#comment-17739248 ] Rui Wang commented on SPARK-44261: -- probably wait a bit for https://github.com/apache/spark/pull/41794

[jira] [Commented] (SPARK-44261) Move QueryCompilationErrors to sql/api

[ https://issues.apache.org/jira/browse/SPARK-44261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739247#comment-17739247 ] Rui Wang commented on SPARK-44261: -- I probably need to work on this one. I got a chance to talk to

[jira] [Updated] (SPARK-44266) Move Util.truncatedString to sql/api

[ https://issues.apache.org/jira/browse/SPARK-44266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-44266: - Summary: Move Util.truncatedString to sql/api (was: Move Util.truncatedString) > Move

[jira] [Created] (SPARK-44266) Move Util.truncatedString

Rui Wang created SPARK-44266: Summary: Move Util.truncatedString Key: SPARK-44266 URL: https://issues.apache.org/jira/browse/SPARK-44266 Project: Spark Issue Type: Sub-task Components:

[jira] [Resolved] (SPARK-44160) Extract shared code from StructType

[ https://issues.apache.org/jira/browse/SPARK-44160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-44160. -- Resolution: Won't Fix > Extract shared code from StructType > --- > >

[jira] [Commented] (SPARK-42887) Simple DataType interface

[ https://issues.apache.org/jira/browse/SPARK-42887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739245#comment-17739245 ] Rui Wang commented on SPARK-42887: -- [~panbingkun] yes please! any help is very welcome! Basically I

[jira] [Updated] (SPARK-44251) Potential for incorrect results or NPE when full outer USING join has null key value

[ https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-44251: -- Affects Version/s: 3.3.2 > Potential for incorrect results or NPE when full outer USING join

[jira] [Updated] (SPARK-44251) Potential for incorrect results or NPE when full outer USING join has null key value

[ https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-44251: -- Affects Version/s: 3.4.1 > Potential for incorrect results or NPE when full outer USING join

[jira] [Created] (SPARK-44265) Built-in XML data source support

Sandip Agarwala created SPARK-44265: --- Summary: Built-in XML data source support Key: SPARK-44265 URL: https://issues.apache.org/jira/browse/SPARK-44265 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-44252) Add error class for the case when loading state from DFS fails

[ https://issues.apache.org/jira/browse/SPARK-44252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucy Yao updated SPARK-44252: - Description: This is part of

[jira] [Updated] (SPARK-44252) Add error class for the case when loading state from DFS fails

[ https://issues.apache.org/jira/browse/SPARK-44252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucy Yao updated SPARK-44252: - Description: This is part of [https://github.com/apache/spark/pull/41705.] Wrap the exception during

[jira] [Created] (SPARK-44264) DeepSpeed Distrobutor

Lu Wang created SPARK-44264: --- Summary: DeepSpeed Distrobutor Key: SPARK-44264 URL: https://issues.apache.org/jira/browse/SPARK-44264 Project: Spark Issue Type: Improvement Components:

[jira] [Assigned] (SPARK-41487) Assign name to _LEGACY_ERROR_TEMP_1020

[ https://issues.apache.org/jira/browse/SPARK-41487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41487: Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_1020 >

[jira] [Resolved] (SPARK-41487) Assign name to _LEGACY_ERROR_TEMP_1020

[ https://issues.apache.org/jira/browse/SPARK-41487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41487. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39702

[jira] [Commented] (SPARK-44251) Potential for incorrect results or NPE when full outer USING join has null key value

[ https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739180#comment-17739180 ] Bruce Robbins commented on SPARK-44251: --- PR can be found here:

[jira] [Assigned] (SPARK-43986) Add error classes for HyperLogLog functions

[ https://issues.apache.org/jira/browse/SPARK-43986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-43986: Assignee: Daniel > Add error classes for HyperLogLog functions >

[jira] [Resolved] (SPARK-43986) Add error classes for HyperLogLog functions

[ https://issues.apache.org/jira/browse/SPARK-43986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-43986. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41486

[jira] [Assigned] (SPARK-44260) Assign names to the error class _LEGACY_ERROR_TEMP_[1215-1245-2329] & Use checkError() to check Exception in *CharVarchar*Suite

[ https://issues.apache.org/jira/browse/SPARK-44260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44260: Assignee: BingKun Pan > Assign names to the error class _LEGACY_ERROR_TEMP_[1215-1245-2329] &

[jira] [Resolved] (SPARK-44260) Assign names to the error class _LEGACY_ERROR_TEMP_[1215-1245-2329] & Use checkError() to check Exception in *CharVarchar*Suite

[ https://issues.apache.org/jira/browse/SPARK-44260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-44260. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41768

[jira] [Resolved] (SPARK-44257) Update some maven plugins & scalafmt to newest version

[ https://issues.apache.org/jira/browse/SPARK-44257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-44257. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41803

[jira] [Assigned] (SPARK-44257) Update some maven plugins & scalafmt to newest version

[ https://issues.apache.org/jira/browse/SPARK-44257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-44257: Assignee: BingKun Pan > Update some maven plugins & scalafmt to newest version >

[jira] [Updated] (SPARK-44257) Update some maven plugins & scalafmt to newest version

[ https://issues.apache.org/jira/browse/SPARK-44257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-44257: - Priority: Trivial (was: Minor) > Update some maven plugins & scalafmt to newest version >

[jira] [Commented] (SPARK-41599) Memory leak in FileSystem.CACHE when submitting apps to secure cluster using InProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-41599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739088#comment-17739088 ] Xieming Li commented on SPARK-41599: [~srowen], [~ste...@apache.org]  Thank you very much for your

[jira] [Resolved] (SPARK-41599) Memory leak in FileSystem.CACHE when submitting apps to secure cluster using InProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-41599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41599. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41692

[jira] [Updated] (SPARK-41599) Memory leak in FileSystem.CACHE when submitting apps to secure cluster using InProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-41599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41599: - Priority: Minor (was: Major) > Memory leak in FileSystem.CACHE when submitting apps to secure

[jira] [Assigned] (SPARK-41599) Memory leak in FileSystem.CACHE when submitting apps to secure cluster using InProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-41599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41599: Assignee: Xieming Li > Memory leak in FileSystem.CACHE when submitting apps to secure

[jira] [Created] (SPARK-44263) Allow ChannelBuilder extensions -- Scala

Alice Sayutina created SPARK-44263: -- Summary: Allow ChannelBuilder extensions -- Scala Key: SPARK-44263 URL: https://issues.apache.org/jira/browse/SPARK-44263 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-44241) Set io.connectionTimeout/connectionCreationTimeout to zero or negative will cause executor incessantes cons/destructions

[ https://issues.apache.org/jira/browse/SPARK-44241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-44241. -- Fix Version/s: 3.3.3 3.5.0 3.4.2 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-44241) Set io.connectionTimeout/connectionCreationTimeout to zero or negative will cause executor incessantes cons/destructions

[ https://issues.apache.org/jira/browse/SPARK-44241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-44241: Assignee: Kent Yao > Set io.connectionTimeout/connectionCreationTimeout to zero or negative will

[jira] [Assigned] (SPARK-43922) Add named argument support in parser for function call

[ https://issues.apache.org/jira/browse/SPARK-43922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-43922: Assignee: Richard Yu > Add named argument support in parser for function call >

[jira] [Resolved] (SPARK-43922) Add named argument support in parser for function call

[ https://issues.apache.org/jira/browse/SPARK-43922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-43922. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41796

[jira] [Updated] (SPARK-44262) JdbcUtils hardcodes some SQL statements

[ https://issues.apache.org/jira/browse/SPARK-44262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florent BIVILLE updated SPARK-44262: Description: I am currently investigating an integration with the [Neo4j JBDC

[jira] [Commented] (SPARK-43922) Add named argument support in parser for function call

[ https://issues.apache.org/jira/browse/SPARK-43922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738982#comment-17738982 ] ASF GitHub Bot commented on SPARK-43922: User 'learningchess2003' has created a pull request for

[jira] [Commented] (SPARK-44220) Move StringConcat to sql/api

[ https://issues.apache.org/jira/browse/SPARK-44220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738984#comment-17738984 ] ASF GitHub Bot commented on SPARK-44220: User 'amaliujia' has created a pull request for this

[jira] [Created] (SPARK-44262) JdbcUtils hardcodes some SQL statements

Florent BIVILLE created SPARK-44262: --- Summary: JdbcUtils hardcodes some SQL statements Key: SPARK-44262 URL: https://issues.apache.org/jira/browse/SPARK-44262 Project: Spark Issue Type:

[jira] [Commented] (SPARK-44246) Follow-ups for Jar/Classfile Isolation

[ https://issues.apache.org/jira/browse/SPARK-44246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738971#comment-17738971 ] ASF GitHub Bot commented on SPARK-44246: User 'vicennial' has created a pull request for this

[jira] [Commented] (SPARK-44246) Follow-ups for Jar/Classfile Isolation

[ https://issues.apache.org/jira/browse/SPARK-44246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738970#comment-17738970 ] ASF GitHub Bot commented on SPARK-44246: User 'vicennial' has created a pull request for this

[jira] [Created] (SPARK-44261) Move QueryCompilationErrors to sql/api

BingKun Pan created SPARK-44261: --- Summary: Move QueryCompilationErrors to sql/api Key: SPARK-44261 URL: https://issues.apache.org/jira/browse/SPARK-44261 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-42887) Simple DataType interface

[ https://issues.apache.org/jira/browse/SPARK-42887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738957#comment-17738957 ] BingKun Pan commented on SPARK-42887: - [~amaliujia] Can I participate in this? > Simple DataType