[jira] [Commented] (SPARK-44629) Publish PySpark Test Guidelines webpage

2023-08-04 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751260#comment-17751260 ] Snoot.io commented on SPARK-44629: -- User 'asl3' has created a pull request for this issue:

[jira] [Commented] (SPARK-44665) Add support for pandas DataFrame assertDataFrameEqual

2023-08-04 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751257#comment-17751257 ] Snoot.io commented on SPARK-44665: -- User 'asl3' has created a pull request for this issue:

[jira] [Commented] (SPARK-44665) Add support for pandas DataFrame assertDataFrameEqual

2023-08-04 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751256#comment-17751256 ] Snoot.io commented on SPARK-44665: -- User 'asl3' has created a pull request for this issue:

[jira] [Commented] (SPARK-44306) Group FileStatus with few RPC calls within Yarn Client

2023-08-04 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751255#comment-17751255 ] Snoot.io commented on SPARK-44306: -- User 'shuwang21' has created a pull request for this issue:

[jira] [Created] (SPARK-44686) Add option to create RowEncoder in Encoders helper class.

2023-08-04 Thread Jira
Herman van Hövell created SPARK-44686: - Summary: Add option to create RowEncoder in Encoders helper class. Key: SPARK-44686 URL: https://issues.apache.org/jira/browse/SPARK-44686 Project: Spark

[jira] [Updated] (SPARK-44662) SPIP: Improving performance of BroadcastHashJoin queries with stream side join key on non partition columns

2023-08-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44662: Target Version/s: (was: 3.3.3) > SPIP: Improving performance of BroadcastHashJoin queries with

[jira] [Updated] (SPARK-44662) SPIP: Improving performance of BroadcastHashJoin queries with stream side join key on non partition columns

2023-08-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44662: Fix Version/s: (was: 3.3.3) > SPIP: Improving performance of BroadcastHashJoin queries with

[jira] [Created] (SPARK-44685) Remove deprecated Catalog#createExternalTable

2023-08-04 Thread Jia Fan (Jira)
Jia Fan created SPARK-44685: --- Summary: Remove deprecated Catalog#createExternalTable Key: SPARK-44685 URL: https://issues.apache.org/jira/browse/SPARK-44685 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-44433) Implement termination of Python process for foreachBatch & streaming listener

2023-08-04 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-44433. --- Assignee: Wei Liu Resolution: Fixed Issue resolved by pull request 42283

[jira] [Updated] (SPARK-44684) Runtime min-max filter

2023-08-04 Thread GANHONGNAN (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GANHONGNAN updated SPARK-44684: --- Remaining Estimate: 2,016h (was: 0.05h) Original Estimate: 2,016h (was: 0.05h) > Runtime

[jira] [Commented] (SPARK-44684) Runtime min-max filter

2023-08-04 Thread GANHONGNAN (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751250#comment-17751250 ] GANHONGNAN commented on SPARK-44684: [~cloud_fan] could you pls review this Jira and assign it to

[jira] [Created] (SPARK-44684) Runtime min-max filter

2023-08-04 Thread GANHONGNAN (Jira)
GANHONGNAN created SPARK-44684: -- Summary: Runtime min-max filter Key: SPARK-44684 URL: https://issues.apache.org/jira/browse/SPARK-44684 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-44683) Logging level isn't passed to RocksDB state store provider correctly

2023-08-04 Thread Siying Dong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siying Dong updated SPARK-44683: Description: We pass log4j's log level to RocksDB so that RocksDB debug log can go to log4j.

[jira] [Updated] (SPARK-44005) Improve error messages for regular Python UDTFs that return non-tuple values

2023-08-04 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-44005: - Summary: Improve error messages for regular Python UDTFs that return non-tuple values (was:

[jira] [Updated] (SPARK-44005) Improve error messages when regular Python UDTFs that return non-tuple values

2023-08-04 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-44005: - Summary: Improve error messages when regular Python UDTFs that return non-tuple values (was:

[jira] [Updated] (SPARK-44005) Support returning non-tuple values for regular Python UDTFs

2023-08-04 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-44005: - Description: Currently, if you have a UDTF like this: {code:java} class TestUDTF: def

[jira] [Assigned] (SPARK-44667) Uninstall large ML libraries for non-ML jobs

2023-08-04 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44667: - Assignee: Ruifeng Zheng > Uninstall large ML libraries for non-ML jobs >

[jira] [Resolved] (SPARK-44667) Uninstall large ML libraries for non-ML jobs

2023-08-04 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44667. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42334

[jira] [Created] (SPARK-44683) Logging level isn't passed to RocksDB state store provider correctly

2023-08-04 Thread Siying Dong (Jira)
Siying Dong created SPARK-44683: --- Summary: Logging level isn't passed to RocksDB state store provider correctly Key: SPARK-44683 URL: https://issues.apache.org/jira/browse/SPARK-44683 Project: Spark

[jira] [Resolved] (SPARK-44663) Disable arrow optimization by default for Python UDTFs

2023-08-04 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-44663. --- Fix Version/s: 3.5.0 Assignee: Allison Wang Resolution: Fixed Issue

[jira] [Commented] (SPARK-24815) Structured Streaming should support dynamic allocation

2023-08-04 Thread Pavan Kotikalapudi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751237#comment-17751237 ] Pavan Kotikalapudi commented on SPARK-24815: Here is the draft PR with initial

[jira] [Updated] (SPARK-43797) Python User-defined Table Functions

2023-08-04 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-43797: - Affects Version/s: 4.0.0 > Python User-defined Table Functions >

[jira] [Resolved] (SPARK-44678) Downgrade Hadoop to 3.3.4

2023-08-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44678. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42345

[jira] [Assigned] (SPARK-44678) Downgrade Hadoop to 3.3.4

2023-08-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44678: - Assignee: Dongjoon Hyun > Downgrade Hadoop to 3.3.4 > - > >

[jira] [Resolved] (SPARK-44644) Improve error messages for creating Python UDTFs with pickling errors

2023-08-04 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-44644. --- Fix Version/s: 4.0.0 Target Version/s: 3.5.0 Assignee: Allison Wang

[jira] [Resolved] (SPARK-44258) Move Metadata to sql/api

2023-08-04 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-44258. -- Resolution: Fixed > Move Metadata to sql/api > > > Key:

[jira] [Resolved] (SPARK-42887) Simple DataType interface

2023-08-04 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-42887. -- Resolution: Fixed > Simple DataType interface > - > > Key:

[jira] [Created] (SPARK-44682) Make pandas error class message_parameters strings

2023-08-04 Thread Amanda Liu (Jira)
Amanda Liu created SPARK-44682: -- Summary: Make pandas error class message_parameters strings Key: SPARK-44682 URL: https://issues.apache.org/jira/browse/SPARK-44682 Project: Spark Issue Type:

[jira] [Created] (SPARK-44681) Solve issue referencing github.com/apache/spark-connect-go as Go library

2023-08-04 Thread BoYang (Jira)
BoYang created SPARK-44681: -- Summary: Solve issue referencing github.com/apache/spark-connect-go as Go library Key: SPARK-44681 URL: https://issues.apache.org/jira/browse/SPARK-44681 Project: Spark

[jira] [Commented] (SPARK-43351) Support Golang in Spark Connect

2023-08-04 Thread BoYang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751186#comment-17751186 ] BoYang commented on SPARK-43351: Thanks! We can keep it as 3.5.0 now. > Support Golang in Spark Connect

[jira] [Resolved] (SPARK-44648) Set up memory limits for analyze in Python.

2023-08-04 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-44648. --- Assignee: Takuya Ueshin Resolution: Fixed Issue resolved by pull request 42328

[jira] [Updated] (SPARK-44679) java.lang.OutOfMemoryError: Requested array size exceeds VM limit

2023-08-04 Thread Haitham Eltaweel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haitham Eltaweel updated SPARK-44679: - Attachment: code_sample.txt > java.lang.OutOfMemoryError: Requested array size exceeds

[jira] [Created] (SPARK-44680) parameter markers are not blocked from DEFAULT (and other places)

2023-08-04 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-44680: Summary: parameter markers are not blocked from DEFAULT (and other places) Key: SPARK-44680 URL: https://issues.apache.org/jira/browse/SPARK-44680 Project: Spark

[jira] [Updated] (SPARK-44678) Downgrade Hadoop to 3.3.4

2023-08-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44678: -- Description: There is a community report on S3A committer performance regression. Although

[jira] [Updated] (SPARK-44679) java.lang.OutOfMemoryError: Requested array size exceeds VM limit

2023-08-04 Thread Haitham Eltaweel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haitham Eltaweel updated SPARK-44679: - Language: (was: Python) > java.lang.OutOfMemoryError: Requested array size exceeds VM

[jira] [Created] (SPARK-44679) java.lang.OutOfMemoryError: Requested array size exceeds VM limit

2023-08-04 Thread Haitham Eltaweel (Jira)
Haitham Eltaweel created SPARK-44679: Summary: java.lang.OutOfMemoryError: Requested array size exceeds VM limit Key: SPARK-44679 URL: https://issues.apache.org/jira/browse/SPARK-44679 Project:

[jira] [Created] (SPARK-44678) Downgrade Hadoop to 3.3.4

2023-08-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-44678: - Summary: Downgrade Hadoop to 3.3.4 Key: SPARK-44678 URL: https://issues.apache.org/jira/browse/SPARK-44678 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-44671) Retry ExecutePlan in case initial request didn't reach server in Python client

2023-08-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44671: Assignee: Hyukjin Kwon > Retry ExecutePlan in case initial request didn't reach server

[jira] [Resolved] (SPARK-44671) Retry ExecutePlan in case initial request didn't reach server in Python client

2023-08-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44671. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-44677) Drop legacy Hive-based ORC file format

2023-08-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751148#comment-17751148 ] Dongjoon Hyun commented on SPARK-44677: --- +1. Thank you, [~chengpan]. > Drop legacy Hive-based ORC

[jira] [Created] (SPARK-44677) Drop legacy Hive-based ORC file format

2023-08-04 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-44677: - Summary: Drop legacy Hive-based ORC file format Key: SPARK-44677 URL: https://issues.apache.org/jira/browse/SPARK-44677 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-44672) Fix git ignore rules related to Antlr

2023-08-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44672: - Assignee: Yang Jie > Fix git ignore rules related to Antlr >

[jira] [Resolved] (SPARK-44672) Fix git ignore rules related to Antlr

2023-08-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44672. --- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-44634) Encoders.bean does no longer support nested beans with type arguments

2023-08-04 Thread Giambattista Bloisi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giambattista Bloisi updated SPARK-44634: Description: Hi,   while upgrading a project from spark 2.4.0 to 3.4.1 version,

[jira] [Resolved] (SPARK-44674) Remove `BytecodeUtils` from `graphx` module

2023-08-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44674. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42343

[jira] [Assigned] (SPARK-44674) Remove `BytecodeUtils` from `graphx` module

2023-08-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44674: - Assignee: Yang Jie > Remove `BytecodeUtils` from `graphx` module >

[jira] [Created] (SPARK-44676) Ensure Spark Connect scala client CloseableIterator is closed in all cases where exception could be thrown

2023-08-04 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44676: - Summary: Ensure Spark Connect scala client CloseableIterator is closed in all cases where exception could be thrown Key: SPARK-44676 URL:

[jira] [Assigned] (SPARK-44656) Close dangling iterators in SparkResult too (Spark Connect Scala)

2023-08-04 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-44656: - Assignee: Alice Sayutina > Close dangling iterators in SparkResult too (Spark

[jira] [Resolved] (SPARK-44656) Close dangling iterators in SparkResult too (Spark Connect Scala)

2023-08-04 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44656. --- Fix Version/s: 3.5.0 Resolution: Fixed > Close dangling iterators in

[jira] [Assigned] (SPARK-44675) Increase ReservedCodeCacheSize for release build

2023-08-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44675: --- Assignee: Yuming Wang > Increase ReservedCodeCacheSize for release build >

[jira] [Resolved] (SPARK-44675) Increase ReservedCodeCacheSize for release build

2023-08-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44675. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42344

[jira] [Created] (SPARK-44675) Increase ReservedCodeCacheSize for release build

2023-08-04 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-44675: --- Summary: Increase ReservedCodeCacheSize for release build Key: SPARK-44675 URL: https://issues.apache.org/jira/browse/SPARK-44675 Project: Spark Issue Type:

[jira] [Created] (SPARK-44674) Remove `BytecodeUtils` from `graphx` module

2023-08-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-44674: Summary: Remove `BytecodeUtils` from `graphx` module Key: SPARK-44674 URL: https://issues.apache.org/jira/browse/SPARK-44674 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-44673) Raise a ArrowIOError with empty messages

2023-08-04 Thread Deng An (Jira)
Deng An created SPARK-44673: --- Summary: Raise a ArrowIOError with empty messages Key: SPARK-44673 URL: https://issues.apache.org/jira/browse/SPARK-44673 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-44600) Make `repl` module daily test pass

2023-08-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44600. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42291

[jira] [Assigned] (SPARK-44600) Make `repl` module daily test pass

2023-08-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44600: Assignee: Yang Jie > Make `repl` module daily test pass > -- > >

[jira] [Created] (SPARK-44672) Fix git ignore rules related to Antlr

2023-08-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-44672: Summary: Fix git ignore rules related to Antlr Key: SPARK-44672 URL: https://issues.apache.org/jira/browse/SPARK-44672 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-44666) Uninstall CodeQL/Go/Node in non-container jobs

2023-08-04 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44666. --- Assignee: Ruifeng Zheng Resolution: Resolved > Uninstall CodeQL/Go/Node in

[jira] [Commented] (SPARK-44666) Uninstall CodeQL/Go/Node in non-container jobs

2023-08-04 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750998#comment-17750998 ] Ruifeng Zheng commented on SPARK-44666: --- resolved in https://github.com/apache/spark/pull/42333 >

[jira] [Commented] (SPARK-44070) Bump snappy-java 1.1.10.1

2023-08-04 Thread Anil Poriya (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750985#comment-17750985 ] Anil Poriya commented on SPARK-44070: - [~chengpan] Hi, is there any plan to backport this fix to