[jira] [Assigned] (SPARK-48604) Replace deprecated classes and methods of arrow-vector called in Spark

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48604: -- Assignee: (was: Apache Spark) > Replace deprecated classes and methods of ar

[jira] [Resolved] (SPARK-48543) Track invalid unsafe row exception explicitly as error class

2024-06-13 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-48543. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46885 [https

[jira] [Assigned] (SPARK-48543) Track invalid unsafe row exception explicitly as error class

2024-06-13 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-48543: Assignee: Anish Shrigondekar > Track invalid unsafe row exception explicitly as er

[jira] [Commented] (SPARK-48613) Umbrella: Storage Partition Join Improvements

2024-06-13 Thread Szehon Ho (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854665#comment-17854665 ] Szehon Ho commented on SPARK-48613: --- Adding new umbrella Jira as discussed in [https://github.com

[jira] [Updated] (SPARK-48614) Cleanup deprecated api usage related to kafka-clients

2024-06-13 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48614: Description: (was: There are some deprecated classes and methods in commons-io called in Spark, we

[jira] [Created] (SPARK-48614) Cleanup deprecated api usage related to kafka-clients

2024-06-13 Thread Wei Guo (Jira)
Wei Guo created SPARK-48614: --- Summary: Cleanup deprecated api usage related to kafka-clients Key: SPARK-48614 URL: https://issues.apache.org/jira/browse/SPARK-48614 Project: Spark Issue Type

[jira] [Comment Edited] (SPARK-15041) adding mode strategy for ml.feature.Imputer for categorical features

2024-06-13 Thread Chhavi Bansal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854661#comment-17854661 ] Chhavi Bansal edited comment on SPARK-15041 at 6/13/24 7:43 AM

[jira] [Commented] (SPARK-15041) adding mode strategy for ml.feature.Imputer for categorical features

2024-06-13 Thread Chhavi Bansal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854661#comment-17854661 ] Chhavi Bansal commented on SPARK-15041: --- Are there plans to have imputations for Categorical

[jira] [Created] (SPARK-48613) Umbrella: Storage Partition Join Improvements

2024-06-13 Thread Szehon Ho (Jira)
Szehon Ho created SPARK-48613: - Summary: Umbrella: Storage Partition Join Improvements Key: SPARK-48613 URL: https://issues.apache.org/jira/browse/SPARK-48613 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-48612) Cleanup deprecated api usage related to commons-pool2

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48612: --- Labels: pull-request-available (was: ) > Cleanup deprecated api usage related to comm

[jira] [Created] (SPARK-48612) Cleanup deprecated api usage related to commons-pool2

2024-06-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-48612: Summary: Cleanup deprecated api usage related to commons-pool2 Key: SPARK-48612 URL: https://issues.apache.org/jira/browse/SPARK-48612 Project: Spark Issue Type

[jira] [Resolved] (SPARK-48609) Upgrade `scala-xml` to 2.3

2024-06-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48609. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46964 [https

[jira] [Assigned] (SPARK-48609) Upgrade `scala-xml` to 2.3

2024-06-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-48609: Assignee: BingKun Pan > Upgrade `scala-xml` to

[jira] [Updated] (SPARK-48611) Log TID for input split in HadoopRDD and NewHadoopRDD

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48611: --- Labels: pull-request-available (was: ) > Log TID for input split in Hadoop

[jira] [Updated] (SPARK-48574) Fix support for StructTypes with collations

2024-06-13 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-48574: -- Summary: Fix support for StructTypes with collations (was: Add support

[jira] [Created] (SPARK-48611) Log TID for input split in HadoopRDD and NewHadoopRDD

2024-06-13 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-48611: - Summary: Log TID for input split in HadoopRDD and NewHadoopRDD Key: SPARK-48611 URL: https://issues.apache.org/jira/browse/SPARK-48611 Project: Spark Issue Type

[jira] [Assigned] (SPARK-48602) Make csv generator support different output style with spark.sql.binaryOutputStyle

2024-06-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48602: Assignee: Kent Yao > Make csv generator support different output st

[jira] [Resolved] (SPARK-48602) Make csv generator support different output style with spark.sql.binaryOutputStyle

2024-06-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48602. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46956 [https

[jira] [Assigned] (SPARK-48583) Replace deprecated classes and methods of commons-io called in Spark

2024-06-12 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-48583: Assignee: Wei Guo > Replace deprecated classes and methods of commons-io called in Sp

[jira] [Resolved] (SPARK-48583) Replace deprecated classes and methods of commons-io called in Spark

2024-06-12 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48583. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46935 [https

[jira] [Updated] (SPARK-48610) Remove ExplainUtils.processPlan synchronize

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48610: --- Labels: pull-request-available (was: ) > Remove ExplainUtils.processPlan synchron

[jira] [Created] (SPARK-48610) Remove ExplainUtils.processPlan synchronize

2024-06-12 Thread Ziqi Liu (Jira)
Ziqi Liu created SPARK-48610: Summary: Remove ExplainUtils.processPlan synchronize Key: SPARK-48610 URL: https://issues.apache.org/jira/browse/SPARK-48610 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-48593) Fix the string representation of lambda function

2024-06-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48593. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46948 [https

[jira] [Assigned] (SPARK-48593) Fix the string representation of lambda function

2024-06-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48593: Assignee: Ruifeng Zheng > Fix the string representation of lambda funct

[jira] [Assigned] (SPARK-48421) SPJ: Add documentation

2024-06-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48421: Assignee: Szehon Ho > SPJ: Add documentat

[jira] [Resolved] (SPARK-48421) SPJ: Add documentation

2024-06-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48421. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46745 [https

[jira] [Resolved] (SPARK-48591) Simplify the if-else branches with `F.lit`

2024-06-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48591. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46946 [https

[jira] [Assigned] (SPARK-48591) Simplify the if-else branches with `F.lit`

2024-06-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48591: Assignee: Ruifeng Zheng > Simplify the if-else branches with `F.

[jira] [Assigned] (SPARK-48598) Propagate cached schema in dataframe operations

2024-06-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48598: Assignee: Ruifeng Zheng > Propagate cached schema in dataframe operati

[jira] [Resolved] (SPARK-48598) Propagate cached schema in dataframe operations

2024-06-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48598. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46954 [https

[jira] [Updated] (SPARK-48609) Upgrade `scala-xml` to 2.3

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48609: --- Labels: pull-request-available (was: ) > Upgrade `scala-xml` to

[jira] [Created] (SPARK-48609) Upgrade `scala-xml` to 2.3

2024-06-12 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48609: --- Summary: Upgrade `scala-xml` to 2.3 Key: SPARK-48609 URL: https://issues.apache.org/jira/browse/SPARK-48609 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-48589) Add option snapshotStartBatchId and snapshotPartitionId to state data source

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48589: --- Labels: pull-request-available (was: ) > Add option snapshotStartBatc

[jira] [Resolved] (SPARK-48607) Support more types of expressions in VALUES lists

2024-06-12 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel resolved SPARK-48607. Resolution: Duplicate > Support more types of expressions in VALUES li

[jira] [Updated] (SPARK-48608) Spark 3.5: fails to build with value defaultValueNotConstantError is not a member of object org.apache.spark.sql.errors.QueryCompilationErrors

2024-06-12 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-48608: -- Priority: Blocker (was: Major) > Spark 3.5: fails to build with va

[jira] [Created] (SPARK-48608) Spark 3.5: fails to build with value defaultValueNotConstantError is not a member of object org.apache.spark.sql.errors.QueryCompilationErrors

2024-06-12 Thread Thomas Graves (Jira)
: https://issues.apache.org/jira/browse/SPARK-48608 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 3.5.2 Reporter: Thomas Graves PR [https://github.com/apache/spark/pull/46594] seems to have broken the Spark 3.5 build

[jira] [Created] (SPARK-48607) Support more types of expressions in VALUES lists

2024-06-12 Thread Daniel (Jira)
Daniel created SPARK-48607: -- Summary: Support more types of expressions in VALUES lists Key: SPARK-48607 URL: https://issues.apache.org/jira/browse/SPARK-48607 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-48606) Upgrade `google-java-format` to 1.22.0

2024-06-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48606. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-48606) Upgrade `google-java-format` to 1.22.0

2024-06-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48606: - Assignee: Dongjoon Hyun > Upgrade `google-java-format` to 1.2

[jira] [Updated] (SPARK-48606) Upgrade `google-java-format` to 1.22.0

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48606: --- Labels: pull-request-available (was: ) > Upgrade `google-java-format` to 1.2

[jira] [Created] (SPARK-48606) Upgrade `google-java-format` to 1.22.0

2024-06-12 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-48606: - Summary: Upgrade `google-java-format` to 1.22.0 Key: SPARK-48606 URL: https://issues.apache.org/jira/browse/SPARK-48606 Project: Spark Issue Type

[jira] [Updated] (SPARK-48605) UI display driver thread first on the thread dump page

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48605: --- Labels: pull-request-available (was: ) > UI display driver thread first on the thread d

[jira] [Created] (SPARK-48605) UI display driver thread first on the thread dump page

2024-06-12 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-48605: - Summary: UI display driver thread first on the thread dump page Key: SPARK-48605 URL: https://issues.apache.org/jira/browse/SPARK-48605 Project: Spark Issue Type

[jira] [Created] (SPARK-48604) Replace deprecated classes and methods of arrow-vector called in Spark

2024-06-12 Thread Wei Guo (Jira)
Wei Guo created SPARK-48604: --- Summary: Replace deprecated classes and methods of arrow-vector called in Spark Key: SPARK-48604 URL: https://issues.apache.org/jira/browse/SPARK-48604 Project: Spark

[jira] [Updated] (SPARK-48604) Replace deprecated classes and methods of arrow-vector called in Spark

2024-06-12 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48604: Description: There are some deprecated classes and methods in arrow-vector called in Spark, we need

[jira] [Updated] (SPARK-48603) Update *ParquetReadSchemaSuite to cover type widen capability

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48603: --- Labels: pull-request-available (was: ) > Update *ParquetReadSchemaSuite to cover t

[jira] [Created] (SPARK-48603) Update *ParquetReadSchemaSuite to cover type widen capability

2024-06-12 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-48603: - Summary: Update *ParquetReadSchemaSuite to cover type widen capability Key: SPARK-48603 URL: https://issues.apache.org/jira/browse/SPARK-48603 Project: Spark

[jira] [Resolved] (SPARK-48596) Perf improvement for calculating hex string for long

2024-06-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48596. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46952 [https

[jira] [Assigned] (SPARK-48596) Perf improvement for calculating hex string for long

2024-06-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48596: Assignee: Kent Yao > Perf improvement for calculating hex string for l

[jira] [Updated] (SPARK-48602) Make csv generator support different output style with spark.sql.binaryOutputStyle

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48602: --- Labels: pull-request-available (was: ) > Make csv generator support different output st

[jira] [Created] (SPARK-48602) Make csv generator support different output style with spark.sql.binaryOutputStyle

2024-06-12 Thread Kent Yao (Jira)
Kent Yao created SPARK-48602: Summary: Make csv generator support different output style with spark.sql.binaryOutputStyle Key: SPARK-48602 URL: https://issues.apache.org/jira/browse/SPARK-48602 Project

[jira] [Updated] (SPARK-48600) Fix Lag expression implicit casting

2024-06-12 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-48600: -- Description: Expression walker found the error of Lag expression not behaving

[jira] [Created] (SPARK-48600) Fix Lag expression implicit casting

2024-06-12 Thread Mihailo Milosevic (Jira)
Mihailo Milosevic created SPARK-48600: - Summary: Fix Lag expression implicit casting Key: SPARK-48600 URL: https://issues.apache.org/jira/browse/SPARK-48600 Project: Spark Issue Type

[jira] [Created] (SPARK-48599) OIDC support for Spark

2024-06-12 Thread Yeachan Park (Jira)
Yeachan Park created SPARK-48599: Summary: OIDC support for Spark Key: SPARK-48599 URL: https://issues.apache.org/jira/browse/SPARK-48599 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-48342) [M0] Parser support

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48342: -- Assignee: (was: Apache Spark) > [M0] Parser supp

[jira] [Assigned] (SPARK-48342) [M0] Parser support

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48342: -- Assignee: Apache Spark > [M0] Parser supp

[jira] [Resolved] (SPARK-48595) Cleanup deprecated api usage related to commons-compress

2024-06-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48595. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46950 [https

[jira] [Assigned] (SPARK-48595) Cleanup deprecated api usage related to commons-compress

2024-06-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48595: Assignee: Yang Jie > Cleanup deprecated api usage related to commons-compr

[jira] [Resolved] (SPARK-48584) Perf improvement for unescapePathName

2024-06-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48584. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46938 [https

[jira] [Updated] (SPARK-48583) Replace deprecated classes and methods of commons-io called in Spark

2024-06-12 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48583: Summary: Replace deprecated classes and methods of commons-io called in Spark (was: Replace deprecated

[jira] [Updated] (SPARK-48583) Replace deprecated classes and methods of `commons-io` called in Spark

2024-06-12 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48583: Description: There are some deprecated classes and methods in commons-io called in Spark, we need

[jira] [Updated] (SPARK-48583) Replace deprecated classes and methods of `commons-io` called in Spark

2024-06-12 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48583: Description: There are some deprecated classes and methods in `commons-io` called in Spark, we need

[jira] [Updated] (SPARK-48583) Replace deprecated classes and methods of `commons-io` called in Spark

2024-06-12 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48583: Description: There are some deprecated classes and methods in `commons-io` called in Spark, we need

[jira] [Updated] (SPARK-48583) Replace deprecated classes and methods of `commons-io` called in Spark

2024-06-12 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48583: Summary: Replace deprecated classes and methods of `commons-io` called in Spark (was: Replace deprecated

[jira] [Updated] (SPARK-48598) Propagate cached schema in dataframe operations

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48598: --- Labels: pull-request-available (was: ) > Propagate cached schema in dataframe operati

[jira] [Updated] (SPARK-48597) Distinguish the streaming nodes from the text representation of logical plan

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48597: --- Labels: pull-request-available (was: ) > Distinguish the streaming nodes from the t

[jira] [Created] (SPARK-48598) Propagate cached schema in dataframe operations

2024-06-12 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-48598: - Summary: Propagate cached schema in dataframe operations Key: SPARK-48598 URL: https://issues.apache.org/jira/browse/SPARK-48598 Project: Spark Issue Type

[jira] [Resolved] (SPARK-48581) Upgrade dropwizard metrics to 4.2.26

2024-06-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48581. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46932 [https

[jira] [Created] (SPARK-48597) Distinguish the streaming nodes from the text representation of logical plan

2024-06-12 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-48597: Summary: Distinguish the streaming nodes from the text representation of logical plan Key: SPARK-48597 URL: https://issues.apache.org/jira/browse/SPARK-48597 Project

[jira] [Commented] (SPARK-48597) Distinguish the streaming nodes from the text representation of logical plan

2024-06-12 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854291#comment-17854291 ] Jungtaek Lim commented on SPARK-48597: -- Will submit a PR sooner. > Distinguish the streaming no

[jira] [Updated] (SPARK-48596) Perf improvement for calculating hex string for long

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48596: --- Labels: pull-request-available (was: ) > Perf improvement for calculating hex str

[jira] [Created] (SPARK-48596) Perf improvement for calculating hex string for long

2024-06-12 Thread Kent Yao (Jira)
Kent Yao created SPARK-48596: Summary: Perf improvement for calculating hex string for long Key: SPARK-48596 URL: https://issues.apache.org/jira/browse/SPARK-48596 Project: Spark Issue Type

[jira] [Updated] (SPARK-48595) Cleanup deprecated api usage related to commons-compress

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48595: --- Labels: pull-request-available (was: ) > Cleanup deprecated api usage related to comm

[jira] [Created] (SPARK-48595) Cleanup deprecated api usage related to commons-compress

2024-06-11 Thread Yang Jie (Jira)
Yang Jie created SPARK-48595: Summary: Cleanup deprecated api usage related to commons-compress Key: SPARK-48595 URL: https://issues.apache.org/jira/browse/SPARK-48595 Project: Spark Issue Type

[jira] [Resolved] (SPARK-48411) Add E2E test for DropDuplicateWithinWatermark

2024-06-11 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-48411. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46740 [https

[jira] [Assigned] (SPARK-48411) Add E2E test for DropDuplicateWithinWatermark

2024-06-11 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-48411: Assignee: Yuchen Liu > Add E2E test for DropDuplicateWithinWaterm

[jira] [Commented] (SPARK-48562) Writing to JDBC Temporary View Failed

2024-06-11 Thread Junqing Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854223#comment-17854223 ] Junqing Li commented on SPARK-48562: Thanks for your reply. Since we do not restrict writes to views

[jira] [Assigned] (SPARK-48582) Bump `braces` from 3.0.2 to 3.0.3 in /ui-test

2024-06-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48582: Assignee: Yang Jie > Bump `braces` from 3.0.2 to 3.0.3 in /ui-t

[jira] [Resolved] (SPARK-48582) Bump `braces` from 3.0.2 to 3.0.3 in /ui-test

2024-06-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48582. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46933 [https

[jira] [Updated] (SPARK-48594) Rename `parent` field to `child` in `ColumnAlias`

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48594: --- Labels: pull-request-available (was: ) > Rename `parent` field to `child` in `ColumnAl

[jira] [Updated] (SPARK-48593) Fix the string representation of lambda function

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48593: --- Labels: pull-request-available (was: ) > Fix the string representation of lambda funct

[jira] [Created] (SPARK-48593) Fix the string representation of lambda function

2024-06-11 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-48593: - Summary: Fix the string representation of lambda function Key: SPARK-48593 URL: https://issues.apache.org/jira/browse/SPARK-48593 Project: Spark Issue

[jira] [Updated] (SPARK-48592) Add scala style check for logging message inline variables

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48592: --- Labels: pull-request-available (was: ) > Add scala style check for logging message inl

[jira] [Created] (SPARK-48592) Add scala style check for logging message inline variables

2024-06-11 Thread Amanda Liu (Jira)
Amanda Liu created SPARK-48592: -- Summary: Add scala style check for logging message inline variables Key: SPARK-48592 URL: https://issues.apache.org/jira/browse/SPARK-48592 Project: Spark Issue

[jira] [Commented] (SPARK-48463) MLLib function unable to handle nested data

2024-06-11 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854214#comment-17854214 ] Weichen Xu commented on SPARK-48463: ah got it. then it is not supported :)    as a workaround, I

[jira] [Updated] (SPARK-48591) Simplify the if-else branches with `F.lit`

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48591: --- Labels: pull-request-available (was: ) > Simplify the if-else branches with `F.

[jira] [Created] (SPARK-48591) Simplify the if-else branches with `F.lit`

2024-06-11 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-48591: - Summary: Simplify the if-else branches with `F.lit` Key: SPARK-48591 URL: https://issues.apache.org/jira/browse/SPARK-48591 Project: Spark Issue Type

[jira] [Commented] (SPARK-47193) Converting dataframe to rdd results in data loss

2024-06-11 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854211#comment-17854211 ] Bruce Robbins commented on SPARK-47193: --- I took a look at this today. This issue happens even

[jira] [Updated] (SPARK-48590) Upgrade netty to `4.1.111.Final`

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48590: --- Labels: pull-request-available (was: ) > Upgrade netty to `4.1.111.Fi

[jira] [Created] (SPARK-48590) Upgrade netty to `4.1.111.Final`

2024-06-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48590: --- Summary: Upgrade netty to `4.1.111.Final` Key: SPARK-48590 URL: https://issues.apache.org/jira/browse/SPARK-48590 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-48588) Fine-grained State Data Source

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48588: --- Labels: pull-request-available (was: ) > Fine-grained State Data Sou

[jira] [Created] (SPARK-48589) Add option snapshotStartBatchId and snapshotPartitionId to state data source

2024-06-11 Thread Yuchen Liu (Jira)
Yuchen Liu created SPARK-48589: -- Summary: Add option snapshotStartBatchId and snapshotPartitionId to state data source Key: SPARK-48589 URL: https://issues.apache.org/jira/browse/SPARK-48589 Project

[jira] [Commented] (SPARK-24497) ANSI SQL: Recursive query

2024-06-11 Thread Jonathan Boarman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854182#comment-17854182 ] Jonathan Boarman commented on SPARK-24497: -- There's a lot of folks wondering when this will get

[jira] [Commented] (SPARK-31561) Add QUALIFY Clause

2024-06-11 Thread Jonathan Boarman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854181#comment-17854181 ] Jonathan Boarman commented on SPARK-31561: -- How do we revive this PR and add reviewers to get

[jira] [Created] (SPARK-48588) Fine-grained State Data Source

2024-06-11 Thread Yuchen Liu (Jira)
Yuchen Liu created SPARK-48588: -- Summary: Fine-grained State Data Source Key: SPARK-48588 URL: https://issues.apache.org/jira/browse/SPARK-48588 Project: Spark Issue Type: Epic

[jira] [Updated] (SPARK-48572) Fix DateSub, DateAdd, WindowTime, TimeWindow and SessionWindow expressions

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48572: --- Labels: pull-request-available (was: ) > Fix DateSub, DateAdd, WindowTime, TimeWin

[jira] [Comment Edited] (SPARK-48463) MLLib function unable to handle nested data

2024-06-11 Thread Chhavi Bansal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854153#comment-17854153 ] Chhavi Bansal edited comment on SPARK-48463 at 6/11/24 6:32 PM

[jira] [Commented] (SPARK-48463) MLLib function unable to handle nested data

2024-06-11 Thread Chhavi Bansal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854153#comment-17854153 ] Chhavi Bansal commented on SPARK-48463: --- [~weichenxu123] I tried using  {code:java} new

[jira] [Updated] (SPARK-48586) Remove lock contention between maintenance and task threads

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48586: --- Labels: pull-request-available (was: ) > Remove lock contention between maintena

[jira] [Updated] (SPARK-33152) SPIP: Constraint Propagation code causes OOM issues or increasing compilation time to hours

2024-06-11 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-33152: - Labels: SPIP pull-request-available (was: SPIP) > SPIP: Constraint Propagation code causes OOM iss

<    1   2   3   4   5   6   7   8   9   10   >