[jira] [Commented] (SPARK-43291) Match behavior for DataFrame.cov on string DataFrame

[ https://issues.apache.org/jira/browse/SPARK-43291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731449#comment-17731449 ] Haejoon Lee commented on SPARK-43291: - I'm currently doing an analysis of the usage

[jira] [Updated] (SPARK-44025) CSV Table Read Error with CharType(length) column

[ https://issues.apache.org/jira/browse/SPARK-44025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44025: Target Version/s: 3.4.1 > CSV Table Read Error with CharType(length) column >

[jira] [Assigned] (SPARK-43529) Support general expressions as OPTIONS values

[ https://issues.apache.org/jira/browse/SPARK-43529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-43529: -- Assignee: Daniel > Support general expressions as OPTIONS values > -

[jira] [Resolved] (SPARK-43529) Support general expressions as OPTIONS values

[ https://issues.apache.org/jira/browse/SPARK-43529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-43529. Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41191 [https:

[jira] [Commented] (SPARK-44021) Add a config to make it do not generate too many partitions

[ https://issues.apache.org/jira/browse/SPARK-44021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731429#comment-17731429 ] Snoot.io commented on SPARK-44021: -- User 'wangyum' has created a pull request for this

[jira] [Commented] (SPARK-44021) Add a config to make it do not generate too many partitions

[ https://issues.apache.org/jira/browse/SPARK-44021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731428#comment-17731428 ] Snoot.io commented on SPARK-44021: -- User 'wangyum' has created a pull request for this

[jira] [Created] (SPARK-44025) CSV Table Read Error with CharType(length) column

Fengyu Cao created SPARK-44025: -- Summary: CSV Table Read Error with CharType(length) column Key: SPARK-44025 URL: https://issues.apache.org/jira/browse/SPARK-44025 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-32559) Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters correctly

[ https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731425#comment-17731425 ] Snoot.io commented on SPARK-32559: -- User 'Kwafoor' has created a pull request for this

[jira] [Updated] (SPARK-44024) Change to use `map` where `unzip` used to extract a single element

[ https://issues.apache.org/jira/browse/SPARK-44024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44024: - Summary: Change to use `map` where `unzip` used to extract a single element (was: Change to use map wh

[jira] [Updated] (SPARK-44024) Change to use `map` where `unzip` used to extract a single element

[ https://issues.apache.org/jira/browse/SPARK-44024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44024: - Description: For example:   Seq((1, 11), (2, 22)).unzip._1   should change to    Seq((1, 11), (2,

[jira] [Created] (SPARK-44024) Change to use map where unzip used to extract a single element

Yang Jie created SPARK-44024: Summary: Change to use map where unzip used to extract a single element Key: SPARK-44024 URL: https://issues.apache.org/jira/browse/SPARK-44024 Project: Spark Issu

[jira] [Created] (SPARK-44023) Add System.gc at beforeEach in PruneFileSourcePartitionsSuite

Yang Jie created SPARK-44023: Summary: Add System.gc at beforeEach in PruneFileSourcePartitionsSuite Key: SPARK-44023 URL: https://issues.apache.org/jira/browse/SPARK-44023 Project: Spark Issue

[jira] [Updated] (SPARK-44022) Enforce Java max bytecode version to maven dependencies

[ https://issues.apache.org/jira/browse/SPARK-44022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Liang updated SPARK-44022: Description: To enforce Java's max bytecode version to maven dependencies, by using `enforceByteco

[jira] [Updated] (SPARK-44022) Enforce Java max bytecode version to maven dependencies

[ https://issues.apache.org/jira/browse/SPARK-44022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Liang updated SPARK-44022: Description: To enforce Java's max bytecode version to maven dependencies, by using `enforceBytec

[jira] [Created] (SPARK-44022) Enforce Java max bytecode version to maven dependencies

Bowen Liang created SPARK-44022: --- Summary: Enforce Java max bytecode version to maven dependencies Key: SPARK-44022 URL: https://issues.apache.org/jira/browse/SPARK-44022 Project: Spark Issue T

[jira] [Assigned] (SPARK-43617) Enable pyspark.pandas.spark.functions.product in Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43617: - Assignee: Ruifeng Zheng > Enable pyspark.pandas.spark.functions.product in Spark Connec

[jira] [Assigned] (SPARK-43938) Add to_* functions to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43938: - Assignee: BingKun Pan > Add to_* functions to Scala and Python > --

[jira] [Resolved] (SPARK-43938) Add to_* functions to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43938. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41505 [https://

[jira] [Created] (SPARK-44021) Add a config to make it do not generate too many partitions

Yuming Wang created SPARK-44021: --- Summary: Add a config to make it do not generate too many partitions Key: SPARK-44021 URL: https://issues.apache.org/jira/browse/SPARK-44021 Project: Spark Is

[jira] [Resolved] (SPARK-43179) Add option for applications to control saving of metadata in the External Shuffle Service LevelDB

[ https://issues.apache.org/jira/browse/SPARK-43179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-43179. -- Resolution: Fixed Issue resolved by pull request 41502 [https://github.com/apache/spark/pull/4

[jira] [Commented] (SPARK-43942) Add string functions to Scala and Python - part 1

[ https://issues.apache.org/jira/browse/SPARK-43942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731340#comment-17731340 ] BingKun Pan commented on SPARK-43942: - I work on it. > Add string functions to Scal

[jira] [Commented] (SPARK-42290) Spark Driver hangs on OOM during Broadcast when AQE is enabled

[ https://issues.apache.org/jira/browse/SPARK-42290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731331#comment-17731331 ] Jia Fan commented on SPARK-42290: - Thanks [~dongjoon]  > Spark Driver hangs on OOM duri

[jira] [Commented] (SPARK-43926) Add array_agg, array_size, cardinality, count_min_sketch,mask,named_struct,json_* to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731326#comment-17731326 ] Tengfei Huang commented on SPARK-43926: --- I am working on this, will send a PR soon

[jira] [Commented] (SPARK-43438) Fix mismatched column list error on INSERT

[ https://issues.apache.org/jira/browse/SPARK-43438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731321#comment-17731321 ] Max Gekk commented on SPARK-43438: -- [~erico] Would you like to work on this issue? It i

[jira] [Updated] (SPARK-43438) Fix mismatched column list error on INSERT

[ https://issues.apache.org/jira/browse/SPARK-43438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-43438: - Parent: SPARK-37935 Issue Type: Sub-task (was: Improvement) > Fix mismatched column list error

[jira] [Commented] (SPARK-42298) Assign name to _LEGACY_ERROR_TEMP_2132

[ https://issues.apache.org/jira/browse/SPARK-42298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731320#comment-17731320 ] ASF GitHub Bot commented on SPARK-42298: User 'Hisoka-X' has created a pull requ

[jira] [Commented] (SPARK-40637) Spark-shell can correctly encode BINARY type but Spark-sql cannot

[ https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731318#comment-17731318 ] ASF GitHub Bot commented on SPARK-40637: User 'Hisoka-X' has created a pull requ

[jira] [Resolved] (SPARK-43772) Move version configuration in `connect` module to parent

[ https://issues.apache.org/jira/browse/SPARK-43772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-43772. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41295 [https://github.com

[jira] [Assigned] (SPARK-43772) Move version configuration in `connect` module to parent

[ https://issues.apache.org/jira/browse/SPARK-43772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-43772: Assignee: BingKun Pan > Move version configuration in `connect` module to parent > --