[jira] (SPARK-44050) Unable to Mount ConfigMap in Driver Pod - ConfigMap Creation Issue

[ https://issues.apache.org/jira/browse/SPARK-44050 ] Harshwardhan Singh Dodiya deleted comment on SPARK-44050: --- was (Author: JIRAUSER300640): !image-2023-06-14-11-07-36-960.png! > Unable to Mount ConfigMap in Driver Pod -

[jira] [Commented] (SPARK-44050) Unable to Mount ConfigMap in Driver Pod - ConfigMap Creation Issue

[ https://issues.apache.org/jira/browse/SPARK-44050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732373#comment-17732373 ] Harshwardhan Singh Dodiya commented on SPARK-44050: ---

[jira] [Updated] (SPARK-44050) Unable to Mount ConfigMap in Driver Pod - ConfigMap Creation Issue

[ https://issues.apache.org/jira/browse/SPARK-44050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harshwardhan Singh Dodiya updated SPARK-44050: -- Attachment: image-2023-06-14-11-07-36-960.png > Unable to Mount

[jira] [Created] (SPARK-44050) Unable to Mount ConfigMap in Driver Pod - ConfigMap Creation Issue

Harshwardhan Singh Dodiya created SPARK-44050: - Summary: Unable to Mount ConfigMap in Driver Pod - ConfigMap Creation Issue Key: SPARK-44050 URL: https://issues.apache.org/jira/browse/SPARK-44050

[jira] [Commented] (SPARK-44048) Remove sql-migration-old.md

[ https://issues.apache.org/jira/browse/SPARK-44048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732353#comment-17732353 ] Snoot.io commented on SPARK-44048: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-43932) Add current_* functions to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732352#comment-17732352 ] Snoot.io commented on SPARK-43932: -- User 'zhengruifeng' has created a pull request for this issue:

[jira] [Commented] (SPARK-44045) Mark `WholeStageCodegenSparkSubmitSuite` as `ExtendedSQLTest`

[ https://issues.apache.org/jira/browse/SPARK-44045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732351#comment-17732351 ] Snoot.io commented on SPARK-44045: -- User 'dongjoon-hyun' has created a pull request for this issue:

[jira] [Resolved] (SPARK-43932) Add current_* functions to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43932. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41516

[jira] [Assigned] (SPARK-43932) Add current_* functions to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43932: - Assignee: Ruifeng Zheng > Add current_* functions to Scala and Python >

[jira] [Resolved] (SPARK-43981) Basic saving / loading implementation

[ https://issues.apache.org/jira/browse/SPARK-43981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-43981. Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41478

[jira] [Commented] (SPARK-43655) Enable NamespaceParityTests.test_get_index_map

[ https://issues.apache.org/jira/browse/SPARK-43655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732348#comment-17732348 ] Snoot.io commented on SPARK-43655: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-43654) Enable InternalFrameParityTests.test_from_pandas

[ https://issues.apache.org/jira/browse/SPARK-43654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732347#comment-17732347 ] Snoot.io commented on SPARK-43654: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-43655) Enable NamespaceParityTests.test_get_index_map

[ https://issues.apache.org/jira/browse/SPARK-43655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732346#comment-17732346 ] Snoot.io commented on SPARK-43655: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-43654) Enable InternalFrameParityTests.test_from_pandas

[ https://issues.apache.org/jira/browse/SPARK-43654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732345#comment-17732345 ] Snoot.io commented on SPARK-43654: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-43474) Add support to create DataFrame Reference in Spark connect

[ https://issues.apache.org/jira/browse/SPARK-43474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732344#comment-17732344 ] Snoot.io commented on SPARK-43474: -- User 'rangadi' has created a pull request for this issue:

[jira] [Commented] (SPARK-44049) Fix KubernetesSuite to use `inNamespace` for validating driver pod cleanup

[ https://issues.apache.org/jira/browse/SPARK-44049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732341#comment-17732341 ] Snoot.io commented on SPARK-44049: -- User 'dongjoon-hyun' has created a pull request for this issue:

[jira] [Commented] (SPARK-44049) Fix KubernetesSuite to use `inNamespace` for validating driver pod cleanup

[ https://issues.apache.org/jira/browse/SPARK-44049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732342#comment-17732342 ] Snoot.io commented on SPARK-44049: -- User 'dongjoon-hyun' has created a pull request for this issue:

[jira] [Created] (SPARK-44049) Fix KubernetesSuite to use `inNamespace` for validating driver pod cleanup

Dongjoon Hyun created SPARK-44049: - Summary: Fix KubernetesSuite to use `inNamespace` for validating driver pod cleanup Key: SPARK-44049 URL: https://issues.apache.org/jira/browse/SPARK-44049

[jira] [Assigned] (SPARK-43622) Enable pyspark.pandas.spark.functions.var in Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43622: - Assignee: Ruifeng Zheng > Enable pyspark.pandas.spark.functions.var in Spark Connect.

[jira] [Assigned] (SPARK-43663) Enable SeriesParityTests.test_compare

[ https://issues.apache.org/jira/browse/SPARK-43663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43663: - Assignee: Haejoon Lee > Enable SeriesParityTests.test_compare >

[jira] [Resolved] (SPARK-43663) Enable SeriesParityTests.test_compare

[ https://issues.apache.org/jira/browse/SPARK-43663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43663. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41567

[jira] [Commented] (SPARK-44048) Remove sql-migration-old.md

[ https://issues.apache.org/jira/browse/SPARK-44048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732336#comment-17732336 ] Yuming Wang commented on SPARK-44048: - https://github.com/apache/spark/pull/41583 > Remove

[jira] [Created] (SPARK-44048) Remove sql-migration-old.md

Yuming Wang created SPARK-44048: --- Summary: Remove sql-migration-old.md Key: SPARK-44048 URL: https://issues.apache.org/jira/browse/SPARK-44048 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-43486) number of files read is incorrect if it is bucket table

[ https://issues.apache.org/jira/browse/SPARK-43486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732320#comment-17732320 ] Jia Fan commented on SPARK-43486: - I didn't reproduce it too.:( > number of files read is incorrect if

[jira] [Updated] (SPARK-44021) Add spark.sql.files.maxPartitionNum

[ https://issues.apache.org/jira/browse/SPARK-44021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44021: -- Summary: Add spark.sql.files.maxPartitionNum (was: Add a config to make it do not generate

[jira] [Assigned] (SPARK-44021) Add a config to make it do not generate too many partitions

[ https://issues.apache.org/jira/browse/SPARK-44021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44021: - Assignee: Yuming Wang > Add a config to make it do not generate too many partitions >

[jira] [Resolved] (SPARK-44021) Add a config to make it do not generate too many partitions

[ https://issues.apache.org/jira/browse/SPARK-44021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44021. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41545

[jira] [Created] (SPARK-44047) Upgrade google guava for connect from 31.0.1-jre to 32.0.1-jre

BingKun Pan created SPARK-44047: --- Summary: Upgrade google guava for connect from 31.0.1-jre to 32.0.1-jre Key: SPARK-44047 URL: https://issues.apache.org/jira/browse/SPARK-44047 Project: Spark

[jira] [Commented] (SPARK-43486) number of files read is incorrect if it is bucket table

[ https://issues.apache.org/jira/browse/SPARK-43486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732308#comment-17732308 ] BingKun Pan commented on SPARK-43486: - Sorry, I didn't reproduce it. > number of files read is

[jira] [Assigned] (SPARK-43934) Add regexp_* functions to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43934: - Assignee: jiaan.geng > Add regexp_* functions to Scala and Python >

[jira] [Resolved] (SPARK-43934) Add regexp_* functions to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43934. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41515

[jira] [Assigned] (SPARK-43691) Enable NumOpsParityTests.test_ne.

[ https://issues.apache.org/jira/browse/SPARK-43691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43691: Assignee: Haejoon Lee > Enable NumOpsParityTests.test_ne. >

[jira] [Assigned] (SPARK-43684) Fix NullOps.eq to work with Spark Connect Column.

[ https://issues.apache.org/jira/browse/SPARK-43684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43684: Assignee: Haejoon Lee > Fix NullOps.eq to work with Spark Connect Column. >

[jira] [Resolved] (SPARK-43684) Fix NullOps.eq to work with Spark Connect Column.

[ https://issues.apache.org/jira/browse/SPARK-43684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43684. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41514

[jira] [Resolved] (SPARK-43691) Enable NumOpsParityTests.test_ne.

[ https://issues.apache.org/jira/browse/SPARK-43691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43691. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41514

[jira] [Resolved] (SPARK-43686) Enable NumOpsParityTests.test_eq

[ https://issues.apache.org/jira/browse/SPARK-43686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43686. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41514

[jira] [Assigned] (SPARK-43685) Fix NullOps.ne to work with Spark Connect Column.

[ https://issues.apache.org/jira/browse/SPARK-43685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43685: Assignee: Haejoon Lee > Fix NullOps.ne to work with Spark Connect Column. >

[jira] [Resolved] (SPARK-43685) Fix NullOps.ne to work with Spark Connect Column.

[ https://issues.apache.org/jira/browse/SPARK-43685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43685. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41514

[jira] [Assigned] (SPARK-43686) Enable NumOpsParityTests.test_eq

[ https://issues.apache.org/jira/browse/SPARK-43686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43686: Assignee: Haejoon Lee > Enable NumOpsParityTests.test_eq >

[jira] [Created] (SPARK-44046) Pyspark StreamingQueryListener listListener

Wei Liu created SPARK-44046: --- Summary: Pyspark StreamingQueryListener listListener Key: SPARK-44046 URL: https://issues.apache.org/jira/browse/SPARK-44046 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-43922) Add named argument support in parser for function call

[ https://issues.apache.org/jira/browse/SPARK-43922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732290#comment-17732290 ] Hudson commented on SPARK-43922: User 'learningchess2003' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38162) Optimize one row plan in normal and AQE Optimizer

[ https://issues.apache.org/jira/browse/SPARK-38162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-38162: --- Assignee: XiDuo You > Optimize one row plan in normal and AQE Optimizer >

[jira] [Assigned] (SPARK-44045) Mark `WholeStageCodegenSparkSubmitSuite` as `ExtendedSQLTest`

[ https://issues.apache.org/jira/browse/SPARK-44045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44045: - Assignee: Dongjoon Hyun > Mark `WholeStageCodegenSparkSubmitSuite` as

[jira] [Resolved] (SPARK-44045) Mark `WholeStageCodegenSparkSubmitSuite` as `ExtendedSQLTest`

[ https://issues.apache.org/jira/browse/SPARK-44045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44045. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41579

[jira] [Created] (SPARK-44045) Mark `WholeStageCodegenSparkSubmitSuite` as `ExtendedSQLTest`

Dongjoon Hyun created SPARK-44045: - Summary: Mark `WholeStageCodegenSparkSubmitSuite` as `ExtendedSQLTest` Key: SPARK-44045 URL: https://issues.apache.org/jira/browse/SPARK-44045 Project: Spark

[jira] [Commented] (SPARK-44041) Upgrade ammonite to 2.5.9

[ https://issues.apache.org/jira/browse/SPARK-44041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732236#comment-17732236 ] Dongjoon Hyun commented on SPARK-44041: --- Feel free to ping me when you make a PR~ I'm highly

[jira] [Commented] (SPARK-44044) Improve Error message for SQL Window functions

[ https://issues.apache.org/jira/browse/SPARK-44044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732218#comment-17732218 ] Siying Dong commented on SPARK-44044: - OSS PR created: [https://github.com/apache/spark/pull/41578/]

[jira] [Created] (SPARK-44044) Improve Error message for SQL Window functions

Siying Dong created SPARK-44044: --- Summary: Improve Error message for SQL Window functions Key: SPARK-44044 URL: https://issues.apache.org/jira/browse/SPARK-44044 Project: Spark Issue Type:

[jira] [Commented] (SPARK-44018) Improve the hashCode for Some DS V2 Expression

[ https://issues.apache.org/jira/browse/SPARK-44018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732189#comment-17732189 ] Dongjoon Hyun commented on SPARK-44018: --- It seems that I'm confused. "Improve XXX" means this is

[jira] [Commented] (SPARK-44018) Improve the hashCode for Some DS V2 Expression

[ https://issues.apache.org/jira/browse/SPARK-44018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732188#comment-17732188 ] Dongjoon Hyun commented on SPARK-44018: --- Hi, [~beliefer]. We need to update `Affected Version` of

[jira] [Created] (SPARK-44043) Reuse main scan exchange in group-based UPDATEs

Anton Okolnychyi created SPARK-44043: Summary: Reuse main scan exchange in group-based UPDATEs Key: SPARK-44043 URL: https://issues.apache.org/jira/browse/SPARK-44043 Project: Spark

[jira] [Updated] (SPARK-44040) Incorrect result after count distinct

[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44040: Affects Version/s: 3.3.2 > Incorrect result after count distinct >

[jira] [Resolved] (SPARK-44016) Artifacts with name as an absolute path may overwrite other files

[ https://issues.apache.org/jira/browse/SPARK-44016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44016. --- Resolution: Fixed > Artifacts with name as an absolute path may overwrite other

[jira] [Commented] (SPARK-44041) Upgrade ammonite to 2.5.9

[ https://issues.apache.org/jira/browse/SPARK-44041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732173#comment-17732173 ] Dongjoon Hyun commented on SPARK-44041: --- Great! Thank you for making this happen, [~LuciferYang]!

[jira] [Commented] (SPARK-44040) Incorrect result after count distinct

[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732170#comment-17732170 ] Yuming Wang commented on SPARK-44040: - https://github.com/apache/spark/pull/41576 > Incorrect

[jira] [Commented] (SPARK-44040) Incorrect result after count distinct

[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732163#comment-17732163 ] Bruce Robbins commented on SPARK-44040: --- It seems this can be reproduced in {{spark-sql}} as well.

[jira] [Commented] (SPARK-44040) Incorrect result after count distinct

[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732159#comment-17732159 ] Yuming Wang commented on SPARK-44040: - Thanks for reporting this bug. We will fix it soon. >

[jira] [Resolved] (SPARK-44028) Upgrade commons-io to 2.13.0

[ https://issues.apache.org/jira/browse/SPARK-44028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44028. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41556

[jira] [Assigned] (SPARK-44028) Upgrade commons-io to 2.13.0

[ https://issues.apache.org/jira/browse/SPARK-44028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44028: - Assignee: Yang Jie > Upgrade commons-io to 2.13.0 > > >

[jira] [Updated] (SPARK-44040) Incorrect result after count distinct

[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44040: Target Version/s: 3.4.1 > Incorrect result after count distinct >

[jira] [Created] (SPARK-44042) SPIP: PySpark Test Framework

Amanda Liu created SPARK-44042: -- Summary: SPIP: PySpark Test Framework Key: SPARK-44042 URL: https://issues.apache.org/jira/browse/SPARK-44042 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-44039) Improve for PlanGenerationTestSuite & ProtoToParsedPlanTestSuite

[ https://issues.apache.org/jira/browse/SPARK-44039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-44039: Description: Improve for PlanGenerationTestSuite & ProtoToParsedPlanTestSuite, include: - When

[jira] [Commented] (SPARK-44041) Upgrade ammonite to 2.5.9

[ https://issues.apache.org/jira/browse/SPARK-44041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732113#comment-17732113 ] Yang Jie commented on SPARK-44041: -- Waiting for can download through Maven   > Upgrade ammonite to

[jira] [Commented] (SPARK-44039) Improve for PlanGenerationTestSuite & ProtoToParsedPlanTestSuite

[ https://issues.apache.org/jira/browse/SPARK-44039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732112#comment-17732112 ] Ignite TC Bot commented on SPARK-44039: --- User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-38477) Use error classes in org.apache.spark.storage

[ https://issues.apache.org/jira/browse/SPARK-38477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732111#comment-17732111 ] Ignite TC Bot commented on SPARK-38477: --- User 'bozhang2820' has created a pull request for this

[jira] [Commented] (SPARK-44041) Upgrade ammonite to 2.5.9

[ https://issues.apache.org/jira/browse/SPARK-44041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732106#comment-17732106 ] Yang Jie commented on SPARK-44041: -- cc [~dongjoon]  > Upgrade ammonite to 2.5.9 >

[jira] [Created] (SPARK-44041) Upgrade ammonite to 2.5.9

Yang Jie created SPARK-44041: Summary: Upgrade ammonite to 2.5.9 Key: SPARK-44041 URL: https://issues.apache.org/jira/browse/SPARK-44041 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-44040) Incorrect result after count distinct

[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandr Aleksandrov updated SPARK-44040: -- Description: When i try to call count after distinct function for Decimal

[jira] [Created] (SPARK-44040) Incorrect result after count distinct

Aleksandr Aleksandrov created SPARK-44040: - Summary: Incorrect result after count distinct Key: SPARK-44040 URL: https://issues.apache.org/jira/browse/SPARK-44040 Project: Spark

[jira] [Commented] (SPARK-43486) number of files read is incorrect if it is bucket table

[ https://issues.apache.org/jira/browse/SPARK-43486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732045#comment-17732045 ] Jia Fan commented on SPARK-43486: - [~panbingkun] Hi, any update for this? > number of files read is

[jira] [Resolved] (SPARK-44036) Cleanup & consolidate tickets to simplify the tasks.

[ https://issues.apache.org/jira/browse/SPARK-44036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44036. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41566

[jira] [Assigned] (SPARK-44036) Cleanup & consolidate tickets to simplify the tasks.

[ https://issues.apache.org/jira/browse/SPARK-44036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44036: Assignee: Haejoon Lee > Cleanup & consolidate tickets to simplify the tasks. >

[jira] [Created] (SPARK-44039) Improve for PlanGenerationTestSuite & ProtoToParsedPlanTestSuite

BingKun Pan created SPARK-44039: --- Summary: Improve for PlanGenerationTestSuite & ProtoToParsedPlanTestSuite Key: SPARK-44039 URL: https://issues.apache.org/jira/browse/SPARK-44039 Project: Spark

[jira] [Commented] (SPARK-43891) Support SHOW VIEWS IN . when not is not the current selected catalog

[ https://issues.apache.org/jira/browse/SPARK-43891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732031#comment-17732031 ] Jia Fan commented on SPARK-43891: - cc [~cloud_fan] [~dongjoon]  > Support SHOW VIEWS IN . when not is

[jira] (SPARK-43891) Support SHOW VIEWS IN . when not is not the current selected catalog

[ https://issues.apache.org/jira/browse/SPARK-43891 ] Jia Fan deleted comment on SPARK-43891: - was (Author: fanjia): I can work for this. > Support SHOW VIEWS IN . when not is not the > current selected catalog >

[jira] [Commented] (SPARK-43891) Support SHOW VIEWS IN . when not is not the current selected catalog

[ https://issues.apache.org/jira/browse/SPARK-43891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732030#comment-17732030 ] Jia Fan commented on SPARK-43891: - Hi [~amaliujia] , I have a question about view, I find Spark add

[jira] [Resolved] (SPARK-44038) Update YuniKorn docs with v1.3

[ https://issues.apache.org/jira/browse/SPARK-44038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44038. --- Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-44038) Update YuniKorn docs with v1.3

[ https://issues.apache.org/jira/browse/SPARK-44038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44038: - Assignee: Dongjoon Hyun > Update YuniKorn docs with v1.3 >

[jira] [Commented] (SPARK-43753) Incorrect result of MINUS in spark sql.

[ https://issues.apache.org/jira/browse/SPARK-43753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732012#comment-17732012 ] Jia Fan commented on SPARK-43753: - Seem already fixed on the master branch. > Incorrect result of MINUS

[jira] [Updated] (SPARK-44038) Update YuniKorn docs with v1.3

[ https://issues.apache.org/jira/browse/SPARK-44038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44038: -- Issue Type: Documentation (was: Improvement) > Update YuniKorn docs with v1.3 >

[jira] [Updated] (SPARK-44038) Update YuniKorn docs with v1.3

[ https://issues.apache.org/jira/browse/SPARK-44038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44038: -- Affects Version/s: 3.4.1 > Update YuniKorn docs with v1.3 > -- >

[jira] [Created] (SPARK-44038) Update YuniKorn docs with v1.3

Dongjoon Hyun created SPARK-44038: - Summary: Update YuniKorn docs with v1.3 Key: SPARK-44038 URL: https://issues.apache.org/jira/browse/SPARK-44038 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-43891) Support SHOW VIEWS IN . when not is not the current selected catalog

[ https://issues.apache.org/jira/browse/SPARK-43891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732006#comment-17732006 ] Jia Fan commented on SPARK-43891: - I can work for this. > Support SHOW VIEWS IN . when not is not the

[jira] [Updated] (SPARK-44037) Add maxCharsPerRow option for CSV datasource

[ https://issues.apache.org/jira/browse/SPARK-44037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Sysolyatin updated SPARK-44037: -- Description: CSV datasource supports maxColumns and maxCharsPerColumn options. But

[jira] [Updated] (SPARK-44037) Add maxCharsPerRow option for CSV datasource

[ https://issues.apache.org/jira/browse/SPARK-44037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Sysolyatin updated SPARK-44037: -- Description: CSV datasource supports maxColumns and maxCharsPerColumn options. But

[jira] [Comment Edited] (SPARK-44018) Improve the hashCode for Some DS V2 Expression

[ https://issues.apache.org/jira/browse/SPARK-44018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17731988#comment-17731988 ] jiaan.geng edited comment on SPARK-44018 at 6/13/23 8:38 AM: -

[jira] [Updated] (SPARK-44037) Add maxCharsPerRow option for CSV datasource

[ https://issues.apache.org/jira/browse/SPARK-44037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Sysolyatin updated SPARK-44037: -- Description: CSV datasource supports maxColumns and maxCharsPerColumn options. But

[jira] [Updated] (SPARK-44037) Add maxCharsPerRow option for CSV datasource

[ https://issues.apache.org/jira/browse/SPARK-44037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Sysolyatin updated SPARK-44037: -- Description: CSV datasource supports maxColumns and maxCharsPerColumn options. But

[jira] [Commented] (SPARK-44018) Improve the hashCode for Some DS V2 Expression

[ https://issues.apache.org/jira/browse/SPARK-44018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17731988#comment-17731988 ] jiaan.geng commented on SPARK-44018: [~dongjoon]Yes. I have created PR for this. > Improve the

[jira] [Created] (SPARK-44037) Add maxCharsPerRow option for CSV datasource

Dmitry Sysolyatin created SPARK-44037: - Summary: Add maxCharsPerRow option for CSV datasource Key: SPARK-44037 URL: https://issues.apache.org/jira/browse/SPARK-44037 Project: Spark Issue

[jira] [Updated] (SPARK-43619) Enable DataFrameSlowParityTests.test_udt

[ https://issues.apache.org/jira/browse/SPARK-43619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43619: Fix Version/s: 3.5.0 > Enable DataFrameSlowParityTests.test_udt >

[jira] [Updated] (SPARK-43661) Enable ReshapeParityTests.test_get_dummies_date_datetime

[ https://issues.apache.org/jira/browse/SPARK-43661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43661: Fix Version/s: 3.5.0 > Enable ReshapeParityTests.test_get_dummies_date_datetime >

[jira] [Resolved] (SPARK-43619) Enable DataFrameSlowParityTests.test_udt

[ https://issues.apache.org/jira/browse/SPARK-43619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43619. - Resolution: Resolved This is contained by SPARK-44036. > Enable

[jira] [Resolved] (SPARK-43661) Enable ReshapeParityTests.test_get_dummies_date_datetime

[ https://issues.apache.org/jira/browse/SPARK-43661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43661. - Resolution: Resolved This is contained by SPARK-44036. > Enable

[jira] [Created] (SPARK-44036) Cleanup & consolidate tickets to simplify the tasks.

Haejoon Lee created SPARK-44036: --- Summary: Cleanup & consolidate tickets to simplify the tasks. Key: SPARK-44036 URL: https://issues.apache.org/jira/browse/SPARK-44036 Project: Spark Issue

[jira] [Resolved] (SPARK-43710) Support functions.date_part for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-43710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43710. - Resolution: Duplicate It's duplicated by SPARK-43705 > Support functions.date_part for Spark

[jira] [Created] (SPARK-44035) Split `pyspark.pandas.tests.connect.test_parity_ops_on_diff_frames_slow`

Ruifeng Zheng created SPARK-44035: - Summary: Split `pyspark.pandas.tests.connect.test_parity_ops_on_diff_frames_slow` Key: SPARK-44035 URL: https://issues.apache.org/jira/browse/SPARK-44035 Project:

[jira] [Resolved] (SPARK-43653) Enable GroupBySlowParityTests.test_split_apply_combine_on_series

[ https://issues.apache.org/jira/browse/SPARK-43653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43653. - Resolution: Duplicate This is duplicated by SPARK-43445 > Enable

[jira] [Resolved] (SPARK-43652) Enable GroupBy.rank with Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-43652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43652. - Resolution: Duplicate This is duplicated by SPARK-43611. > Enable GroupBy.rank with Spark