[jira] [Commented] (SPARK-31709) Proper base path for location when it is a relative path

[ https://issues.apache.org/jira/browse/SPARK-31709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489528#comment-17489528 ] Apache Spark commented on SPARK-31709: -- User 'bozhang2820' has created a pull request for this

[jira] [Resolved] (SPARK-36145) Remove Python 3.6 support in codebase and CI

[ https://issues.apache.org/jira/browse/SPARK-36145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36145. -- Assignee: Maciej Szymkiewicz Resolution: Done > Remove Python 3.6 support in codebase

[jira] [Commented] (SPARK-38166) Duplicates after task failure in dropDuplicates and repartition

[ https://issues.apache.org/jira/browse/SPARK-38166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489523#comment-17489523 ] Willi Raschkowski commented on SPARK-38166: --- Attaching driver logs: [^driver.log] Notable

[jira] [Updated] (SPARK-38166) Duplicates after task failure in dropDuplicates and repartition

[ https://issues.apache.org/jira/browse/SPARK-38166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Willi Raschkowski updated SPARK-38166: -- Attachment: driver.log > Duplicates after task failure in dropDuplicates and

[jira] [Commented] (SPARK-38139) ml.recommendation.ALS doctests failures

[ https://issues.apache.org/jira/browse/SPARK-38139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489521#comment-17489521 ] zhengruifeng commented on SPARK-38139: -- I think it is ok to adjust the tol in this case >

[jira] [Commented] (SPARK-34160) pyspark.ml.stat.Summarizer should allow sparse vector results

[ https://issues.apache.org/jira/browse/SPARK-34160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489518#comment-17489518 ] zhengruifeng commented on SPARK-34160: -- you can get a sparse vector by calling

[jira] [Resolved] (SPARK-34160) pyspark.ml.stat.Summarizer should allow sparse vector results

[ https://issues.apache.org/jira/browse/SPARK-34160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-34160. -- Resolution: Not A Problem > pyspark.ml.stat.Summarizer should allow sparse vector results >

[jira] [Commented] (SPARK-34452) OneVsRest with GBTClassifier throws InternalCompilerException in 3.1.0

[ https://issues.apache.org/jira/browse/SPARK-34452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489517#comment-17489517 ] zhengruifeng commented on SPARK-34452: -- I can not reproduce this issue in 3.1.2, could you please

[jira] [Created] (SPARK-38166) Duplicates after task failure in dropDuplicates and repartition

Willi Raschkowski created SPARK-38166: - Summary: Duplicates after task failure in dropDuplicates and repartition Key: SPARK-38166 URL: https://issues.apache.org/jira/browse/SPARK-38166 Project:

[jira] [Updated] (SPARK-38165) private classes fail at runtime in scala 2.12.13+

[ https://issues.apache.org/jira/browse/SPARK-38165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Everson updated SPARK-38165: --- Description: h2. reproduction steps {code:java} git clone

[jira] [Updated] (SPARK-38165) private classes fail at runtime in scala 2.12.13+

[ https://issues.apache.org/jira/browse/SPARK-38165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Everson updated SPARK-38165: --- Description: h2. reproduction steps {code:java} git clone

[jira] [Assigned] (SPARK-38164) New SQL function: try_subtract and try_multiply

[ https://issues.apache.org/jira/browse/SPARK-38164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38164: Assignee: Apache Spark (was: Gengliang Wang) > New SQL function: try_subtract and

[jira] [Commented] (SPARK-38164) New SQL function: try_subtract and try_multiply

[ https://issues.apache.org/jira/browse/SPARK-38164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489490#comment-17489490 ] Apache Spark commented on SPARK-38164: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-38164) New SQL function: try_subtract and try_multiply

[ https://issues.apache.org/jira/browse/SPARK-38164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38164: Assignee: Gengliang Wang (was: Apache Spark) > New SQL function: try_subtract and

[jira] [Created] (SPARK-38165) private classes fail at runtime in scala 2.12.13+

Johnny Everson created SPARK-38165: -- Summary: private classes fail at runtime in scala 2.12.13+ Key: SPARK-38165 URL: https://issues.apache.org/jira/browse/SPARK-38165 Project: Spark Issue

[jira] [Created] (SPARK-38164) New SQL function: try_subtract and try_multiply

Gengliang Wang created SPARK-38164: -- Summary: New SQL function: try_subtract and try_multiply Key: SPARK-38164 URL: https://issues.apache.org/jira/browse/SPARK-38164 Project: Spark Issue

[jira] [Created] (SPARK-38163) Preserve the error class of `AnalysisException` while constructing of function builder

Max Gekk created SPARK-38163: Summary: Preserve the error class of `AnalysisException` while constructing of function builder Key: SPARK-38163 URL: https://issues.apache.org/jira/browse/SPARK-38163

[jira] [Commented] (SPARK-38163) Preserve the error class of `AnalysisException` while constructing of function builder

[ https://issues.apache.org/jira/browse/SPARK-38163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489482#comment-17489482 ] Max Gekk commented on SPARK-38163: -- I am working on the fix. > Preserve the error class of

[jira] [Assigned] (SPARK-38160) Shuffle by rand could lead to incorrect answers when ShuffleFetchFailed happend

[ https://issues.apache.org/jira/browse/SPARK-38160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38160: Assignee: (was: Apache Spark) > Shuffle by rand could lead to incorrect answers when

[jira] [Commented] (SPARK-38160) Shuffle by rand could lead to incorrect answers when ShuffleFetchFailed happend

[ https://issues.apache.org/jira/browse/SPARK-38160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489433#comment-17489433 ] Apache Spark commented on SPARK-38160: -- User 'WangGuangxin' has created a pull request for this

[jira] [Assigned] (SPARK-38160) Shuffle by rand could lead to incorrect answers when ShuffleFetchFailed happend

[ https://issues.apache.org/jira/browse/SPARK-38160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38160: Assignee: Apache Spark > Shuffle by rand could lead to incorrect answers when

[jira] [Created] (SPARK-38162) Remove distinct in aggregate if its child is empty

XiDuo You created SPARK-38162: - Summary: Remove distinct in aggregate if its child is empty Key: SPARK-38162 URL: https://issues.apache.org/jira/browse/SPARK-38162 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-37952) Add missing statements to ALTER TABLE document.

[ https://issues.apache.org/jira/browse/SPARK-37952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37952: --- Assignee: Yuto Akutsu > Add missing statements to ALTER TABLE document. >

[jira] [Resolved] (SPARK-37952) Add missing statements to ALTER TABLE document.

[ https://issues.apache.org/jira/browse/SPARK-37952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37952. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35239

[jira] [Created] (SPARK-38161) when clean data hope to spilt one dataframe or dataset to two dataframe

gaokui created SPARK-38161: -- Summary: when clean data hope to spilt one dataframe or dataset to two dataframe Key: SPARK-38161 URL: https://issues.apache.org/jira/browse/SPARK-38161 Project: Spark

[jira] [Assigned] (SPARK-38150) Update comment of RelationConversions

[ https://issues.apache.org/jira/browse/SPARK-38150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38150: --- Assignee: angerszhu > Update comment of RelationConversions >

[jira] [Resolved] (SPARK-38150) Update comment of RelationConversions

[ https://issues.apache.org/jira/browse/SPARK-38150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38150. - Resolution: Fixed Issue resolved by pull request 35453

[jira] [Assigned] (SPARK-38120) HiveExternalCatalog.listPartitions is failing when partition column name is upper case and dot in partition value

[ https://issues.apache.org/jira/browse/SPARK-38120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38120: --- Assignee: Khalid Mammadov > HiveExternalCatalog.listPartitions is failing when partition

[jira] [Resolved] (SPARK-38120) HiveExternalCatalog.listPartitions is failing when partition column name is upper case and dot in partition value

[ https://issues.apache.org/jira/browse/SPARK-38120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38120. - Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-38160) Shuffle by rand could lead to incorrect answers when ShuffleFetchFailed happend

EdisonWang created SPARK-38160: -- Summary: Shuffle by rand could lead to incorrect answers when ShuffleFetchFailed happend Key: SPARK-38160 URL: https://issues.apache.org/jira/browse/SPARK-38160 Project:

[jira] [Assigned] (SPARK-38159) Minor refactor of MetadataAttribute unapply method

[ https://issues.apache.org/jira/browse/SPARK-38159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38159: Assignee: (was: Apache Spark) > Minor refactor of MetadataAttribute unapply method >

[jira] [Assigned] (SPARK-38159) Minor refactor of MetadataAttribute unapply method

[ https://issues.apache.org/jira/browse/SPARK-38159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38159: Assignee: Apache Spark > Minor refactor of MetadataAttribute unapply method >

[jira] [Commented] (SPARK-38159) Minor refactor of MetadataAttribute unapply method

[ https://issues.apache.org/jira/browse/SPARK-38159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489359#comment-17489359 ] Apache Spark commented on SPARK-38159: -- User 'Yaohua628' has created a pull request for this issue:

[jira] [Created] (SPARK-38159) Minor refactor of MetadataAttribute unapply method

Yaohua Zhao created SPARK-38159: --- Summary: Minor refactor of MetadataAttribute unapply method Key: SPARK-38159 URL: https://issues.apache.org/jira/browse/SPARK-38159 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-37770) Performance improvements for ColumnVector `putByteArray`

[ https://issues.apache.org/jira/browse/SPARK-37770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaohua Zhao resolved SPARK-37770. - Resolution: Fixed > Performance improvements for ColumnVector `putByteArray` >

[jira] [Resolved] (SPARK-38056) Structured streaming not working in history server when using LevelDB

[ https://issues.apache.org/jira/browse/SPARK-38056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-38056. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35356

[jira] [Assigned] (SPARK-38056) Structured streaming not working in history server when using LevelDB

[ https://issues.apache.org/jira/browse/SPARK-38056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-38056: Assignee: wy > Structured streaming not working in history server when using LevelDB >

<    1   2