[jira] [Resolved] (SPARK-38283) Test invalid datetime parsing under ANSI mode

2022-02-22 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-38283. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35606

[jira] [Commented] (SPARK-32838) Connot insert overwite different partition with same table

2022-02-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496023#comment-17496023 ] Apache Spark commented on SPARK-32838: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-38115) No spark conf to control the path of _temporary when writing to target filesystem

2022-02-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496022#comment-17496022 ] Steve Loughran commented on SPARK-38115: bq. Is there any config as such to stop using

[jira] [Commented] (SPARK-36060) Support backing off dynamic allocation increases if resources are "stuck"

2022-02-22 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495987#comment-17495987 ] Yikun Jiang commented on SPARK-36060: - Yep, agree with [~wwei] . it can be also resolved by [queue

[jira] [Resolved] (SPARK-38278) Add SparkContext.addArchive in PySpark

2022-02-22 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-38278. Assignee: Hyukjin Kwon Resolution: Fixed Issue resolved in

[jira] [Updated] (SPARK-38278) Add SparkContext.addArchive in PySpark

2022-02-22 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-38278: --- Fix Version/s: 3.3.0 > Add SparkContext.addArchive in PySpark >

[jira] [Resolved] (SPARK-36593) [Deprecated] Support the Volcano Job API

2022-02-22 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-36593. - Resolution: Abandoned > [Deprecated] Support the Volcano Job API >

[jira] [Updated] (SPARK-38271) PoissonSampler may output more rows than MaxRows

2022-02-22 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-38271: - Summary: PoissonSampler may output more rows than MaxRows (was: PoissonSampler may generate

[jira] [Assigned] (SPARK-38284) Add the TIMESTAMPDIFF() function

2022-02-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38284: Assignee: Max Gekk (was: Apache Spark) > Add the TIMESTAMPDIFF() function >

[jira] [Commented] (SPARK-38284) Add the TIMESTAMPDIFF() function

2022-02-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495973#comment-17495973 ] Apache Spark commented on SPARK-38284: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-38284) Add the TIMESTAMPDIFF() function

2022-02-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495972#comment-17495972 ] Apache Spark commented on SPARK-38284: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38284) Add the TIMESTAMPDIFF() function

2022-02-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38284: Assignee: Apache Spark (was: Max Gekk) > Add the TIMESTAMPDIFF() function >

[jira] [Updated] (SPARK-38285) ClassCastException: GenericArrayData cannot be cast to InternalRow

2022-02-22 Thread Alessandro Bacchini (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alessandro Bacchini updated SPARK-38285: Description: The following code with Spark 3.2.1 raises an exception:

[jira] [Created] (SPARK-38285) ClassCastException: GenericArrayData cannot be cast to InternalRow

2022-02-22 Thread Alessandro Bacchini (Jira)
Alessandro Bacchini created SPARK-38285: --- Summary: ClassCastException: GenericArrayData cannot be cast to InternalRow Key: SPARK-38285 URL: https://issues.apache.org/jira/browse/SPARK-38285

[jira] [Commented] (SPARK-38273) Native memory leak in SparkPlan

2022-02-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495966#comment-17495966 ] Dongjoon Hyun commented on SPARK-38273: --- Yep, I'm working with [~kevin.w.sewell] in order to make

[jira] [Commented] (SPARK-38284) Add the TIMESTAMPDIFF() function

2022-02-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495954#comment-17495954 ] Max Gekk commented on SPARK-38284: -- I am working on this. > Add the TIMESTAMPDIFF() function >

[jira] [Created] (SPARK-38284) Add the TIMESTAMPDIFF() function

2022-02-22 Thread Max Gekk (Jira)
Max Gekk created SPARK-38284: Summary: Add the TIMESTAMPDIFF() function Key: SPARK-38284 URL: https://issues.apache.org/jira/browse/SPARK-38284 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-38195) Add the TIMESTAMPADD() function

2022-02-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38195: - Description: The function TIMESTAMPADD() is a part of the ODBC api and implemented virtually by ALL

<    1   2