[jira] [Resolved] (SPARK-42914) Reuse transformUnregisteredFunction for DistributedSequenceID.

2023-04-02 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-42914. - Fix Version/s: 3.5.0 Resolution: Fixed Resolved

[jira] [Created] (SPARK-43007) Upgrade rocksdbjni to 8.0.0

2023-04-02 Thread Yang Jie (Jira)
Yang Jie created SPARK-43007: Summary: Upgrade rocksdbjni to 8.0.0 Key: SPARK-43007 URL: https://issues.apache.org/jira/browse/SPARK-43007 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42519) Add more WriteTo tests after Scala Client session config is supported

2023-04-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42519: Assignee: Jia Fan > Add more WriteTo tests after Scala Client session config is

[jira] [Updated] (SPARK-42519) Add more WriteTo tests after Scala Client session config is supported

2023-04-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42519: - Fix Version/s: 3.4.1 (was: 3.4.0) > Add more WriteTo tests after Scala

[jira] [Resolved] (SPARK-42519) Add more WriteTo tests after Scala Client session config is supported

2023-04-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42519. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40564

[jira] [Resolved] (SPARK-43004) vendor==vendor typo in ResourceRequest.equals()

2023-04-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-43004. -- Fix Version/s: 3.2.4 3.3.3 3.4.1

[jira] [Commented] (SPARK-43004) vendor==vendor typo in ResourceRequest.equals()

2023-04-02 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707748#comment-17707748 ] Snoot.io commented on SPARK-43004: -- User 'thyecust' has created a pull request for this issue:

[jira] [Updated] (SPARK-43004) vendor==vendor typo in ResourceRequest.equals()

2023-04-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-43004: - Priority: Minor (was: Major) > vendor==vendor typo in ResourceRequest.equals() >

[jira] [Commented] (SPARK-43004) vendor==vendor typo in ResourceRequest.equals()

2023-04-02 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707749#comment-17707749 ] Snoot.io commented on SPARK-43004: -- User 'thyecust' has created a pull request for this issue:

[jira] [Commented] (SPARK-43005) `v is v >= 0` typo in pyspark/pandas/config.py

2023-04-02 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707747#comment-17707747 ] Snoot.io commented on SPARK-43005: -- User 'thyecust' has created a pull request for this issue:

[jira] [Commented] (SPARK-43005) `v is v >= 0` typo in pyspark/pandas/config.py

2023-04-02 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707744#comment-17707744 ] Snoot.io commented on SPARK-43005: -- User 'thyecust' has created a pull request for this issue:

[jira] [Commented] (SPARK-42859) Basic support for pandas API on Spark

2023-04-02 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707746#comment-17707746 ] Snoot.io commented on SPARK-42859: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-43006) self.deserialized == self.deserialized typo in StorageLevel __eq__()

2023-04-02 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707745#comment-17707745 ] Snoot.io commented on SPARK-43006: -- User 'thyecust' has created a pull request for this issue:

[jira] [Commented] (SPARK-43006) self.deserialized == self.deserialized typo in StorageLevel __eq__()

2023-04-02 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707743#comment-17707743 ] Snoot.io commented on SPARK-43006: -- User 'thyecust' has created a pull request for this issue:

[jira] [Created] (SPARK-43006) self.deserialized == self.deserialized typo in StorageLevel __eq__()

2023-04-02 Thread Tian Haoyu (Jira)
Tian Haoyu created SPARK-43006: -- Summary: self.deserialized == self.deserialized typo in StorageLevel __eq__() Key: SPARK-43006 URL: https://issues.apache.org/jira/browse/SPARK-43006 Project: Spark

[jira] [Created] (SPARK-43005) `v is v >= 0` typo in pyspark/pandas/config.py

2023-04-02 Thread Tian Haoyu (Jira)
Tian Haoyu created SPARK-43005: -- Summary: `v is v >= 0` typo in pyspark/pandas/config.py Key: SPARK-43005 URL: https://issues.apache.org/jira/browse/SPARK-43005 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-43004) vendor==vendor typo in ResourceRequest.equals()

2023-04-02 Thread Tian Haoyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tian Haoyu updated SPARK-43004: --- Description: vendor == vendor is always true, this is likely to be a typo. We should fix `vendor

[jira] [Updated] (SPARK-43004) vendor==vendor typo in ResourceRequest.equals()

2023-04-02 Thread Tian Haoyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tian Haoyu updated SPARK-43004: --- Description: `vendor == vendor` is always true, this is likely to be a typo. We should fix `vendor

[jira] [Created] (SPARK-43004) vendor==vendor typo in ResourceRequest.equals()

2023-04-02 Thread Tian Haoyu (Jira)
Tian Haoyu created SPARK-43004: -- Summary: vendor==vendor typo in ResourceRequest.equals() Key: SPARK-43004 URL: https://issues.apache.org/jira/browse/SPARK-43004 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-43003) Enable doctest

2023-04-02 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-43003: --- Summary: Enable doctest Key: SPARK-43003 URL: https://issues.apache.org/jira/browse/SPARK-43003 Project: Spark Issue Type: Sub-task Components:

[jira] [Updated] (SPARK-43002) Modify Yarn Client's application report to reduce noise

2023-04-02 Thread Shreyesh Shaju Arangath (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shreyesh Shaju Arangath updated SPARK-43002: Attachment: Screen Shot 2023-03-14 at 8.49.54 AM.png > Modify Yarn

[jira] [Updated] (SPARK-43002) Modify Yarn Client's application report to reduce noise

2023-04-02 Thread Shreyesh Shaju Arangath (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shreyesh Shaju Arangath updated SPARK-43002: Description: Right now, an application report is generated and loggeds

[jira] [Created] (SPARK-43002) Modify Yarn Client's application report to reduce noise

2023-04-02 Thread Shreyesh Shaju Arangath (Jira)
Shreyesh Shaju Arangath created SPARK-43002: --- Summary: Modify Yarn Client's application report to reduce noise Key: SPARK-43002 URL: https://issues.apache.org/jira/browse/SPARK-43002

[jira] [Updated] (SPARK-42926) Upgrade Parquet to 1.13.0

2023-04-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-42926: Summary: Upgrade Parquet to 1.13.0 (was: Upgrade Parquet to 1.12.4) > Upgrade Parquet to 1.13.0

[jira] [Resolved] (SPARK-42811) Make proto message `CacheTable` support `StorageLevel`

2023-04-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42811. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40438

[jira] [Assigned] (SPARK-42806) Add Catalog

2023-04-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42806: Assignee: Yang Jie > Add Catalog > --- > > Key: SPARK-42806 >

[jira] [Resolved] (SPARK-42806) Add Catalog

2023-04-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42806. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40438

[jira] [Assigned] (SPARK-42811) Make proto message `CacheTable` support `StorageLevel`

2023-04-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42811: Assignee: Yang Jie > Make proto message `CacheTable` support `StorageLevel` >

[jira] [Updated] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-04-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42627: - Issue Type: Improvement (was: Bug) Priority: Minor (was: Major) > Spark: Getting

[jira] [Commented] (SPARK-42774) Expose VectorTypes API for DataSourceV2 Batch Scans

2023-04-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707623#comment-17707623 ] ASF GitHub Bot commented on SPARK-42774: User 'clownxc' has created a pull request for this

[jira] [Updated] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-04-02 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-42627: -- Description:   {code:java} Exception in thread "main" org.apache.spark.SparkSQLException: Unrecognized SQL

[jira] [Comment Edited] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-04-02 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707619#comment-17707619 ] melin edited comment on SPARK-42627 at 4/2/23 6:50 AM: --- not support type:

[jira] [Commented] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-04-02 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707619#comment-17707619 ] melin commented on SPARK-42627: --- not support type: TIMESTAMP (3) WITH LOCAL TIME ZONE NOT NULL ENABLE  

[jira] [Updated] (SPARK-38200) [SQL] Spark JDBC Savemode Supports Upsert

2023-04-02 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-38200: -- Description: upsert sql for different databases， Most databases support merge sql： sqlserver merge into sql