[jira] [Comment Edited] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693044#comment-17693044 ] kevinshin edited comment on SPARK-42550 at 2/24/23 7:44 AM: when try to 

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: (was: image-2023-02-24-15-26-01-846.png) > table directory will lost on hdfs when

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: (was: image-2023-02-24-15-22-45-876.png) > table directory will lost on hdfs when

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693053#comment-17693053 ] kevinshin commented on SPARK-42550: --- the diffrent is :  1、spark3.2.1 will delete table's data files

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693044#comment-17693044 ] kevinshin commented on SPARK-42550: --- when try to  refresh table test.spark32_overwrite

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: image-2023-02-24-15-26-01-846.png > table directory will lost on hdfs when `INSERT

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: image-2023-02-24-15-25-57-770.png > table directory will lost on hdfs when `INSERT

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Description: {color:#4c9aff}when a  `{*}INSERT{*} OVERWRITE *TABLE`* statment faild during

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: image-2023-02-24-15-23-32-977.png > table directory will lost on hdfs when `INSERT

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Description: {color:#4c9aff}when a  `{*}INSERT{*} OVERWRITE *TABLE`* statment faild during

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: image-2023-02-24-15-22-45-876.png > table directory will lost on hdfs when `INSERT

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: image-2023-02-24-15-21-55-273.png > table directory will lost on hdfs when `INSERT

[jira] [Commented] (SPARK-42551) Support subexpression elimination in FilterExec

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693038#comment-17693038 ] Apache Spark commented on SPARK-42551: -- User 'wankunde' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42551) Support subexpression elimination in FilterExec

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42551: Assignee: (was: Apache Spark) > Support subexpression elimination in FilterExec >

[jira] [Assigned] (SPARK-42551) Support subexpression elimination in FilterExec

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42551: Assignee: Apache Spark > Support subexpression elimination in FilterExec >

[jira] [Updated] (SPARK-42551) Support subexpression elimination in FilterExec

2023-02-23 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-42551: Description: Just like SPARK-33092, We can support subexpression elimination in FilterExec in

[jira] [Updated] (SPARK-42551) Support subexpression elimination in FilterExec

2023-02-23 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-42551: Description: Just like SPARK-33092, We can support subexpression elimination in FilterExec in

[jira] [Created] (SPARK-42551) Support subexpression elimination in FilterExec

2023-02-23 Thread Wan Kun (Jira)
Wan Kun created SPARK-42551: --- Summary: Support subexpression elimination in FilterExec Key: SPARK-42551 URL: https://issues.apache.org/jira/browse/SPARK-42551 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42497) Basic support of pandas API on Spark for Spark Connect.

2023-02-23 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693020#comment-17693020 ] Haejoon Lee commented on SPARK-42497: - I'm working on this. > Basic support of pandas API on Spark

[jira] (SPARK-42497) Basic support of pandas API on Spark for Spark Connect.

2023-02-23 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42497 ] Haejoon Lee deleted comment on SPARK-42497: - was (Author: itholic): I'm working on this. Will submit a PR soon. > Basic support of pandas API on Spark for Spark Connect. >

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693016#comment-17693016 ] Yuming Wang commented on SPARK-42550: - Please refresh table: {code:sql} refresh table

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-42550: Description: {color:#4c9aff}when a  `{*}INSERT{*} OVERWRITE *TABLE`* statment faild during

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Description: {color:#4c9aff}when a  `{*}INSERT{*} OVERWRITE *TABLE`* statment faild during

[jira] [Created] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

2023-02-23 Thread kevinshin (Jira)
kevinshin created SPARK-42550: - Summary: table directory will lost on hdfs when `INSERT OVERWRITE` faild Key: SPARK-42550 URL: https://issues.apache.org/jira/browse/SPARK-42550 Project: Spark

[jira] [Created] (SPARK-42549) Allow multiple event time columns in single DataFrame

2023-02-23 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-42549: Summary: Allow multiple event time columns in single DataFrame Key: SPARK-42549 URL: https://issues.apache.org/jira/browse/SPARK-42549 Project: Spark Issue

[jira] [Assigned] (SPARK-42547) Make PySpark working with Python 3.7

2023-02-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42547: - Assignee: Hyukjin Kwon > Make PySpark working with Python 3.7 >

[jira] [Resolved] (SPARK-42547) Make PySpark working with Python 3.7

2023-02-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42547. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40153

[jira] [Commented] (SPARK-41823) DataFrame.join creating ambiguous column names

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693005#comment-17693005 ] Apache Spark commented on SPARK-41823: -- User 'hvanhovell' has created a pull request for this

[jira] [Commented] (SPARK-42534) Fix DB2 Limit clause

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693004#comment-17693004 ] Apache Spark commented on SPARK-42534: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Updated] (SPARK-42548) Add ReferenceAllColumns to skip rewriting attributes

2023-02-23 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-42548: -- Summary: Add ReferenceAllColumns to skip rewriting attributes (was: Add PlainReferences to skip

[jira] [Assigned] (SPARK-42548) Add PlainReferences to skip rewriting attributes

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42548: Assignee: Apache Spark > Add PlainReferences to skip rewriting attributes >

[jira] [Assigned] (SPARK-42548) Add PlainReferences to skip rewriting attributes

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42548: Assignee: (was: Apache Spark) > Add PlainReferences to skip rewriting attributes >

[jira] [Commented] (SPARK-42548) Add PlainReferences to skip rewriting attributes

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692992#comment-17692992 ] Apache Spark commented on SPARK-42548: -- User 'ulysses-you' has created a pull request for this

[jira] [Created] (SPARK-42548) Add PlainReferences to skip rewriting attributes

2023-02-23 Thread XiDuo You (Jira)
XiDuo You created SPARK-42548: - Summary: Add PlainReferences to skip rewriting attributes Key: SPARK-42548 URL: https://issues.apache.org/jira/browse/SPARK-42548 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-42547) Make PySpark working with Python 3.7

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42547: Assignee: (was: Apache Spark) > Make PySpark working with Python 3.7 >

[jira] [Assigned] (SPARK-42547) Make PySpark working with Python 3.7

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42547: Assignee: Apache Spark > Make PySpark working with Python 3.7 >

[jira] [Commented] (SPARK-42547) Make PySpark working with Python 3.7

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692988#comment-17692988 ] Apache Spark commented on SPARK-42547: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-42547) Make PySpark working with Python 3.7

2023-02-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42547: - Priority: Blocker (was: Major) > Make PySpark working with Python 3.7 >

[jira] [Assigned] (SPARK-42289) DS V2 pushdown could let JDBC dialect decide to push down offset and limit

2023-02-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42289: --- Assignee: jiaan.geng > DS V2 pushdown could let JDBC dialect decide to push down offset

[jira] [Resolved] (SPARK-42289) DS V2 pushdown could let JDBC dialect decide to push down offset and limit

2023-02-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42289. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39954

[jira] [Created] (SPARK-42547) Make PySpark working with Python 3.7

2023-02-23 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-42547: Summary: Make PySpark working with Python 3.7 Key: SPARK-42547 URL: https://issues.apache.org/jira/browse/SPARK-42547 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-42546) SPARK-42045 is incomplete in supporting ANSI_MODE fro round() and bround()

2023-02-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692985#comment-17692985 ] Wenchen Fan commented on SPARK-42546: - [~beliefer] do you have time to take a look? > SPARK-42045

[jira] [Created] (SPARK-42546) SPARK-42045 is incomplete in supporting ANSI_MODE fro round() and bround()

2023-02-23 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-42546: Summary: SPARK-42045 is incomplete in supporting ANSI_MODE fro round() and bround() Key: SPARK-42546 URL: https://issues.apache.org/jira/browse/SPARK-42546 Project:

[jira] [Comment Edited] (SPARK-42472) Make spark connect supporting canceling job group

2023-02-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692981#comment-17692981 ] Ruifeng Zheng edited comment on SPARK-42472 at 2/24/23 2:40 AM: Since in

[jira] [Commented] (SPARK-42472) Make spark connect supporting canceling job group

2023-02-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692981#comment-17692981 ] Ruifeng Zheng commented on SPARK-42472: --- Since in ml side 'groupId' is only used in training

[jira] [Assigned] (SPARK-42475) Getting Started: Live Notebook for Spark Connect

2023-02-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42475: Assignee: Haejoon Lee > Getting Started: Live Notebook for Spark Connect >

[jira] [Resolved] (SPARK-42475) Getting Started: Live Notebook for Spark Connect

2023-02-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42475. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40092

[jira] [Resolved] (SPARK-42545) Remove `experimental` from Volcano docs

2023-02-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42545. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40152

[jira] [Assigned] (SPARK-42545) Remove `experimental` from Volcano docs

2023-02-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42545: - Assignee: Dongjoon Hyun > Remove `experimental` from Volcano docs >

[jira] [Resolved] (SPARK-42544) Spark Connect Scala Client: support parameterized SQL

2023-02-23 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42544. --- Fix Version/s: 3.4.1 Resolution: Fixed > Spark Connect Scala Client: support

[jira] [Assigned] (SPARK-42545) Remove `experimental` from Volcano docs

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42545: Assignee: Apache Spark > Remove `experimental` from Volcano docs >

[jira] [Commented] (SPARK-42545) Remove `experimental` from Volcano docs

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692963#comment-17692963 ] Apache Spark commented on SPARK-42545: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-42545) Remove `experimental` from Volcano docs

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42545: Assignee: (was: Apache Spark) > Remove `experimental` from Volcano docs >

[jira] [Created] (SPARK-42545) Remove `experimental` from Volcano docs

2023-02-23 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42545: - Summary: Remove `experimental` from Volcano docs Key: SPARK-42545 URL: https://issues.apache.org/jira/browse/SPARK-42545 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-42121) Add built-in table-valued functions posexplode and posexplode_outer

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42121: Assignee: Apache Spark > Add built-in table-valued functions posexplode and

[jira] [Assigned] (SPARK-42121) Add built-in table-valued functions posexplode and posexplode_outer

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42121: Assignee: (was: Apache Spark) > Add built-in table-valued functions posexplode and

[jira] [Commented] (SPARK-42121) Add built-in table-valued functions posexplode and posexplode_outer

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692961#comment-17692961 ] Apache Spark commented on SPARK-42121: -- User 'allisonwang-db' has created a pull request for this

[jira] [Updated] (SPARK-41955) Support fetch latest map output from executor

2023-02-23 Thread Zhongwei Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongwei Zhu updated SPARK-41955: - Summary: Support fetch latest map output from executor (was: Support fetch latest map output

[jira] [Resolved] (SPARK-42444) DataFrame.drop should handle multi columns properly

2023-02-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42444. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40135

[jira] [Assigned] (SPARK-42444) DataFrame.drop should handle multi columns properly

2023-02-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42444: - Assignee: Ruifeng Zheng > DataFrame.drop should handle multi columns properly >

[jira] [Commented] (SPARK-41834) Implement SparkSession.conf

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692947#comment-17692947 ] Apache Spark commented on SPARK-41834: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41834) Implement SparkSession.conf

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41834: Assignee: Apache Spark > Implement SparkSession.conf > --- > >

[jira] [Assigned] (SPARK-41834) Implement SparkSession.conf

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41834: Assignee: (was: Apache Spark) > Implement SparkSession.conf >

[jira] [Commented] (SPARK-41834) Implement SparkSession.conf

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692946#comment-17692946 ] Apache Spark commented on SPARK-41834: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42122) Add built-in table-valued function stack

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42122: Assignee: (was: Apache Spark) > Add built-in table-valued function stack >

[jira] [Commented] (SPARK-42122) Add built-in table-valued function stack

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692945#comment-17692945 ] Apache Spark commented on SPARK-42122: -- User 'allisonwang-db' has created a pull request for this

[jira] [Assigned] (SPARK-42122) Add built-in table-valued function stack

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42122: Assignee: Apache Spark > Add built-in table-valued function stack >

[jira] [Commented] (SPARK-42540) Add more test case(s) for longer chain of multiple stateful operators

2023-02-23 Thread Raghu Angadi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692942#comment-17692942 ] Raghu Angadi commented on SPARK-42540: -- I am interested in working on this. Not sure about ETA. >

[jira] [Commented] (SPARK-42544) Spark Connect Scala Client: support parameterized SQL

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692937#comment-17692937 ] Apache Spark commented on SPARK-42544: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42544) Spark Connect Scala Client: support parameterized SQL

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42544: Assignee: Apache Spark (was: Rui Wang) > Spark Connect Scala Client: support

[jira] [Assigned] (SPARK-42544) Spark Connect Scala Client: support parameterized SQL

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42544: Assignee: Rui Wang (was: Apache Spark) > Spark Connect Scala Client: support

[jira] [Commented] (SPARK-42544) Spark Connect Scala Client: support parameterized SQL

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692936#comment-17692936 ] Apache Spark commented on SPARK-42544: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Created] (SPARK-42544) Spark Connect Scala Client: support parameterized SQL

2023-02-23 Thread Rui Wang (Jira)
Rui Wang created SPARK-42544: Summary: Spark Connect Scala Client: support parameterized SQL Key: SPARK-42544 URL: https://issues.apache.org/jira/browse/SPARK-42544 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42543) Specify protocol for UDF artifact transfer in JVM/Scala client

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692924#comment-17692924 ] Apache Spark commented on SPARK-42543: -- User 'vicennial' has created a pull request for this issue:

[jira] [Commented] (SPARK-42543) Specify protocol for UDF artifact transfer in JVM/Scala client

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692923#comment-17692923 ] Apache Spark commented on SPARK-42543: -- User 'vicennial' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42543) Specify protocol for UDF artifact transfer in JVM/Scala client

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42543: Assignee: (was: Apache Spark) > Specify protocol for UDF artifact transfer in

[jira] [Assigned] (SPARK-42543) Specify protocol for UDF artifact transfer in JVM/Scala client

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42543: Assignee: Apache Spark > Specify protocol for UDF artifact transfer in JVM/Scala client

[jira] [Assigned] (SPARK-42120) Add built-in table-valued function json_tuple

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42120: Assignee: Apache Spark > Add built-in table-valued function json_tuple >

[jira] [Commented] (SPARK-42120) Add built-in table-valued function json_tuple

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692921#comment-17692921 ] Apache Spark commented on SPARK-42120: -- User 'allisonwang-db' has created a pull request for this

[jira] [Assigned] (SPARK-42120) Add built-in table-valued function json_tuple

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42120: Assignee: (was: Apache Spark) > Add built-in table-valued function json_tuple >

[jira] [Created] (SPARK-42543) Specify protocol for UDF artifact transfer in JVM/Scala client

2023-02-23 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-42543: Summary: Specify protocol for UDF artifact transfer in JVM/Scala client Key: SPARK-42543 URL: https://issues.apache.org/jira/browse/SPARK-42543

[jira] [Resolved] (SPARK-25050) Handle more than two types in avro union types when writing avro files

2023-02-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-25050. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36506

[jira] [Assigned] (SPARK-25050) Handle more than two types in avro union types when writing avro files

2023-02-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-25050: -- Assignee: Steven Aerts > Handle more than two types in avro union types when writing

[jira] [Assigned] (SPARK-42541) Support Pivot with provided pivot column values

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42541: Assignee: Apache Spark (was: Rui Wang) > Support Pivot with provided pivot column

[jira] [Assigned] (SPARK-42541) Support Pivot with provided pivot column values

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42541: Assignee: Rui Wang (was: Apache Spark) > Support Pivot with provided pivot column

[jira] [Commented] (SPARK-42541) Support Pivot with provided pivot column values

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692913#comment-17692913 ] Apache Spark commented on SPARK-42541: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Created] (SPARK-42542) Support Pivot without providing pivot column values

2023-02-23 Thread Rui Wang (Jira)
Rui Wang created SPARK-42542: Summary: Support Pivot without providing pivot column values Key: SPARK-42542 URL: https://issues.apache.org/jira/browse/SPARK-42542 Project: Spark Issue Type:

[jira] [Created] (SPARK-42541) Support Pivot with provided pivot column values

2023-02-23 Thread Rui Wang (Jira)
Rui Wang created SPARK-42541: Summary: Support Pivot with provided pivot column values Key: SPARK-42541 URL: https://issues.apache.org/jira/browse/SPARK-42541 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-42540) Add more test case(s) for longer chain of multiple stateful operators

2023-02-23 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692905#comment-17692905 ] Jungtaek Lim commented on SPARK-42540: -- cc. [~rangadi]  Spark project discourages to set an

[jira] [Created] (SPARK-42540) Add more test case(s) for longer chain of multiple stateful operators

2023-02-23 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-42540: Summary: Add more test case(s) for longer chain of multiple stateful operators Key: SPARK-42540 URL: https://issues.apache.org/jira/browse/SPARK-42540 Project: Spark

[jira] [Assigned] (SPARK-42473) An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42473: Assignee: Apache Spark > An explicit cast will be needed when INSERT OVERWRITE SELECT

[jira] [Commented] (SPARK-42473) An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692857#comment-17692857 ] Apache Spark commented on SPARK-42473: -- User 'RunyaoChen' has created a pull request for this

[jira] [Assigned] (SPARK-42473) An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42473: Assignee: (was: Apache Spark) > An explicit cast will be needed when INSERT

[jira] [Commented] (SPARK-41991) Interpreted mode subexpression elimination can throw exception during insert

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692854#comment-17692854 ] Apache Spark commented on SPARK-41991: -- User 'RunyaoChen' has created a pull request for this

[jira] [Assigned] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin"

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42539: Assignee: Apache Spark > User-provided JARs can override Spark's Hive metadata client

[jira] [Commented] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin"

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692820#comment-17692820 ] Apache Spark commented on SPARK-42539: -- User 'xkrogen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin"

2023-02-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42539: Assignee: (was: Apache Spark) > User-provided JARs can override Spark's Hive

[jira] [Updated] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin"

2023-02-23 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated SPARK-42539: Description: Recently we observed that on version 3.2.0 and Java 8, it is possible for

[jira] [Created] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin"

2023-02-23 Thread Erik Krogen (Jira)
Erik Krogen created SPARK-42539: --- Summary: User-provided JARs can override Spark's Hive metadata client JARs when using "builtin" Key: SPARK-42539 URL: https://issues.apache.org/jira/browse/SPARK-42539

[jira] [Commented] (SPARK-41454) Support Python 3.11

2023-02-23 Thread Kevin Appel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692802#comment-17692802 ] Kevin Appel commented on SPARK-41454: - [~dongjoon] thank you for working on this, looking forward to

  1   2   >