[jira] [Resolved] (SPARK-37310) Migrate ALTER NAMESPACE ... SET PROPERTIES to use v2 command by default

[ https://issues.apache.org/jira/browse/SPARK-37310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-37310. Fix Version/s: 3.3.0 Assignee: Terry Kim (was: Apache Spark) Resolution:

[jira] [Commented] (SPARK-37644) Support datasource v2 complete aggregate pushdown

[ https://issues.apache.org/jira/browse/SPARK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459117#comment-17459117 ] jiaan.geng commented on SPARK-37644: I'm working on. > Support datasource v2 complete aggregate

[jira] [Commented] (SPARK-37630) Security issue from Log4j 1.X exploit

[ https://issues.apache.org/jira/browse/SPARK-37630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459018#comment-17459018 ] Ismail H commented on SPARK-37630: -- Sean, thanks for the comment. Since this is my first contribution

[jira] (SPARK-37641) Support ANSI Aggregate Function: regr_r2

[ https://issues.apache.org/jira/browse/SPARK-37641 ] jiaan.geng deleted comment on SPARK-37641: was (Author: beliefer): I'm working on. > Support ANSI Aggregate Function: regr_r2 > > >

[jira] [Created] (SPARK-37643) when charVarcharAsString is true, char datatype partition table query incorrect

YuanGuanhu created SPARK-37643: -- Summary: when charVarcharAsString is true, char datatype partition table query incorrect Key: SPARK-37643 URL: https://issues.apache.org/jira/browse/SPARK-37643 Project:

[jira] [Updated] (SPARK-37630) Security issue from Log4j 1.X exploit

[ https://issues.apache.org/jira/browse/SPARK-37630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismail H updated SPARK-37630: - Summary: Security issue from Log4j 1.X exploit (was: Security issue from Log4j 0day exploit) >

[jira] [Resolved] (SPARK-37635) SHOW TBLPROPERTIES should print the fully qualified table name

[ https://issues.apache.org/jira/browse/SPARK-37635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-37635. Fix Version/s: 3.3.0 Assignee: Wenchen Fan Resolution: Fixed Issue

[jira] [Created] (SPARK-37642) Fall back to SortMergeJoin if BroadcastHashJoin has OOM issue

Yuming Wang created SPARK-37642: --- Summary: Fall back to SortMergeJoin if BroadcastHashJoin has OOM issue Key: SPARK-37642 URL: https://issues.apache.org/jira/browse/SPARK-37642 Project: Spark

[jira] [Assigned] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6305: --- Assignee: Apache Spark > Add support for log4j 2.x to Spark >

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459007#comment-17459007 ] Apache Spark commented on SPARK-6305: - User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6305: --- Assignee: (was: Apache Spark) > Add support for log4j 2.x to Spark >

[jira] [Commented] (SPARK-37641) Support ANSI Aggregate Function: regr_r2

[ https://issues.apache.org/jira/browse/SPARK-37641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458968#comment-17458968 ] jiaan.geng commented on SPARK-37641: I'm working on. > Support ANSI Aggregate Function: regr_r2 >

[jira] [Commented] (SPARK-37641) Support ANSI Aggregate Function: regr_r2

[ https://issues.apache.org/jira/browse/SPARK-37641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458988#comment-17458988 ] Apache Spark commented on SPARK-37641: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-37641) Support ANSI Aggregate Function: regr_r2

[ https://issues.apache.org/jira/browse/SPARK-37641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458989#comment-17458989 ] Apache Spark commented on SPARK-37641: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37641) Support ANSI Aggregate Function: regr_r2

[ https://issues.apache.org/jira/browse/SPARK-37641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37641: Assignee: (was: Apache Spark) > Support ANSI Aggregate Function: regr_r2 >

[jira] [Assigned] (SPARK-37641) Support ANSI Aggregate Function: regr_r2

[ https://issues.apache.org/jira/browse/SPARK-37641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37641: Assignee: Apache Spark > Support ANSI Aggregate Function: regr_r2 >

[jira] [Updated] (SPARK-37643) when charVarcharAsString is true, char datatype partition table query incorrect

[ https://issues.apache.org/jira/browse/SPARK-37643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuanGuanhu updated SPARK-37643: --- Description: This ticket aim at fixing the bug that does not apply right-padding for char types

[jira] [Assigned] (SPARK-37575) null values should be saved as nothing rather than quoted empty Strings "" with default settings

[ https://issues.apache.org/jira/browse/SPARK-37575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-37575: Assignee: Guo Wei > null values should be saved as nothing rather than quoted empty Strings ""

[jira] [Resolved] (SPARK-37575) null values should be saved as nothing rather than quoted empty Strings "" with default settings

[ https://issues.apache.org/jira/browse/SPARK-37575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-37575. -- Fix Version/s: 3.3.0 3.2.1 Resolution: Fixed Issue resolved by pull request

[jira] [Created] (SPARK-37644) Support datasource v2 complete aggregate pushdown

jiaan.geng created SPARK-37644: -- Summary: Support datasource v2 complete aggregate pushdown Key: SPARK-37644 URL: https://issues.apache.org/jira/browse/SPARK-37644 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-37645) Word spell error - "labeled" spells as "labled"

[ https://issues.apache.org/jira/browse/SPARK-37645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37645: Assignee: Apache Spark > Word spell error - "labeled" spells as "labled" >

[jira] [Commented] (SPARK-37645) Word spell error - "labeled" spells as "labled"

[ https://issues.apache.org/jira/browse/SPARK-37645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459180#comment-17459180 ] Apache Spark commented on SPARK-37645: -- User 'dcoliversun' has created a pull request for this

[jira] [Assigned] (SPARK-37645) Word spell error - "labeled" spells as "labled"

[ https://issues.apache.org/jira/browse/SPARK-37645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37645: Assignee: (was: Apache Spark) > Word spell error - "labeled" spells as "labled" >

[jira] [Assigned] (SPARK-37646) Avoid touching Scala reflection APIs in the lit function

[ https://issues.apache.org/jira/browse/SPARK-37646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-37646: Assignee: Shixiong Zhu > Avoid touching Scala reflection APIs in the lit function >

[jira] [Commented] (SPARK-37646) Avoid touching Scala reflection APIs in the lit function

[ https://issues.apache.org/jira/browse/SPARK-37646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459394#comment-17459394 ] Apache Spark commented on SPARK-37646: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37646) Avoid touching Scala reflection APIs in the lit function

[ https://issues.apache.org/jira/browse/SPARK-37646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37646: Assignee: Apache Spark (was: Shixiong Zhu) > Avoid touching Scala reflection APIs in

[jira] [Assigned] (SPARK-37646) Avoid touching Scala reflection APIs in the lit function

[ https://issues.apache.org/jira/browse/SPARK-37646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37646: Assignee: Shixiong Zhu (was: Apache Spark) > Avoid touching Scala reflection APIs in

[jira] [Updated] (SPARK-37217) The number of dynamic partitions should early check when writing to external tables

[ https://issues.apache.org/jira/browse/SPARK-37217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-37217: - Fix Version/s: 3.2.1 > The number of dynamic partitions should early check when writing to external >

[jira] [Created] (SPARK-37646) Avoid touching Scala reflection APIs in the lit function

Shixiong Zhu created SPARK-37646: Summary: Avoid touching Scala reflection APIs in the lit function Key: SPARK-37646 URL: https://issues.apache.org/jira/browse/SPARK-37646 Project: Spark

[jira] [Assigned] (SPARK-37592) Improve performance of JoinSelection

[ https://issues.apache.org/jira/browse/SPARK-37592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37592: --- Assignee: jiaan.geng > Improve performance of JoinSelection >

[jira] [Resolved] (SPARK-37592) Improve performance of JoinSelection

[ https://issues.apache.org/jira/browse/SPARK-37592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37592. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34844

[jira] [Updated] (SPARK-28884) [Spark]Spark driver cores is showing 0 instead of 1 in UI for cluster mode deployment

[ https://issues.apache.org/jira/browse/SPARK-28884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksey Tsalolikhin updated SPARK-28884: Attachment: Screen+Shot+2021-12-09+at+9.39.58+AM.png > [Spark]Spark driver cores

[jira] [Created] (SPARK-37645) Word spell error - "labeled" spells as "labled"

qian created SPARK-37645: Summary: Word spell error - "labeled" spells as "labled" Key: SPARK-37645 URL: https://issues.apache.org/jira/browse/SPARK-37645 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-37643) when charVarcharAsString is true, char datatype partition table query incorrect

[ https://issues.apache.org/jira/browse/SPARK-37643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37643: Assignee: (was: Apache Spark) > when charVarcharAsString is true, char datatype

[jira] [Assigned] (SPARK-37643) when charVarcharAsString is true, char datatype partition table query incorrect

[ https://issues.apache.org/jira/browse/SPARK-37643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37643: Assignee: Apache Spark > when charVarcharAsString is true, char datatype partition table

[jira] [Commented] (SPARK-37643) when charVarcharAsString is true, char datatype partition table query incorrect

[ https://issues.apache.org/jira/browse/SPARK-37643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459273#comment-17459273 ] Apache Spark commented on SPARK-37643: -- User 'fhygh' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37568) Support 2-arguments by the convert_timezone() function

[ https://issues.apache.org/jira/browse/SPARK-37568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37568: Assignee: (was: Apache Spark) > Support 2-arguments by the convert_timezone()

[jira] [Assigned] (SPARK-37568) Support 2-arguments by the convert_timezone() function

[ https://issues.apache.org/jira/browse/SPARK-37568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37568: Assignee: Apache Spark > Support 2-arguments by the convert_timezone() function >

[jira] [Commented] (SPARK-37568) Support 2-arguments by the convert_timezone() function

[ https://issues.apache.org/jira/browse/SPARK-37568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459135#comment-17459135 ] Apache Spark commented on SPARK-37568: -- User 'yoda-mon' has created a pull request for this issue:

[jira] [Commented] (SPARK-28884) [Spark]Spark driver cores is showing 0 instead of 1 in UI for cluster mode deployment

[ https://issues.apache.org/jira/browse/SPARK-28884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459286#comment-17459286 ] Aleksey Tsalolikhin commented on SPARK-28884: - I've run into this as well, on Spark 3.1.2. 

[jira] [Updated] (SPARK-28884) [Spark]Spark driver cores is showing 0 instead of 1 in UI for cluster mode deployment

[ https://issues.apache.org/jira/browse/SPARK-28884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksey Tsalolikhin updated SPARK-28884: Attachment: Screen Shot 2021-12-14 at 8.31.23 AM.png > [Spark]Spark driver cores

[jira] [Resolved] (SPARK-37567) reuse Exchange failed

[ https://issues.apache.org/jira/browse/SPARK-37567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37567. -- Resolution: Not A Problem > reuse Exchange failed > -- > >

[jira] [Resolved] (SPARK-37645) Word spell error - "labeled" spells as "labled"

[ https://issues.apache.org/jira/browse/SPARK-37645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37645. --- Resolution: Fixed This is resolved via https://github.com/apache/spark/pull/34899 > Word

[jira] [Assigned] (SPARK-37645) Word spell error - "labeled" spells as "labled"

[ https://issues.apache.org/jira/browse/SPARK-37645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37645: - Assignee: qian > Word spell error - "labeled" spells as "labled" >

[jira] [Commented] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis

[ https://issues.apache.org/jira/browse/SPARK-24853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459467#comment-17459467 ] Nicholas Chammas commented on SPARK-24853: -- [~hyukjin.kwon] - Are you still opposed to this

[jira] [Commented] (SPARK-26589) proper `median` method for spark dataframe

[ https://issues.apache.org/jira/browse/SPARK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459455#comment-17459455 ] Nicholas Chammas commented on SPARK-26589: -- It looks like making a distributed,

[jira] [Updated] (SPARK-37645) Word spell error - "labeled" spells as "labled"

[ https://issues.apache.org/jira/browse/SPARK-37645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37645: -- Affects Version/s: 3.3.0 (was: 3.1.0)

[jira] [Updated] (SPARK-37645) Word spell error - "labeled" spells as "labled"

[ https://issues.apache.org/jira/browse/SPARK-37645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37645: -- Component/s: Tests > Word spell error - "labeled" spells as "labled" >

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459494#comment-17459494 ] Nicholas Chammas commented on SPARK-25150: -- I re-ran my test (described in the issue

[jira] [Assigned] (SPARK-37146) Inline type hints for python/pyspark/__init__.py

[ https://issues.apache.org/jira/browse/SPARK-37146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37146: -- Assignee: dch nguyen > Inline type hints for python/pyspark/__init__.py >

[jira] [Resolved] (SPARK-37146) Inline type hints for python/pyspark/__init__.py

[ https://issues.apache.org/jira/browse/SPARK-37146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37146. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Created] (SPARK-37647) Expose percentile function in Scala/Python APIs

Nicholas Chammas created SPARK-37647: Summary: Expose percentile function in Scala/Python APIs Key: SPARK-37647 URL: https://issues.apache.org/jira/browse/SPARK-37647 Project: Spark

[jira] [Resolved] (SPARK-26589) proper `median` method for spark dataframe

[ https://issues.apache.org/jira/browse/SPARK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-26589. -- Resolution: Won't Fix Marking this as "Won't Fix", but I suppose if someone really

[jira] [Resolved] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-25150. -- Fix Version/s: 3.2.0 Resolution: Fixed It looks like Spark 3.1.2 exhibits a

[jira] [Created] (SPARK-37648) Spark catalog and Delta tables

Hanna Liashchuk created SPARK-37648: --- Summary: Spark catalog and Delta tables Key: SPARK-37648 URL: https://issues.apache.org/jira/browse/SPARK-37648 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-26404) set spark.pyspark.python or PYSPARK_PYTHON doesn't work in k8s client-cluster mode.

[ https://issues.apache.org/jira/browse/SPARK-26404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459552#comment-17459552 ] Tim Sanders commented on SPARK-26404: - I'm running into this as well.  I'm on Spark 3.2.0, not using

[jira] [Resolved] (SPARK-37646) Avoid touching Scala reflection APIs in the lit function

[ https://issues.apache.org/jira/browse/SPARK-37646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37646. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34901

[jira] [Updated] (SPARK-37575) null values should be saved as nothing rather than quoted empty Strings "" with default settings

[ https://issues.apache.org/jira/browse/SPARK-37575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37575: - Fix Version/s: (was: 3.2.1) > null values should be saved as nothing rather than quoted

[jira] [Commented] (SPARK-37575) null values should be saved as nothing rather than quoted empty Strings "" with default settings

[ https://issues.apache.org/jira/browse/SPARK-37575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459647#comment-17459647 ] Apache Spark commented on SPARK-37575: -- User 'itholic' has created a pull request for this issue:

[jira] [Updated] (SPARK-37628) Upgrade Netty from 4.1.68 to 4.1.72

[ https://issues.apache.org/jira/browse/SPARK-37628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-37628: - Summary: Upgrade Netty from 4.1.68 to 4.1.72 (was: Upgrade Netty from 4.1.68 to 4.1.71) > Upgrade

[jira] [Updated] (SPARK-37628) Upgrade Netty from 4.1.68 to 4.1.72

[ https://issues.apache.org/jira/browse/SPARK-37628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-37628: - Description: After SPARK-36729, netty released 3 new versions: *

[jira] [Updated] (SPARK-37628) Upgrade Netty from 4.1.68 to 4.1.72

[ https://issues.apache.org/jira/browse/SPARK-37628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-37628: - Description: After SPARK-36729, netty released 3 new versions: *

[jira] [Assigned] (SPARK-37644) Support datasource v2 complete aggregate pushdown

[ https://issues.apache.org/jira/browse/SPARK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37644: Assignee: (was: Apache Spark) > Support datasource v2 complete aggregate pushdown >

[jira] [Assigned] (SPARK-37644) Support datasource v2 complete aggregate pushdown

[ https://issues.apache.org/jira/browse/SPARK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37644: Assignee: Apache Spark > Support datasource v2 complete aggregate pushdown >

[jira] [Commented] (SPARK-37644) Support datasource v2 complete aggregate pushdown

[ https://issues.apache.org/jira/browse/SPARK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459639#comment-17459639 ] Apache Spark commented on SPARK-37644: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-37644) Support datasource v2 complete aggregate pushdown

[ https://issues.apache.org/jira/browse/SPARK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459638#comment-17459638 ] Apache Spark commented on SPARK-37644: -- User 'beliefer' has created a pull request for this issue:

[jira] (SPARK-37644) Support datasource v2 complete aggregate pushdown

[ https://issues.apache.org/jira/browse/SPARK-37644 ] jiaan.geng deleted comment on SPARK-37644: was (Author: beliefer): I'm working on. > Support datasource v2 complete aggregate pushdown > --

[jira] [Closed] (SPARK-36168) Support Scala 2.13 in `dev/test-dependencies.sh`

[ https://issues.apache.org/jira/browse/SPARK-36168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-36168. - > Support Scala 2.13 in `dev/test-dependencies.sh` >

[jira] [Created] (SPARK-37649) Switch default index to distributed-sequence by default in pandas API on Spark

Hyukjin Kwon created SPARK-37649: Summary: Switch default index to distributed-sequence by default in pandas API on Spark Key: SPARK-37649 URL: https://issues.apache.org/jira/browse/SPARK-37649

[jira] [Resolved] (SPARK-37626) Upgrade libthrift to 0.15.0

[ https://issues.apache.org/jira/browse/SPARK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37626. -- Fix Version/s: (was: 3.3.0) Resolution: Duplicate > Upgrade libthrift to 0.15.0 >

[jira] [Resolved] (SPARK-37274) When the value of this parameter is greater than the maximum value of int type, the value will be thrown out of bounds. The document description of this parameter shoul

[ https://issues.apache.org/jira/browse/SPARK-37274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37274. -- Resolution: Won't Fix > When the value of this parameter is greater than the maximum value of

[jira] [Commented] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis

[ https://issues.apache.org/jira/browse/SPARK-24853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459579#comment-17459579 ] Hyukjin Kwon commented on SPARK-24853: -- [~nchammas], actually I don't think this can truly handle

[jira] [Commented] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis

[ https://issues.apache.org/jira/browse/SPARK-24853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459601#comment-17459601 ] Nicholas Chammas commented on SPARK-24853: -- Assuming we are talking about the example I

[jira] [Resolved] (SPARK-36168) Support Scala 2.13 in `dev/test-dependencies.sh`

[ https://issues.apache.org/jira/browse/SPARK-36168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36168. -- Resolution: Not A Problem > Support Scala 2.13 in `dev/test-dependencies.sh` >

[jira] [Updated] (SPARK-37643) when charVarcharAsString is true, char datatype partition table query incorrect

[ https://issues.apache.org/jira/browse/SPARK-37643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuanGuanhu updated SPARK-37643: --- Description: This ticket aim at fixing the bug that does not apply right-padding for char types

[jira] [Resolved] (SPARK-37649) Switch default index to distributed-sequence by default in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37649. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34902

[jira] [Assigned] (SPARK-37649) Switch default index to distributed-sequence by default in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37649: Assignee: Hyukjin Kwon > Switch default index to distributed-sequence by default in

[jira] [Resolved] (SPARK-37638) Use existing active Spark session instead of SparkSession.getOrCreate in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37638. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34893

[jira] [Resolved] (SPARK-37625) update log4j to 2.15

[ https://issues.apache.org/jira/browse/SPARK-37625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37625. -- Resolution: Duplicate > update log4j to 2.15 > - > >

[jira] [Resolved] (SPARK-36584) ExecutorMonitor#onBlockUpdated will receive event from driver

[ https://issues.apache.org/jira/browse/SPARK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36584. -- Resolution: Invalid > ExecutorMonitor#onBlockUpdated will receive event from driver >

[jira] [Created] (SPARK-37650) Tell spark-env.sh the python interpreter

Andrew Malone Melo created SPARK-37650: -- Summary: Tell spark-env.sh the python interpreter Key: SPARK-37650 URL: https://issues.apache.org/jira/browse/SPARK-37650 Project: Spark Issue

[jira] [Commented] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis

[ https://issues.apache.org/jira/browse/SPARK-24853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459607#comment-17459607 ] Hyukjin Kwon commented on SPARK-24853: -- Oh I meant that it will allow something like:

[jira] [Commented] (SPARK-37630) Security issue from Log4j 1.X exploit

[ https://issues.apache.org/jira/browse/SPARK-37630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459567#comment-17459567 ] Sean R. Owen commented on SPARK-37630: -- Spark depends on a whole lot of other libraries, and they

[jira] [Resolved] (SPARK-37630) Security issue from Log4j 1.X exploit

[ https://issues.apache.org/jira/browse/SPARK-37630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37630. -- Resolution: Duplicate > Security issue from Log4j 1.X exploit >

[jira] [Updated] (SPARK-37620) Use more precise types for SparkContext Optional fields (i.e. _gateway, _jvm)

[ https://issues.apache.org/jira/browse/SPARK-37620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37620: --- Parent: SPARK-37094 Issue Type: Sub-task (was: Improvement) > Use more

[jira] [Assigned] (SPARK-37649) Switch default index to distributed-sequence by default in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37649: Assignee: (was: Apache Spark) > Switch default index to distributed-sequence by

[jira] [Assigned] (SPARK-37649) Switch default index to distributed-sequence by default in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37649: Assignee: Apache Spark > Switch default index to distributed-sequence by default in

[jira] [Commented] (SPARK-37649) Switch default index to distributed-sequence by default in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459578#comment-17459578 ] Apache Spark commented on SPARK-37649: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-37650) Tell spark-env.sh the python interpreter

[ https://issues.apache.org/jira/browse/SPARK-37650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459584#comment-17459584 ] Apache Spark commented on SPARK-37650: -- User 'PerilousApricot' has created a pull request for this

[jira] [Assigned] (SPARK-37650) Tell spark-env.sh the python interpreter

[ https://issues.apache.org/jira/browse/SPARK-37650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37650: Assignee: Apache Spark > Tell spark-env.sh the python interpreter >

[jira] [Assigned] (SPARK-37650) Tell spark-env.sh the python interpreter

[ https://issues.apache.org/jira/browse/SPARK-37650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37650: Assignee: (was: Apache Spark) > Tell spark-env.sh the python interpreter >

[jira] [Assigned] (SPARK-37629) speed up Expression.canonicalized

[ https://issues.apache.org/jira/browse/SPARK-37629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37629: Assignee: Wenchen Fan > speed up Expression.canonicalized >

[jira] [Resolved] (SPARK-37629) speed up Expression.canonicalized

[ https://issues.apache.org/jira/browse/SPARK-37629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37629. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34883

[jira] [Resolved] (SPARK-37563) Implement days, seconds, microseconds properties of TimedeltaIndex

[ https://issues.apache.org/jira/browse/SPARK-37563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37563. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34825

[jira] [Assigned] (SPARK-37563) Implement days, seconds, microseconds properties of TimedeltaIndex

[ https://issues.apache.org/jira/browse/SPARK-37563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37563: Assignee: Xinrong Meng > Implement days, seconds, microseconds properties of

[jira] (SPARK-37154) Inline type hints for python/pyspark/rdd.py

[ https://issues.apache.org/jira/browse/SPARK-37154 ] Byron Hsu deleted comment on SPARK-37154: --- was (Author: byronhsu): i am working on this > Inline type hints for python/pyspark/rdd.py > --- > >

[jira] [Created] (SPARK-37651) Use existing active Spark session in all places of pandas API on Spark

Xinrong Meng created SPARK-37651: Summary: Use existing active Spark session in all places of pandas API on Spark Key: SPARK-37651 URL: https://issues.apache.org/jira/browse/SPARK-37651 Project:

[jira] [Resolved] (SPARK-32294) GroupedData Pandas UDF 2Gb limit

[ https://issues.apache.org/jira/browse/SPARK-32294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32294. -- Fix Version/s: 3.3.0 Resolution: Cannot Reproduce This is fixed in the master branch.

[jira] [Commented] (SPARK-37651) Use existing active Spark session in all places of pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459690#comment-17459690 ] Apache Spark commented on SPARK-37651: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-37651) Use existing active Spark session in all places of pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37651: Assignee: (was: Apache Spark) > Use existing active Spark session in all places of

  1   2   >