[jira] [Assigned] (SPARK-42491) Upgrade jetty to 9.4.51.v20230217

[ https://issues.apache.org/jira/browse/SPARK-42491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42491: Assignee: (was: Apache Spark) > Upgrade jetty to 9.4.51.v20230217 >

[jira] [Assigned] (SPARK-42491) Upgrade jetty to 9.4.51.v20230217

[ https://issues.apache.org/jira/browse/SPARK-42491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42491: Assignee: Apache Spark > Upgrade jetty to 9.4.51.v20230217 >

[jira] [Commented] (SPARK-42491) Upgrade jetty to 9.4.51.v20230217

[ https://issues.apache.org/jira/browse/SPARK-42491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694393#comment-17694393 ] Apache Spark commented on SPARK-42491: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-42617) Support `isocalendar`

Haejoon Lee created SPARK-42617: --- Summary: Support `isocalendar` Key: SPARK-42617 URL: https://issues.apache.org/jira/browse/SPARK-42617 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-42548) Add ReferenceAllColumns to skip rewriting attributes

[ https://issues.apache.org/jira/browse/SPARK-42548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42548: --- Assignee: XiDuo You > Add ReferenceAllColumns to skip rewriting attributes >

[jira] [Resolved] (SPARK-42548) Add ReferenceAllColumns to skip rewriting attributes

[ https://issues.apache.org/jira/browse/SPARK-42548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42548. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40154

[jira] [Commented] (SPARK-42599) Make `CompatibilitySuite` as a tool like `dev/mima`

[ https://issues.apache.org/jira/browse/SPARK-42599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694378#comment-17694378 ] Apache Spark commented on SPARK-42599: -- User 'LuciferYang' has created a pull request for this

[jira] [Resolved] (SPARK-41171) Push down filter through window when partitionSpec is empty

[ https://issues.apache.org/jira/browse/SPARK-41171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41171. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40142

[jira] [Assigned] (SPARK-41171) Push down filter through window when partitionSpec is empty

[ https://issues.apache.org/jira/browse/SPARK-41171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41171: --- Assignee: jiaan.geng > Push down filter through window when partitionSpec is empty >

[jira] [Assigned] (SPARK-42616) SparkSQLCLIDriver shall only close started hive sessionState

[ https://issues.apache.org/jira/browse/SPARK-42616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42616: Assignee: Apache Spark > SparkSQLCLIDriver shall only close started hive sessionState >

[jira] [Assigned] (SPARK-42613) PythonRunner should set OMP_NUM_THREADS to task cpus instead of executor cores by default

[ https://issues.apache.org/jira/browse/SPARK-42613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42613: Assignee: Apache Spark > PythonRunner should set OMP_NUM_THREADS to task cpus instead of

[jira] [Commented] (SPARK-42613) PythonRunner should set OMP_NUM_THREADS to task cpus instead of executor cores by default

[ https://issues.apache.org/jira/browse/SPARK-42613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694324#comment-17694324 ] Apache Spark commented on SPARK-42613: -- User 'jzhuge' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42616) SparkSQLCLIDriver shall only close started hive sessionState

[ https://issues.apache.org/jira/browse/SPARK-42616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42616: Assignee: (was: Apache Spark) > SparkSQLCLIDriver shall only close started hive

[jira] [Assigned] (SPARK-42613) PythonRunner should set OMP_NUM_THREADS to task cpus instead of executor cores by default

[ https://issues.apache.org/jira/browse/SPARK-42613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42613: Assignee: (was: Apache Spark) > PythonRunner should set OMP_NUM_THREADS to task cpus

[jira] [Commented] (SPARK-42616) SparkSQLCLIDriver shall only close started hive sessionState

[ https://issues.apache.org/jira/browse/SPARK-42616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694323#comment-17694323 ] Apache Spark commented on SPARK-42616: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Updated] (SPARK-42613) PythonRunner should set OMP_NUM_THREADS to task cpus instead of executor cores by default

[ https://issues.apache.org/jira/browse/SPARK-42613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated SPARK-42613: --- Description: Follow up from [https://github.com/apache/spark/pull/40199#discussion_r1119453996]

[jira] [Updated] (SPARK-42583) Remove outer join if all aggregate functions are distinct

[ https://issues.apache.org/jira/browse/SPARK-42583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42583: -- Affects Version/s: 3.5.0 (was: 3.4.0) > Remove outer join if all

[jira] [Resolved] (SPARK-42583) Remove outer join if all aggregate functions are distinct

[ https://issues.apache.org/jira/browse/SPARK-42583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42583. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40177

[jira] [Assigned] (SPARK-42583) Remove outer join if all aggregate functions are distinct

[ https://issues.apache.org/jira/browse/SPARK-42583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42583: - Assignee: Yuming Wang > Remove outer join if all aggregate functions are distinct >

[jira] [Resolved] (SPARK-42610) Add implicit encoders to SQLImplicits

[ https://issues.apache.org/jira/browse/SPARK-42610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42610. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40205

[jira] [Created] (SPARK-42616) SparkSQLCLIDriver shall only close started hive sessionState

Kent Yao created SPARK-42616: Summary: SparkSQLCLIDriver shall only close started hive sessionState Key: SPARK-42616 URL: https://issues.apache.org/jira/browse/SPARK-42616 Project: Spark Issue

[jira] [Updated] (SPARK-42613) PythonRunner should set OMP_NUM_THREADS to task cpus instead of executor cores by default

[ https://issues.apache.org/jira/browse/SPARK-42613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated SPARK-42613: --- Summary: PythonRunner should set OMP_NUM_THREADS to task cpus instead of executor cores by default

[jira] [Assigned] (SPARK-42602) Provide more details in TaskEndReason s for tasks killed by TaskScheduler.cancelTasks

[ https://issues.apache.org/jira/browse/SPARK-42602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42602: - Assignee: Bo Zhang > Provide more details in TaskEndReason s for tasks killed by >

[jira] [Updated] (SPARK-42613) PythonRunner should set OMP_NUM_THREADS to task cpus instead of executor cores by default

[ https://issues.apache.org/jira/browse/SPARK-42613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated SPARK-42613: --- Description: Follow up from [https://github.com/apache/spark/pull/40199#discussion_r1119453996]  

[jira] [Resolved] (SPARK-42602) Provide more details in TaskEndReason s for tasks killed by TaskScheduler.cancelTasks

[ https://issues.apache.org/jira/browse/SPARK-42602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42602. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40194

[jira] [Updated] (SPARK-42613) PythonRunner should set OMP_NUM_THREADS to task cpus times executor cores by default

[ https://issues.apache.org/jira/browse/SPARK-42613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated SPARK-42613: --- Description: Follow up from [https://github.com/apache/spark/pull/40199#discussion_r1119453996]  

[jira] [Updated] (SPARK-42613) PythonRunner should set OMP_NUM_THREADS to task cpus times executor cores by default

[ https://issues.apache.org/jira/browse/SPARK-42613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated SPARK-42613: --- Summary: PythonRunner should set OMP_NUM_THREADS to task cpus times executor cores by default

[jira] [Commented] (SPARK-42615) Refactor the AnalyzePlan RPC and add `session.version`

[ https://issues.apache.org/jira/browse/SPARK-42615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694313#comment-17694313 ] Apache Spark commented on SPARK-42615: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-42615) Refactor the AnalyzePlan RPC and add `session.version`

[ https://issues.apache.org/jira/browse/SPARK-42615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42615: Assignee: (was: Apache Spark) > Refactor the AnalyzePlan RPC and add

[jira] [Assigned] (SPARK-42615) Refactor the AnalyzePlan RPC and add `session.version`

[ https://issues.apache.org/jira/browse/SPARK-42615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42615: Assignee: Apache Spark > Refactor the AnalyzePlan RPC and add `session.version` >

[jira] [Created] (SPARK-42615) Refactor the AnalyzePlan RPC and add `session.version`

Ruifeng Zheng created SPARK-42615: - Summary: Refactor the AnalyzePlan RPC and add `session.version` Key: SPARK-42615 URL: https://issues.apache.org/jira/browse/SPARK-42615 Project: Spark

[jira] [Resolved] (SPARK-42406) [PROTOBUF] Recursive field handling is incompatible with delta

[ https://issues.apache.org/jira/browse/SPARK-42406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42406. Resolution: Fixed Issue resolved by pull request 40141

[jira] [Commented] (SPARK-42427) Conv should return an error if the internal conversion overflows

[ https://issues.apache.org/jira/browse/SPARK-42427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694299#comment-17694299 ] Apache Spark commented on SPARK-42427: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin"

[ https://issues.apache.org/jira/browse/SPARK-42539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42539: Assignee: Apache Spark > User-provided JARs can override Spark's Hive metadata client

[jira] [Assigned] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin"

[ https://issues.apache.org/jira/browse/SPARK-42539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42539: Assignee: (was: Apache Spark) > User-provided JARs can override Spark's Hive

[jira] [Reopened] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin"

[ https://issues.apache.org/jira/browse/SPARK-42539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-42539: -- Assignee: (was: Erik Krogen) Reverted in

[jira] [Updated] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin"

[ https://issues.apache.org/jira/browse/SPARK-42539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42539: - Fix Version/s: (was: 3.4.0) (was: 3.5.0) > User-provided JARs can

[jira] [Resolved] (SPARK-42612) Enable more parity tests related to functions

[ https://issues.apache.org/jira/browse/SPARK-42612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42612. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40203

[jira] [Assigned] (SPARK-42612) Enable more parity tests related to functions

[ https://issues.apache.org/jira/browse/SPARK-42612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42612: Assignee: Takuya Ueshin > Enable more parity tests related to functions >

[jira] [Assigned] (SPARK-40776) Add documentation (similar to Avro functions).

[ https://issues.apache.org/jira/browse/SPARK-40776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40776: Assignee: Sandish Kumar HN (was: Raghu Angadi) > Add documentation (similar to Avro

[jira] [Resolved] (SPARK-40776) Add documentation (similar to Avro functions).

[ https://issues.apache.org/jira/browse/SPARK-40776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40776. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39039

[jira] [Assigned] (SPARK-40776) Add documentation (similar to Avro functions).

[ https://issues.apache.org/jira/browse/SPARK-40776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40776: Assignee: Raghu Angadi > Add documentation (similar to Avro functions). >

[jira] [Assigned] (SPARK-42515) ClientE2ETestSuite local test failed

[ https://issues.apache.org/jira/browse/SPARK-42515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42515: Assignee: Yang Jie > ClientE2ETestSuite local test failed >

[jira] [Resolved] (SPARK-42515) ClientE2ETestSuite local test failed

[ https://issues.apache.org/jira/browse/SPARK-42515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42515. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40136

[jira] [Resolved] (SPARK-42367) DataFrame.drop should handle duplicated columns properly

[ https://issues.apache.org/jira/browse/SPARK-42367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42367. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40013

[jira] [Assigned] (SPARK-42367) DataFrame.drop should handle duplicated columns properly

[ https://issues.apache.org/jira/browse/SPARK-42367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42367: - Assignee: Ruifeng Zheng > DataFrame.drop should handle duplicated columns properly >

[jira] [Resolved] (SPARK-42572) Logic error for StateStore.validateStateRowFormat

[ https://issues.apache.org/jira/browse/SPARK-42572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-42572. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40187

[jira] [Assigned] (SPARK-42572) Logic error for StateStore.validateStateRowFormat

[ https://issues.apache.org/jira/browse/SPARK-42572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-42572: Assignee: Wei Liu > Logic error for StateStore.validateStateRowFormat >

[jira] [Commented] (SPARK-42592) Document SS guide doc for supporting multiple stateful operators (especially chained aggregations)

[ https://issues.apache.org/jira/browse/SPARK-42592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694281#comment-17694281 ] Apache Spark commented on SPARK-42592: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-42614) Make all constructors private[sql]

[ https://issues.apache.org/jira/browse/SPARK-42614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694279#comment-17694279 ] Apache Spark commented on SPARK-42614: -- User 'hvanhovell' has created a pull request for this

[jira] [Assigned] (SPARK-42614) Make all constructors private[sql]

[ https://issues.apache.org/jira/browse/SPARK-42614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42614: Assignee: Herman van Hövell (was: Apache Spark) > Make all constructors private[sql] >

[jira] [Assigned] (SPARK-42614) Make all constructors private[sql]

[ https://issues.apache.org/jira/browse/SPARK-42614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42614: Assignee: Apache Spark (was: Herman van Hövell) > Make all constructors private[sql] >

[jira] [Commented] (SPARK-42614) Make all constructors private[sql]

[ https://issues.apache.org/jira/browse/SPARK-42614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694278#comment-17694278 ] Apache Spark commented on SPARK-42614: -- User 'hvanhovell' has created a pull request for this

[jira] [Updated] (SPARK-42611) Insert char/varchar length checks for inner fields during resolution

[ https://issues.apache.org/jira/browse/SPARK-42611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Okolnychyi updated SPARK-42611: - Affects Version/s: 3.3.2 3.3.1 3.3.0

[jira] [Created] (SPARK-42614) Make all constructors private[sql]

Herman van Hövell created SPARK-42614: - Summary: Make all constructors private[sql] Key: SPARK-42614 URL: https://issues.apache.org/jira/browse/SPARK-42614 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-42611) Insert char/varchar length checks for inner fields during resolution

[ https://issues.apache.org/jira/browse/SPARK-42611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42611: Assignee: (was: Apache Spark) > Insert char/varchar length checks for inner fields

[jira] [Closed] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin closed SPARK-42550. - > table directory will lost on hdfs when `INSERT OVERWRITE` faild >

[jira] [Commented] (SPARK-42611) Insert char/varchar length checks for inner fields during resolution

[ https://issues.apache.org/jira/browse/SPARK-42611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694272#comment-17694272 ] Apache Spark commented on SPARK-42611: -- User 'aokolnychyi' has created a pull request for this

[jira] [Assigned] (SPARK-42611) Insert char/varchar length checks for inner fields during resolution

[ https://issues.apache.org/jira/browse/SPARK-42611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42611: Assignee: Apache Spark > Insert char/varchar length checks for inner fields during

[jira] [Commented] (SPARK-42611) Insert char/varchar length checks for inner fields during resolution

[ https://issues.apache.org/jira/browse/SPARK-42611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694271#comment-17694271 ] Apache Spark commented on SPARK-42611: -- User 'aokolnychyi' has created a pull request for this

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694270#comment-17694270 ] kevinshin commented on SPARK-42550: --- this is not spark's issue > table directory will lost on hdfs

[jira] [Resolved] (SPARK-42596) [YARN] OMP_NUM_THREADS not set to number of executor cores by default

[ https://issues.apache.org/jira/browse/SPARK-42596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42596. -- Fix Version/s: 3.3.3 3.2.4 3.4.0 Resolution:

[jira] [Assigned] (SPARK-42596) [YARN] OMP_NUM_THREADS not set to number of executor cores by default

[ https://issues.apache.org/jira/browse/SPARK-42596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42596: Assignee: John Zhuge > [YARN] OMP_NUM_THREADS not set to number of executor cores by

[jira] [Commented] (SPARK-42610) Add implicit encoders to SQLImplicits

[ https://issues.apache.org/jira/browse/SPARK-42610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694265#comment-17694265 ] Apache Spark commented on SPARK-42610: -- User 'hvanhovell' has created a pull request for this

[jira] [Commented] (SPARK-42601) New physical type Decimal128 for DecimalType

[ https://issues.apache.org/jira/browse/SPARK-42601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694259#comment-17694259 ] Apache Spark commented on SPARK-42601: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42601) New physical type Decimal128 for DecimalType

[ https://issues.apache.org/jira/browse/SPARK-42601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42601: Assignee: (was: Apache Spark) > New physical type Decimal128 for DecimalType >

[jira] [Assigned] (SPARK-42601) New physical type Decimal128 for DecimalType

[ https://issues.apache.org/jira/browse/SPARK-42601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42601: Assignee: Apache Spark > New physical type Decimal128 for DecimalType >

[jira] [Commented] (SPARK-42601) New physical type Decimal128 for DecimalType

[ https://issues.apache.org/jira/browse/SPARK-42601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694258#comment-17694258 ] Apache Spark commented on SPARK-42601: -- User 'beliefer' has created a pull request for this issue:

[jira] [Updated] (SPARK-42613) PythonRunner should set OMP_NUM_THREADS to task cpus instead of executor cores by default

[ https://issues.apache.org/jira/browse/SPARK-42613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated SPARK-42613: --- Description: Follow up from [https://github.com/apache/spark/pull/40199#discussion_r1119453996]  

[jira] [Created] (SPARK-42613) PythonRunner should set OMP_NUM_THREADS to task cpus instead of executor cores by default

John Zhuge created SPARK-42613: -- Summary: PythonRunner should set OMP_NUM_THREADS to task cpus instead of executor cores by default Key: SPARK-42613 URL: https://issues.apache.org/jira/browse/SPARK-42613

[jira] [Assigned] (SPARK-42600) currentDatabase Shall use NamespaceHelper instead of MultipartIdentifierHelper

[ https://issues.apache.org/jira/browse/SPARK-42600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42600: --- Assignee: Kent Yao > currentDatabase Shall use NamespaceHelper instead of >

[jira] [Resolved] (SPARK-42600) currentDatabase Shall use NamespaceHelper instead of MultipartIdentifierHelper

[ https://issues.apache.org/jira/browse/SPARK-42600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42600. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40192

[jira] [Updated] (SPARK-41956) Refetch shuffle blocks when executor is decommissioned

[ https://issues.apache.org/jira/browse/SPARK-41956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongwei Zhu updated SPARK-41956: - Summary: Refetch shuffle blocks when executor is decommissioned (was: Shuffle output location

[jira] [Assigned] (SPARK-42612) Enable more parity tests related to functions

[ https://issues.apache.org/jira/browse/SPARK-42612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42612: Assignee: (was: Apache Spark) > Enable more parity tests related to functions >

[jira] [Assigned] (SPARK-42612) Enable more parity tests related to functions

[ https://issues.apache.org/jira/browse/SPARK-42612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42612: Assignee: Apache Spark > Enable more parity tests related to functions >

[jira] [Commented] (SPARK-42612) Enable more parity tests related to functions

[ https://issues.apache.org/jira/browse/SPARK-42612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694244#comment-17694244 ] Apache Spark commented on SPARK-42612: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-42612) Enable more parity tests related to functions

[ https://issues.apache.org/jira/browse/SPARK-42612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694245#comment-17694245 ] Apache Spark commented on SPARK-42612: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-42612) Enable more parity tests related to functions

Takuya Ueshin created SPARK-42612: - Summary: Enable more parity tests related to functions Key: SPARK-42612 URL: https://issues.apache.org/jira/browse/SPARK-42612 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42608) Use full column names for inner fields in resolution errors

[ https://issues.apache.org/jira/browse/SPARK-42608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694242#comment-17694242 ] Apache Spark commented on SPARK-42608: -- User 'aokolnychyi' has created a pull request for this

[jira] [Assigned] (SPARK-42608) Use full column names for inner fields in resolution errors

[ https://issues.apache.org/jira/browse/SPARK-42608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42608: Assignee: Apache Spark > Use full column names for inner fields in resolution errors >

[jira] [Assigned] (SPARK-42608) Use full column names for inner fields in resolution errors

[ https://issues.apache.org/jira/browse/SPARK-42608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42608: Assignee: (was: Apache Spark) > Use full column names for inner fields in resolution

[jira] [Resolved] (SPARK-42121) Add built-in table-valued functions posexplode and posexplode_outer

[ https://issues.apache.org/jira/browse/SPARK-42121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42121. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40151

[jira] [Assigned] (SPARK-42121) Add built-in table-valued functions posexplode and posexplode_outer

[ https://issues.apache.org/jira/browse/SPARK-42121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42121: --- Assignee: Allison Wang > Add built-in table-valued functions posexplode and

[jira] [Created] (SPARK-42611) Insert char/varchar length checks for inner fields during resolution

Anton Okolnychyi created SPARK-42611: Summary: Insert char/varchar length checks for inner fields during resolution Key: SPARK-42611 URL: https://issues.apache.org/jira/browse/SPARK-42611

[jira] [Updated] (SPARK-42592) Document SS guide doc for supporting multiple stateful operators (especially chained aggregations)

[ https://issues.apache.org/jira/browse/SPARK-42592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-42592: - Fix Version/s: 3.4.1 > Document SS guide doc for supporting multiple stateful operators

[jira] [Assigned] (SPARK-42592) Document SS guide doc for supporting multiple stateful operators (especially chained aggregations)

[ https://issues.apache.org/jira/browse/SPARK-42592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-42592: Assignee: Jungtaek Lim > Document SS guide doc for supporting multiple stateful

[jira] [Resolved] (SPARK-42592) Document SS guide doc for supporting multiple stateful operators (especially chained aggregations)

[ https://issues.apache.org/jira/browse/SPARK-42592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-42592. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40188

[jira] [Updated] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin"

[ https://issues.apache.org/jira/browse/SPARK-42539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-42539: - Fix Version/s: 3.4.0 > User-provided JARs can override Spark's Hive metadata client JARs when using >

[jira] [Resolved] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin"

[ https://issues.apache.org/jira/browse/SPARK-42539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-42539. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40144

[jira] [Assigned] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin"

[ https://issues.apache.org/jira/browse/SPARK-42539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-42539: Assignee: Erik Krogen > User-provided JARs can override Spark's Hive metadata client JARs when

[jira] [Assigned] (SPARK-42610) Add implicit encoders to SQLImplicits

[ https://issues.apache.org/jira/browse/SPARK-42610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-42610: - Assignee: Herman van Hövell > Add implicit encoders to SQLImplicits >

[jira] [Updated] (SPARK-42467) Spark Connect Scala Client: GroupBy and Aggregation

[ https://issues.apache.org/jira/browse/SPARK-42467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-42467: -- Epic Link: SPARK-42554 > Spark Connect Scala Client: GroupBy and Aggregation >

[jira] [Resolved] (SPARK-42542) Support Pivot without providing pivot column values

[ https://issues.apache.org/jira/browse/SPARK-42542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42542. --- Fix Version/s: 3.4.1 Resolution: Fixed > Support Pivot without providing

[jira] [Assigned] (SPARK-41725) Remove the workaround of sql(...).collect back in PySpark tests

[ https://issues.apache.org/jira/browse/SPARK-41725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41725: Assignee: (was: Apache Spark) > Remove the workaround of sql(...).collect back in

[jira] [Commented] (SPARK-41725) Remove the workaround of sql(...).collect back in PySpark tests

[ https://issues.apache.org/jira/browse/SPARK-41725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694208#comment-17694208 ] Apache Spark commented on SPARK-41725: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-41725) Remove the workaround of sql(...).collect back in PySpark tests

[ https://issues.apache.org/jira/browse/SPARK-41725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41725: Assignee: Apache Spark > Remove the workaround of sql(...).collect back in PySpark tests

[jira] [Commented] (SPARK-42510) Implement `DataFrame.mapInPandas`

[ https://issues.apache.org/jira/browse/SPARK-42510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694162#comment-17694162 ] Apache Spark commented on SPARK-42510: -- User 'ueshin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-42510) Implement `DataFrame.mapInPandas`

[ https://issues.apache.org/jira/browse/SPARK-42510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-42510. --- Fix Version/s: 3.4.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Created] (SPARK-42610) Add implicit encoders to SQLImplicits

Herman van Hövell created SPARK-42610: - Summary: Add implicit encoders to SQLImplicits Key: SPARK-42610 URL: https://issues.apache.org/jira/browse/SPARK-42610 Project: Spark Issue Type:

[jira] [Created] (SPARK-42609) Support Grouping/Grouping_Set

Rui Wang created SPARK-42609: Summary: Support Grouping/Grouping_Set Key: SPARK-42609 URL: https://issues.apache.org/jira/browse/SPARK-42609 Project: Spark Issue Type: Sub-task

  1   2   >