[jira] [Resolved] (SPARK-47221) Uses AbstractParser instead of CsvParser for CSV parser signature

2024-02-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47221. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45328

[jira] [Updated] (SPARK-47223) Update usage of deprecated Thread.getId() to Thread.threadId()

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47223: --- Labels: pull-request-available (was: ) > Update usage of deprecated Thread.getId() to

[jira] [Commented] (SPARK-47223) Update usage of deprecated Thread.getId() to Thread.threadId()

2024-02-28 Thread Neil Gupta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821925#comment-17821925 ] Neil Gupta commented on SPARK-47223: I can take a stab it this one myself > Update usage of

[jira] [Created] (SPARK-47223) Update usage of deprecated Thread.getId() to Thread.threadId()

2024-02-28 Thread Neil Gupta (Jira)
Neil Gupta created SPARK-47223: -- Summary: Update usage of deprecated Thread.getId() to Thread.threadId() Key: SPARK-47223 URL: https://issues.apache.org/jira/browse/SPARK-47223 Project: Spark

[jira] [Updated] (SPARK-47223) Update usage of deprecated Thread.getId() to Thread.threadId()

2024-02-28 Thread Neil Gupta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neil Gupta updated SPARK-47223: --- Description: Update usage of deprecated Thread.getId() to Thread.threadId().   Currently in

[jira] [Updated] (SPARK-47148) Avoid to materialize AQE ExchangeQueryStageExec on the cancellation

2024-02-28 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-47148: --- Summary: Avoid to materialize AQE ExchangeQueryStageExec on the cancellation (was:

[jira] [Commented] (SPARK-47222) fileCompressionFactor should be applied to the size of the table

2024-02-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821923#comment-17821923 ] Yuming Wang commented on SPARK-47222: - https://github.com/apache/spark/pull/45329 >

[jira] [Updated] (SPARK-47222) fileCompressionFactor should be applied to the size of the table

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47222: --- Labels: pull-request-available (was: ) > fileCompressionFactor should be applied to the

[jira] [Created] (SPARK-47222) fileCompressionFactor should be applied to the size of the table

2024-02-28 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-47222: --- Summary: fileCompressionFactor should be applied to the size of the table Key: SPARK-47222 URL: https://issues.apache.org/jira/browse/SPARK-47222 Project: Spark

[jira] [Updated] (SPARK-47221) Uses AbstractParser instead of CsvParser for CSV parser signature

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47221: --- Labels: pull-request-available (was: ) > Uses AbstractParser instead of CsvParser for CSV

[jira] [Updated] (SPARK-47146) Possible thread leak when doing sort merge join

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47146: --- Labels: pull-request-available (was: ) > Possible thread leak when doing sort merge join >

[jira] [Commented] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

2024-02-28 Thread Zhen Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821918#comment-17821918 ] Zhen Li commented on SPARK-46762: - [~tenstriker] can you provide more info to reproduce your error? the

[jira] [Updated] (SPARK-47078) Documentation for SparkSession-based Profilers

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47078: --- Labels: pull-request-available (was: ) > Documentation for SparkSession-based Profilers >

[jira] [Updated] (SPARK-43744) Spark Connect scala UDF serialization pulling in unrelated classes not available on server

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43744: --- Labels: SPARK-43745 pull-request-available (was: SPARK-43745) > Spark Connect scala UDF

[jira] [Commented] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

2024-02-28 Thread nirav patel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821911#comment-17821911 ] nirav patel commented on SPARK-46762: - [~zhenli]  is this related to following?   

[jira] [Updated] (SPARK-47206) Add official image Dockerfile for Apache Spark 3.5.1

2024-02-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-47206: Fix Version/s: 3.5.1 (was: 4.0.0) > Add official image Dockerfile for

[jira] [Assigned] (SPARK-47206) Add official image Dockerfile for Apache Spark 3.5.1

2024-02-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-47206: --- Assignee: Yikun Jiang > Add official image Dockerfile for Apache Spark 3.5.1 >

[jira] [Resolved] (SPARK-47206) Add official image Dockerfile for Apache Spark 3.5.1

2024-02-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-47206. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 59

[jira] [Created] (SPARK-47220) log4j race condition during shutdown

2024-02-28 Thread Holden Karau (Jira)
Holden Karau created SPARK-47220: Summary: log4j race condition during shutdown Key: SPARK-47220 URL: https://issues.apache.org/jira/browse/SPARK-47220 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-47214) Create API for 'analyze' method to differentiate constant NULL arguments and other types of arguments

2024-02-28 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-47214. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45319

[jira] [Assigned] (SPARK-47214) Create API for 'analyze' method to differentiate constant NULL arguments and other types of arguments

2024-02-28 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-47214: - Assignee: Daniel > Create API for 'analyze' method to differentiate constant NULL

[jira] [Updated] (SPARK-47218) XML: Ignore commented Row Tags in XML tokenizer

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47218: --- Labels: pull-request-available (was: ) > XML: Ignore commented Row Tags in XML tokenizer >

[jira] [Resolved] (SPARK-47135) Implement error classes for Kafka data loss exceptions

2024-02-28 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47135. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45221

[jira] [Updated] (SPARK-47218) XML: Ignore commented Row Tags in XML tokenizer

2024-02-28 Thread Yousof Hosny (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yousof Hosny updated SPARK-47218: - Summary: XML: Ignore commented Row Tags in XML tokenizer (was: XML: Ignore commented row tags

[jira] [Assigned] (SPARK-47135) Implement error classes for Kafka data loss exceptions

2024-02-28 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-47135: Assignee: B. Micheal Okutubo > Implement error classes for Kafka data loss exceptions >

[jira] [Updated] (SPARK-47218) XML: Ignore commented row tags in XML tokenizer

2024-02-28 Thread Yousof Hosny (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yousof Hosny updated SPARK-47218: - Summary: XML: Ignore commented row tags in XML tokenizer (was: XML: Skip rowTag in a comment)

[jira] [Created] (SPARK-47219) XML: Ignore commented row tags in XML tokenizer

2024-02-28 Thread Sandip Agarwala (Jira)
Sandip Agarwala created SPARK-47219: --- Summary: XML: Ignore commented row tags in XML tokenizer Key: SPARK-47219 URL: https://issues.apache.org/jira/browse/SPARK-47219 Project: Spark Issue

[jira] [Resolved] (SPARK-47215) Reduce the number of required threads in MasterSuite

2024-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47215. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45320

[jira] [Assigned] (SPARK-47215) Reduce the number of required threads in MasterSuite

2024-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47215: - Assignee: Dongjoon Hyun > Reduce the number of required threads in MasterSuite >

[jira] [Updated] (SPARK-44265) Built-in XML data source support

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44265: --- Labels: pull-request-available (was: ) > Built-in XML data source support >

[jira] [Updated] (SPARK-47218) XML: Skip rowTag in a comment

2024-02-28 Thread Yousof Hosny (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yousof Hosny updated SPARK-47218: - Description: The following returns rows that was within comments: ``` {{// BUG: rowTag in

[jira] [Updated] (SPARK-47218) XML: Skip rowTag in a comment

2024-02-28 Thread Yousof Hosny (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yousof Hosny updated SPARK-47218: - Description: The following returns rows that was within comments: {{}} {code:java} // BUG:

[jira] [Updated] (SPARK-47218) XML: Skip rowTag in a comment

2024-02-28 Thread Yousof Hosny (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yousof Hosny updated SPARK-47218: - Summary: XML: Skip rowTag in a comment (was: XML: Skip rowTag in a comment,) > XML: Skip

[jira] [Created] (SPARK-47218) XML: Skip rowTag in a comment,

2024-02-28 Thread Yousof Hosny (Jira)
Yousof Hosny created SPARK-47218: Summary: XML: Skip rowTag in a comment, Key: SPARK-47218 URL: https://issues.apache.org/jira/browse/SPARK-47218 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47217) De-duplication of Relations in Joins, can result in plan resolution failure

2024-02-28 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-47217: - Description: In case of some flavours of  nested joins involving repetition of relation, the projected columns

[jira] [Updated] (SPARK-47216) Refine layout of SQL performance tuning page

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47216: --- Labels: pull-request-available (was: ) > Refine layout of SQL performance tuning page >

[jira] [Updated] (SPARK-47217) De-duplication of Relations in Joins, can result in plan resolution failure

2024-02-28 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-47217: - Description: In case of some flavours of self join queries or nested joins involving repetition of relation,

[jira] [Updated] (SPARK-47217) De-duplication of Relations in Joins, can result in plan resolution failure

2024-02-28 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-47217: - Description: In case of some flavours of nested self join queries, the projected columns when passed to the

[jira] [Created] (SPARK-47217) De-duplication of Relations in Joins, can result in plan resolution failure

2024-02-28 Thread Asif (Jira)
Asif created SPARK-47217: Summary: De-duplication of Relations in Joins, can result in plan resolution failure Key: SPARK-47217 URL: https://issues.apache.org/jira/browse/SPARK-47217 Project: Spark

[jira] [Created] (SPARK-47216) Refine layout of SQL performance tuning page

2024-02-28 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-47216: Summary: Refine layout of SQL performance tuning page Key: SPARK-47216 URL: https://issues.apache.org/jira/browse/SPARK-47216 Project: Spark Issue

[jira] [Updated] (SPARK-47215) Reduce the number of required threads in MasterSuite

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47215: --- Labels: pull-request-available (was: ) > Reduce the number of required threads in

[jira] [Updated] (SPARK-47214) Create API for 'analyze' method to differentiate constant NULL arguments and other types of arguments

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47214: --- Labels: pull-request-available (was: ) > Create API for 'analyze' method to differentiate

[jira] [Created] (SPARK-47215) Reduce the number of required threads in MasterSuite

2024-02-28 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47215: - Summary: Reduce the number of required threads in MasterSuite Key: SPARK-47215 URL: https://issues.apache.org/jira/browse/SPARK-47215 Project: Spark Issue

[jira] [Created] (SPARK-47214) Create API for 'analyze' method to differentiate constant NULL arguments and other types of arguments

2024-02-28 Thread Daniel (Jira)
Daniel created SPARK-47214: -- Summary: Create API for 'analyze' method to differentiate constant NULL arguments and other types of arguments Key: SPARK-47214 URL: https://issues.apache.org/jira/browse/SPARK-47214

[jira] [Resolved] (SPARK-47207) Support `spark.driver.timeout` and `DriverTimeoutPlugin`

2024-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47207. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45313

[jira] [Assigned] (SPARK-47209) Upgrade slf4j to 2.0.12

2024-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47209: - Assignee: Yang Jie > Upgrade slf4j to 2.0.12 > --- > >

[jira] [Resolved] (SPARK-47209) Upgrade slf4j to 2.0.12

2024-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47209. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45315

[jira] [Commented] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin

2024-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821741#comment-17821741 ] Dongjoon Hyun commented on SPARK-41392: --- To [~ste...@apache.org] , as you know, we update

[jira] [Resolved] (SPARK-47197) Failed to connect HiveMetastore when using iceberg with HiveCatalog on spark-sql or spark-shell

2024-02-28 Thread YUBI LEE (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YUBI LEE resolved SPARK-47197. -- Resolution: Not A Problem https://github.com/apache/spark/pull/45309#issuecomment-1969269354 >

[jira] [Updated] (SPARK-47211) Fix ignored PySpark Connect string collation

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47211: --- Labels: pull-request-available (was: ) > Fix ignored PySpark Connect string collation >

[jira] [Updated] (SPARK-47211) Fix ignored PySpark Connect string collation

2024-02-28 Thread Nikola Mandic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Mandic updated SPARK-47211: -- Component/s: Connect > Fix ignored PySpark Connect string collation >

[jira] [Created] (SPARK-47213) Proposal about moving on from the Shepherd terminology in SPIPs to "Mentor"

2024-02-28 Thread Mich Talebzadeh (Jira)
Mich Talebzadeh created SPARK-47213: --- Summary: Proposal about moving on from the Shepherd terminology in SPIPs to "Mentor" Key: SPARK-47213 URL: https://issues.apache.org/jira/browse/SPARK-47213

[jira] [Created] (SPARK-47212) When creating Jira please use the word "mentor" instead of "Shepherd" in SPIP

2024-02-28 Thread Mich Talebzadeh (Jira)
Mich Talebzadeh created SPARK-47212: --- Summary: When creating Jira please use the word "mentor" instead of "Shepherd" in SPIP Key: SPARK-47212 URL: https://issues.apache.org/jira/browse/SPARK-47212

[jira] [Updated] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-41392: --- Labels: pull-request-available (was: ) > spark builds against hadoop trunk/3.4.0-SNAPSHOT

[jira] [Updated] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin

2024-02-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-41392: --- Priority: Major (was: Minor) > spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in

[jira] [Commented] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin

2024-02-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821694#comment-17821694 ] Steve Loughran commented on SPARK-41392: Hadoop 3.4.0 RC2 exhibits this; spark needs its patches

[jira] [Updated] (SPARK-47168) Disable parquet filter pushdown for non default collated strings

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47168: --- Labels: pull-request-available (was: ) > Disable parquet filter pushdown for non default

[jira] [Created] (SPARK-47211) Fix ignored PySpark Connect string collation

2024-02-28 Thread Nikola Mandic (Jira)
Nikola Mandic created SPARK-47211: - Summary: Fix ignored PySpark Connect string collation Key: SPARK-47211 URL: https://issues.apache.org/jira/browse/SPARK-47211 Project: Spark Issue Type:

[jira] [Created] (SPARK-47210) Implicit casting on collated expressions

2024-02-28 Thread Mihailo Milosevic (Jira)
Mihailo Milosevic created SPARK-47210: - Summary: Implicit casting on collated expressions Key: SPARK-47210 URL: https://issues.apache.org/jira/browse/SPARK-47210 Project: Spark Issue

[jira] [Updated] (SPARK-46919) Upgrade `grpcio*` and `grpc-java` to 1.62

2024-02-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46919: - Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade `grpcio*` and

[jira] [Updated] (SPARK-46919) Upgrade `grpcio*` and `grpc-java` to 1.62

2024-02-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46919: - Summary: Upgrade `grpcio*` and `grpc-java` to 1.62 (was: Upgrade `grpcio*` to 1.60.0 and `grpc-java`

[jira] [Updated] (SPARK-47209) Upgrade slf4j to 2.0.12

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47209: --- Labels: pull-request-available (was: ) > Upgrade slf4j to 2.0.12 > ---

[jira] [Created] (SPARK-47209) Upgrade slf4j to 2.0.12

2024-02-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-47209: Summary: Upgrade slf4j to 2.0.12 Key: SPARK-47209 URL: https://issues.apache.org/jira/browse/SPARK-47209 Project: Spark Issue Type: Sub-task Components:

[jira] [Updated] (SPARK-42040) SPJ: Introduce a new API for V2 input partition to report partition size

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42040: --- Labels: pull-request-available (was: ) > SPJ: Introduce a new API for V2 input partition

[jira] [Resolved] (SPARK-47132) Mistake in Docstring for Pyspark's Dataframe.head()

2024-02-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47132. -- Fix Version/s: 4.0.0 Resolution: Fixed > Mistake in Docstring for Pyspark's Dataframe.head() >

[jira] [Commented] (SPARK-47208) Allow overriding base overhead memory

2024-02-28 Thread Joao Correia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821601#comment-17821601 ] Joao Correia commented on SPARK-47208: -- https://github.com/apache/spark/pull/45240 > Allow

[jira] [Updated] (SPARK-47208) Allow overriding base overhead memory

2024-02-28 Thread Joao Correia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Correia updated SPARK-47208: - Component/s: Spark Core > Allow overriding base overhead memory >

[jira] [Assigned] (SPARK-47132) Mistake in Docstring for Pyspark's Dataframe.head()

2024-02-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47132: Assignee: Albert Ziegler > Mistake in Docstring for Pyspark's Dataframe.head() >

[jira] [Resolved] (SPARK-47147) Fix Pyspark collated string conversion error

2024-02-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47147. -- Resolution: Fixed Issue resolved by pull request 45257

[jira] [Created] (SPARK-47208) Allow overriding base overhead memory

2024-02-28 Thread Joao Correia (Jira)
Joao Correia created SPARK-47208: Summary: Allow overriding base overhead memory Key: SPARK-47208 URL: https://issues.apache.org/jira/browse/SPARK-47208 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: (was: Apache Spark) > Add COLLATION_ENABLED config flag >

[jira] [Assigned] (SPARK-47094) SPJ : Dynamically rebalance number of buckets when they are not equal

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47094: -- Assignee: Apache Spark > SPJ : Dynamically rebalance number of buckets when they are

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: Apache Spark > Add COLLATION_ENABLED config flag >

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: (was: Apache Spark) > Add COLLATION_ENABLED config flag >

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: Apache Spark > Add COLLATION_ENABLED config flag >

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: (was: Apache Spark) > Add COLLATION_ENABLED config flag >

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: Apache Spark > Add COLLATION_ENABLED config flag >

[jira] [Assigned] (SPARK-47094) SPJ : Dynamically rebalance number of buckets when they are not equal

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47094: -- Assignee: Apache Spark > SPJ : Dynamically rebalance number of buckets when they are

[jira] [Assigned] (SPARK-47207) Support `spark.driver.timeout` and `DriverTimeoutPlugin`

2024-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47207: - Assignee: Dongjoon Hyun > Support `spark.driver.timeout` and `DriverTimeoutPlugin` >

[jira] [Assigned] (SPARK-47145) Provide table identifier to scan node when DS v2 strategy is applied

2024-02-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47145: --- Assignee: Uros Stankovic > Provide table identifier to scan node when DS v2 strategy is

[jira] [Resolved] (SPARK-47145) Provide table identifier to scan node when DS v2 strategy is applied

2024-02-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47145. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45200

[jira] [Updated] (SPARK-47207) Support `spark.driver.timeout` and `DriverTimeoutPlugin`

2024-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47207: --- Labels: pull-request-available (was: ) > Support `spark.driver.timeout` and

[jira] [Created] (SPARK-47207) Support `spark.driver.timeout` and `DriverTimeoutPlugin`

2024-02-28 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47207: - Summary: Support `spark.driver.timeout` and `DriverTimeoutPlugin` Key: SPARK-47207 URL: https://issues.apache.org/jira/browse/SPARK-47207 Project: Spark

[jira] [Resolved] (SPARK-47205) Upgrade docker-java to 3.3.5

2024-02-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47205. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45307

[jira] [Resolved] (SPARK-46077) Error in postgresql when pushing down filter by timestamp_ntz field

2024-02-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46077. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45261

[jira] [Assigned] (SPARK-46077) Error in postgresql when pushing down filter by timestamp_ntz field

2024-02-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46077: Assignee: Pablo Langa Blanco > Error in postgresql when pushing down filter by timestamp_ntz