[jira] [Commented] (SPARK-35363) Refactor sort merge join code-gen be agnostic to join type

[ https://issues.apache.org/jira/browse/SPARK-35363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344318#comment-17344318 ] Apache Spark commented on SPARK-35363: -- User 'c21' has created a pull request for this issue:

[jira] [Commented] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344312#comment-17344312 ] Nick Hryhoriev commented on SPARK-11844: [~sungwy92] spark.hadoop.fs.s3a.fast.upload": "true",

[jira] [Commented] (SPARK-35351) Add code-gen for left anti sort merge join

[ https://issues.apache.org/jira/browse/SPARK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344311#comment-17344311 ] Apache Spark commented on SPARK-35351: -- User 'c21' has created a pull request for this issue:

[jira] [Commented] (SPARK-35351) Add code-gen for left anti sort merge join

[ https://issues.apache.org/jira/browse/SPARK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344310#comment-17344310 ] Apache Spark commented on SPARK-35351: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35351) Add code-gen for left anti sort merge join

[ https://issues.apache.org/jira/browse/SPARK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35351: Assignee: Apache Spark > Add code-gen for left anti sort merge join >

[jira] [Assigned] (SPARK-35351) Add code-gen for left anti sort merge join

[ https://issues.apache.org/jira/browse/SPARK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35351: Assignee: (was: Apache Spark) > Add code-gen for left anti sort merge join >

[jira] [Updated] (SPARK-35378) Eagerly execute Command so that query command with CTE

[ https://issues.apache.org/jira/browse/SPARK-35378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-35378: --- Summary: Eagerly execute Command so that query command with CTE (was: Eagerly execute

[jira] [Assigned] (SPARK-35395) Move ORC data source options from Python and Scala into a single page

[ https://issues.apache.org/jira/browse/SPARK-35395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35395: Assignee: Apache Spark > Move ORC data source options from Python and Scala into a

[jira] [Assigned] (SPARK-35395) Move ORC data source options from Python and Scala into a single page

[ https://issues.apache.org/jira/browse/SPARK-35395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35395: Assignee: (was: Apache Spark) > Move ORC data source options from Python and Scala

[jira] [Commented] (SPARK-35395) Move ORC data source options from Python and Scala into a single page

[ https://issues.apache.org/jira/browse/SPARK-35395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344308#comment-17344308 ] Apache Spark commented on SPARK-35395: -- User 'itholic' has created a pull request for this issue:

[jira] [Resolved] (SPARK-35207) hash() and other hash builtins do not normalize negative zero

[ https://issues.apache.org/jira/browse/SPARK-35207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35207. - Fix Version/s: 3.2.0 Assignee: Pablo Langa Blanco Resolution: Fixed > hash()

[jira] [Updated] (SPARK-35378) Eagerly execute LeafRunnableCommand so that query command with CTE

[ https://issues.apache.org/jira/browse/SPARK-35378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-35378: --- Summary: Eagerly execute LeafRunnableCommand so that query command with CTE (was: Eagerly execute

[jira] [Updated] (SPARK-35378) Eagerly execute LeafRunnableCommand so as query command with CTE

[ https://issues.apache.org/jira/browse/SPARK-35378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-35378: --- Summary: Eagerly execute LeafRunnableCommand so as query command with CTE (was: Convert

[jira] [Commented] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

[ https://issues.apache.org/jira/browse/SPARK-32484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344228#comment-17344228 ] Apache Spark commented on SPARK-32484: -- User 'LittleCuteBug' has created a pull request for this

[jira] [Commented] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

[ https://issues.apache.org/jira/browse/SPARK-32484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344227#comment-17344227 ] Apache Spark commented on SPARK-32484: -- User 'LittleCuteBug' has created a pull request for this

[jira] [Updated] (SPARK-35393) PIP packaging test is skipped in GitHub Actions build

[ https://issues.apache.org/jira/browse/SPARK-35393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35393: - Affects Version/s: 3.0.2 3.1.1 > PIP packaging test is skipped in GitHub

[jira] [Updated] (SPARK-35393) PIP packaging test is skipped in GitHub Actions build

[ https://issues.apache.org/jira/browse/SPARK-35393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35393: - Fix Version/s: 3.1.2 3.0.3 > PIP packaging test is skipped in GitHub Actions

[jira] [Resolved] (SPARK-35311) Add exposed SS UI state information metrics to the documentation

[ https://issues.apache.org/jira/browse/SPARK-35311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-35311. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32433

[jira] [Assigned] (SPARK-35311) Add exposed SS UI state information metrics to the documentation

[ https://issues.apache.org/jira/browse/SPARK-35311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-35311: Assignee: Gabor Somogyi > Add exposed SS UI state information metrics to the

[jira] [Commented] (SPARK-35332) Not Coalesce shuffle partitions when cache table

[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344218#comment-17344218 ] Apache Spark commented on SPARK-35332: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-35332) Not Coalesce shuffle partitions when cache table

[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344217#comment-17344217 ] Apache Spark commented on SPARK-35332: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-35403) Migrate ALTER TABLE commands that alter columns to new framework

[ https://issues.apache.org/jira/browse/SPARK-35403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344216#comment-17344216 ] Apache Spark commented on SPARK-35403: -- User 'imback82' has created a pull request for this issue:

[jira] [Commented] (SPARK-35403) Migrate ALTER TABLE commands that alter columns to new framework

[ https://issues.apache.org/jira/browse/SPARK-35403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344215#comment-17344215 ] Apache Spark commented on SPARK-35403: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35403) Migrate ALTER TABLE commands that alter columns to new framework

[ https://issues.apache.org/jira/browse/SPARK-35403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35403: Assignee: (was: Apache Spark) > Migrate ALTER TABLE commands that alter columns to

[jira] [Assigned] (SPARK-35403) Migrate ALTER TABLE commands that alter columns to new framework

[ https://issues.apache.org/jira/browse/SPARK-35403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35403: Assignee: Apache Spark > Migrate ALTER TABLE commands that alter columns to new

[jira] [Commented] (SPARK-34764) Propagate reason for executor loss to the UI

[ https://issues.apache.org/jira/browse/SPARK-34764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344211#comment-17344211 ] Apache Spark commented on SPARK-34764: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-35329) Split generated switch code into pieces in ExpandExec

[ https://issues.apache.org/jira/browse/SPARK-35329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-35329. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32457

[jira] [Assigned] (SPARK-35329) Split generated switch code into pieces in ExpandExec

[ https://issues.apache.org/jira/browse/SPARK-35329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-35329: --- Assignee: Takeshi Yamamuro > Split generated switch code into pieces in ExpandExec >

[jira] [Updated] (SPARK-35403) Migrate ALTER TABLE commands that alter columns to new framework

[ https://issues.apache.org/jira/browse/SPARK-35403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-35403: -- Description: Migrate the following ALTER TABLE commands: * ALTER TABLE ... ADD COLUMNS * ALTER

[jira] [Created] (SPARK-35403) Migrate ALTER TABLE commands that alter columns to new framework

Terry Kim created SPARK-35403: - Summary: Migrate ALTER TABLE commands that alter columns to new framework Key: SPARK-35403 URL: https://issues.apache.org/jira/browse/SPARK-35403 Project: Spark

[jira] [Resolved] (SPARK-34764) Propagate reason for executor loss to the UI

[ https://issues.apache.org/jira/browse/SPARK-34764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-34764. -- Fix Version/s: 3.2.0 Assignee: Holden Karau Resolution: Fixed Merged. For

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344105#comment-17344105 ] Sungwon edited comment on SPARK-11844 at 5/13/21, 7:58 PM: --- I'm in agreement

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344105#comment-17344105 ] Sungwon edited comment on SPARK-11844 at 5/13/21, 7:58 PM: --- I'm in agreement

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344105#comment-17344105 ] Sungwon edited comment on SPARK-11844 at 5/13/21, 7:57 PM: --- I'm in agreement

[jira] [Commented] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344105#comment-17344105 ] Sungwon commented on SPARK-11844: - I'm in agreement with your intuition that S3aOutputStream may be

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344095#comment-17344095 ] Sungwon edited comment on SPARK-11844 at 5/13/21, 7:42 PM: --- [~hryhoriev.nick] 

[jira] [Commented] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344095#comment-17344095 ] Sungwon commented on SPARK-11844: - [~hryhoriev.nick] where do you see this option? I don't see it in

[jira] [Commented] (SPARK-34941) Enable mypy for pandas-on-Spark

[ https://issues.apache.org/jira/browse/SPARK-34941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344061#comment-17344061 ] Apache Spark commented on SPARK-34941: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34941) Enable mypy for pandas-on-Spark

[ https://issues.apache.org/jira/browse/SPARK-34941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34941: Assignee: Apache Spark > Enable mypy for pandas-on-Spark >

[jira] [Commented] (SPARK-34941) Enable mypy for pandas-on-Spark

[ https://issues.apache.org/jira/browse/SPARK-34941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344062#comment-17344062 ] Apache Spark commented on SPARK-34941: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34941) Enable mypy for pandas-on-Spark

[ https://issues.apache.org/jira/browse/SPARK-34941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34941: Assignee: (was: Apache Spark) > Enable mypy for pandas-on-Spark >

[jira] [Resolved] (SPARK-35397) Replace sys.err usage with explicit exception type

[ https://issues.apache.org/jira/browse/SPARK-35397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35397. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32535

[jira] [Assigned] (SPARK-35393) PIP packaging test is skipped in GitHub Actions build

[ https://issues.apache.org/jira/browse/SPARK-35393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35393: - Assignee: Hyukjin Kwon > PIP packaging test is skipped in GitHub Actions build >

[jira] [Resolved] (SPARK-35393) PIP packaging test is skipped in GitHub Actions build

[ https://issues.apache.org/jira/browse/SPARK-35393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35393. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32537

[jira] [Resolved] (SPARK-35366) Avoid using deprecated `buildForBatch` and `buildForStreaming`

[ https://issues.apache.org/jira/browse/SPARK-35366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35366. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32497

[jira] [Assigned] (SPARK-35366) Avoid using deprecated `buildForBatch` and `buildForStreaming`

[ https://issues.apache.org/jira/browse/SPARK-35366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35366: --- Assignee: Linhong Liu > Avoid using deprecated `buildForBatch` and `buildForStreaming` >

[jira] [Commented] (SPARK-35402) Make thread pool of jetty server in Web UIs configurable

[ https://issues.apache.org/jira/browse/SPARK-35402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344004#comment-17344004 ] Apache Spark commented on SPARK-35402: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35402) Make thread pool of jetty server in Web UIs configurable

[ https://issues.apache.org/jira/browse/SPARK-35402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35402: Assignee: Apache Spark > Make thread pool of jetty server in Web UIs configurable >

[jira] [Assigned] (SPARK-35402) Make thread pool of jetty server in Web UIs configurable

[ https://issues.apache.org/jira/browse/SPARK-35402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35402: Assignee: (was: Apache Spark) > Make thread pool of jetty server in Web UIs

[jira] [Created] (SPARK-35402) Make thread pool of jetty server in Web UIs configurable

Kent Yao created SPARK-35402: Summary: Make thread pool of jetty server in Web UIs configurable Key: SPARK-35402 URL: https://issues.apache.org/jira/browse/SPARK-35402 Project: Spark Issue

[jira] [Updated] (SPARK-35401) java.io.StreamCorruptedException: invalid stream header: 204356EC when using toPandas() with PySpark

[ https://issues.apache.org/jira/browse/SPARK-35401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Farmer updated SPARK-35401: -- Description: Whenever I try to read a Spark dataset using PySpark and convert it to a Pandas

[jira] [Created] (SPARK-35401) java.io.StreamCorruptedException: invalid stream header: 204356EC when using toPandas() with PySpark

Nathan Farmer created SPARK-35401: - Summary: java.io.StreamCorruptedException: invalid stream header: 204356EC when using toPandas() with PySpark Key: SPARK-35401 URL:

[jira] [Commented] (SPARK-35256) str_to_map + split performance regression

[ https://issues.apache.org/jira/browse/SPARK-35256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343929#comment-17343929 ] Ondrej Kokes commented on SPARK-35256: -- I ran git bisect with the setup mentioned in this ticket

[jira] [Updated] (SPARK-35256) str_to_map + split performance regression

[ https://issues.apache.org/jira/browse/SPARK-35256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ondrej Kokes updated SPARK-35256: - Attachment: bisect_timing.csv bisect_log.txt > str_to_map + split performance

[jira] [Resolved] (SPARK-35062) Group exception messages in sql/streaming

[ https://issues.apache.org/jira/browse/SPARK-35062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35062. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32464

[jira] [Assigned] (SPARK-35062) Group exception messages in sql/streaming

[ https://issues.apache.org/jira/browse/SPARK-35062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35062: --- Assignee: jiaan.geng > Group exception messages in sql/streaming >

[jira] [Resolved] (SPARK-35332) Not Coalesce shuffle partitions when cache table

[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35332. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32482

[jira] [Commented] (SPARK-35399) State is still needed in the event of executor failure

[ https://issues.apache.org/jira/browse/SPARK-35399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343911#comment-17343911 ] Apache Spark commented on SPARK-35399: -- User 'chrisheaththomas' has created a pull request for this

[jira] [Assigned] (SPARK-35332) Not Coalesce shuffle partitions when cache table

[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35332: --- Assignee: XiDuo You > Not Coalesce shuffle partitions when cache table >

[jira] [Assigned] (SPARK-35399) State is still needed in the event of executor failure

[ https://issues.apache.org/jira/browse/SPARK-35399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35399: Assignee: (was: Apache Spark) > State is still needed in the event of executor

[jira] [Assigned] (SPARK-35399) State is still needed in the event of executor failure

[ https://issues.apache.org/jira/browse/SPARK-35399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35399: Assignee: Apache Spark > State is still needed in the event of executor failure >

[jira] [Commented] (SPARK-35399) State is still needed in the event of executor failure

[ https://issues.apache.org/jira/browse/SPARK-35399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343910#comment-17343910 ] Apache Spark commented on SPARK-35399: -- User 'chrisheaththomas' has created a pull request for this

[jira] [Commented] (SPARK-35400) improve error message for correlated subquery

[ https://issues.apache.org/jira/browse/SPARK-35400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343902#comment-17343902 ] Apache Spark commented on SPARK-35400: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35400) improve error message for correlated subquery

[ https://issues.apache.org/jira/browse/SPARK-35400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35400: Assignee: Apache Spark > improve error message for correlated subquery >

[jira] [Commented] (SPARK-35400) improve error message for correlated subquery

[ https://issues.apache.org/jira/browse/SPARK-35400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343900#comment-17343900 ] Apache Spark commented on SPARK-35400: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35400) improve error message for correlated subquery

[ https://issues.apache.org/jira/browse/SPARK-35400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35400: Assignee: (was: Apache Spark) > improve error message for correlated subquery >

[jira] [Created] (SPARK-35400) improve error message for correlated subquery

Wenchen Fan created SPARK-35400: --- Summary: improve error message for correlated subquery Key: SPARK-35400 URL: https://issues.apache.org/jira/browse/SPARK-35400 Project: Spark Issue Type:

[jira] [Updated] (SPARK-35399) State is still needed in the event of executor failure

[ https://issues.apache.org/jira/browse/SPARK-35399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris updated SPARK-35399: -- Description: [Graceful Decommission of

[jira] [Assigned] (SPARK-35162) New SQL functions: TRY_ADD/TRY_DIVIDE

[ https://issues.apache.org/jira/browse/SPARK-35162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-35162: -- Assignee: Gengliang Wang > New SQL functions: TRY_ADD/TRY_DIVIDE >

[jira] [Resolved] (SPARK-35162) New SQL functions: TRY_ADD/TRY_DIVIDE

[ https://issues.apache.org/jira/browse/SPARK-35162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35162. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32292

[jira] [Created] (SPARK-35399) State is still needed in the event of executor failure

Chris created SPARK-35399: - Summary: State is still needed in the event of executor failure Key: SPARK-35399 URL: https://issues.apache.org/jira/browse/SPARK-35399 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-35373) Verify checksums of downloaded artifacts in build/mvn

[ https://issues.apache.org/jira/browse/SPARK-35373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-35373. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32505

[jira] [Assigned] (SPARK-35392) Flaky Test: GaussianMixture at ml/clustering.py and Word2Vec at ml/feature.py

[ https://issues.apache.org/jira/browse/SPARK-35392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35392: Assignee: zhengruifeng > Flaky Test: GaussianMixture at ml/clustering.py and Word2Vec at

[jira] [Updated] (SPARK-35392) Flaky Test: GaussianMixture at ml/clustering.py and Word2Vec at ml/feature.py

[ https://issues.apache.org/jira/browse/SPARK-35392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35392: - Fix Version/s: 3.2.0 > Flaky Test: GaussianMixture at ml/clustering.py and Word2Vec at

[jira] [Resolved] (SPARK-35392) Flaky Test: GaussianMixture at ml/clustering.py and Word2Vec at ml/feature.py

[ https://issues.apache.org/jira/browse/SPARK-35392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35392. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/32533 > Flaky Test:

[jira] [Assigned] (SPARK-35393) PIP packaging test is skipped in GitHub Actions build

[ https://issues.apache.org/jira/browse/SPARK-35393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35393: Assignee: Apache Spark > PIP packaging test is skipped in GitHub Actions build >

[jira] [Commented] (SPARK-35393) PIP packaging test is skipped in GitHub Actions build

[ https://issues.apache.org/jira/browse/SPARK-35393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343853#comment-17343853 ] Apache Spark commented on SPARK-35393: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-35393) PIP packaging test is skipped in GitHub Actions build

[ https://issues.apache.org/jira/browse/SPARK-35393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35393: Assignee: (was: Apache Spark) > PIP packaging test is skipped in GitHub Actions

[jira] [Resolved] (SPARK-34637) Support DPP in AQE when the boradcast exchange can be reused

[ https://issues.apache.org/jira/browse/SPARK-34637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34637. - Fix Version/s: 3.2.0 Resolution: Fixed > Support DPP in AQE when the boradcast exchange

[jira] [Assigned] (SPARK-34637) Support DPP in AQE when the boradcast exchange can be reused

[ https://issues.apache.org/jira/browse/SPARK-34637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34637: --- Assignee: Ke Jia > Support DPP in AQE when the boradcast exchange can be reused >

[jira] [Assigned] (SPARK-34720) Incorrect star expansion logic MERGE INSERT * / UPDATE *

[ https://issues.apache.org/jira/browse/SPARK-34720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34720: --- Assignee: Wenchen Fan > Incorrect star expansion logic MERGE INSERT * / UPDATE * >

[jira] [Resolved] (SPARK-34720) Incorrect star expansion logic MERGE INSERT * / UPDATE *

[ https://issues.apache.org/jira/browse/SPARK-34720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34720. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32192

[jira] [Resolved] (SPARK-35350) Add code-gen for left semi sort merge join

[ https://issues.apache.org/jira/browse/SPARK-35350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35350. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32528

[jira] [Assigned] (SPARK-35350) Add code-gen for left semi sort merge join

[ https://issues.apache.org/jira/browse/SPARK-35350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35350: --- Assignee: Cheng Su > Add code-gen for left semi sort merge join >

[jira] [Updated] (SPARK-35392) Flaky Test: GaussianMixture at ml/clustering.py and Word2Vec at ml/feature.py

[ https://issues.apache.org/jira/browse/SPARK-35392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35392: - Description: Some python tests should be updated/removed, because of

[jira] [Updated] (SPARK-35392) Flaky Test: GaussianMixture at ml/clustering.py and Word2Vec at ml/feature.py

[ https://issues.apache.org/jira/browse/SPARK-35392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35392: - Summary: Flaky Test: GaussianMixture at ml/clustering.py and Word2Vec at ml/feature.py (was:

[jira] [Assigned] (SPARK-28834) JDBC option "sessionInitStatement" does not executes sql statement when write data into database from dataframe

[ https://issues.apache.org/jira/browse/SPARK-28834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28834: Assignee: (was: Apache Spark) > JDBC option "sessionInitStatement" does not executes

[jira] [Updated] (SPARK-35392) Flaky Test: spark/spark/python/pyspark/ml/clustering.py GaussianMixture

[ https://issues.apache.org/jira/browse/SPARK-35392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-35392: - Description: Some python tests should be updated/removed, because of

[jira] [Assigned] (SPARK-28834) JDBC option "sessionInitStatement" does not executes sql statement when write data into database from dataframe

[ https://issues.apache.org/jira/browse/SPARK-28834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28834: Assignee: Apache Spark > JDBC option "sessionInitStatement" does not executes sql

[jira] [Assigned] (SPARK-35398) Simplify the way to get classes from ClassBodyEvaluator in CodeGenerator.updateAndGetCompilationStats method

[ https://issues.apache.org/jira/browse/SPARK-35398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35398: Assignee: (was: Apache Spark) > Simplify the way to get classes from

[jira] [Assigned] (SPARK-35398) Simplify the way to get classes from ClassBodyEvaluator in CodeGenerator.updateAndGetCompilationStats method

[ https://issues.apache.org/jira/browse/SPARK-35398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35398: Assignee: Apache Spark > Simplify the way to get classes from ClassBodyEvaluator in >

[jira] [Created] (SPARK-35398) Simplify the way to get classes from ClassBodyEvaluator in CodeGenerator.updateAndGetCompilationStats method

Yang Jie created SPARK-35398: Summary: Simplify the way to get classes from ClassBodyEvaluator in CodeGenerator.updateAndGetCompilationStats method Key: SPARK-35398 URL:

[jira] [Commented] (SPARK-35253) Upgrade Janino from 3.0.16 to 3.1.4

[ https://issues.apache.org/jira/browse/SPARK-35253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343791#comment-17343791 ] Apache Spark commented on SPARK-35253: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-35380) Support loading SparkSessionExtensions from ServiceLoader

[ https://issues.apache.org/jira/browse/SPARK-35380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-35380: Assignee: Kent Yao > Support loading SparkSessionExtensions from ServiceLoader >

[jira] [Resolved] (SPARK-35380) Support loading SparkSessionExtensions from ServiceLoader

[ https://issues.apache.org/jira/browse/SPARK-35380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-35380. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32515

[jira] [Updated] (SPARK-35396) Support to manual close/release entries in MemoryStore and InMemoryRelation instead of replying on GC

[ https://issues.apache.org/jira/browse/SPARK-35396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chendi.Xue updated SPARK-35396: --- Summary: Support to manual close/release entries in MemoryStore and InMemoryRelation instead of

[jira] [Updated] (SPARK-35396) Support to manual close entries in MemoryStore and InMemoryRelation

[ https://issues.apache.org/jira/browse/SPARK-35396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chendi.Xue updated SPARK-35396: --- External issue ID: (was: 32534) External issue URL: (was:

[jira] [Updated] (SPARK-35396) Support to manual close entries in MemoryStore and InMemoryRelation

[ https://issues.apache.org/jira/browse/SPARK-35396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chendi.Xue updated SPARK-35396: --- Affects Version/s: (was: 3.0.0) 3.2.0 3.1.2

[jira] [Commented] (SPARK-35397) Replace sys.err usage with explicit exception type

[ https://issues.apache.org/jira/browse/SPARK-35397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343764#comment-17343764 ] Apache Spark commented on SPARK-35397: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35397) Replace sys.err usage with explicit exception type

[ https://issues.apache.org/jira/browse/SPARK-35397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35397: Assignee: Apache Spark (was: L. C. Hsieh) > Replace sys.err usage with explicit

  1   2   >