[jira] [Commented] (SPARK-37049) executorIdleTimeout is not working for pending pods on K8s

[ https://issues.apache.org/jira/browse/SPARK-37049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430998#comment-17430998 ] Weiwei Yang commented on SPARK-37049: - Thank you [~dongjoon]. Seems like this issue

[jira] [Commented] (SPARK-37006) MapStatus adds localDirs to avoid the rpc request by method getHostLocalDirs when shuffle reading

[ https://issues.apache.org/jira/browse/SPARK-37006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430994#comment-17430994 ] jinhai commented on SPARK-37006: hi [~Ngone51], can you review this issue for me? > Map

[jira] [Resolved] (SPARK-37029) Modify the assignment logic of dirFetchRequests variables

[ https://issues.apache.org/jira/browse/SPARK-37029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jinhai resolved SPARK-37029. Resolution: Won't Fix > Modify the assignment logic of dirFetchRequests variables > --

[jira] [Resolved] (SPARK-37049) executorIdleTimeout is not working for pending pods on K8s

[ https://issues.apache.org/jira/browse/SPARK-37049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37049. --- Fix Version/s: 3.1.3 3.2.1 3.3.0 Resolution: Fix

[jira] [Assigned] (SPARK-37049) executorIdleTimeout is not working for pending pods on K8s

[ https://issues.apache.org/jira/browse/SPARK-37049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37049: - Assignee: wwei > executorIdleTimeout is not working for pending pods on K8s > -

[jira] [Commented] (SPARK-27696) kubernetes driver pod not deleted after finish.

[ https://issues.apache.org/jira/browse/SPARK-27696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430971#comment-17430971 ] Jin Xing commented on SPARK-27696: -- We also suffer from this issue. From our side, we h

[jira] [Resolved] (SPARK-36348) unexpected Index loaded: pd.Index([10, 20, None], name="x")

[ https://issues.apache.org/jira/browse/SPARK-36348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36348. -- Fix Version/s: 3.3.0 Resolution: Fixed Fixed in https://github.com/apache/spark/pull/34

[jira] [Updated] (SPARK-37068) Confusing tgz filename for download

[ https://issues.apache.org/jira/browse/SPARK-37068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Yu updated SPARK-37068: - Attachment: spark-download-issue.png > Confusing tgz filename for download > ---

[jira] [Created] (SPARK-37068) Confusing tgz filename for download

James Yu created SPARK-37068: Summary: Confusing tgz filename for download Key: SPARK-37068 URL: https://issues.apache.org/jira/browse/SPARK-37068 Project: Spark Issue Type: Bug Compone

[jira] [Commented] (SPARK-37067) DateTimeUtils.stringToTimestamp() incorrectly rejects timezone without colon

[ https://issues.apache.org/jira/browse/SPARK-37067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430872#comment-17430872 ] Apache Spark commented on SPARK-37067: -- User 'linhongliu-db' has created a pull req

[jira] [Commented] (SPARK-37067) DateTimeUtils.stringToTimestamp() incorrectly rejects timezone without colon

[ https://issues.apache.org/jira/browse/SPARK-37067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430871#comment-17430871 ] Apache Spark commented on SPARK-37067: -- User 'linhongliu-db' has created a pull req

[jira] [Assigned] (SPARK-37067) DateTimeUtils.stringToTimestamp() incorrectly rejects timezone without colon

[ https://issues.apache.org/jira/browse/SPARK-37067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37067: Assignee: (was: Apache Spark) > DateTimeUtils.stringToTimestamp() incorrectly rejects

[jira] [Assigned] (SPARK-37067) DateTimeUtils.stringToTimestamp() incorrectly rejects timezone without colon

[ https://issues.apache.org/jira/browse/SPARK-37067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37067: Assignee: Apache Spark > DateTimeUtils.stringToTimestamp() incorrectly rejects timezone w

[jira] [Created] (SPARK-37067) DateTimeUtils.stringToTimestamp() incorrectly rejects timezone without colon

Linhong Liu created SPARK-37067: --- Summary: DateTimeUtils.stringToTimestamp() incorrectly rejects timezone without colon Key: SPARK-37067 URL: https://issues.apache.org/jira/browse/SPARK-37067 Project: S

[jira] [Assigned] (SPARK-36348) unexpected Index loaded: pd.Index([10, 20, None], name="x")

[ https://issues.apache.org/jira/browse/SPARK-36348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36348: Assignee: Yikun Jiang > unexpected Index loaded: pd.Index([10, 20, None], name="x") > ---

[jira] [Commented] (SPARK-37066) Improve ORC RecordReader's error message

[ https://issues.apache.org/jira/browse/SPARK-37066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430858#comment-17430858 ] Apache Spark commented on SPARK-37066: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-37066) Improve ORC RecordReader's error message

[ https://issues.apache.org/jira/browse/SPARK-37066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37066: Assignee: Apache Spark > Improve ORC RecordReader's error message > -

[jira] [Commented] (SPARK-37066) Improve ORC RecordReader's error message

[ https://issues.apache.org/jira/browse/SPARK-37066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430857#comment-17430857 ] Apache Spark commented on SPARK-37066: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-37066) Improve ORC RecordReader's error message

[ https://issues.apache.org/jira/browse/SPARK-37066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37066: Assignee: (was: Apache Spark) > Improve ORC RecordReader's error message > --

[jira] [Created] (SPARK-37066) Improve ORC RecordReader's error message

angerszhu created SPARK-37066: - Summary: Improve ORC RecordReader's error message Key: SPARK-37066 URL: https://issues.apache.org/jira/browse/SPARK-37066 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-37035) Improve error message when use vectorize reader

[ https://issues.apache.org/jira/browse/SPARK-37035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-37035: -- Parent: SPARK-37065 Issue Type: Sub-task (was: Improvement) > Improve error message when use

[jira] [Created] (SPARK-37065) improve File reader's error message for each data source

angerszhu created SPARK-37065: - Summary: improve File reader's error message for each data source Key: SPARK-37065 URL: https://issues.apache.org/jira/browse/SPARK-37065 Project: Spark Issue Type

[jira] [Resolved] (SPARK-37044) Add Row to __all__ in pyspark.sql.types

[ https://issues.apache.org/jira/browse/SPARK-37044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37044. -- Fix Version/s: 3.3.0 Assignee: Maciej Szymkiewicz Resolution: Fixed Fixed in h

[jira] [Assigned] (SPARK-36763) Pull out ordering expressions

[ https://issues.apache.org/jira/browse/SPARK-36763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36763: Assignee: Apache Spark > Pull out ordering expressions > - >

[jira] [Assigned] (SPARK-36763) Pull out ordering expressions

[ https://issues.apache.org/jira/browse/SPARK-36763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36763: Assignee: (was: Apache Spark) > Pull out ordering expressions > -

[jira] [Assigned] (SPARK-37064) Fix outer join return the wrong max rows if other side is empty

[ https://issues.apache.org/jira/browse/SPARK-37064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37064: Assignee: Apache Spark > Fix outer join return the wrong max rows if other side is empty

[jira] [Commented] (SPARK-37064) Fix outer join return the wrong max rows if other side is empty

[ https://issues.apache.org/jira/browse/SPARK-37064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430846#comment-17430846 ] Apache Spark commented on SPARK-37064: -- User 'ulysses-you' has created a pull reque

[jira] [Commented] (SPARK-36763) Pull out ordering expressions

[ https://issues.apache.org/jira/browse/SPARK-36763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430847#comment-17430847 ] Apache Spark commented on SPARK-36763: -- User 'RabbidHY' has created a pull request

[jira] [Assigned] (SPARK-36348) unexpected Index loaded: pd.Index([10, 20, None], name="x")

[ https://issues.apache.org/jira/browse/SPARK-36348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36348: Assignee: (was: Apache Spark) > unexpected Index loaded: pd.Index([10, 20, None], nam

[jira] [Assigned] (SPARK-37064) Fix outer join return the wrong max rows if other side is empty

[ https://issues.apache.org/jira/browse/SPARK-37064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37064: Assignee: (was: Apache Spark) > Fix outer join return the wrong max rows if other sid

[jira] [Assigned] (SPARK-36348) unexpected Index loaded: pd.Index([10, 20, None], name="x")

[ https://issues.apache.org/jira/browse/SPARK-36348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36348: Assignee: Apache Spark > unexpected Index loaded: pd.Index([10, 20, None], name="x") > --

[jira] [Commented] (SPARK-36348) unexpected Index loaded: pd.Index([10, 20, None], name="x")

[ https://issues.apache.org/jira/browse/SPARK-36348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430845#comment-17430845 ] Apache Spark commented on SPARK-36348: -- User 'Yikun' has created a pull request for

[jira] [Created] (SPARK-37064) Fix outer join return the wrong max rows if other side is empty

XiDuo You created SPARK-37064: - Summary: Fix outer join return the wrong max rows if other side is empty Key: SPARK-37064 URL: https://issues.apache.org/jira/browse/SPARK-37064 Project: Spark Is

[jira] [Commented] (SPARK-37063) SQL Adaptive Query Execution QA: Phase 2

[ https://issues.apache.org/jira/browse/SPARK-37063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430838#comment-17430838 ] XiDuo You commented on SPARK-37063: --- thank you [~dongjoon] for creating this umbrella

[jira] [Resolved] (SPARK-37002) Introduce the 'compute.eager_check' option

[ https://issues.apache.org/jira/browse/SPARK-37002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37002. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34281 [https://gi

[jira] [Assigned] (SPARK-37002) Introduce the 'compute.eager_check' option

[ https://issues.apache.org/jira/browse/SPARK-37002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37002: Assignee: dch nguyen > Introduce the 'compute.eager_check' option > -

[jira] [Resolved] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-37059. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved in https://github.com/apache/

[jira] [Resolved] (SPARK-37041) Backport HIVE-15025: Secure-Socket-Layer (SSL) support for HMS

[ https://issues.apache.org/jira/browse/SPARK-37041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-37041. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34312 [https://gith

[jira] [Assigned] (SPARK-37041) Backport HIVE-15025: Secure-Socket-Layer (SSL) support for HMS

[ https://issues.apache.org/jira/browse/SPARK-37041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-37041: --- Assignee: Yuming Wang > Backport HIVE-15025: Secure-Socket-Layer (SSL) support for HMS > --

[jira] [Commented] (SPARK-37043) Cancel all running job after AQE plan finished

[ https://issues.apache.org/jira/browse/SPARK-37043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430797#comment-17430797 ] Erik Krogen commented on SPARK-37043: - [~ulysses] any concerns if I make this a sub-

[jira] [Commented] (SPARK-33828) SQL Adaptive Query Execution QA

[ https://issues.apache.org/jira/browse/SPARK-33828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430798#comment-17430798 ] Erik Krogen commented on SPARK-33828: - Thanks [~dongjoon]! > SQL Adaptive Query Exe

[jira] [Assigned] (SPARK-37062) Introduce a new data source for providing consistent set of rows per microbatch

[ https://issues.apache.org/jira/browse/SPARK-37062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37062: Assignee: (was: Apache Spark) > Introduce a new data source for providing consistent

[jira] [Assigned] (SPARK-37062) Introduce a new data source for providing consistent set of rows per microbatch

[ https://issues.apache.org/jira/browse/SPARK-37062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37062: Assignee: Apache Spark > Introduce a new data source for providing consistent set of rows

[jira] [Commented] (SPARK-37062) Introduce a new data source for providing consistent set of rows per microbatch

[ https://issues.apache.org/jira/browse/SPARK-37062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430796#comment-17430796 ] Apache Spark commented on SPARK-37062: -- User 'HeartSaVioR' has created a pull reque

[jira] [Commented] (SPARK-33828) SQL Adaptive Query Execution QA

[ https://issues.apache.org/jira/browse/SPARK-33828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430790#comment-17430790 ] Dongjoon Hyun commented on SPARK-33828: --- To All. This JIRA contains all efforts de

[jira] [Resolved] (SPARK-33828) SQL Adaptive Query Execution QA

[ https://issues.apache.org/jira/browse/SPARK-33828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33828. --- Fix Version/s: 3.2.0 Resolution: Done > SQL Adaptive Query Execution QA > ---

[jira] [Updated] (SPARK-36443) Demote BroadcastJoin causes performance regression and increases OOM risks

[ https://issues.apache.org/jira/browse/SPARK-36443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36443: -- Parent: SPARK-37063 Issue Type: Sub-task (was: Bug) > Demote BroadcastJoin causes per

[jira] [Updated] (SPARK-35540) Make config maxShuffledHashJoinLocalMapThreshold fallback to advisoryPartitionSizeInBytes

[ https://issues.apache.org/jira/browse/SPARK-35540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35540: -- Parent: SPARK-37063 Issue Type: Sub-task (was: Bug) > Make config maxShuffledHashJoin

[jira] [Updated] (SPARK-36443) Demote BroadcastJoin causes performance regression and increases OOM risks

[ https://issues.apache.org/jira/browse/SPARK-36443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36443: -- Parent: (was: SPARK-33828) Issue Type: Bug (was: Sub-task) > Demote BroadcastJoin

[jira] [Updated] (SPARK-32304) Flaky Test: AdaptiveQueryExecSuite.multiple joins

[ https://issues.apache.org/jira/browse/SPARK-32304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32304: -- Parent: SPARK-37063 Issue Type: Sub-task (was: Bug) > Flaky Test: AdaptiveQueryExecSu

[jira] [Updated] (SPARK-35540) Make config maxShuffledHashJoinLocalMapThreshold fallback to advisoryPartitionSizeInBytes

[ https://issues.apache.org/jira/browse/SPARK-35540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35540: -- Parent: (was: SPARK-33828) Issue Type: Bug (was: Sub-task) > Make config maxShuff

[jira] [Updated] (SPARK-32304) Flaky Test: AdaptiveQueryExecSuite.multiple joins

[ https://issues.apache.org/jira/browse/SPARK-32304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32304: -- Parent: (was: SPARK-33828) Issue Type: Bug (was: Sub-task) > Flaky Test: Adaptive

[jira] [Updated] (SPARK-35414) Completely fix the broadcast timeout issue in AQE

[ https://issues.apache.org/jira/browse/SPARK-35414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35414: -- Parent: SPARK-37063 Issue Type: Sub-task (was: Bug) > Completely fix the broadcast ti

[jira] [Updated] (SPARK-35414) Completely fix the broadcast timeout issue in AQE

[ https://issues.apache.org/jira/browse/SPARK-35414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35414: -- Parent: (was: SPARK-33828) Issue Type: Bug (was: Sub-task) > Completely fix the b

[jira] [Updated] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34827: -- Parent: (was: SPARK-33828) Issue Type: Bug (was: Sub-task) > Support fetching shu

[jira] [Updated] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34827: -- Parent: SPARK-37063 Issue Type: Sub-task (was: Bug) > Support fetching shuffle blocks

[jira] [Created] (SPARK-37063) SQL Adaptive Query Execution QA: Phase 2

Dongjoon Hyun created SPARK-37063: - Summary: SQL Adaptive Query Execution QA: Phase 2 Key: SPARK-37063 URL: https://issues.apache.org/jira/browse/SPARK-37063 Project: Spark Issue Type: Umbrel

[jira] [Commented] (SPARK-36913) Implement createIndex and IndexExists in JDBC (MySQL dialect)

[ https://issues.apache.org/jira/browse/SPARK-36913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430780#comment-17430780 ] Reynold Xin commented on SPARK-36913: - My concern is not about JDBC (I should've com

[jira] [Commented] (SPARK-36913) Implement createIndex and IndexExists in JDBC (MySQL dialect)

[ https://issues.apache.org/jira/browse/SPARK-36913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430778#comment-17430778 ] Huaxin Gao commented on SPARK-36913: [~rxin] Hi Reynold, thank you for taking a loo

[jira] [Updated] (SPARK-29497) Cannot assign instance of java.lang.invoke.SerializedLambda to field

[ https://issues.apache.org/jira/browse/SPARK-29497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29497: -- Affects Version/s: 3.2.0 > Cannot assign instance of java.lang.invoke.SerializedLambda to fiel

[jira] [Updated] (SPARK-29497) Cannot assign instance of java.lang.invoke.SerializedLambda to field

[ https://issues.apache.org/jira/browse/SPARK-29497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29497: -- Environment: Spark 2.4.3 Scala 2.12 Spark 3.2.0 Scala 2.13.5 (Java 11.0.12) was:Spark 2.4.3

[jira] [Commented] (SPARK-37062) Introduce a new data source for providing consistent set of rows per microbatch

[ https://issues.apache.org/jira/browse/SPARK-37062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430761#comment-17430761 ] Jungtaek Lim commented on SPARK-37062: -- will submit a PR for this sooner. > Introd

[jira] [Created] (SPARK-37062) Introduce a new data source for providing consistent set of rows per microbatch

Jungtaek Lim created SPARK-37062: Summary: Introduce a new data source for providing consistent set of rows per microbatch Key: SPARK-37062 URL: https://issues.apache.org/jira/browse/SPARK-37062 Proje

[jira] [Updated] (SPARK-37061) Custom V2 Metrics uses wrong classname for lookup

[ https://issues.apache.org/jira/browse/SPARK-37061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Spitzer updated SPARK-37061: Description: Currently CustomMetrics uses `getCanonicalName` to get the metric type name

[jira] [Created] (SPARK-37061) Custom V2 Metrics uses wrong classname in for lookup

Russell Spitzer created SPARK-37061: --- Summary: Custom V2 Metrics uses wrong classname in for lookup Key: SPARK-37061 URL: https://issues.apache.org/jira/browse/SPARK-37061 Project: Spark Is

[jira] [Updated] (SPARK-37061) Custom V2 Metrics uses wrong classname for lookup

[ https://issues.apache.org/jira/browse/SPARK-37061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Spitzer updated SPARK-37061: Summary: Custom V2 Metrics uses wrong classname for lookup (was: Custom V2 Metrics uses w

[jira] [Commented] (SPARK-37044) Add Row to __all__ in pyspark.sql.types

[ https://issues.apache.org/jira/browse/SPARK-37044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430675#comment-17430675 ] Apache Spark commented on SPARK-37044: -- User 'zero323' has created a pull request f

[jira] [Assigned] (SPARK-37044) Add Row to __all__ in pyspark.sql.types

[ https://issues.apache.org/jira/browse/SPARK-37044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37044: Assignee: (was: Apache Spark) > Add Row to __all__ in pyspark.sql.types > ---

[jira] [Commented] (SPARK-37044) Add Row to __all__ in pyspark.sql.types

[ https://issues.apache.org/jira/browse/SPARK-37044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430673#comment-17430673 ] Apache Spark commented on SPARK-37044: -- User 'zero323' has created a pull request f

[jira] [Assigned] (SPARK-37044) Add Row to __all__ in pyspark.sql.types

[ https://issues.apache.org/jira/browse/SPARK-37044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37044: Assignee: Apache Spark > Add Row to __all__ in pyspark.sql.types > --

[jira] [Updated] (SPARK-33152) SPIP: Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-33152: - Description: h2. Q1. What are you trying to do? Articulate your objectives using absolutely no jargon. Proposi

[jira] [Updated] (SPARK-37060) Report driver status does not handle response from backup masters

[ https://issues.apache.org/jira/browse/SPARK-37060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohamadreza Rostami updated SPARK-37060: Description: After an improvement in SPARK-31486, contributor uses 'asyncSendToMas

[jira] [Updated] (SPARK-33152) SPIP: Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-33152: - Description: h2. Q1. What are you trying to do? Articulate your objectives using absolutely no jargon. Proposi

[jira] [Assigned] (SPARK-37060) Report driver status does not handle response from backup masters

[ https://issues.apache.org/jira/browse/SPARK-37060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37060: Assignee: (was: Apache Spark) > Report driver status does not handle response from ba

[jira] [Commented] (SPARK-37060) Report driver status does not handle response from backup masters

[ https://issues.apache.org/jira/browse/SPARK-37060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430613#comment-17430613 ] Apache Spark commented on SPARK-37060: -- User 'mohamadrezarostami' has created a pul

[jira] [Assigned] (SPARK-37060) Report driver status does not handle response from backup masters

[ https://issues.apache.org/jira/browse/SPARK-37060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37060: Assignee: Apache Spark > Report driver status does not handle response from backup master

[jira] [Updated] (SPARK-37060) Report driver status does not handle response from backup masters

[ https://issues.apache.org/jira/browse/SPARK-37060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohamadreza Rostami updated SPARK-37060: Description: After a improvement in SPARK-31486, contributor uses 'asyncSendToMast

[jira] [Created] (SPARK-37060) Report driver status does not handle response from backup masters

Mohamadreza Rostami created SPARK-37060: --- Summary: Report driver status does not handle response from backup masters Key: SPARK-37060 URL: https://issues.apache.org/jira/browse/SPARK-37060 Proje

[jira] [Resolved] (SPARK-36796) Make all unit tests pass on Java 17

[ https://issues.apache.org/jira/browse/SPARK-36796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36796. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34153 [https://gi

[jira] [Assigned] (SPARK-36796) Make all unit tests pass on Java 17

[ https://issues.apache.org/jira/browse/SPARK-36796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-36796: Assignee: Yang Jie > Make all unit tests pass on Java 17 > --

[jira] [Assigned] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37059: Assignee: Apache Spark (was: Kousuke Saruta) > Ensure the sort order of the output in th

[jira] [Commented] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430551#comment-17430551 ] Apache Spark commented on SPARK-37059: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37059: Assignee: Kousuke Saruta (was: Apache Spark) > Ensure the sort order of the output in th

[jira] [Updated] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37059: --- Description: The collect_set builtin function doesn't ensure the sort order of its result f

[jira] [Updated] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37059: --- Description: The collect_set builtin function doesn't ensure the sort order of its result f

[jira] [Updated] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37059: --- Description: The collect_set builtin function doesn't ensure the sort order of its result f

[jira] [Updated] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37059: --- Description: The collect_set builtin function doesn't ensure the sort order of its result f

[jira] [Updated] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37059: --- Component/s: Tests > Ensure the sort order of the output in the PySpark doctests > -

[jira] [Updated] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37059: --- Summary: Ensure the sort order of the output in the PySpark doctests (was: Ensure the sort

[jira] [Created] (SPARK-37059) Ensure the sort order of the output in the PySpark examples

Kousuke Saruta created SPARK-37059: -- Summary: Ensure the sort order of the output in the PySpark examples Key: SPARK-37059 URL: https://issues.apache.org/jira/browse/SPARK-37059 Project: Spark

[jira] [Assigned] (SPARK-37058) Add spark-shell command line unit test

[ https://issues.apache.org/jira/browse/SPARK-37058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37058: Assignee: (was: Apache Spark) > Add spark-shell command line unit test >

[jira] [Assigned] (SPARK-37058) Add spark-shell command line unit test

[ https://issues.apache.org/jira/browse/SPARK-37058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37058: Assignee: Apache Spark > Add spark-shell command line unit test > ---

[jira] [Commented] (SPARK-37058) Add spark-shell command line unit test

[ https://issues.apache.org/jira/browse/SPARK-37058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430484#comment-17430484 ] Apache Spark commented on SPARK-37058: -- User 'AngersZh' has created a pull requ

[jira] [Updated] (SPARK-37051) The filter operator gets wrong results in ORC's char type

[ https://issues.apache.org/jira/browse/SPARK-37051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] frankli updated SPARK-37051: Description: When I try the following sample SQL on  the TPCDS data, the filter operator returns an empty

[jira] [Commented] (SPARK-37051) The filter operator gets wrong results in ORC's char type

[ https://issues.apache.org/jira/browse/SPARK-37051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430450#comment-17430450 ] frankli commented on SPARK-37051: - It seems to be affected by the right padding. [SPARK

[jira] [Created] (SPARK-37058) Add spark-shell command line unit test

angerszhu created SPARK-37058: - Summary: Add spark-shell command line unit test Key: SPARK-37058 URL: https://issues.apache.org/jira/browse/SPARK-37058 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430425#comment-17430425 ] Michał Wieleba commented on SPARK-33564: Are there any plans to introduce Promet

[jira] [Resolved] (SPARK-37057) Fix wrong DocSearch facet filter in release-tag.sh

[ https://issues.apache.org/jira/browse/SPARK-37057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-37057. Fix Version/s: 3.2.1 3.3.0 Resolution: Fixed Issue resolved by p

[jira] [Updated] (SPARK-37051) The filter operator gets wrong results in ORC's char type

[ https://issues.apache.org/jira/browse/SPARK-37051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] frankli updated SPARK-37051: Affects Version/s: 3.3.0 > The filter operator gets wrong results in ORC's char type > ---

[jira] [Commented] (SPARK-36348) unexpected Index loaded: pd.Index([10, 20, None], name="x")

[ https://issues.apache.org/jira/browse/SPARK-36348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430392#comment-17430392 ] Yikun Jiang commented on SPARK-36348: - revisit this, it had been already fixed in cu

  1   2   >