[jira] [Assigned] (SPARK-35675) EnsureRequirements remove shuffle should respect PartitioningCollection

[ https://issues.apache.org/jira/browse/SPARK-35675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35675: Assignee: Apache Spark > EnsureRequirements remove shuffle should respect PartitioningCol

[jira] [Assigned] (SPARK-35675) EnsureRequirements remove shuffle should respect PartitioningCollection

[ https://issues.apache.org/jira/browse/SPARK-35675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35675: Assignee: (was: Apache Spark) > EnsureRequirements remove shuffle should respect Part

[jira] [Updated] (SPARK-35653) [SQL] CatalystToExternalMap interpreted path fails for Map with case classes as keys or values

[ https://issues.apache.org/jira/browse/SPARK-35653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35653: - Affects Version/s: 3.2.0 3.0.2 > [SQL] CatalystToExternalMap inte

[jira] [Commented] (SPARK-35675) EnsureRequirements remove shuffle should respect PartitioningCollection

[ https://issues.apache.org/jira/browse/SPARK-35675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359072#comment-17359072 ] Apache Spark commented on SPARK-35675: -- User 'ulysses-you' has created a pull reque

[jira] [Updated] (SPARK-35675) EnsureRequirements remove shuffle should respect PartitioningCollection

[ https://issues.apache.org/jira/browse/SPARK-35675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-35675: -- Description: Currently EnsureRequirements only check if child has semantic equal HashPartitioning and

[jira] [Created] (SPARK-35675) EnsureRequirements remove shuffle should respect PartitioningCollection

XiDuo You created SPARK-35675: - Summary: EnsureRequirements remove shuffle should respect PartitioningCollection Key: SPARK-35675 URL: https://issues.apache.org/jira/browse/SPARK-35675 Project: Spark

[jira] [Resolved] (SPARK-35632) SELECT rand(cast(3 / 7 AS int)) value gives different resultset in Spark 3.1 as compared to Spark 2.4.5

[ https://issues.apache.org/jira/browse/SPARK-35632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35632. -- Resolution: Not A Problem > SELECT rand(cast(3 / 7 AS int)) value gives different resu

[jira] [Commented] (SPARK-3159) Check for reducible DecisionTree

[ https://issues.apache.org/jira/browse/SPARK-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359064#comment-17359064 ] Carlos Bribiescas commented on SPARK-3159: -- [~xujiajin] Have added this request 

[jira] [Commented] (SPARK-35667) spark.speculation causes incorrect query results with TRANSFORM

[ https://issues.apache.org/jira/browse/SPARK-35667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359062#comment-17359062 ] Takeshi Yamamuro commented on SPARK-35667: -- Could you check this in newer Spark

[jira] [Commented] (SPARK-35673) Spark fails on unrecognized hint in subquery

[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359059#comment-17359059 ] Takeshi Yamamuro commented on SPARK-35673: -- Since 2.4.x does not have this issu

[jira] [Updated] (SPARK-35673) Spark fails on unrecognized hint in subquery

[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35673: - Affects Version/s: 3.2.0 > Spark fails on unrecognized hint in subquery > --

[jira] [Created] (SPARK-35674) Test timestamp without time zone in UDF

Gengliang Wang created SPARK-35674: -- Summary: Test timestamp without time zone in UDF Key: SPARK-35674 URL: https://issues.apache.org/jira/browse/SPARK-35674 Project: Spark Issue Type: Sub-t

[jira] [Commented] (SPARK-35637) 2 active tasks shown in Spark UI but executor core is 1 and task cpu is 1

[ https://issues.apache.org/jira/browse/SPARK-35637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359041#comment-17359041 ] Kousuke Saruta commented on SPARK-35637: Hmm, the cause seems task-result-getter

[jira] [Commented] (SPARK-35664) Support java.time. LocalDateTime as an external type of TimestampWithoutTZ type

[ https://issues.apache.org/jira/browse/SPARK-35664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359038#comment-17359038 ] Apache Spark commented on SPARK-35664: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-35664) Support java.time. LocalDateTime as an external type of TimestampWithoutTZ type

[ https://issues.apache.org/jira/browse/SPARK-35664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35664: Assignee: Gengliang Wang (was: Apache Spark) > Support java.time. LocalDateTime as an ex

[jira] [Assigned] (SPARK-35664) Support java.time. LocalDateTime as an external type of TimestampWithoutTZ type

[ https://issues.apache.org/jira/browse/SPARK-35664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35664: Assignee: Apache Spark (was: Gengliang Wang) > Support java.time. LocalDateTime as an ex

[jira] [Commented] (SPARK-35664) Support java.time. LocalDateTime as an external type of TimestampWithoutTZ type

[ https://issues.apache.org/jira/browse/SPARK-35664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359036#comment-17359036 ] Apache Spark commented on SPARK-35664: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-34591) Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challenging to

[ https://issues.apache.org/jira/browse/SPARK-34591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34591: Assignee: Apache Spark > Pyspark undertakes pruning of decision trees and random forests

[jira] [Assigned] (SPARK-34591) Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challenging to

[ https://issues.apache.org/jira/browse/SPARK-34591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34591: Assignee: (was: Apache Spark) > Pyspark undertakes pruning of decision trees and rand

[jira] [Commented] (SPARK-34591) Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challenging to

[ https://issues.apache.org/jira/browse/SPARK-34591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359034#comment-17359034 ] Apache Spark commented on SPARK-34591: -- User 'CBribiescas' has created a pull reque

[jira] [Commented] (SPARK-34591) Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challenging to

[ https://issues.apache.org/jira/browse/SPARK-34591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359033#comment-17359033 ] Apache Spark commented on SPARK-34591: -- User 'CBribiescas' has created a pull reque

[jira] [Commented] (SPARK-35636) Do not push down extract value in higher order function that references both sides of a join

[ https://issues.apache.org/jira/browse/SPARK-35636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359025#comment-17359025 ] Apache Spark commented on SPARK-35636: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-35668) Use "concurrency" setting on Github Actions

[ https://issues.apache.org/jira/browse/SPARK-35668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35668: Assignee: Yikun Jiang > Use "concurrency" setting on Github Actions > ---

[jira] [Resolved] (SPARK-35668) Use "concurrency" setting on Github Actions

[ https://issues.apache.org/jira/browse/SPARK-35668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35668. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32806 [https://gi

[jira] [Assigned] (SPARK-35603) Add data source options link for R API documentation.

[ https://issues.apache.org/jira/browse/SPARK-35603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35603: Assignee: Haejoon Lee > Add data source options link for R API documentation. > -

[jira] [Resolved] (SPARK-35603) Add data source options link for R API documentation.

[ https://issues.apache.org/jira/browse/SPARK-35603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35603. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32797 [https://gi

[jira] [Assigned] (SPARK-35638) Introduce InternalField to manage dtypes and StructFields.

[ https://issues.apache.org/jira/browse/SPARK-35638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35638: Assignee: Takuya Ueshin > Introduce InternalField to manage dtypes and StructFields. > --

[jira] [Resolved] (SPARK-35638) Introduce InternalField to manage dtypes and StructFields.

[ https://issues.apache.org/jira/browse/SPARK-35638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35638. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32775 [https://gi

[jira] [Commented] (SPARK-35667) spark.speculation causes incorrect query results with TRANSFORM

[ https://issues.apache.org/jira/browse/SPARK-35667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358998#comment-17358998 ] yuanxm commented on SPARK-35667: FYI, here is a strange thing, the input size/records of

[jira] [Updated] (SPARK-35667) spark.speculation causes incorrect query results with TRANSFORM

[ https://issues.apache.org/jira/browse/SPARK-35667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxm updated SPARK-35667: --- Attachment: image-2021-06-08-10-02-34-979.png > spark.speculation causes incorrect query results with TRANSF

[jira] [Commented] (SPARK-29626) notEqual() should return true when the one is null, the other is not null

[ https://issues.apache.org/jira/browse/SPARK-29626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358969#comment-17358969 ] dc-heros commented on SPARK-29626: -- I would like to work on this > notEqual() should r

[jira] [Updated] (SPARK-35673) Spark fails on unrecognized hint in subquery

[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Willi Raschkowski updated SPARK-35673: -- Issue Type: Bug (was: Task) > Spark fails on unrecognized hint in subquery >

[jira] [Updated] (SPARK-35673) Spark fails on unrecognized hint in subquery

[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Willi Raschkowski updated SPARK-35673: -- Description: Spark queries to fail on unrecognized hints in subqueries. An example to

[jira] [Updated] (SPARK-35673) Spark fails on unrecognized hint in subquery

[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Willi Raschkowski updated SPARK-35673: -- Description: Spark queries seem to fail on unrecognized hints in subqueries. An exampl

[jira] [Updated] (SPARK-35673) Spark fails on unrecognized hint in subquery

[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Willi Raschkowski updated SPARK-35673: -- Description: Spark fails on unrecognized hint in subquery. To reproduce: {code:sql} S

[jira] [Created] (SPARK-35673) Spark fails on unrecognized hint in subquery

Willi Raschkowski created SPARK-35673: - Summary: Spark fails on unrecognized hint in subquery Key: SPARK-35673 URL: https://issues.apache.org/jira/browse/SPARK-35673 Project: Spark Issue

[jira] [Commented] (SPARK-34591) Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challenging to

[ https://issues.apache.org/jira/browse/SPARK-34591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358956#comment-17358956 ] Julian King commented on SPARK-34591: - The fact that there's no signal isn't the iss

[jira] [Commented] (SPARK-34591) Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challenging to

[ https://issues.apache.org/jira/browse/SPARK-34591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358955#comment-17358955 ] Sean R. Owen commented on SPARK-34591: -- I think it's OK to at least expose the para

[jira] [Commented] (SPARK-34591) Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challenging to

[ https://issues.apache.org/jira/browse/SPARK-34591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358953#comment-17358953 ] Julian King commented on SPARK-34591: - Here is a reproducible example of this bug wh

[jira] [Updated] (SPARK-34591) Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challenging to d

[ https://issues.apache.org/jira/browse/SPARK-34591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julian King updated SPARK-34591: Attachment: Reproducible example of Spark bug.pdf > Pyspark undertakes pruning of decision trees a

[jira] [Updated] (SPARK-34591) Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challenging to d

[ https://issues.apache.org/jira/browse/SPARK-34591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julian King updated SPARK-34591: Attachment: Reproducible example of Spark bug.pdf > Pyspark undertakes pruning of decision trees a

[jira] [Updated] (SPARK-34591) Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challenging to d

[ https://issues.apache.org/jira/browse/SPARK-34591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julian King updated SPARK-34591: Attachment: (was: Reproducible example of Spark bug.pdf) > Pyspark undertakes pruning of decis

[jira] [Updated] (SPARK-34591) Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challenging to d

[ https://issues.apache.org/jira/browse/SPARK-34591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julian King updated SPARK-34591: Priority: Major (was: Minor) > Pyspark undertakes pruning of decision trees and random forests ou

[jira] [Resolved] (SPARK-35341) Introduce BooleanExtensionOps

[ https://issues.apache.org/jira/browse/SPARK-35341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-35341. --- Fix Version/s: 3.2.0 Assignee: Xinrong Meng Resolution: Fixed Issue resolved

[jira] [Assigned] (SPARK-35671) Add Support in the ESS to serve merged shuffle block meta and data to executors

[ https://issues.apache.org/jira/browse/SPARK-35671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35671: Assignee: (was: Apache Spark) > Add Support in the ESS to serve merged shuffle block

[jira] [Assigned] (SPARK-35671) Add Support in the ESS to serve merged shuffle block meta and data to executors

[ https://issues.apache.org/jira/browse/SPARK-35671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35671: Assignee: Apache Spark > Add Support in the ESS to serve merged shuffle block meta and da

[jira] [Commented] (SPARK-35671) Add Support in the ESS to serve merged shuffle block meta and data to executors

[ https://issues.apache.org/jira/browse/SPARK-35671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358885#comment-17358885 ] Apache Spark commented on SPARK-35671: -- User 'otterc' has created a pull request fo

[jira] [Assigned] (SPARK-35672) Spark fails to launch executors with very large user classpath lists on YARN

[ https://issues.apache.org/jira/browse/SPARK-35672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35672: Assignee: (was: Apache Spark) > Spark fails to launch executors with very large user

[jira] [Commented] (SPARK-35672) Spark fails to launch executors with very large user classpath lists on YARN

[ https://issues.apache.org/jira/browse/SPARK-35672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358849#comment-17358849 ] Apache Spark commented on SPARK-35672: -- User 'xkrogen' has created a pull request f

[jira] [Assigned] (SPARK-35672) Spark fails to launch executors with very large user classpath lists on YARN

[ https://issues.apache.org/jira/browse/SPARK-35672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35672: Assignee: Apache Spark > Spark fails to launch executors with very large user classpath l

[jira] [Resolved] (SPARK-35343) Make the conversion from/to pandas data-type-based for non-ExtensionDtypes

[ https://issues.apache.org/jira/browse/SPARK-35343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-35343. --- Fix Version/s: 3.2.0 Assignee: Xinrong Meng Resolution: Fixed Issue resolved

[jira] [Created] (SPARK-35672) Spark fails to launch executors with very large user classpath lists on YARN

Erik Krogen created SPARK-35672: --- Summary: Spark fails to launch executors with very large user classpath lists on YARN Key: SPARK-35672 URL: https://issues.apache.org/jira/browse/SPARK-35672 Project: S

[jira] [Commented] (SPARK-34791) SparkR throws node stack overflow

[ https://issues.apache.org/jira/browse/SPARK-34791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358839#comment-17358839 ] obfuscated_dvlper commented on SPARK-34791: --- hi team, any updates on this. tri

[jira] [Updated] (SPARK-35671) Add Support in the ESS to serve merged shuffle block meta and data to executors

[ https://issues.apache.org/jira/browse/SPARK-35671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-35671: -- Description: With push-based shuffle enabled, the reducers send 2 different requests to the E

[jira] [Commented] (SPARK-35670) Upgrade ZSTD-JNI to 1.5.0-1

[ https://issues.apache.org/jira/browse/SPARK-35670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358788#comment-17358788 ] Apache Spark commented on SPARK-35670: -- User 'dchristle' has created a pull request

[jira] [Commented] (SPARK-35670) Upgrade ZSTD-JNI to 1.5.0-1

[ https://issues.apache.org/jira/browse/SPARK-35670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358786#comment-17358786 ] Apache Spark commented on SPARK-35670: -- User 'dchristle' has created a pull request

[jira] [Assigned] (SPARK-35670) Upgrade ZSTD-JNI to 1.5.0-1

[ https://issues.apache.org/jira/browse/SPARK-35670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35670: Assignee: (was: Apache Spark) > Upgrade ZSTD-JNI to 1.5.0-1 > ---

[jira] [Assigned] (SPARK-35670) Upgrade ZSTD-JNI to 1.5.0-1

[ https://issues.apache.org/jira/browse/SPARK-35670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35670: Assignee: Apache Spark > Upgrade ZSTD-JNI to 1.5.0-1 > --- > >

[jira] [Created] (SPARK-35671) Add Support in the ESS to serve merged shuffle block meta and data to executors

Chandni Singh created SPARK-35671: - Summary: Add Support in the ESS to serve merged shuffle block meta and data to executors Key: SPARK-35671 URL: https://issues.apache.org/jira/browse/SPARK-35671 Pro

[jira] [Created] (SPARK-35670) Upgrade ZSTD-JNI to 1.5.0-1

David Christle created SPARK-35670: -- Summary: Upgrade ZSTD-JNI to 1.5.0-1 Key: SPARK-35670 URL: https://issues.apache.org/jira/browse/SPARK-35670 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-32922) Add support for ShuffleBlockFetcherIterator to read from merged shuffle partitions and to fallback to original shuffle blocks if encountering failures

[ https://issues.apache.org/jira/browse/SPARK-32922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358768#comment-17358768 ] Chandni Singh commented on SPARK-32922: --- Splitting the changes into ESS server sid

[jira] [Assigned] (SPARK-35074) spark.jars.xxx configs should be moved to config/package.scala

[ https://issues.apache.org/jira/browse/SPARK-35074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-35074: - Assignee: dc-heros > spark.jars.xxx configs should be moved to config/package.scala > -

[jira] [Updated] (SPARK-35664) Support java.time. LocalDateTime as an external type of TimestampWithoutTZ type

[ https://issues.apache.org/jira/browse/SPARK-35664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35664: --- Description: Allow parallelization/collection of java.time.LocalDateTime values, and convert

[jira] [Updated] (SPARK-35664) Support java.time. LocalDateTime as an external type of TimestampWithoutTZ type

[ https://issues.apache.org/jira/browse/SPARK-35664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35664: --- Summary: Support java.time. LocalDateTime as an external type of TimestampWithoutTZ type (w

[jira] [Updated] (SPARK-35662) Support Timestamp without time zone data type

[ https://issues.apache.org/jira/browse/SPARK-35662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35662: --- Description: Spark SQL today supports the TIMESTAMP data type. However the semantics provid

[jira] [Updated] (SPARK-35663) Add Timestamp without time zone type

[ https://issues.apache.org/jira/browse/SPARK-35663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35663: --- Description: Extend Catalyst's type system by a new type that conform to the SQL standard (

[jira] [Commented] (SPARK-35667) spark.speculation causes incorrect query results with TRANSFORM

[ https://issues.apache.org/jira/browse/SPARK-35667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358707#comment-17358707 ] Erik Krogen commented on SPARK-35667: - fyi [~vsowrirajan] [~ron8hu] > spark.specula

[jira] [Commented] (SPARK-35598) Improve Spark-ML PCA analysis

[ https://issues.apache.org/jira/browse/SPARK-35598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358660#comment-17358660 ] Apache Spark commented on SPARK-35598: -- User 'Antozamm' has created a pull request

[jira] [Assigned] (SPARK-35598) Improve Spark-ML PCA analysis

[ https://issues.apache.org/jira/browse/SPARK-35598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35598: Assignee: (was: Apache Spark) > Improve Spark-ML PCA analysis > -

[jira] [Commented] (SPARK-35598) Improve Spark-ML PCA analysis

[ https://issues.apache.org/jira/browse/SPARK-35598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358659#comment-17358659 ] Apache Spark commented on SPARK-35598: -- User 'Antozamm' has created a pull request

[jira] [Assigned] (SPARK-35598) Improve Spark-ML PCA analysis

[ https://issues.apache.org/jira/browse/SPARK-35598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35598: Assignee: Apache Spark > Improve Spark-ML PCA analysis > - >

[jira] [Resolved] (SPARK-35074) spark.jars.xxx configs should be moved to config/package.scala

[ https://issues.apache.org/jira/browse/SPARK-35074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-35074. --- Fix Version/s: 3.2.0 Resolution: Fixed > spark.jars.xxx configs should be moved to co

[jira] [Resolved] (SPARK-35663) Add Timestamp without time zone type

[ https://issues.apache.org/jira/browse/SPARK-35663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35663. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32802 [https://gith

[jira] [Assigned] (SPARK-35669) fix special char in CSV header with filter pushdown

[ https://issues.apache.org/jira/browse/SPARK-35669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35669: Assignee: Apache Spark > fix special char in CSV header with filter pushdown > --

[jira] [Assigned] (SPARK-35669) fix special char in CSV header with filter pushdown

[ https://issues.apache.org/jira/browse/SPARK-35669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35669: Assignee: (was: Apache Spark) > fix special char in CSV header with filter pushdown >

[jira] [Commented] (SPARK-35669) fix special char in CSV header with filter pushdown

[ https://issues.apache.org/jira/browse/SPARK-35669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358626#comment-17358626 ] Apache Spark commented on SPARK-35669: -- User 'cloud-fan' has created a pull request

[jira] [Updated] (SPARK-35667) spark.speculation causes incorrect query results with TRANSFORM

[ https://issues.apache.org/jira/browse/SPARK-35667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxm updated SPARK-35667: --- Description: SQL as follow gets incorrect results sometimes when spark.speculation is true:  {code:java} SEL

[jira] [Updated] (SPARK-35667) spark.speculation causes incorrect query results with TRANSFORM

[ https://issues.apache.org/jira/browse/SPARK-35667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxm updated SPARK-35667: --- Description: SQL as follow gets incorrect results sometimes when spark.speculation is true:  {code:java} SEL

[jira] [Created] (SPARK-35669) fix special char in CSV header with filter pushdown

Wenchen Fan created SPARK-35669: --- Summary: fix special char in CSV header with filter pushdown Key: SPARK-35669 URL: https://issues.apache.org/jira/browse/SPARK-35669 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-35543) Small memory leak in BlockManagerMasterEndpoint

[ https://issues.apache.org/jira/browse/SPARK-35543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros resolved SPARK-35543. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32790

[jira] [Commented] (SPARK-35668) Use "concurrency" setting on Github Actions

[ https://issues.apache.org/jira/browse/SPARK-35668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358597#comment-17358597 ] Apache Spark commented on SPARK-35668: -- User 'Yikun' has created a pull request for

[jira] [Commented] (SPARK-35668) Use "concurrency" setting on Github Actions

[ https://issues.apache.org/jira/browse/SPARK-35668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358596#comment-17358596 ] Apache Spark commented on SPARK-35668: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-35668) Use "concurrency" setting on Github Actions

[ https://issues.apache.org/jira/browse/SPARK-35668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35668: Assignee: (was: Apache Spark) > Use "concurrency" setting on Github Actions > ---

[jira] [Assigned] (SPARK-35668) Use "concurrency" setting on Github Actions

[ https://issues.apache.org/jira/browse/SPARK-35668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35668: Assignee: Apache Spark > Use "concurrency" setting on Github Actions > --

[jira] [Created] (SPARK-35668) Use "concurrency" setting on Github Actions

Yikun Jiang created SPARK-35668: --- Summary: Use "concurrency" setting on Github Actions Key: SPARK-35668 URL: https://issues.apache.org/jira/browse/SPARK-35668 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-35667) spark.speculation causes incorrect query results with TRANSFORM

[ https://issues.apache.org/jira/browse/SPARK-35667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxm updated SPARK-35667: --- Description: SQL as follow gets incorrect results sometimes when spark.speculation is true:  {code:java} SEL

[jira] [Updated] (SPARK-35667) spark.speculation causes incorrect query results with TRANSFORM

[ https://issues.apache.org/jira/browse/SPARK-35667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxm updated SPARK-35667: --- Description: SQL as follow gets incorrect results sometimes when spark.speculation is true:  {code:java} SEL

[jira] [Updated] (SPARK-35667) spark.speculation causes incorrect query results with TRANSFORM

[ https://issues.apache.org/jira/browse/SPARK-35667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxm updated SPARK-35667: --- Environment: (was: {code:java} ./bin/spark-sql --master yarn \ --conf spark.speculation=true \ --conf s

[jira] [Created] (SPARK-35667) spark.speculation causes incorrect query results with TRANSFORM

yuanxm created SPARK-35667: -- Summary: spark.speculation causes incorrect query results with TRANSFORM Key: SPARK-35667 URL: https://issues.apache.org/jira/browse/SPARK-35667 Project: Spark Issue Ty

[jira] [Commented] (SPARK-35666) add new gemv to skip array shape checking

[ https://issues.apache.org/jira/browse/SPARK-35666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358558#comment-17358558 ] Apache Spark commented on SPARK-35666: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-35666) add new gemv to skip array shape checking

[ https://issues.apache.org/jira/browse/SPARK-35666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35666: Assignee: Apache Spark > add new gemv to skip array shape checking >

[jira] [Assigned] (SPARK-35666) add new gemv to skip array shape checking

[jira] [Commented] (SPARK-35666) add new gemv to skip array shape checking

[ https://issues.apache.org/jira/browse/SPARK-35666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358557#comment-17358557 ] Apache Spark commented on SPARK-35666: -- User 'zhengruifeng' has created a pull requ

[jira] [Resolved] (SPARK-35665) resolve UnresolvedAlias in CollectMetrics

[ https://issues.apache.org/jira/browse/SPARK-35665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35665. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32803 [https://gi

[jira] [Assigned] (SPARK-35665) resolve UnresolvedAlias in CollectMetrics

[ https://issues.apache.org/jira/browse/SPARK-35665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35665: Assignee: Wenchen Fan > resolve UnresolvedAlias in CollectMetrics > -

[jira] [Created] (SPARK-35666) add new gemv to skip array shape checking

zhengruifeng created SPARK-35666: Summary: add new gemv to skip array shape checking Key: SPARK-35666 URL: https://issues.apache.org/jira/browse/SPARK-35666 Project: Spark Issue Type: Sub-tas

[jira] [Commented] (SPARK-35591) Rename "Koalas" to "pandas API on Spark" in the documents

[ https://issues.apache.org/jira/browse/SPARK-35591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358538#comment-17358538 ] Haejoon Lee commented on SPARK-35591: - [~pingsutw] Thanks for the concern, but I alm

[jira] [Commented] (SPARK-26867) Spark Support of YARN Placement Constraint

[ https://issues.apache.org/jira/browse/SPARK-26867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358463#comment-17358463 ] Apache Spark commented on SPARK-26867: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-26867) Spark Support of YARN Placement Constraint

[ https://issues.apache.org/jira/browse/SPARK-26867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26867: Assignee: Apache Spark > Spark Support of YARN Placement Constraint > ---

[jira] [Assigned] (SPARK-26867) Spark Support of YARN Placement Constraint

[ https://issues.apache.org/jira/browse/SPARK-26867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26867: Assignee: (was: Apache Spark) > Spark Support of YARN Placement Constraint >

  1   2   >