[jira] [Created] (SPARK-40388) SQL configuration spark.sql.mapKeyDedupPolicy not always applied

2022-09-07 Thread Paul Praet (Jira)
Paul Praet created SPARK-40388: -- Summary: SQL configuration spark.sql.mapKeyDedupPolicy not always applied Key: SPARK-40388 URL: https://issues.apache.org/jira/browse/SPARK-40388 Project: Spark

[jira] [Assigned] (SPARK-40354) Support eliminate dynamic partition for v1 writes

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40354: Assignee: Apache Spark > Support eliminate dynamic partition for v1 writes >

[jira] [Assigned] (SPARK-40354) Support eliminate dynamic partition for v1 writes

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40354: Assignee: (was: Apache Spark) > Support eliminate dynamic partition for v1 writes > -

[jira] [Commented] (SPARK-40354) Support eliminate dynamic partition for v1 writes

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601673#comment-17601673 ] Apache Spark commented on SPARK-40354: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-40387) Improve the implementation of Spark Decimal

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40387: Assignee: (was: Apache Spark) > Improve the implementation of Spark Decimal > ---

[jira] [Assigned] (SPARK-40387) Improve the implementation of Spark Decimal

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40387: Assignee: Apache Spark > Improve the implementation of Spark Decimal > --

[jira] [Commented] (SPARK-40387) Improve the implementation of Spark Decimal

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601672#comment-17601672 ] Apache Spark commented on SPARK-40387: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-40387) Improve the implementation of Spark Decimal

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601671#comment-17601671 ] Apache Spark commented on SPARK-40387: -- User 'beliefer' has created a pull request

[jira] [Created] (SPARK-40387) Improve the implementation of Spark Decimal

2022-09-07 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-40387: -- Summary: Improve the implementation of Spark Decimal Key: SPARK-40387 URL: https://issues.apache.org/jira/browse/SPARK-40387 Project: Spark Issue Type: Improveme

[jira] [Assigned] (SPARK-40386) Implement `ddof` in `DataFrame.cov`

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40386: Assignee: (was: Apache Spark) > Implement `ddof` in `DataFrame.cov` > ---

[jira] [Commented] (SPARK-40386) Implement `ddof` in `DataFrame.cov`

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601651#comment-17601651 ] Apache Spark commented on SPARK-40386: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-40386) Implement `ddof` in `DataFrame.cov`

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40386: Assignee: Apache Spark > Implement `ddof` in `DataFrame.cov` > --

[jira] [Created] (SPARK-40386) Implement `ddof` in `DataFrame.cov`

2022-09-07 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40386: - Summary: Implement `ddof` in `DataFrame.cov` Key: SPARK-40386 URL: https://issues.apache.org/jira/browse/SPARK-40386 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40385) Classes with companion object constructor fails interpreted path

2022-09-07 Thread Emil Ejbyfeldt (Jira)
Emil Ejbyfeldt created SPARK-40385: -- Summary: Classes with companion object constructor fails interpreted path Key: SPARK-40385 URL: https://issues.apache.org/jira/browse/SPARK-40385 Project: Spark

[jira] [Assigned] (SPARK-40384) Do base image real in time build only when infra dockerfile is changed

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40384: Assignee: (was: Apache Spark) > Do base image real in time build only when infra dock

[jira] [Commented] (SPARK-40384) Do base image real in time build only when infra dockerfile is changed

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601633#comment-17601633 ] Apache Spark commented on SPARK-40384: -- User 'Yikun' has created a pull request for

[jira] [Commented] (SPARK-40384) Do base image real in time build only when infra dockerfile is changed

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601632#comment-17601632 ] Apache Spark commented on SPARK-40384: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-40384) Do base image real in time build only when infra dockerfile is changed

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40384: Assignee: Apache Spark > Do base image real in time build only when infra dockerfile is c

[jira] [Created] (SPARK-40384) Do base image real in time build only when infra dockerfile is changed

2022-09-07 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-40384: --- Summary: Do base image real in time build only when infra dockerfile is changed Key: SPARK-40384 URL: https://issues.apache.org/jira/browse/SPARK-40384 Project: Spark

[jira] [Commented] (SPARK-40364) Unify `initDB` method in `DBProvider`

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601622#comment-17601622 ] Apache Spark commented on SPARK-40364: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-40364) Unify `initDB` method in `DBProvider`

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601620#comment-17601620 ] Apache Spark commented on SPARK-40364: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-40383) Pin mypy ==0.920 in dev/requirements.txt

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40383: Assignee: (was: Apache Spark) > Pin mypy ==0.920 in dev/requirements.txt > --

[jira] [Assigned] (SPARK-40383) Pin mypy ==0.920 in dev/requirements.txt

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40383: Assignee: Apache Spark > Pin mypy ==0.920 in dev/requirements.txt > -

[jira] [Assigned] (SPARK-40364) Unify `initDB` method in `DBProvider`

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40364: Assignee: Apache Spark > Unify `initDB` method in `DBProvider` >

[jira] [Commented] (SPARK-40383) Pin mypy ==0.920 in dev/requirements.txt

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601621#comment-17601621 ] Apache Spark commented on SPARK-40383: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-40364) Unify `initDB` method in `DBProvider`

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40364: Assignee: (was: Apache Spark) > Unify `initDB` method in `DBProvider` > -

[jira] [Created] (SPARK-40383) Pin mypy ==0.920 in dev/requirements.txt

2022-09-07 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40383: - Summary: Pin mypy ==0.920 in dev/requirements.txt Key: SPARK-40383 URL: https://issues.apache.org/jira/browse/SPARK-40383 Project: Spark Issue Type: Improv

[jira] [Resolved] (SPARK-40186) mergedShuffleCleaner should have been shutdown before db closed

2022-09-07 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40186. - Target Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixe

[jira] [Updated] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

2022-09-07 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-40362: - Description: In the canonicalization code which is now in two stages, canonicalization involving Commutative op

[jira] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

2022-09-07 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40362 ] Asif deleted comment on SPARK-40362: -- was (Author: ashahid7): I have added locally test for  &&, ||, &, | and *  and they all fail for the same reason.. in process of adding tests for xor, greates

[jira] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

2022-09-07 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40362 ] Asif deleted comment on SPARK-40362: -- was (Author: ashahid7): will be generating a PR tomorrow.. > Bug in Canonicalization of expressions like Add & Multiply i.e Commutative > Operators >

[jira] [Resolved] (SPARK-40365) Bump ANTLR runtime version from 4.8 to 4.9.3

2022-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40365. -- Resolution: Fixed Issue resolved by pull request 37814 [https://github.com/apache/spark/pull/3

[jira] [Assigned] (SPARK-40365) Bump ANTLR runtime version from 4.8 to 4.9.3

2022-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40365: Assignee: BingKun Pan > Bump ANTLR runtime version from 4.8 to 4.9.3 > --

[jira] [Resolved] (SPARK-40378) What is React Native.

2022-09-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40378. - Resolution: Invalid > What is React Native. > - > > Key: SPA

[jira] [Updated] (SPARK-40378) What is React Native.

2022-09-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40378: Target Version/s: (was: 3.1.2) > What is React Native. > - > >

[jira] [Updated] (SPARK-40378) What is React Native.

2022-09-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40378: Fix Version/s: (was: 3.1.3) > What is React Native. > - > >

[jira] [Commented] (SPARK-40382) Reduce projections in Expand when multiple distinct aggregations have semantically equivalent children

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601554#comment-17601554 ] Apache Spark commented on SPARK-40382: -- User 'bersprockets' has created a pull requ

[jira] [Assigned] (SPARK-40382) Reduce projections in Expand when multiple distinct aggregations have semantically equivalent children

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40382: Assignee: (was: Apache Spark) > Reduce projections in Expand when multiple distinct a

[jira] [Assigned] (SPARK-40382) Reduce projections in Expand when multiple distinct aggregations have semantically equivalent children

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40382: Assignee: Apache Spark > Reduce projections in Expand when multiple distinct aggregations

[jira] [Created] (SPARK-40382) Reduce projections in Expand when multiple distinct aggregations have semantically equivalent children

2022-09-07 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-40382: - Summary: Reduce projections in Expand when multiple distinct aggregations have semantically equivalent children Key: SPARK-40382 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Comment Edited] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

2022-09-07 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601543#comment-17601543 ] Mars edited comment on SPARK-40320 at 9/7/22 10:50 PM: --- [~Ngone51]

[jira] [Updated] (SPARK-40311) Introduce withColumnsRenamed

2022-09-07 Thread Santosh Pingale (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santosh Pingale updated SPARK-40311: Docs Text: Add withColumnsRenamed to scala and pyspark API > Introduce withColumnsRenamed

[jira] [Updated] (SPARK-40087) Support multiple Column drop in R

2022-09-07 Thread Santosh Pingale (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santosh Pingale updated SPARK-40087: Docs Text: Support for SparkR to drop multiple "Column" > Support multiple Column drop in

[jira] [Updated] (SPARK-39895) pyspark drop doesn't accept *cols

2022-09-07 Thread Santosh Pingale (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santosh Pingale updated SPARK-39895: Docs Text: Support for PySpark to drop multiple "Column" > pyspark drop doesn't accept *c

[jira] [Commented] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

2022-09-07 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601543#comment-17601543 ] Mars commented on SPARK-40320: -- [~Ngone51]  Shouldn't it bring up a new `receiveLoop()` to

[jira] [Updated] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

2022-09-07 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-40362: - Description: In the canonicalization code which is now in two stages, canonicalization involving Commutative op

[jira] [Updated] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

2022-09-07 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-40362: - Shepherd: Wenchen Fan (was: Tanel Kiis) > Bug in Canonicalization of expressions like Add & Multiply i.e Commut

[jira] [Resolved] (SPARK-40291) Improve the message for column not in group by clause error

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40291. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37742 [https://github.com

[jira] [Assigned] (SPARK-40291) Improve the message for column not in group by clause error

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40291: Assignee: Linhong Liu > Improve the message for column not in group by clause error > ---

[jira] [Resolved] (SPARK-40293) Make the V2 table error message more meaningful

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40293. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37746 [https://github.com

[jira] [Assigned] (SPARK-40293) Make the V2 table error message more meaningful

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40293: Assignee: Huaxin Gao > Make the V2 table error message more meaningful >

[jira] [Assigned] (SPARK-40380) Constant-folding of InvokeLike should not result in non-serializable result

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40380: Assignee: (was: Apache Spark) > Constant-folding of InvokeLike should not result in n

[jira] [Assigned] (SPARK-40380) Constant-folding of InvokeLike should not result in non-serializable result

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40380: Assignee: Apache Spark > Constant-folding of InvokeLike should not result in non-serializ

[jira] [Commented] (SPARK-40380) Constant-folding of InvokeLike should not result in non-serializable result

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601472#comment-17601472 ] Apache Spark commented on SPARK-40380: -- User 'rednaxelafx' has created a pull reque

[jira] [Assigned] (SPARK-40381) Support standalone worker recommission

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40381: Assignee: (was: Apache Spark) > Support standalone worker recommission >

[jira] [Commented] (SPARK-40381) Support standalone worker recommission

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601468#comment-17601468 ] Apache Spark commented on SPARK-40381: -- User 'warrenzhu25' has created a pull reque

[jira] [Commented] (SPARK-40381) Support standalone worker recommission

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601469#comment-17601469 ] Apache Spark commented on SPARK-40381: -- User 'warrenzhu25' has created a pull reque

[jira] [Assigned] (SPARK-40381) Support standalone worker recommission

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40381: Assignee: Apache Spark > Support standalone worker recommission > ---

[jira] [Created] (SPARK-40381) Support standalone worker recommission

2022-09-07 Thread Zhongwei Zhu (Jira)
Zhongwei Zhu created SPARK-40381: Summary: Support standalone worker recommission Key: SPARK-40381 URL: https://issues.apache.org/jira/browse/SPARK-40381 Project: Spark Issue Type: Improvemen

[jira] [Created] (SPARK-40380) Constant-folding of InvokeLike should not result in non-serializable result

2022-09-07 Thread Kris Mok (Jira)
Kris Mok created SPARK-40380: Summary: Constant-folding of InvokeLike should not result in non-serializable result Key: SPARK-40380 URL: https://issues.apache.org/jira/browse/SPARK-40380 Project: Spark

[jira] [Assigned] (SPARK-40379) Propagate decommission executor loss reason during onDisconnect in K8s

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40379: Assignee: Apache Spark (was: Holden Karau) > Propagate decommission executor loss reason

[jira] [Commented] (SPARK-40379) Propagate decommission executor loss reason during onDisconnect in K8s

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601386#comment-17601386 ] Apache Spark commented on SPARK-40379: -- User 'holdenk' has created a pull request f

[jira] [Assigned] (SPARK-40379) Propagate decommission executor loss reason during onDisconnect in K8s

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40379: Assignee: Holden Karau (was: Apache Spark) > Propagate decommission executor loss reason

[jira] [Commented] (SPARK-40379) Propagate decommission executor loss reason during onDisconnect in K8s

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601385#comment-17601385 ] Apache Spark commented on SPARK-40379: -- User 'holdenk' has created a pull request f

[jira] [Resolved] (SPARK-40295) Allow v2 functions with literal args in write distribution and ordering

2022-09-07 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-40295. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37749 [https://github.com

[jira] [Assigned] (SPARK-40295) Allow v2 functions with literal args in write distribution and ordering

2022-09-07 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-40295: Assignee: Anton Okolnychyi > Allow v2 functions with literal args in write distribution and order

[jira] [Updated] (SPARK-40378) What is React Native.

2022-09-07 Thread Nikhil Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Sharma updated SPARK-40378: -- Summary: What is React Native. (was: React Native is an open source framework for building mo

[jira] [Created] (SPARK-40379) Propagate decommission executor loss reason during onDisconnect in K8s

2022-09-07 Thread Holden Karau (Jira)
Holden Karau created SPARK-40379: Summary: Propagate decommission executor loss reason during onDisconnect in K8s Key: SPARK-40379 URL: https://issues.apache.org/jira/browse/SPARK-40379 Project: Spark

[jira] [Created] (SPARK-40378) React Native is an open source framework for building mobile apps. It was created by Facebook and is designed for cross-platform capability.

2022-09-07 Thread Nikhil Sharma (Jira)
Nikhil Sharma created SPARK-40378: - Summary: React Native is an open source framework for building mobile apps. It was created by Facebook and is designed for cross-platform capability. Key: SPARK-40378 URL: http

[jira] [Updated] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2022-09-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-40149: Fix Version/s: 3.2.3 > Star expansion after outer join asymmetrically includes joining key > -

[jira] [Commented] (SPARK-38961) Enhance to automatically generate the pandas API support list

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601358#comment-17601358 ] Apache Spark commented on SPARK-38961: -- User 'Yikun' has created a pull request for

[jira] [Commented] (SPARK-38961) Enhance to automatically generate the pandas API support list

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601359#comment-17601359 ] Apache Spark commented on SPARK-38961: -- User 'Yikun' has created a pull request for

[jira] [Commented] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Elhoussine Talab (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601311#comment-17601311 ] Elhoussine Talab commented on SPARK-40376: -- Thanks [~srowen]  > `np.bool` will

[jira] [Updated] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40376: - Issue Type: Improvement (was: Bug) Priority: Trivial (was: Major) This is not a bug > `

[jira] [Assigned] (SPARK-40377) Allow customize maxBroadcastTableBytes and maxBroadcastRows

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40377: Assignee: (was: Apache Spark) > Allow customize maxBroadcastTableBytes and maxBroadca

[jira] [Assigned] (SPARK-40377) Allow customize maxBroadcastTableBytes and maxBroadcastRows

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40377: Assignee: Apache Spark > Allow customize maxBroadcastTableBytes and maxBroadcastRows > --

[jira] [Commented] (SPARK-40377) Allow customize maxBroadcastTableBytes and maxBroadcastRows

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601297#comment-17601297 ] Apache Spark commented on SPARK-40377: -- User 'LLiu' has created a pull request

[jira] [Commented] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

2022-09-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601293#comment-17601293 ] Karl Håkan Nordgren commented on SPARK-38218: - [~hyukjin.kwon] : Could I ask

[jira] [Updated] (SPARK-40377) Allow customize maxBroadcastTableBytes and maxBroadcastRows

2022-09-07 Thread LeeeeLiu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LLiu updated SPARK-40377: - Attachment: 截屏2022-09-07 20.40.06.png 截屏2022-09-07 20.40.16.png > Allow customize maxBro

[jira] [Created] (SPARK-40377) Allow customize maxBroadcastTableBytes and maxBroadcastRows

2022-09-07 Thread LeeeeLiu (Jira)
LLiu created SPARK-40377: Summary: Allow customize maxBroadcastTableBytes and maxBroadcastRows Key: SPARK-40377 URL: https://issues.apache.org/jira/browse/SPARK-40377 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-40185) Remove column suggestion when the candidate list is empty for unresolved column/attribute/map key

2022-09-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40185: --- Assignee: Vitalii Li > Remove column suggestion when the candidate list is empty for unreso

[jira] [Resolved] (SPARK-40185) Remove column suggestion when the candidate list is empty for unresolved column/attribute/map key

2022-09-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40185. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37621 [https://gith

[jira] [Commented] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601258#comment-17601258 ] Apache Spark commented on SPARK-40149: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601257#comment-17601257 ] Apache Spark commented on SPARK-40149: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40376: Assignee: Apache Spark > `np.bool` will be deprecated > > >

[jira] [Updated] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Elhoussine Talab (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elhoussine Talab updated SPARK-40376: - Description: Using `np.bool` generates this warning:  {quote} UserWarning: toPandas atte

[jira] [Commented] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601256#comment-17601256 ] Apache Spark commented on SPARK-40376: -- User 'ELHoussineT' has created a pull reque

[jira] [Assigned] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40376: Assignee: (was: Apache Spark) > `np.bool` will be deprecated > --

[jira] [Commented] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601255#comment-17601255 ] Apache Spark commented on SPARK-40376: -- User 'ELHoussineT' has created a pull reque

[jira] [Created] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Elhoussine Talab (Jira)
Elhoussine Talab created SPARK-40376: Summary: `np.bool` will be deprecated Key: SPARK-40376 URL: https://issues.apache.org/jira/browse/SPARK-40376 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2022-09-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40149. - Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull re

[jira] [Commented] (SPARK-40332) Implement `GroupBy.quantile`.

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601228#comment-17601228 ] Apache Spark commented on SPARK-40332: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-40332) Implement `GroupBy.quantile`.

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40332: Assignee: Apache Spark > Implement `GroupBy.quantile`. > - >

[jira] [Commented] (SPARK-40332) Implement `GroupBy.quantile`.

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601226#comment-17601226 ] Apache Spark commented on SPARK-40332: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-40332) Implement `GroupBy.quantile`.

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40332: Assignee: (was: Apache Spark) > Implement `GroupBy.quantile`. > -

[jira] [Commented] (SPARK-40298) shuffle data recovery on the reused PVCs no effect

2022-09-07 Thread todd (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601225#comment-17601225 ] todd commented on SPARK-40298: -- [~dongjoon]  I use aws spot cluster to terminate the insta

[jira] [Created] (SPARK-40373) Implement `ps.show_versions`

2022-09-07 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40373: --- Summary: Implement `ps.show_versions` Key: SPARK-40373 URL: https://issues.apache.org/jira/browse/SPARK-40373 Project: Spark Issue Type: Sub-task Com

[jira] [Updated] (SPARK-40374) Migrate type check failures of type creators onto error classes

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40374: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the complex type creator ex

[jira] [Created] (SPARK-40375) Implement `spark.show_versions`

2022-09-07 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40375: --- Summary: Implement `spark.show_versions` Key: SPARK-40375 URL: https://issues.apache.org/jira/browse/SPARK-40375 Project: Spark Issue Type: Bug Compo

[jira] [Created] (SPARK-40374) Migrate type check failures of type creators onto error classes

2022-09-07 Thread Max Gekk (Jira)
Max Gekk created SPARK-40374: Summary: Migrate type check failures of type creators onto error classes Key: SPARK-40374 URL: https://issues.apache.org/jira/browse/SPARK-40374 Project: Spark Issu

  1   2   >