[jira] [Updated] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight.

2021-08-20 Thread Sumeet (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumeet updated SPARK-35011: --- Fix Version/s: 3.0.4 > Avoid Block Manager registerations when StopExecutor msg is in-flight. >

[jira] [Commented] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

2021-08-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402436#comment-17402436 ] Apache Spark commented on SPARK-34415: -- User 'srowen' has created a pull request fo

[jira] [Comment Edited] (SPARK-36548) Throwing NoClassDefFoundError for Logging$class

2021-08-20 Thread sadagopan kalyanaraman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402394#comment-17402394 ] sadagopan kalyanaraman edited comment on SPARK-36548 at 8/20/21, 7:37 PM:

[jira] [Commented] (SPARK-36548) Throwing NoClassDefFoundError for Logging$class

2021-08-20 Thread sadagopan kalyanaraman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402394#comment-17402394 ] sadagopan kalyanaraman commented on SPARK-36548: [~sarutak]  i agree on

[jira] [Commented] (SPARK-36374) Push-based shuffle documentation

2021-08-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402393#comment-17402393 ] Apache Spark commented on SPARK-36374: -- User 'venkata91' has created a pull request

[jira] [Commented] (SPARK-36544) Special strings for dates are no longer automatically converted without the "date" keyword

2021-08-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402366#comment-17402366 ] Kousuke Saruta commented on SPARK-36544: [~laurikoobas] The behavior was changed

[jira] [Commented] (SPARK-36548) Throwing NoClassDefFoundError for Logging$class

2021-08-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402364#comment-17402364 ] Kousuke Saruta commented on SPARK-36548: [~sadagopan] It was wrongly exposed bef

[jira] [Commented] (SPARK-36552) varchar datatype behave differently on hive table and datasource table

2021-08-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1740#comment-1740 ] Apache Spark commented on SPARK-36552: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-36552) varchar datatype behave differently on hive table and datasource table

2021-08-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36552: Assignee: (was: Apache Spark) > varchar datatype behave differently on hive table a

[jira] [Assigned] (SPARK-36552) varchar datatype behave differently on hive table and datasource table

2021-08-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36552: Assignee: Apache Spark > varchar datatype behave differently on hive table and datasour

[jira] [Assigned] (SPARK-30641) Project Matrix: Linear Models revisit and refactor

2021-08-20 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-30641: Assignee: zhengruifeng > Project Matrix: Linear Models revisit and refactor > ---

[jira] [Assigned] (SPARK-36448) Exceptions in NoSuchItemException.scala have to be case classes to preserve specific exceptions

2021-08-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36448: --- Assignee: Yesheng Ma > Exceptions in NoSuchItemException.scala have to be case classes to p

[jira] [Resolved] (SPARK-36448) Exceptions in NoSuchItemException.scala have to be case classes to preserve specific exceptions

2021-08-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36448. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33673 [https://gith

[jira] [Updated] (SPARK-36532) Deadlock in CoarseGrainedExecutorBackend.onDisconnected

2021-08-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-36532: Fix Version/s: 3.0.4 3.1.3 > Deadlock in CoarseGrainedExecutorBackend.onDisconn

[jira] [Resolved] (SPARK-36551) Add sphinx-plotly-directive in Spark release Dockerfile

2021-08-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36551. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33797 [https:

[jira] [Updated] (SPARK-36553) KMeans fails with NegativeArraySizeException for K = 50000 after issue #27758 was introduced

2021-08-20 Thread Anders Rydbirk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anders Rydbirk updated SPARK-36553: --- Description: We are running KMeans on approximately 350M rows of x, y, z coordinates using

[jira] [Updated] (SPARK-36553) KMeans fails with NegativeArraySizeException for K = 50000 after issue #27758 was introduced

2021-08-20 Thread Anders Rydbirk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anders Rydbirk updated SPARK-36553: --- Description: We are running KMeans on approximately 350M rows of x, y, z coordinates using

[jira] [Updated] (SPARK-36553) KMeans fails with NegativeArraySizeException for K = 50000 after issue #27758 was introduced

2021-08-20 Thread Anders Rydbirk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anders Rydbirk updated SPARK-36553: --- Description: We are running KMeans on approximately 350M rows of x, y, z coordinates using

[jira] [Updated] (SPARK-36553) KMeans fails with NegativeArraySizeException for K = 50000 after issue #27758 was introduced

2021-08-20 Thread Anders Rydbirk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anders Rydbirk updated SPARK-36553: --- Description: We are running KMeans on approximately 350M rows of x, y, z coordinates using

[jira] [Created] (SPARK-36553) KMeans fails with NegativeArraySizeException for K = 50000 after issue #27758 was introduced

2021-08-20 Thread Anders Rydbirk (Jira)
Anders Rydbirk created SPARK-36553: -- Summary: KMeans fails with NegativeArraySizeException for K = 5 after issue #27758 was introduced Key: SPARK-36553 URL: https://issues.apache.org/jira/browse/SPARK-36553

[jira] [Comment Edited] (SPARK-36434) Implement DataFrame.lookup

2021-08-20 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402151#comment-17402151 ] dgd_contributor edited comment on SPARK-36434 at 8/20/21, 10:44 AM: --

[jira] [Commented] (SPARK-36434) Implement DataFrame.lookup

2021-08-20 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402151#comment-17402151 ] dgd_contributor commented on SPARK-36434: - should we work on this? this docs sho

[jira] [Commented] (SPARK-31336) Support Oracle Kerberos login in JDBC connector

2021-08-20 Thread ABHAYRAJ (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402134#comment-17402134 ] ABHAYRAJ commented on SPARK-31336: --- Hi [~avsek] have you found the fix for the above.

[jira] [Created] (SPARK-36552) varchar datatype behave differently on hive table and datasource table

2021-08-20 Thread ocean (Jira)
ocean created SPARK-36552: - Summary: varchar datatype behave differently on hive table and datasource table Key: SPARK-36552 URL: https://issues.apache.org/jira/browse/SPARK-36552 Project: Spark I

[jira] [Updated] (SPARK-36552) varchar datatype behave differently on hive table and datasource table

2021-08-20 Thread ocean (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ocean updated SPARK-36552: -- Affects Version/s: (was: 3.1.0) 3.1.2 > varchar datatype behave differently on hiv

[jira] [Assigned] (SPARK-36551) Add sphinx-plotly-directive in Spark release Dockerfile

2021-08-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36551: Assignee: Apache Spark (was: Gengliang Wang) > Add sphinx-plotly-directive in Spark rele

[jira] [Updated] (SPARK-36551) Add sphinx-plotly-directive in Spark release Dockerfile

2021-08-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36551: --- Summary: Add sphinx-plotly-directive in Spark release Dockerfile (was: Add sphinx-plotly-di

[jira] [Assigned] (SPARK-36551) Add sphinx-plotly-directive in Spark release docker script

2021-08-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36551: Assignee: Gengliang Wang (was: Apache Spark) > Add sphinx-plotly-directive in Spark rele

[jira] [Assigned] (SPARK-36551) Add sphinx-plotly-directive in Spark release docker script

2021-08-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36551: Assignee: Apache Spark (was: Gengliang Wang) > Add sphinx-plotly-directive in Spark rele

[jira] [Commented] (SPARK-36551) Add sphinx-plotly-directive in Spark release docker script

2021-08-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402126#comment-17402126 ] Apache Spark commented on SPARK-36551: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-36551) Add sphinx-plotly-directive in Spark release docker script

2021-08-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402125#comment-17402125 ] Apache Spark commented on SPARK-36551: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-36551) Add sphinx-plotly-directive in Spark release docker script

2021-08-20 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-36551: -- Summary: Add sphinx-plotly-directive in Spark release docker script Key: SPARK-36551 URL: https://issues.apache.org/jira/browse/SPARK-36551 Project: Spark

[jira] [Updated] (SPARK-36550) Propagation cause when UDF reflection fails

2021-08-20 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-36550: --- Description: Now when UDF reflection fails, InvocationTargetException is thrown, but it is not a specific e

[jira] [Assigned] (SPARK-36550) Propagation cause when UDF reflection fails

2021-08-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36550: Assignee: (was: Apache Spark) > Propagation cause when UDF reflection fails > ---

[jira] [Commented] (SPARK-36550) Propagation cause when UDF reflection fails

2021-08-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402081#comment-17402081 ] Apache Spark commented on SPARK-36550: -- User 'cxzl25' has created a pull request fo

[jira] [Assigned] (SPARK-36550) Propagation cause when UDF reflection fails

2021-08-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36550: Assignee: Apache Spark > Propagation cause when UDF reflection fails > --

[jira] [Created] (SPARK-36550) Propagation cause when UDF reflection fails

2021-08-20 Thread dzcxzl (Jira)
dzcxzl created SPARK-36550: -- Summary: Propagation cause when UDF reflection fails Key: SPARK-36550 URL: https://issues.apache.org/jira/browse/SPARK-36550 Project: Spark Issue Type: Improvement