[jira] [Commented] (SPARK-33444) Adding support to set an initial GMM in spark.ml

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231937#comment-17231937 ] Apache Spark commented on SPARK-33444: -- User 'shahar603' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33444) Adding support to set an initial GMM in spark.ml

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33444: Assignee: (was: Apache Spark) > Adding support to set an initial GMM in spark.ml >

[jira] [Assigned] (SPARK-33444) Adding support to set an initial GMM in spark.ml

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33444: Assignee: Apache Spark > Adding support to set an initial GMM in spark.ml >

[jira] [Commented] (SPARK-33444) Adding support to set an initial GMM in spark.ml

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231936#comment-17231936 ] Apache Spark commented on SPARK-33444: -- User 'shahar603' has created a pull request for this issue:

[jira] [Commented] (SPARK-33395) Spark reading data in scientific notation

2020-11-13 Thread Wei Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231928#comment-17231928 ] Wei Zhang commented on SPARK-33395: --- Hi,  i  want to know  what do you expect, it is like this:  

[jira] [Created] (SPARK-33448) Migrate CACHE/UNCACHE TABLE to new resolution framework

2020-11-13 Thread Terry Kim (Jira)
Terry Kim created SPARK-33448: - Summary: Migrate CACHE/UNCACHE TABLE to new resolution framework Key: SPARK-33448 URL: https://issues.apache.org/jira/browse/SPARK-33448 Project: Spark Issue

[jira] [Commented] (SPARK-33183) Bug in optimizer rule EliminateSorts

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231890#comment-17231890 ] Apache Spark commented on SPARK-33183: -- User 'allisonwang-db' has created a pull request for this

[jira] [Commented] (SPARK-33183) Bug in optimizer rule EliminateSorts

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231889#comment-17231889 ] Apache Spark commented on SPARK-33183: -- User 'allisonwang-db' has created a pull request for this

[jira] [Resolved] (SPARK-33288) Support k8s cluster manager with stage level scheduling

2020-11-13 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-33288. --- Fix Version/s: 3.1.0 Assignee: Thomas Graves Resolution: Fixed > Support

[jira] [Updated] (SPARK-31689) ShuffleBlockFetchIterator keeps localBlocks in its memory even though it never uses it

2020-11-13 Thread Chandni Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-31689: -- Description: The {{localBlocks}} is created and used in the {{initialize}} method of

[jira] [Commented] (SPARK-33172) Spark SQL CodeGenerator does not check for UserDefined type

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231841#comment-17231841 ] Apache Spark commented on SPARK-33172: -- User 'davidrabinowitz' has created a pull request for this

[jira] [Commented] (SPARK-33337) Support subexpression elimination in branches of conditional expressions

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231820#comment-17231820 ] Apache Spark commented on SPARK-7: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-33001) Why am I receiving this warning?

2020-11-13 Thread Danny Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231749#comment-17231749 ] Danny Lee commented on SPARK-33001: --- [~xorz57] - I followed the code back to 1305 in this file 

[jira] [Created] (SPARK-33447) Stage level scheduling, allow specifying other spark configs via ResourceProfile

2020-11-13 Thread Thomas Graves (Jira)
Thomas Graves created SPARK-33447: - Summary: Stage level scheduling, allow specifying other spark configs via ResourceProfile Key: SPARK-33447 URL: https://issues.apache.org/jira/browse/SPARK-33447

[jira] [Comment Edited] (SPARK-33001) Why am I receiving this warning?

2020-11-13 Thread Danny Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231703#comment-17231703 ] Danny Lee edited comment on SPARK-33001 at 11/13/20, 6:11 PM: -- [~xorz57]

[jira] [Commented] (SPARK-33001) Why am I receiving this warning?

2020-11-13 Thread Danny Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231703#comment-17231703 ] Danny Lee commented on SPARK-33001: --- [~xorz57] I'm getting the same error, right before Spark bails

[jira] [Commented] (SPARK-33446) [CORE] Add config spark.executor.coresOverhead

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231694#comment-17231694 ] Apache Spark commented on SPARK-33446: -- User 'warrenzhu25' has created a pull request for this

[jira] [Assigned] (SPARK-33446) [CORE] Add config spark.executor.coresOverhead

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33446: Assignee: (was: Apache Spark) > [CORE] Add config spark.executor.coresOverhead >

[jira] [Commented] (SPARK-33446) [CORE] Add config spark.executor.coresOverhead

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231693#comment-17231693 ] Apache Spark commented on SPARK-33446: -- User 'warrenzhu25' has created a pull request for this

[jira] [Assigned] (SPARK-33446) [CORE] Add config spark.executor.coresOverhead

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33446: Assignee: Apache Spark > [CORE] Add config spark.executor.coresOverhead >

[jira] [Created] (SPARK-33446) [CORE] Add config spark.executor.coresOverhead

2020-11-13 Thread Zhongwei Zhu (Jira)
Zhongwei Zhu created SPARK-33446: Summary: [CORE] Add config spark.executor.coresOverhead Key: SPARK-33446 URL: https://issues.apache.org/jira/browse/SPARK-33446 Project: Spark Issue Type:

[jira] [Updated] (SPARK-33445) Can't parse decimal type from csv file

2020-11-13 Thread Punit Shah (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Punit Shah updated SPARK-33445: --- Attachment: tsd.csv > Can't parse decimal type from csv file >

[jira] [Created] (SPARK-33445) Can't parse decimal type from csv file

2020-11-13 Thread Punit Shah (Jira)
Punit Shah created SPARK-33445: -- Summary: Can't parse decimal type from csv file Key: SPARK-33445 URL: https://issues.apache.org/jira/browse/SPARK-33445 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-33139) protect setActiveSession and clearActiveSession

2020-11-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33139. - Resolution: Won't Fix > protect setActiveSession and clearActiveSession >

[jira] [Assigned] (SPARK-33139) protect setActiveSession and clearActiveSession

2020-11-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33139: --- Assignee: (was: Leanken.Lin) > protect setActiveSession and clearActiveSession >

[jira] [Reopened] (SPARK-33139) protect setActiveSession and clearActiveSession

2020-11-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-33139: - > protect setActiveSession and clearActiveSession > ---

[jira] [Commented] (SPARK-32582) Spark SQL Infer Schema Performance

2020-11-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231440#comment-17231440 ] Steve Loughran commented on SPARK-32582: If you use listStatusIterator() then those clients

[jira] [Commented] (SPARK-33444) Adding support to set an initial GMM in spark.ml

2020-11-13 Thread Shahar S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231408#comment-17231408 ] Shahar S commented on SPARK-33444: -- I will create a pull request with an implementation shortly >

[jira] [Created] (SPARK-33444) Adding support to set an initial GMM in spark.ml

2020-11-13 Thread Shahar Satam (Jira)
Shahar Satam created SPARK-33444: Summary: Adding support to set an initial GMM in spark.ml Key: SPARK-33444 URL: https://issues.apache.org/jira/browse/SPARK-33444 Project: Spark Issue Type:

[jira] [Commented] (SPARK-33443) LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ]

2020-11-13 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231351#comment-17231351 ] jiaan.geng commented on SPARK-33443: I am working on. > LEAD/LAG should support [ IGNORE NULLS |

[jira] [Created] (SPARK-33443) LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ]

2020-11-13 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-33443: -- Summary: LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ] Key: SPARK-33443 URL: https://issues.apache.org/jira/browse/SPARK-33443 Project: Spark Issue

[jira] [Assigned] (SPARK-33442) Change Combine Limit to Eliminate limit using max row

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33442: Assignee: Apache Spark > Change Combine Limit to Eliminate limit using max row >

[jira] [Assigned] (SPARK-33442) Change Combine Limit to Eliminate limit using max row

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33442: Assignee: (was: Apache Spark) > Change Combine Limit to Eliminate limit using max

[jira] [Commented] (SPARK-33442) Change Combine Limit to Eliminate limit using max row

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231286#comment-17231286 ] Apache Spark commented on SPARK-33442: -- User 'ulysses-you' has created a pull request for this

[jira] [Created] (SPARK-33442) Change Combine Limit to Eliminate limit using max row

2020-11-13 Thread ulysses you (Jira)
ulysses you created SPARK-33442: --- Summary: Change Combine Limit to Eliminate limit using max row Key: SPARK-33442 URL: https://issues.apache.org/jira/browse/SPARK-33442 Project: Spark Issue

[jira] [Commented] (SPARK-33143) Make SocketAuthServer socket timeout configurable

2020-11-13 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231270#comment-17231270 ] Gabor Somogyi commented on SPARK-33143: --- [~hyukjin.kwon] thanks for the confirmation, started to

[jira] [Resolved] (SPARK-33166) Provide Search Function in Spark docs site

2020-11-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-33166. Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30292

[jira] [Assigned] (SPARK-33166) Provide Search Function in Spark docs site

2020-11-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-33166: -- Assignee: jiaan.geng > Provide Search Function in Spark docs site >

[jira] [Commented] (SPARK-33143) Make SocketAuthServer socket timeout configurable

2020-11-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231255#comment-17231255 ] Hyukjin Kwon commented on SPARK-33143: -- Yeah, should be fine to have an internal conf to control.

[jira] [Commented] (SPARK-33143) Make SocketAuthServer socket timeout configurable

2020-11-13 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231244#comment-17231244 ] Gabor Somogyi commented on SPARK-33143: --- I've had a look at this issue and under some

[jira] [Commented] (SPARK-33139) protect setActiveSession and clearActiveSession

2020-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231235#comment-17231235 ] Apache Spark commented on SPARK-33139: -- User 'leanken' has created a pull request for this issue: