[jira] [Commented] (SPARK-12519) "Managed memory leak detected" when using distinct on PySpark DataFrame

2017-08-08 Thread min shi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118123#comment-16118123 ] min shi commented on SPARK-12519: - this happens to sparkSql dataframe too. {code:java} val df:

[jira] [Commented] (SPARK-12519) "Managed memory leak detected" when using distinct on PySpark DataFrame

2016-02-05 Thread Jason C Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15135630#comment-15135630 ] Jason C Lee commented on SPARK-12519: - The memory leak in question comes from a