[
https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784831#comment-16784831
]
Parth Gandhi commented on SPARK-26947:
--
[~srowen] Yes your suggestion to limit the
[
https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783858#comment-16783858
]
Sean Owen commented on SPARK-26947:
---
That doesn't sound "very big" but how big are the
[
https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783849#comment-16783849
]
Parth Gandhi commented on SPARK-26947:
--
[~srowen] for this particular case, k is se
[
https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16782076#comment-16782076
]
Sean Owen commented on SPARK-26947:
---
How big is k? yes, you're going to run out of mem
[
https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1665#comment-1665
]
Marco Gaido commented on SPARK-26947:
-
Cloud you also please provide the heap dump o
[
https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773457#comment-16773457
]
Parth Gandhi commented on SPARK-26947:
--
I am unable to attach the dummy dataset as
