[
https://issues.apache.org/jira/browse/SPARK-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289677#comment-14289677
]
Alexander Ulanov commented on SPARK-5386:
-
My spark-env.sh contains:
export
[
https://issues.apache.org/jira/browse/SPARK-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289607#comment-14289607
]
Sean Owen commented on SPARK-5386:
--
Yes, you're creating ~5GB vectors and have at least 2
[
https://issues.apache.org/jira/browse/SPARK-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289633#comment-14289633
]
Sean Owen commented on SPARK-5386:
--
You are allocating 8G for executors? or just the
[
https://issues.apache.org/jira/browse/SPARK-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289679#comment-14289679
]
Shivaram Venkataraman commented on SPARK-5386:
--
Couple of things that might
[
https://issues.apache.org/jira/browse/SPARK-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289621#comment-14289621
]
Alexander Ulanov commented on SPARK-5386:
-
I allocate 8G for driver and each
[
https://issues.apache.org/jira/browse/SPARK-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289731#comment-14289731
]
Shivaram Venkataraman commented on SPARK-5386:
--
Note that having 2 worker
[
https://issues.apache.org/jira/browse/SPARK-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289708#comment-14289708
]
Alexander Ulanov commented on SPARK-5386:
-
Thank you for suggestions.
1. count()
[
https://issues.apache.org/jira/browse/SPARK-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289880#comment-14289880
]
Alexander Ulanov commented on SPARK-5386:
-
Thank you, it might be the problem. I
[
https://issues.apache.org/jira/browse/SPARK-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289957#comment-14289957
]
Shivaram Venkataraman commented on SPARK-5386:
--
Results are merged on the
