[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119177#comment-14119177
]
Nicholas Chammas commented on SPARK-:
-
So I've repeated the tests with the exa
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119119#comment-14119119
]
Nicholas Chammas commented on SPARK-:
-
Just to double check my results, I re-r
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118826#comment-14118826
]
Josh Rosen commented on SPARK-:
---
360/220 is approximately 1.6. Using Splunk, I comp
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118775#comment-14118775
]
Josh Rosen commented on SPARK-:
---
Tried this on a m3.xlarge cluster (1 master, 1 work
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118735#comment-14118735
]
Nicholas Chammas commented on SPARK-:
-
{quote}
If we can't narrow it down in t
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118695#comment-14118695
]
Josh Rosen commented on SPARK-:
---
I was unable to reproduce this on a cluster with tw
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118593#comment-14118593
]
Patrick Wendell commented on SPARK-:
Hey [~nchammas] one other thing. If you g
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118455#comment-14118455
]
Patrick Wendell commented on SPARK-:
Hey [~nchammas] unfortunately we couldn't
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117905#comment-14117905
]
Josh Rosen commented on SPARK-:
---
Still investigating. I tried this on my laptop by
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117903#comment-14117903
]
Aaron Davidson commented on SPARK-:
---
Anyone have a jmap on the driver during thi
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117853#comment-14117853
]
Nicholas Chammas commented on SPARK-:
-
It looks like the default number of re
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117770#comment-14117770
]
Patrick Wendell commented on SPARK-:
[~nchammas]. I think the default number o
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117062#comment-14117062
]
Josh Rosen commented on SPARK-:
---
[~shivaram] and I discussed this; we have a few ide
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117021#comment-14117021
]
Josh Rosen commented on SPARK-:
---
Good point. I guess "culprit" was the wrong word,
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117019#comment-14117019
]
Davies Liu commented on SPARK-:
---
@joserosen This should not be the culprit, it just
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117016#comment-14117016
]
Josh Rosen commented on SPARK-:
---
It looks like https://github.com/apache/spark/pull/
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116985#comment-14116985
]
Josh Rosen commented on SPARK-:
---
I'll resume work on this later tonight, but just wa
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116978#comment-14116978
]
Nicholas Chammas commented on SPARK-:
-
For the record, I got the OOM in a rela
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116969#comment-14116969
]
Josh Rosen commented on SPARK-:
---
Looks like the issue was introduced somewhere betwe
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116948#comment-14116948
]
Josh Rosen commented on SPARK-:
---
Working on doing some manual bisecting to find the
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116942#comment-14116942
]
Matei Zaharia commented on SPARK-:
--
I see, that makes sense.
> Large number of p
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116936#comment-14116936
]
Josh Rosen commented on SPARK-:
---
I agree with Davies; I think this is a more general
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116935#comment-14116935
]
Davies Liu commented on SPARK-:
---
[~matei] I think this is not related to external sp
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116923#comment-14116923
]
Matei Zaharia commented on SPARK-:
--
The slowdown might be partly due to adding ex
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116918#comment-14116918
]
Josh Rosen commented on SPARK-:
---
Even on my laptop, I notice a huge speed difference
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116902#comment-14116902
]
Patrick Wendell commented on SPARK-:
Hey [~nchammas] - I don't think anything
[
https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116895#comment-14116895
]
Nicholas Chammas commented on SPARK-:
-
Note: I have not yet confirmed that 1.1
27 matches
Mail list logo
