[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514054#comment-15514054
]
Josh Rosen commented on SPARK-14209:
I have backported SPARK-17485 to Spark 1.6.x (for inclusion in
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511187#comment-15511187
]
Josh Rosen commented on SPARK-14209:
I believe that this issue should have been fixed by SPARK-17485
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281798#comment-15281798
]
Marcelo Vanzin commented on SPARK-14209:
BTW this particular error looks like SPARK-9439,
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15280980#comment-15280980
]
Marcelo Vanzin commented on SPARK-14209:
Hi [~milesc], I look at your updates after my last
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15275780#comment-15275780
]
Miles Crawford commented on SPARK-14209:
This issue looks a lot like
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252961#comment-15252961
]
Marcelo Vanzin commented on SPARK-14209:
Just to let you know I haven't forgotten about this, I
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240040#comment-15240040
]
Miles Crawford commented on SPARK-14209:
Just had a very similar error when a host was lost:
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15232598#comment-15232598
]
Miles Crawford commented on SPARK-14209:
So, I have launched the exact same simple application
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229394#comment-15229394
]
Miles Crawford commented on SPARK-14209:
I have not forgotten this, worked on getting a cleaner
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222412#comment-15222412
]
Miles Crawford commented on SPARK-14209:
Yes. I'm still committed to helping you - was just
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222401#comment-15222401
]
Marcelo Vanzin commented on SPARK-14209:
So, I don't know what to say. Your log configuration is
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222396#comment-15222396
]
Miles Crawford commented on SPARK-14209:
yes, we definitely use logback - if you look at the top
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222393#comment-15222393
]
Marcelo Vanzin commented on SPARK-14209:
bq. All we're doing in terms of logging is placing a
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222389#comment-15222389
]
Miles Crawford commented on SPARK-14209:
Can you be a bit more specific about the default log
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220716#comment-15220716
]
Marcelo Vanzin commented on SPARK-14209:
Those logs show the same weird issues as the previous
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218572#comment-15218572
]
Miles Crawford commented on SPARK-14209:
Here's a tarball of all the container logs for another
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218393#comment-15218393
]
Marcelo Vanzin commented on SPARK-14209:
Do you have any other application that failed this way?
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218356#comment-15218356
]
Miles Crawford commented on SPARK-14209:
Anything I can do to help you investigate?
>
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218283#comment-15218283
]
Marcelo Vanzin commented on SPARK-14209:
That's weird. I don't know whether the funny logs are a
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217170#comment-15217170
]
Miles Crawford commented on SPARK-14209:
I don't think there's anything custom about our logging
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217150#comment-15217150
]
Marcelo Vanzin commented on SPARK-14209:
Are you using a custom log configuration? I can't find
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217089#comment-15217089
]
Miles Crawford commented on SPARK-14209:
Here you go, from the same application run:
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217085#comment-15217085
]
Miles Crawford commented on SPARK-14209:
Here you go, from the same application run:
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217055#comment-15217055
]
Marcelo Vanzin commented on SPARK-14209:
Are you able to share the logs from your driver?
>
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216899#comment-15216899
]
Miles Crawford commented on SPARK-14209:
That's fantastic news! let me know if I can help test a
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216888#comment-15216888
]
Marcelo Vanzin commented on SPARK-14209:
2.0 doesn't currently suffer from this problem because,
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216283#comment-15216283
]
Miles Crawford commented on SPARK-14209:
It will be useful to know whether the issue is fixed in
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214784#comment-15214784
]
Marcelo Vanzin commented on SPARK-14209:
This code has changed significantly in 2.0 (due to
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214731#comment-15214731
]
Marcelo Vanzin commented on SPARK-14209:
Ah, my bad, I should have noticed this in the original
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214732#comment-15214732
]
Miles Crawford commented on SPARK-14209:
Yes, I am certainly caching.
> Application failure
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214674#comment-15214674
]
Miles Crawford commented on SPARK-14209:
Here is all the nodemanager logs related to an
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214649#comment-15214649
]
Miles Crawford commented on SPARK-14209:
Sorry, i was just showing that they were in use - let me
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214624#comment-15214624
]
Marcelo Vanzin commented on SPARK-14209:
I don't see entries related to the offending executor
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214614#comment-15214614
]
Miles Crawford commented on SPARK-14209:
spark.shuffle.service.enabled is shown to be true in
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214611#comment-15214611
]
Marcelo Vanzin commented on SPARK-14209:
If you're using the shuffle service then executors
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214595#comment-15214595
]
Miles Crawford commented on SPARK-14209:
I am using an external shuffle service, as I mentioned
[
https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214560#comment-15214560
]
Marcelo Vanzin commented on SPARK-14209:
If you have preemption enabled you really should be
37 matches
Mail list logo
