[
https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298838#comment-16298838
]
Imran Rashid commented on SPARK-22577:
--------------------------------------
[~tgraves] what exactly were you thinking?
I remember when first looking at this I wasn't really sure what to show within
a taskset -- from my experience, whenever you have a bad taskset, which
eventually fails, you end up getting a bunch of executor blacklisting. This is
totally fine, but I worried about loudly warning, as it would be misleading --
the users would think the issue was bad executors, when in fact its just a bad
taskset.
I'm guessing you want this to show up in the stage UI -- what did you have in
mind?
> executor page blacklist status should update with TaskSet level blacklisting
> ----------------------------------------------------------------------------
>
> Key: SPARK-22577
> URL: https://issues.apache.org/jira/browse/SPARK-22577
> Project: Spark
> Issue Type: Bug
> Components: Scheduler
> Affects Versions: 2.1.1
> Reporter: Thomas Graves
>
> right now the executor blacklist status only updates with the
> BlacklistTracker after a task set has finished and propagated the
> blacklisting to the application level. We should change that to show at the
> taskset level as well. Without this it can be very confusing to the user why
> things aren't running.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
