[
https://issues.apache.org/jira/browse/SPARK-26774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid updated SPARK-26774:
---------------------------------
Description: TaskSchedulerImpl has a couple of places threading concerns
aren't clearly documented, which could improved a little. There is also a race
in {{killTaskAttempt}} on {{taskIdToExecutorId}} (though I think nobody
actually uses this api). (was: TaskSchedulerImpl has a bunch of threading
concerns, which are not well documented -- in fact the docs it has are somewhat
misleading. In particular, some of the methods should only be called within
the DAGScheduler event loop.
This suggests some potential refactoring to avoid so many mixed concerns inside
TaskSchedulerImpl, but that's a lot harder to do safely, I just want to add
some comments.)
> Document threading concerns in TaskSchedulerImpl
> ------------------------------------------------
>
> Key: SPARK-26774
> URL: https://issues.apache.org/jira/browse/SPARK-26774
> Project: Spark
> Issue Type: Improvement
> Components: Scheduler, Spark Core
> Affects Versions: 3.0.0
> Reporter: Imran Rashid
> Priority: Major
>
> TaskSchedulerImpl has a couple of places threading concerns aren't clearly
> documented, which could improved a little. There is also a race in
> {{killTaskAttempt}} on {{taskIdToExecutorId}} (though I think nobody actually
> uses this api).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
