jin xing created SPARK-18820:
--------------------------------
Summary: Driver may send "LaunchTask" before executor receive
"RegisteredExecutor"
Key: SPARK-18820
URL: https://issues.apache.org/jira/browse/SPARK-18820
Project: Spark
Issue Type: Bug
Components: Scheduler
Affects Versions: 1.6.3
Environment: spark-1.6.3
Reporter: jin xing
CoarseGrainedSchedulerBackend will update executorDataMap after receiving
"RegisterExecutor", thus task scheduler may assign tasks on to this executor;
If LaunchTask arrives at CoarseGrainedExecutorBackend before
RegisteredExecutor, it will result in NullPointerException and executor backend
will exit;
Is it a bug? I think driver should send "LaunchTask" after "RegisteredExecutor"
is already received.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]