Marcelo Vanzin created SPARK-11789:
--------------------------------------
Summary: Spark prints misleading error messages about losing
executors
Key: SPARK-11789
URL: https://issues.apache.org/jira/browse/SPARK-11789
Project: Spark
Issue Type: Improvement
Components: Spark Core, YARN
Affects Versions: 1.6.0
Reporter: Marcelo Vanzin
Priority: Minor
In certain cases, there are misleading ERROR messages in Spark's logs related
to executors stopping:
{quote}
15/11/17 11:48:53 ERROR YarnScheduler: Lost executor 4 on blah: Pending loss
reason.
{quote}
That shouldn't be printed, since the executor's exit reason is not yet known.
{quote}
15/11/17 11:48:53 ERROR YarnScheduler: Actual reason for lost executor 4:
Container container_1447778501188_0006_01_000005 exited from explicit
termination request.
{quote}
That should not be an ERROR, since the executor exited from an explicit request
from the driver (due to dynamic allocation in this case).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
