Marcelo Vanzin created SPARK-23322:
--------------------------------------
Summary: Launcher handles can miss application updates if
application finishes too quickly
Key: SPARK-23322
URL: https://issues.apache.org/jira/browse/SPARK-23322
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.3.0
Reporter: Marcelo Vanzin
This is the underlying issue in SPARK-23020, which was worked around in our
tests, but still exist in the code.
If a child application finishes too quickly, the launcher code may clean up the
handle's state before the connection from the child has been acknowledged. This
means than the application handle will have a final state LOST instead of
whatever final state the application sent.
This doesn't seem to affect child processes as much as the new in-process
launch mode, and it requires the child application to finish very quickly,
which should be rare for the kind of use case the launcher library covers.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
