Marcelo Vanzin created SPARK-21490:
--------------------------------------
Summary: SparkLauncher may fail to redirect streams
Key: SPARK-21490
URL: https://issues.apache.org/jira/browse/SPARK-21490
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.2.0
Reporter: Marcelo Vanzin
Priority: Minor
While investigating a different issue, I noticed that the redirection handling
in SparkLauncher is faulty.
In the default case or when users use only log redirection, things should work
fine.
But if users try to redirect just the stdout of a child process without
redirecting stderr, the launcher won't detect that and the child process may
hang because stderr is not being read and its buffer fills up.
The code should detect these cases and redirect any streams that haven't been
explicitly redirected by the user.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
