GitHub user 10110346 opened a pull request: https://github.com/apache/spark/pull/19690
[SPARK-22467]Added a switch to support whether `stdout_stream` and `stderr_stream` output to disk ## What changes were proposed in this pull request? We should add a switch to control the `stdout_stream` and `stdout_stream` output to disk. In my environment,due to disk I/O blocking, the `stdout_stream` output is very slow, so it can not be timely cleaningï¼and this leads the executor process to be blocked. ## How was this patch tested? Added a unit test You can merge this pull request into a Git repository by running: $ git pull https://github.com/10110346/spark stdout_err Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/19690.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #19690 ---- commit 7b671485e46a7e7c4fbce57b7f9e8fa66adcd82a Author: liuxian <liu.xi...@zte.com.cn> Date: 2017-11-07T09:16:48Z fix ---- --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org