GitHub user 10110346 opened a pull request:
https://github.com/apache/spark/pull/19690
[SPARK-22467]Added a switch to support whether `stdout_stream` and
`stderr_stream` output to disk
## What changes were proposed in this pull request?
We should add a switch to control the `stdout_stream` and `stdout_stream`
output to disk.
In my environment,due to disk I/O blocking, the `stdout_stream` output is
very slow, so it can not be timely cleaningï¼and this leads the executor
process to be blocked.
## How was this patch tested?
Added a unit test
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/10110346/spark stdout_err
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19690.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19690
----
commit 7b671485e46a7e7c4fbce57b7f9e8fa66adcd82a
Author: liuxian <[email protected]>
Date: 2017-11-07T09:16:48Z
fix
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
