GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/20706
[SPARK-23550][core] Cleanup `Utils`.
A few different things going on:
- Remove unused methods.
- Move JSON methods to the only class that uses them.
- Move test-only methods to TestUtils.
- Make getMaxResultSize() a config constant.
- Reuse functionality from existing libraries (JRE or JavaUtils) where
possible.
There is a slight change in the behavior of "createDirectory()": it does
not create
a full directory tree anymore, just the directory being requested. That's
better since
the code would only set up proper permissions for the leaf directory, and
this change
requires its parent to already exist.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vanzin/spark SPARK-23550
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20706.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20706
----
commit 4b8b8e25f4c7d43616dd09988e1dabce77380cf8
Author: Marcelo Vanzin <vanzin@...>
Date: 2018-03-01T00:09:52Z
[SPARK-23550][core] Cleanup `Utils`.
A few different things going on:
- Remove unused methods.
- Move JSON methods to the only class that uses them.
- Move test-only methods to TestUtils.
- Make getMaxResultSize() a config constant.
- Reuse functionality from existing libraries (JRE or JavaUtils) where
possible.
There is a slight change in the behavior of "createDirectory()": it does
not create
a full directory tree anymore, just the directory being requested. That's
better since
the code would only set up proper permissions for the leaf directory, and
this change
requires its parent to already exist.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
