GitHub user taoli91 opened a pull request:
https://github.com/apache/spark/pull/12693
[SPARK-14914] Fix Resource not closed after using, mostly for unit tests
## What changes were proposed in this pull request?
Close `FileStream`s, `ZipFile`s etc to release the resources after using.
Not closing the resources will cause IO Exception to be raised while deleting
temp files.
## How was this patch tested?
Run unit test on both windows and Linux. Note that this fix can't resolve
all the problem of Unit tests on Windows.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/taoli91/spark fix_file_not_close
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/12693.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #12693
----
commit 1b531f864745ba4c5d0322d02a71173e0789e27b
Author: U-FAREAST\tl <[email protected]>
Date: 2016-04-25T03:37:06Z
mvn.cmd for windows
Helping script for windows to download dependency and start zinc to
support incremental building on windows.
commit aa31dd908988f37bd3def550d8d95a9802c3ca3b
Author: U-FAREAST\tl <[email protected]>
Date: 2016-04-25T06:50:59Z
Fix file not closed on FileSuite
commit 151a1b0f4c561e324cecd9e61f2d75f70f52370c
Author: U-FAREAST\tl <[email protected]>
Date: 2016-04-25T07:28:01Z
Fix ReliableCheckpointRDD file won't correctly closed if error on the first
stream
commit 781b1ac81fb56e5789474b0ac51ee6f4396e6c5b
Author: U-FAREAST\tl <[email protected]>
Date: 2016-04-25T07:45:39Z
Fix another file closing
commit 5b83cf6a862d3fd26aced2c205c30ce4d50db984
Author: Tao LI <[email protected]>
Date: 2016-04-25T07:57:42Z
close log data.
commit aa5c0996ce5fb5d70f103b8aaf802004fd5efd41
Author: Tao LI <[email protected]>
Date: 2016-04-25T08:01:55Z
Close the class loader
commit 6108f610ae811e398a5b43aeb8a3ae9320d1f655
Author: Tao LI <[email protected]>
Date: 2016-04-25T08:20:48Z
Another file not closed.
commit 8b988269d06eeb0be5f28b501313ac2fd49a2bae
Author: Tao LI <[email protected]>
Date: 2016-04-25T08:29:16Z
Stop to release resources.
commit 16edc2efb170c4427e68a77055ccee81f2051a8c
Author: U-FAREAST\tl <[email protected]>
Date: 2016-04-25T08:34:45Z
More closing problem
commit 1f91a8d2c15458c58c87a5342cf528ab7bde17d7
Author: U-FAREAST\tl <[email protected]>
Date: 2016-04-25T13:25:42Z
Fix the zip file and jar file in RPackageUtilsSuite
commit e9399a3dddf7528d056e075ee05636c060a60459
Author: U-FAREAST\tl <[email protected]>
Date: 2016-04-26T05:35:35Z
Stop ssc in MasterFailureTest
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
