GitHub user HyukjinKwon reopened a pull request:
https://github.com/apache/spark/pull/15618
[SPARK-14914][CORE] Fix Resource not closed after using, mostly for unit
tests
## What changes were proposed in this pull request?
Close `FileStreams`, `ZipFiles` etc to release the resources after using.
Not closing the resources will cause IO Exception to be raised while deleting
temp files.
## How was this patch tested?
Existing tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HyukjinKwon/spark SPARK-14914-1
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/15618.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #15618
----
commit ceb1681620b83e46425d20f20ff5a228c0a8d75b
Author: U-FAREAST\tl <[email protected]>
Date: 2016-04-25T03:37:06Z
mvn.cmd for windows
Helping script for windows to download dependency and start zinc to
support incremental building on windows.
commit 98ee4ab6a96b3d8ad8acd8dbeb6dedc10523546e
Author: U-FAREAST\tl <[email protected]>
Date: 2016-04-25T06:50:59Z
Fix file not closed on FileSuite
commit ed52ec72fee774e9b8a1bec3183ae4594d758b9f
Author: U-FAREAST\tl <[email protected]>
Date: 2016-04-25T07:45:39Z
Fix another file closing
commit 448508f467c0401f5461d79dadc1454b03210368
Author: Tao LI <[email protected]>
Date: 2016-04-25T07:57:42Z
close log data.
commit 34078a3facde46f09430baf1a1a5976b1c2d2869
Author: Tao LI <[email protected]>
Date: 2016-04-25T08:01:55Z
Close the class loader
commit efb7227518e9fdb8c1a35ae2adb3971c9cfc1ac2
Author: Tao LI <[email protected]>
Date: 2016-04-25T08:20:48Z
Another file not closed.
commit a06bffc02e4d2cd7e723e73102c160c1c57f0915
Author: Tao LI <[email protected]>
Date: 2016-04-25T08:29:16Z
Stop to release resources.
commit 45262dcc58073a99417b9d1a6c0e24c393716c8f
Author: U-FAREAST\tl <[email protected]>
Date: 2016-04-25T08:34:45Z
More closing problem
commit b3c0c96fb4cbe19344cc220e234c98644aa0efcd
Author: U-FAREAST\tl <[email protected]>
Date: 2016-04-25T13:25:42Z
Fix the zip file and jar file in RPackageUtilsSuite
commit a176adbadfa68cb0819a1e958129c4d96b42b42c
Author: U-FAREAST\tl <[email protected]>
Date: 2016-04-26T05:35:35Z
Stop ssc in MasterFailureTest
commit 35aacd29c4667550a4f870ee521ed185c5f9800c
Author: U-FAREAST\tl <[email protected]>
Date: 2016-04-26T08:09:04Z
Remove accidentally added files
commit 9f50128da0660fed97d64b8a5e0d63285dbf93d5
Author: U-FAREAST\tl <[email protected]>
Date: 2016-05-03T06:11:12Z
Code cleanup with respect to comments
commit 55b360e276968eecea970267b0fa438b56e5e703
Author: U-FAREAST\tl <[email protected]>
Date: 2016-05-05T03:51:50Z
Style fixes
commit 91f82b5fac48afefeceadd764ff0e7b61944d875
Author: U-FAREAST\tl <[email protected]>
Date: 2016-05-05T07:29:32Z
Minor code cleanup
commit f3713d1ff59e5bd45a8a207eaf36ab8e6c285812
Author: hyukjinkwon <[email protected]>
Date: 2016-10-25T05:44:15Z
ex -> e and indentation
commit 863ea7f66d4919a3e2c8ee6e3ca575a80a3115dc
Author: hyukjinkwon <[email protected]>
Date: 2016-10-27T15:55:39Z
Use Utils.tryWithSafeFinally where possible.
commit 3949dbeda632e215c64dcc089365bdc7334dacaf
Author: hyukjinkwon <[email protected]>
Date: 2016-10-29T02:02:43Z
close loader later
commit 49cb4e7f259ba0a236b0a977e69719cfc165c265
Author: hyukjinkwon <[email protected]>
Date: 2016-10-30T12:07:32Z
Initialize receivedBlockTracker in start()
commit 15215722dfe2de0785d38cce5713f33fac5e4b03
Author: hyukjinkwon <[email protected]>
Date: 2016-11-01T15:43:39Z
Require nulls for eventpoint and the tracker in start and remove other
checks in methods
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
