[
https://issues.apache.org/jira/browse/METAMODEL-179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kasper Sørensen resolved METAMODEL-179.
---------------------------------------
Resolution: Fixed
Fix Version/s: 4.4.0
> FileSystem instance in HdfsResource should not be closed
> --------------------------------------------------------
>
> Key: METAMODEL-179
> URL: https://issues.apache.org/jira/browse/METAMODEL-179
> Project: Apache MetaModel
> Issue Type: Bug
> Reporter: Tomasz Guzialek
> Assignee: Tomasz Guzialek
> Priority: Critical
> Fix For: 4.4.0
>
>
> In HdfsResource, a FileSystem instance is obtained via get() method.
> According to [1] this method does not return a new instance every time, but
> caches it for the same configuration. Closing such instance may result in
> IOException: Filesystem closed in other, possibly unrelated, places in the
> code also using this FileSystem instance.
> Possible solutions:
> 1) Despite a Java convention to always close Closable objects after use, we
> should leave without closing. Apparently, Hive does it this way (see [1])
> 2) Create instances of FileSystem with newInstance() method, but this is an
> expensive operation.
> [1]
> http://stackoverflow.com/questions/20057881/hadoop-filesystem-closed-exception-when-doing-bufferedreader-close/20061797#20061797
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
