liuxiangwei created YARN-5939:
---------------------------------
Summary: Disabling the cache of FileSystem leads to case that
never close the FileSystem
Key: YARN-5939
URL: https://issues.apache.org/jira/browse/YARN-5939
Project: Hadoop YARN
Issue Type: Bug
Components: nodemanager
Affects Versions: 2.7.3, 2.5.1
Reporter: liuxiangwei
To use our self-defined FileSystem class, the item of configuration
"fs.%s.impl.disable.cache" should set to true.
In YARN's source code, the class named "org.apache.hadoop.yarn.util.FSDownload"
use getFileSystem but never close, which leading to file descriptor leak
because our self-defined FileSystem class close the file descriptor when the
close function is invoked.
My Question below:
1. whether invoking "getFileSystem" but never close is YARN's expected behavior
2. what should we do in our self-defined FileSystem resolve it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
