[ 
https://issues.apache.org/jira/browse/HDFS-15052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041489#comment-17041489
 ] 

Hudson commented on HDFS-15052:
-------------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17971 (See 
[https://builds.apache.org/job/Hadoop-trunk-Commit/17971/])
HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem object (github: 
rev 2338d25dc7150d75fbda84cc95422380b5622224)
* (edit) 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
* (edit) 
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
* (edit) 
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java
* (edit) 
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/web/resources/NamenodeWebHdfsMethods.java


> WebHDFS getTrashRoot leads to OOM due to FileSystem object creation
> -------------------------------------------------------------------
>
>                 Key: HDFS-15052
>                 URL: https://issues.apache.org/jira/browse/HDFS-15052
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: webhdfs
>    Affects Versions: 2.9.0, 3.0.0-alpha2
>            Reporter: Wei-Chiu Chuang
>            Assignee: Masatake Iwasaki
>            Priority: Major
>
> Quoting [~daryn] in HDFS-10756 :
> {quote}Surprised nobody has discovered this will lead to an inevitable OOM in 
> the NN. The NN should not be creating filesystems to itself, and must never 
> create filesystems in a remote user's context or the cache will explode.
> {quote}
> I guess the problem lies in side NamenodeWebHdfsMethods#getTrashRoot
> {code:java}
>         private static String getTrashRoot(String fullPath,
>             Configuration conf) throws IOException {
>           FileSystem fs = FileSystem.get(conf != null ? conf : new 
> Configuration());
>           return fs.getTrashRoot(
>               new org.apache.hadoop.fs.Path(fullPath)).toUri().getPath();
>         }
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to