[ 
https://issues.apache.org/jira/browse/HDFS-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13054577#comment-13054577
 ] 

Tsz Wo (Nicholas), SZE commented on HDFS-2092:
----------------------------------------------

Hi Aaron, we did see some cases in the past that some users put a large object 
in conf and then JT/TT ran out of memory.  Indeed, users can put arbitrary 
large objects in conf.  So this change also prevents such problems.

> Create a light inner conf class in DFSClient
> --------------------------------------------
>
>                 Key: HDFS-2092
>                 URL: https://issues.apache.org/jira/browse/HDFS-2092
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs client
>    Affects Versions: 0.23.0
>            Reporter: Bharath Mundlapudi
>            Assignee: Bharath Mundlapudi
>             Fix For: 0.23.0
>
>         Attachments: HDFS-2092-1.patch, HDFS-2092-2.patch
>
>
> At present, DFSClient stores reference to configuration object. Since, these 
> configuration objects are pretty big at times can blot the processes which 
> has multiple DFSClient objects like in TaskTracker. This is an attempt to 
> remove the reference of conf object in DFSClient. 
> This patch creates a light inner conf class and copies the required keys from 
> the Configuration object.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to