[
https://issues.apache.org/jira/browse/HDFS-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816367#comment-13816367
]
Brandon Li commented on HDFS-5364:
----------------------------------
{quote}2 and 3 are optimization of the eviction method. As we discussed
offline, I will file a following up JIRA for that.{quote}
The new patch added the optimization of the eviction method. Also the scan()
method is not holding the lock all the time. A unit test is added to test the
scan() method.
> Add OpenFileCtx cache
> ---------------------
>
> Key: HDFS-5364
> URL: https://issues.apache.org/jira/browse/HDFS-5364
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: nfs
> Reporter: Brandon Li
> Assignee: Brandon Li
> Attachments: HDFS-5364.001.patch, HDFS-5364.002.patch,
> HDFS-5364.003.patch, HDFS-5364.004.patch, HDFS-5364.005.patch,
> HDFS-5364.006.patch, HDFS-5364.007.patch, HDFS-5364.008.patch
>
>
> NFS gateway can run out of memory when the stream timeout is set to a
> relatively long period(e.g., >1 minute) and user uploads thousands of files
> in parallel. Each stream DFSClient creates a DataStreamer thread, and will
> eventually run out of memory by creating too many threads.
> NFS gateway should have a OpenFileCtx cache to limit the total opened files.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
