[
https://issues.apache.org/jira/browse/HDFS-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12847649#action_12847649
]
Sanjay Radia commented on HDFS-1051:
------------------------------------
The HDFS Name service currently uses a single Namenode. Namenode maintains the
entire file system metadata in memory. This inlcudes:
* the list of files and directories (ie their inodes)
* the block map which maps blockids to their locations
The size of the metadata is limited by the physical memory available on the
node. This results in the following issues:
* Number of files that can be created.
* Number of block, and hence the total storage that can be addressed.
There are various ways to fix this. Some of these have been identified in
http://wiki.apache.org/hadoop/HdfsFutures.
> Umbrella Jira for Scaling the HDFS Name Service
> -----------------------------------------------
>
> Key: HDFS-1051
> URL: https://issues.apache.org/jira/browse/HDFS-1051
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.22.0
> Reporter: Sanjay Radia
> Assignee: Sanjay Radia
> Fix For: 0.22.0
>
>
> The HDFS Name service currently uses a single Namenode which limits its
> scalability. This is a master jira to track sub-jiras to address this problem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
