[
https://issues.apache.org/jira/browse/HADOOP-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12622281#action_12622281
]
Lohit Vijayarenu commented on HADOOP-3948:
------------------------------------------
Running few experiments and observing logs of past run shows that there was IO
contention during checkpoint. It is clear that _edits_ and _fsimage_ should be
separated and we should have an option to configure them into its own
directories. For example _dfs.name.dir_ could have just the image and
_dfs.edits.dir_ could have edits. Few key points
- This enables one to use combination of different directories/drives/mounts
- Also enables administrator to choose how many copies of edits and fsimage
once should maintain
- Splitting this might help for HA feature
- We should think about how we support upgrade and deal with cases when someone
uses same directory for both _edits_ and _fsimage_ or changes the configuration
during restarts
> Separate Namenodes edits and fsimage
> -------------------------------------
>
> Key: HADOOP-3948
> URL: https://issues.apache.org/jira/browse/HADOOP-3948
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Reporter: Lohit Vijayarenu
>
> NameNode's _edits_ and _fsimage_ should be separated with an option of having
> them in their own separate directories.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
