[
https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353434#comment-14353434
]
Arpit Agarwal edited comment on HDFS-7847 at 3/9/15 7:24 PM:
-------------------------------------------------------------
Hi [~clamb], I have attached a couple of rudimentary scripts I used to create
DN blocks. The scripts use template block+meta files to create as many blocks
as you need. It needs updating post HDFS-6482 to put blocks into the correct
subdirectories based on their block ID but the fix should be simple.
On the NN side you can use CreateEditsLog.java which is in our source tree to
generate files with the generated block IDs. The edits log can be copied over
to a freshly formatted namenode.
HTH.
was (Author: arpitagarwal):
Hi [~clamb], I have attached a couple of rudimentary scripts I used to create
DN blocks. The scripts uses template block+meta files to create as many blocks
as you need. It needs updating post HDFS-6482 to put blocks into the correct
subdirectories based on their block ID but the fix should be simple.
On the NN side you can use CreateEditsLog.java which is in our source tree to
generate files with the generated block IDs. The edits log can be copied over
to a freshly formatted namenode.
HTH.
> Write a junit test to simulate a heavy BlockManager load
> --------------------------------------------------------
>
> Key: HDFS-7847
> URL: https://issues.apache.org/jira/browse/HDFS-7847
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Affects Versions: HDFS-7836
> Reporter: Colin Patrick McCabe
> Assignee: Charles Lamb
> Attachments: make_blocks.tar.gz
>
>
> Write a junit test to simulate a heavy BlockManager load. Quantify native
> and java heap sizes, and some latency numbers.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
