[jira] [Commented] (HDFS-14240) blockReport test in NNThroughputBenchmark throws ArrayIndexOutOfBoundsException
[
https://issues.apache.org/jira/browse/HDFS-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427592#comment-17427592
]
JiangHua Zhu commented on HDFS-14240:
-
Sorry, I did not notice that there is already a similar problem.
[~iwasakims] [~RANith] [~shenyinjie], I created a new issue (HDFS-16269) and it
is already being resolved.
> blockReport test in NNThroughputBenchmark throws
> ArrayIndexOutOfBoundsException
> ---
>
> Key: HDFS-14240
> URL: https://issues.apache.org/jira/browse/HDFS-14240
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Shen Yinjie
>Assignee: Ranith Sardar
>Priority: Major
> Attachments: screenshot-1.png
>
>
> _emphasized text_When I run a blockReport test with NNThroughputBenchmark,
> BlockReportStats.addBlocks() throws ArrayIndexOutOfBoundsException.
> digging the code:
> {code:java}
> for(DatanodeInfo dnInfo : loc.getLocations())
> { int dnIdx = dnInfo.getXferPort() - 1;
> datanodes[dnIdx].addBlock(loc.getBlock().getLocalBlock());{code}
>
> problem is here:array datanodes's length is determined by args as
> "-datanodes" or "-threads" ，but dnIdx = dnInfo.getXferPort() is a random port.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14240) blockReport test in NNThroughputBenchmark throws ArrayIndexOutOfBoundsException
[
https://issues.apache.org/jira/browse/HDFS-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861710#comment-16861710
]
Shen Yinjie commented on HDFS-14240:
Sorry for my late replies.[~RANith]
I use a real namenode to run “NNThroughputBenchmark -fs hdfs://hc1:8020 -op
blockReport -datanodes 10 -reports 30 -blocksPerReport 100 -blocksPerFile 10”.
> blockReport test in NNThroughputBenchmark throws
> ArrayIndexOutOfBoundsException
> ---
>
> Key: HDFS-14240
> URL: https://issues.apache.org/jira/browse/HDFS-14240
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Shen Yinjie
>Assignee: Ranith Sardar
>Priority: Major
> Attachments: screenshot-1.png
>
>
> _emphasized text_When I run a blockReport test with NNThroughputBenchmark,
> BlockReportStats.addBlocks() throws ArrayIndexOutOfBoundsException.
> digging the code:
> {code:java}
> for(DatanodeInfo dnInfo : loc.getLocations())
> { int dnIdx = dnInfo.getXferPort() - 1;
> datanodes[dnIdx].addBlock(loc.getBlock().getLocalBlock());{code}
>
> problem is here:array datanodes's length is determined by args as
> "-datanodes" or "-threads" ，but dnIdx = dnInfo.getXferPort() is a random port.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14240) blockReport test in NNThroughputBenchmark throws ArrayIndexOutOfBoundsException
[
https://issues.apache.org/jira/browse/HDFS-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761669#comment-16761669
]
Ranith Sardar commented on HDFS-14240:
--
[~shenyinjie], please mention which command you used?
> blockReport test in NNThroughputBenchmark throws
> ArrayIndexOutOfBoundsException
> ---
>
> Key: HDFS-14240
> URL: https://issues.apache.org/jira/browse/HDFS-14240
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Shen Yinjie
>Assignee: Ranith Sardar
>Priority: Major
> Attachments: screenshot-1.png
>
>
> _emphasized text_When I run a blockReport test with NNThroughputBenchmark,
> BlockReportStats.addBlocks() throws ArrayIndexOutOfBoundsException.
> digging the code:
> {code:java}
> for(DatanodeInfo dnInfo : loc.getLocations())
> { int dnIdx = dnInfo.getXferPort() - 1;
> datanodes[dnIdx].addBlock(loc.getBlock().getLocalBlock());{code}
>
> problem is here:array datanodes's length is determined by args as
> "-datanodes" or "-threads" ，but dnIdx = dnInfo.getXferPort() is a random port.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14240) blockReport test in NNThroughputBenchmark throws ArrayIndexOutOfBoundsException
[
https://issues.apache.org/jira/browse/HDFS-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757595#comment-16757595
]
Masatake Iwasaki commented on HDFS-14240:
-
{quote}roblem is here:array datanodes's length is determined by args as
"-datanodes" or "-threads" ，but dnIdx = dnInfo.getXferPort() is a random port.
{quote}
NNThroughputBenchmark registers fake datanode having port number based on idx
if using in-process NameNode. The code path assuming the mode seems to be
reached in the mode using real NameNode.
[~shenyinjie] if you can show the command line to reproduce the issue, it would
be help.
[~RANith] I assigned you to this ticket.
> blockReport test in NNThroughputBenchmark throws
> ArrayIndexOutOfBoundsException
> ---
>
> Key: HDFS-14240
> URL: https://issues.apache.org/jira/browse/HDFS-14240
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Shen Yinjie
>Assignee: Ranith Sardar
>Priority: Major
> Attachments: screenshot-1.png
>
>
> When I run a blockReport test with NNThroughputBenchmark,
> BlockReportStats.addBlocks() throws ArrayIndexOutOfBoundsException.
> digging the code:
> {code:java}
> for(DatanodeInfo dnInfo : loc.getLocations())
> { int dnIdx = dnInfo.getXferPort() - 1;
> datanodes[dnIdx].addBlock(loc.getBlock().getLocalBlock());{code}
>
> problem is here:array datanodes's length is determined by args as
> "-datanodes" or "-threads" ，but dnIdx = dnInfo.getXferPort() is a random port.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14240) blockReport test in NNThroughputBenchmark throws ArrayIndexOutOfBoundsException
[
https://issues.apache.org/jira/browse/HDFS-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754671#comment-16754671
]
Ranith Sardar commented on HDFS-14240:
--
would like to work on this issue.
> blockReport test in NNThroughputBenchmark throws
> ArrayIndexOutOfBoundsException
> ---
>
> Key: HDFS-14240
> URL: https://issues.apache.org/jira/browse/HDFS-14240
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Shen Yinjie
>Priority: Major
> Attachments: screenshot-1.png
>
>
> When I run a blockReport test with NNThroughputBenchmark,
> BlockReportStats.addBlocks() throws ArrayIndexOutOfBoundsException.
> digging the code:
> {code:java}
> for(DatanodeInfo dnInfo : loc.getLocations())
> { int dnIdx = dnInfo.getXferPort() - 1;
> datanodes[dnIdx].addBlock(loc.getBlock().getLocalBlock());{code}
>
> problem is here:array datanodes's length is determined by args as
> "-datanodes" or "-threads" ，but dnIdx = dnInfo.getXferPort() is a random port.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
