[
https://issues.apache.org/jira/browse/HDFS-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464772#comment-13464772
]
Junping Du commented on HDFS-1338:
----------------------------------
Hi,
This jira looks to be pending for a long time. Do we have conclusion to
improve TestDFSIO or have something brand-new like: TestMRIO? I agree with Arun
that we should have something to evaluate HDFS throughput in MR pattern.
Thanks,
Junping
> Improve TestDFSIO
> -----------------
>
> Key: HDFS-1338
> URL: https://issues.apache.org/jira/browse/HDFS-1338
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: test
> Reporter: Arun C Murthy
> Attachments: TestDFSIOparser_y0.20.patch
>
>
> Currently the read test in TestDFSIO benchmark just opens a large side file
> and measures the read performance. The MR scheduler has no opportunity to do
> *any* optimization for the TestDFSIO MR application. The side-effect of this
> is that it is *very* hard to do any meaningful analysis of the results of the
> benchmark i.e. to check if node-local or rack-local or off-switch read
> performance improved/degraded.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
