[
https://issues.apache.org/jira/browse/HDFS-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Suresh Srinivas updated HDFS-2246:
----------------------------------
Attachment: HDFS-2246.20s.1.patch
Nathan, I added some code to TestShortCircuitLocalRead to enable bench marks.
Please see the the documentation in the class on how to run it. These are the
results of benchmarks I observed:
Threads 1: Shortcircuit 22010, Regular 25292
Threads 2: Shortcircuit 22110, Regular 28455
Threads 3: Shortcircuit 24406, Regular 30012
Threads 4: Shortcircuit 30469, Regular 48898
Threads 10: Shortcircuit 73692, Regular 109824
Beyond 3 threads, in regular reads I see bunch of IOExceptions (bind failed,
could not find datanode with the block etc.) that I have not dug into.
> Shortcut a local client reads to a Datanodes files directly
> -----------------------------------------------------------
>
> Key: HDFS-2246
> URL: https://issues.apache.org/jira/browse/HDFS-2246
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Sanjay Radia
> Attachments: 0001-HDFS-347.-Local-reads.patch, HDFS-2246.20s.1.patch,
> HDFS-2246.20s.patch, localReadShortcut20-security.2patch
>
>
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
