[
https://issues.apache.org/jira/browse/HDFS-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mona Chitnis updated HDFS-1324:
-------------------------------
Priority: Minor (was: Major)
Issue Type: Improvement (was: Test)
Remaining Estimate: 1,008h (was: 168h)
Original Estimate: 1,008h (was: 168h)
> Quantifying HDFS Client Latency to understand performance and scalability
> -------------------------------------------------------------------------
>
> Key: HDFS-1324
> URL: https://issues.apache.org/jira/browse/HDFS-1324
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: benchmarks
> Affects Versions: 0.20-append
> Environment: An HDFS cluster of 9 nodes (same rack; 1 rack = 40 nodes
> to one rack switch) was deployed on Yahoo!'s R&D grid cluster. It comprised
> of 1 Namenode, 1 JobTracker and 7 Datanodes. client assigned to a separate
> compute node not part of this HDFS. The characteristics of the testbed are as
> follows:
> • Hadoop 0.20.1xx - latest Yahoo! Hadoop Security version
> • OS - GNU/Linux x86_64 kernel version 2.6.18
> • Java 1.6
> • Processor - 2 SMP Quad-core Intel Xeon @ 2.5Ghz per node
> • Memory - 16GB RAM per node
> Reporter: Mona Chitnis
> Priority: Minor
> Attachments: Client_Latency_Observation_v4.0.ppt, Paper1.pdf,
> README.txt, catstat.sh, executor.sh, run_watchers.sh, watcher.jar
>
> Original Estimate: 1,008h
> Remaining Estimate: 1,008h
>
> JAR to measure HDFS client latencies. Runs a process comprising of HDFS
> operations with helper scripts to specify number of iterations, number of
> concurrent instances and base directory. Compiles statistics in 2 text files
> inside base directory which can be read/manipulated using data charts
> applications (e.g. MS Excel).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
