[
https://issues.apache.org/jira/browse/HDFS-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13115707#comment-13115707
]
Sanjay Radia commented on HDFS-2181:
------------------------------------
I ran NN LoadGenerator on my a single node cluster on my laptop with trunk and
with my patch.
The average ops/sec on trunk over 4 runs was 465 ops/s
With my patch, the average was 475 ops/s
Details:
./hadoop-common/bin/hadoop org.apache.hadoop.fs.loadGenerator.LoadGenerator
-numOfThreads 5 -elapsedTime 600
Trunk:
Average open execution time: 0.8110216038081289ms
Average list execution time: 0.7630895320332224ms
Average deletion execution time: 2.43875027278679ms
Average create execution time: 2.981632356150433ms
Average write_close execution time: 25.23023205062923ms
Average operations per second: 457.07666666666665ops/s
Average open execution time: 1.1143497342641804ms
Average list execution time: 1.134255236545821ms
Average deletion execution time: 3.5265635133883073ms
Average create execution time: 4.072732326507921ms
Average write_close execution time: 44.87295469285648ms
Average operations per second: 449.97833333333335ops/s
Average open execution time: 0.9722300699649344ms
Average list execution time: 0.9654723561904444ms
Average deletion execution time: 2.9690067776755082ms
Average create execution time: 3.1925863944439796ms
Average write_close execution time: 41.305614592921096ms
Average operations per second: 498.935ops/s
Average open execution time: 0.7890530261272186ms
Average list execution time: 0.7375761255542677ms
Average deletion execution time: 2.2088214396327133ms
Average create execution time: 2.847619741660442ms
Average write_close execution time: 25.8978666035089ms
Average operations per second: 455.74ops/s
Average ops/s = 465 ops/s
With Patch
Average open execution time: 0.7613523367583692ms
Average list execution time: 0.721509125260513ms
Average deletion execution time: 1.8838200226730777ms
Average create execution time: 3.8352292717251086ms
Average write_close execution time: 15.838004769164614ms
Average operations per second: 426.86ops/s
Average open execution time: 1.163135555907786ms
Average list execution time: 1.0820202514821358ms
Average deletion execution time: 3.4564453811029154ms
Average create execution time: 3.927116262732701ms
Average write_close execution time: 42.11554267650158ms
Average operations per second: 474.63666666666666ops/s
Average open execution time: 1.1151890742340667ms
Average list execution time: 1.093346178121782ms
Average deletion execution time: 3.092686422880763ms
Average create execution time: 3.704323477449248ms
Average write_close execution time: 40.115570519017304ms
Average operations per second: 500.64666666666665ops/s
Average open execution time: 1.0694835059391854ms
Average list execution time: 1.0539717409755853ms
Average deletion execution time: 3.099491162292448ms
Average create execution time: 3.543200990894483ms
Average write_close execution time: 40.48833355650777ms
Average operations per second: 499.60833333333335ops/s
Average ops/s = 475 ops/s
> Seperate HDFS wire protocol data types
> --------------------------------------
>
> Key: HDFS-2181
> URL: https://issues.apache.org/jira/browse/HDFS-2181
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Sanjay Radia
> Assignee: Sanjay Radia
> Attachments: separateDataType1.patch, separateDataType2.patch,
> separateDataType6.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
