Hi Gokul,
What is the network topology ? Is it a 1Gbps or 10Gbps n/w ? It is
possible that network could be getting choked up causing the write time to
increase.
Thanks,
Sagar
From: Gokulakannan M [mailto:gok...@huawei.com]
Sent: Monday, April 12, 2010 7:52 PM
To: hdfs-user@hadoop.apache.org
Subject: response time increases lineraly for each thread!
Hi,
When I tested the performance of a 11 node hadoop cluster(private
nw) for the write scenario with several threads, I noticed that the time for
each write increases linearly(what ever the file size may be).
Actually I'm running these threads as a single process in the
system where namenode is running. I'm getting inconsistent results when I run
this suite each time. The results are fluctuating. What might be the
bottlenecks?
I think running this in parallel by spawning multiple shells will
give consistent result. But running these in the same system will give exact
results??
Any ways to measure the performance correctly?
Appreciated any help in this.
Thanks,
Gokul
DISCLAIMER
==========
This e-mail may contain privileged and confidential information which is the
property of Persistent Systems Ltd. It is intended only for the use of the
individual or entity to which it is addressed. If you are not the intended
recipient, you are not authorized to read, retain, copy, print, distribute or
use this message. If you have received this communication in error, please
notify the sender and delete all copies of this message. Persistent Systems
Ltd. does not accept any liability for virus infected mails.
