Hi,
When I tested the performance of a 11 node hadoop
cluster(private nw) for the write scenario with several threads, I noticed
that the time for each write increases linearly(what ever the file size may
be).
Actually I'm running these threads as a single process in the
system where namenode is running. I'm getting inconsistent results when I
run this suite each time. The results are fluctuating. What might be the
bottlenecks?
I think running this in parallel by spawning multiple shells
will give consistent result. But running these in the same system will give
exact results??
Any ways to measure the performance correctly?
Appreciated any help in this.
Thanks,
Gokul
