Pradeep Fernando wrote:
although this sounds good. there are clouds like Amazon EC2 for setting up a cluster.Are you devs make use of that sort of infrastructure in development testing.I dont knw this is a right question or this is relevent at all. plz bare with me if.
I guess you are asking if it would be more convenient if one had access to a larger cluster for development.. I doubt it.
At Y! I have access to many machines and clusters.. but about 99% of my development happens using single machine for testing. I would guess that is true for most of the Hadoop developers. It is just more convenient on a single machine. I run multiple datanodes on the same machine if required.
Real clusters are useful mainly to stress the system and to debug performance issues or hard to reproduce bugs.
Raghu.
