Ted, thanks very much. I'll try to split these things.
Ted Dunning wrote:
It will be very difficult to do. If you have n machines running 4
different things, you will probably get better results segregating
tasks as much as possible. Interactions can be very subtle and can
have major impact on performance in a few cases.
Hadoop, in general, will use a lot of the resources if they appear to
be available. The intent, after all, is to run batch jobs absolutely
as fast as your hardware can handle.
On Wed, Mar 2, 2011 at 7:31 PM, liupei <[email protected]
<mailto:[email protected]>> wrote:
Hi,
I'd like to tune params in hadoop config for my job. But my
current cluster runs lot of other processes such as mongod, php
gateways and some other routine hadoop jobs. It is impossible to
stop all to get a clear environment for testing. Is there any way
to get reliable results for my tuning in such a mixture environment?
Thanks