One more, I wonder that the more map task, the more faster on any condition.

/Edward

On Tue, Dec 2, 2008 at 2:32 PM, Andrew Purtell <[EMAIL PROTECTED]> wrote:
> Hello Jonathan,
>
> +1 on sharing your Nagios plugins for Hadoop and HBase as a
> contrib. :-)
>
>   - Andy
>
>
>> From: Jonathan Gray <[EMAIL PROTECTED]>
>> Subject: RE: Bulk import question.
>> To: [email protected]
>> Date: Monday, December 1, 2008, 7:20 PM
>>
>> Your new best friends:  Ganglia and Nagios
>>
>> Ganglia is great for monitoring cluster-wide resource usage
>> over time.  You'll see memory, cpu, disk, network usage
>> over time for entire cluster and for each node.  It is very
>> easy to setup because it uses UDP broadcast so no need to
>> actually configure nodes in conf files.  HBase 0.19
>> introduces ganglia metrics which will also be available in
>> the ganglia web interface.
>>
>> http://ganglia.info/
>>
>> Nagios is good for monitoring services as well as resource
>> utilization.  Rather than give data over time, it's aim
>> is really to alert you when something is wrong.  For
>> example, when a server is no longer reachable or when
>> available disk space reaches a configurable threshold.  It
>> does require a bit more work to get up and running because
>> you have to setup your node and service configurations.  I
>> have written custom nagios plugins for hadoop and hbase, if
>> there's interest I will look at cleaning them up and
>> contrib'ing them.
>>
>> http://www.nagios.org/
>>
>> Both are free and essential tools for properly monitoring
>> your cluster.
>>
>> JG
>
>
>
>
>



-- 
Best Regards, Edward J. Yoon @ NHN, corp.
[EMAIL PROTECTED]
http://blog.udanax.org

Reply via email to