You might also want to check out Chukwa, which is a Hadoop subproject aiming to do scalable monitoring and analysis of large clusters, particularly Hadoop clusters. It's still in development, so you'd be able to have an influence on the design and priorities that come out.
--Ari On Fri, Jun 5, 2009 at 6:55 AM, Anthony McCulley<[email protected]> wrote: > Hey all, > I'm currently tasked to come up with a web/flex-based > visualization/monitoring system for a cloud system using hadoop as part of a > university research project. I was wondering if I could elicit some > feedback from all of you with regards to: > > > - If you were an engineer of a cloud system running hadoop, what > information would you be interested in capturing, viewing, monitoring, etc? > - Is there any sort of real-time stats or monitoring currently available > for hadoop? if so, is in a web-friendly format? > > Thanks in advance, > > - Anthony > -- Ari Rabkin [email protected] UC Berkeley Computer Science Department
