Chukwa is good for general purpose log aggregation, and it has specific knowledge of analyze hadoop logs for monitoring/reporting hadoop performance. Log aggregation component is a completed system in Chukwa 0.4 for streaming logs into hadoop. Trunk also provides a completed reference implementation to stream log to Hbase. Analytics and reporting framework are incomplete in trunk. There are a couple patches (PIG-1782, PIG-1832) in flight to make the framework more polished to support the analytics framework.
Regards, Eric On 3/21/11 11:24 AM, "Mark" <static.void....@gmail.com> wrote: Is Chukwa primarily used for analytics or log aggregation. I thought it was the latter but it seems more and more its like the former. On 3/21/11 8:27 AM, Eric Yang wrote: > Chukwa is waiting on a official release of Hadoop and HBase which > works together. In Chukwa trunk, Chukwa is using HBase as data > storage, and using pig+hbase for data analytics. Unfortunately, > Hadoop security release branch and Hadoop trunk are both broken for > HBase. Hence, Chukwa is in hibernation mode until those dependencies > are resolved then release Chukwa 0.5. > > regards, > Eric > > On Sun, Mar 20, 2011 at 10:44 PM, Bill Graham<billgra...@gmail.com> wrote: >> Chukwa hasn't had a release since moving from Hadoop to incubator so >> there are no releases in the /incubator repos. Follow the link on the >> Chukwa homepage to the downloads repos: >> >> http://incubator.apache.org/chukwa/ >> http://www.apache.org/dyn/closer.cgi/hadoop/chukwa/chukwa-0.4.0 >> >> >> On Sun, Mar 20, 2011 at 9:38 AM, Mark<static.void....@gmail.com> wrote: >>> Whats the deal with Chukwa? Mailing list doesn't look like its alive as well >>> as any of the download options??? >>> http://www.apache.org/dyn/closer.cgi/incubator/chukwa/ >>> >>> Is this project dead? >>>
