Cluster Status business dev Cluster Size 10 nodes Chukwa Usage: monitoring + analytics Cluster: yahoo data center All components Data analytics: pig+MR Agent less solution: no preference Hive: no preference
What is missing: - Missing good storage format. - Missing good post demux report generator. - Missing good data retention process. - Missing full body index for Archive for search, i.e. find log entries. - The list goes on and on... It will take time to build all those features. Regards, Eric On 2/24/10 9:41 AM, "Jerome Boulon" <jbou...@netflix.com> wrote: > Hi, > I would like to get some stats on how Chukwa is used? > Thanks in advance, > /Jerome. > > * cluster status >> * personal >> * business experiment >> * business dev >> * business test >> * business prod > > * cluster size >> * < 10 nodes >> * < 100 nodes >> * < 200 nodes >> * < 500 nodes >> * > 1000 nodes > > * Chukwa usage >> * monitoring >> * analytics > > * Are you using Chukwa to collect: >> * Log files >> * Metrics information > > * Cluster running >> * in your own data center >> * in the cloud (ex: amazon ec2) > > * which Chukwa components are you using? >> * UI (HICC) >> * Log4j Appender >> * Agent adaptors (list) >> * Archiver >> * Demuxer > > * Data analytics on ChukwaRecords >> * pig >> * M/R > > * Would you be interested in an agent less solution? > > * Would you like to be able to use Hive instead of/in addition to Pig? > > * What from your point of view is missing in Chukwa, today? > >
