I just opened CHUKWA-239 for this. It should be a near-trivial patch. Am I right in assuming that Yahoo! has internal corporate settings which will override chukwa-demux-conf anyway?
--Ari On Thu, May 14, 2009 at 8:04 AM, Cheng Zhang <[email protected]> wrote: > +1. As an open source project, the default settings should be workable. > > > >> -----Original Message----- >> From: Ariel Rabkin [mailto:[email protected]] >> Sent: Wednesday, May 13, 2009 11:29 PM >> To: [email protected] >> Subject: another rc4 issue? >> >> Also, the demux mapred jobs all fail almost immediately with an >> out-of-memory. The sort buffer sizes in chukwa-demux-conf are >> incompatible with the Hadoop defaults. >> >> I think we should dial down the default sizes in chukwa-demux-conf. >> Outside Yahoo!, much smaller buffers should still be OK, since nobody >> else will be running Chukwa at large scale for a while. >> >> --Ari >> >> -- >> Ari Rabkin [email protected] >> UC Berkeley Computer Science Department > -- Ari Rabkin [email protected] UC Berkeley Computer Science Department
