Also, the demux mapred jobs all fail almost immediately with an out-of-memory. The sort buffer sizes in chukwa-demux-conf are incompatible with the Hadoop defaults.
I think we should dial down the default sizes in chukwa-demux-conf. Outside Yahoo!, much smaller buffers should still be OK, since nobody else will be running Chukwa at large scale for a while. --Ari -- Ari Rabkin [email protected] UC Berkeley Computer Science Department
