When procession 65billion records and using LZO or Snappy codecs, disk IO is at 100% because mappers are spilling all the time, but CPU is at 40%. Is there a setting where I can raise compression ratio for map/reduce internal temp data (for LZO or Snappy)? So that I can raise effort on CPU and lower IO? Google didn't gave any ideas...
Thanks. Marek M.
