I notice that the process reduce > copy  is very slow.

I would like to configure hadoop to compress the map ouput.
<property>
  <name>mapred.compress.map.output</name>
  <value>true</value>
  <description></description>
</property>

<property>
  <name>map.output.compression.type</name>
  <value>RECORD</value>
  <description></description>
</property>

I'm wondering if someone already use it or if you have some statistics about
the improvement.

Any advice or feedback are welcome.

Thanks

Reply via email to