-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26536/
-----------------------------------------------------------

(Updated Oct. 10, 2014, 4:35 p.m.)


Review request for hcatalog and hive.


Changes
-------

Picked up the latest HCatUtil.java from the trunk.


Repository: hive-git


Description
-------

Currently all objects shipped via Hadoop Configuration are not compressed.  
Compression is limited to the data member "partitions" in InputJobInfo.  This 
patch will compress all serialized objects.  This will cut down the traffic in 
the cluster when Configuration object is shipped to all compute nodes.  Also, 
there is a 5 MB size limit on the Configuration object.  Compression will make 
this limiit hardly reachable.


Diffs (updated)
-----

  hcatalog/core/src/main/java/org/apache/hive/hcatalog/common/HCatUtil.java 
2f624df 
  
hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/InputJobInfo.java
 360e77b 

Diff: https://reviews.apache.org/r/26536/diff/


Testing
-------

No new test required.  All existing tests should pass.


Thanks,

Mariappan Asokan

Reply via email to