Micah Whitacre created CRUNCH-534:
-------------------------------------

             Summary: Protobuf Size Limit Exception 
                 Key: CRUNCH-534
                 URL: https://issues.apache.org/jira/browse/CRUNCH-534
             Project: Crunch
          Issue Type: Bug
          Components: IO
            Reporter: Micah Whitacre


With HBase's switch to ProtocolBuffers there is now an imposed restriction on 
the size of data which can be stored in protocol buffers and therefore 
Cells/Puts/etc.  

It is definitely an HBase problem[1] but Crunch also might have changes needed 
since we use protobuf serialization in our HBaseTypes.[2]  So might need to 
make sure error isn't only on our side as they work through the issue or might 
need to look at MOB support[3].

[1] - https://issues.apache.org/jira/browse/HBASE-13825
[2] - 
https://github.com/apache/crunch/blob/d176778cf803374506cb7743069a05e28e07e2cf/crunch-hbase/src/main/java/org/apache/crunch/io/hbase/HBaseTypes.java#L33
[3] - https://issues.apache.org/jira/browse/HBASE-11339



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to