[ 
https://issues.apache.org/jira/browse/HBASE-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-8737:
-------------------------

    Attachment: 8737v5.txt

Address Chris and Jesse feedback from rb.

Added a main to TestIPCUtil which allows passing counts and cell sizes.  Used 
it to do some compare of fixed buffer size vs estimating buffer size by 
iterating Cells.  As expected, if we exceed fixed buffer size, the estimation 
makes for big savings (saw half the time to complete cycling 1k times w/ 10k 
cells) but if the cell block is <= fixed cell block size, the estimation costs.

For now, if a SizedCellScanner, use the size otherwise, just go w/ the fixed 
size buffer.
                
> [replication] Change replication RPC to use cell blocks
> -------------------------------------------------------
>
>                 Key: HBASE-8737
>                 URL: https://issues.apache.org/jira/browse/HBASE-8737
>             Project: HBase
>          Issue Type: Improvement
>          Components: Replication
>            Reporter: Chris Trezzo
>            Assignee: stack
>            Priority: Critical
>             Fix For: 0.98.0, 0.95.2
>
>         Attachments: 
> 0001-HBASE-8737-replication-Change-replication-RPC-to-use.patch, 8737.txt, 
> 8737v3.txt, 8737v4.txt, 8737v5.txt
>
>
> Currently, the replication rpc that ships edits simply dumps the byte value 
> of WAL edit key/value pairs into a protobuf message.
> Modify the replication rpc mechanism to use cell blocks so it can leverage 
> encoding and compression.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to