[ 
https://issues.apache.org/jira/browse/HBASE-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178619#comment-14178619
 ] 

stack commented on HBASE-12282:
-------------------------------

bq. BBs may have more index and position management internally. BR may come 
handy here.

What you thinking here?

bq.  Can our HFileBlock be bigger than that?

2G is max? int?  Else we need to do aggregate of BBs.

Thanks for posting patch.  Looking at the Cell changes, my immediate thought is 
that a BB-backed Cell is just a particular implementation of Cell but I think 
what we are finding is that we are bumping into limitations of a byte-array 
only based Cell; it won't work if the Cell references DBBs?  Is that what you 
fellas are seeing?  And what about BR?  Where does it fall down?  What are 
limitations of BR over a BB.

Can we write up a doc?  It is hard to keep account of all the issues around 
off-heaping at this stage.  Doc could be an offheap read-path and/or an 
off-heap write-path?

Good work lads.



> Ensure Cells and its implementations work with Buffers also
> -----------------------------------------------------------
>
>                 Key: HBASE-12282
>                 URL: https://issues.apache.org/jira/browse/HBASE-12282
>             Project: HBase
>          Issue Type: Sub-task
>          Components: regionserver, Scanners
>    Affects Versions: 0.99.1
>            Reporter: ramkrishna.s.vasudevan
>            Assignee: ramkrishna.s.vasudevan
>             Fix For: 2.0.0, 0.99.2
>
>         Attachments: HBASE-12224_2.patch
>
>
> This issue can be used to brainstorm and then do the necessary changes for 
> the offheap work.  All impl of cells deal with byte[] but when we change the 
> Hfileblocks/Readers to work purely with Buffers then the byte[] usage would 
> mean that always the data is copied to the onheap.  Cell may need some 
> interface change to implement this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to