[
https://issues.apache.org/jira/browse/HBASE-14921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15306551#comment-15306551
]
Anastasia Braginsky commented on HBASE-14921:
---------------------------------------------
Hi All,
Hereby we would like to declare the intent of the roadmap for this JIRA.
After discussing this internally, we see that CellChunkMap bears additional
overhead of yet unresolved problems like:
1. Problem with cells bigger then MSLAB chunk
2. Impossibility to flatten into CellChunkMap
3. Requirement to MemStoreChunkPool to always exist (non-null)
4. Etc.
On the other hand, CellArrayMap data structure is already ready, well tested
and bench-marked.
CellArrayMap is not involved in none of the problems mentioned above.
So next we would like to publish a possibly commit-able patch that includes all
the needed refactoring and new CompactingMemStore, which may compact into
ConcurrentSkipListMap or CellArrayMap and may flatten into CellArrayMap only.
This will be accompanied with the benchmark results.
We hope that the CellArrayMap-only patch can be well reviewed and even quickly
committed.
While dealing with CellChunkMap implementation will be left to the later phase.
So bottom line, we would like to separate a ready to commit CellArrayMap code
(from which the majority of the HBase's users can already benefit) from the
CellChunkMap code that may require more time to get ready.
Would be nice to hear you comments!
Thanks!
> Memory optimizations
> --------------------
>
> Key: HBASE-14921
> URL: https://issues.apache.org/jira/browse/HBASE-14921
> Project: HBase
> Issue Type: Sub-task
> Affects Versions: 2.0.0
> Reporter: Eshcar Hillel
> Assignee: Anastasia Braginsky
> Attachments: CellBlocksSegmentInMemStore.pdf,
> CellBlocksSegmentinthecontextofMemStore(1).pdf, HBASE-14921-V01.patch,
> HBASE-14921-V02.patch, HBASE-14921-V03.patch,
> IntroductiontoNewFlatandCompactMemStore.pdf
>
>
> Memory optimizations including compressed format representation and offheap
> allocations
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
