[
https://issues.apache.org/jira/browse/ARROW-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16187243#comment-16187243
]
Yuliya Feldman commented on ARROW-1627:
---------------------------------------
Here is the link to proposal on how to deal with the issue:
https://docs.google.com/document/d/1pIrPgtwGxMBq-dRzhA-BKDB7KdS2crkTZI21gU-4KDQ/edit?usp=sharing
Will submit PR shortly
> Reducing memory footprint in AllocationManager.BufferLedger
> -----------------------------------------------------------
>
> Key: ARROW-1627
> URL: https://issues.apache.org/jira/browse/ARROW-1627
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Java - Memory
> Reporter: Yuliya Feldman
>
> Currently we instantiate IdentityHashMap while creating an instance of
> AllocationManager which is in turn is part of BufferLedger
> By default IdentityHashMap allocates an array of 64 objects which is 272
> bytes of heap from the start. In reality a lot of ArrowBuf(s) will not need
> that many entries in the map, since they want share BufferAllocators with
> many other BufferLedgers.
> Suggestion is to come up with different collection to save heap w/o
> sacrificing much of the performance (if any).
> I have a suggestion in mind that I will share via a doc. later today
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
