[
https://issues.apache.org/jira/browse/ARROW-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16714939#comment-16714939
]
Wes McKinney commented on ARROW-3987:
-------------------------------------
Reopening this so I can add more issue metadata. I don't think that JIRA should
be used in this fashion -- shouldn't this be posted on ARROW-1807?
> Compact ArrowBuf to reduce its heap footprint
> ---------------------------------------------
>
> Key: ARROW-3987
> URL: https://issues.apache.org/jira/browse/ARROW-3987
> Project: Apache Arrow
> Issue Type: Task
> Components: Java
> Reporter: shyam narayan singh
> Assignee: shyam narayan singh
> Priority: Minor
> Fix For: 0.12.0
>
>
> This is to record numbers for a test that has been done internally to compact
> ArrowBuf heap foot print by moving variables (udle, refcnt, isempty) to
> buffer ledger. It also removes the debug fields in ledger (buffers,
> historical log) to a different class.
> Running a test that does 20000 allocations of arrow bufs and with ravindra's
> ongoing fix that does the slicing of arrow bufs, below are the results
> (without/with above fix)
> Without above fix :
>
> Total Bytes: 13,028,109
> Total Classes: 2,367
> Total Instances: 193,471
> Classloaders: 77
> GC Roots: 1,641
> Number of Objects Pending for Finalization: 0
>
> With above fix :
>
> Total Bytes: 12,700,115
> Total Classes: 2,373
> Total Instances: 193,635
> Classloaders: 82
> GC Roots: 1,642
> Number of Objects Pending for Finalization: 0
>
>
> ArrowBuf size decreased from 109 bytes to 88 bytes and BufferLedger size
> increased from 80 bytes to 89 bytes.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
