[
https://issues.apache.org/jira/browse/ARROW-5232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16829070#comment-16829070
]
Pindikura Ravindra commented on ARROW-5232:
-------------------------------------------
There is a bug in arrow code : for a value vector
vector->allocateNew() -> allocates a buffer of default size, say 32K
vector->clear() -> frees up buffer
vector->setSafe(0, 10) -> sees the buffer is null, allocates a buffer double
the last known size (64K in this example)
If the above 3 steps are run in a loop, the buffer size doubles in each
iteration and fails when it hits the 2G limit.
> [Java] value vector size increases rapidly in case of clear/setSafe loop
> ------------------------------------------------------------------------
>
> Key: ARROW-5232
> URL: https://issues.apache.org/jira/browse/ARROW-5232
> Project: Apache Arrow
> Issue Type: Bug
> Components: Java
> Reporter: Pindikura Ravindra
> Assignee: Pindikura Ravindra
> Priority: Major
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
