[
https://issues.apache.org/jira/browse/PARQUET-585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Szadovszky updated PARQUET-585:
-------------------------------------
Fix Version/s: 1.8.2
> Slowly ramp up sizes of int[]s in IntList to keep sizes small when data sets
> are small
> --------------------------------------------------------------------------------------
>
> Key: PARQUET-585
> URL: https://issues.apache.org/jira/browse/PARQUET-585
> Project: Parquet
> Issue Type: Improvement
> Reporter: Piyush Narang
> Assignee: Piyush Narang
> Priority: Minor
> Fix For: 1.9.0, 1.8.2
>
>
> One of the items that I listed in jira:
> https://issues.apache.org/jira/browse/PARQUET-580 was to ensure that we
> slowly ramp up the size of the int[] we create in IntList instead of 64K
> arrays directly. This ensures that we don't allocate large 64K arrays at the
> start(which is potentially wasteful if there are only a few hundred bytes).
> So rather than create arrays of size 64K at a time, we could create say a 4K
> int[], then when it fills up an 8K[] and so on till we reach 64K (at which
> point the behavior is the same as the current implementation).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
