Piyush Narang created PARQUET-585:
-------------------------------------
Summary: Slowly ramp up sizes of int[]s in IntList to keep sizes
small when data sets are small
Key: PARQUET-585
URL: https://issues.apache.org/jira/browse/PARQUET-585
Project: Parquet
Issue Type: Improvement
Reporter: Piyush Narang
Assignee: Piyush Narang
Priority: Minor
One of the items that I listed in jira:
https://issues.apache.org/jira/browse/PARQUET-580 was to ensure that we slowly
ramp up the size of the int[] we create in IntList instead of 64K arrays
directly. This ensures that we don't allocate large 64K arrays at the
start(which is potentially wasteful if there are only a few hundred bytes).
So rather than create arrays of size 64K at a time, we could create say a 4K
int[], then when it fills up an 8K[] and so on till we reach 64K (at which
point the behavior is the same as the current implementation).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
